[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:04:51.718243 21001 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.130.126:45411
I20260709 13:04:51.719900 21001 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:04:51.721026 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:51.739343 21008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.739344 21007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.744879 21010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.746208 21001 server_base.cc:1061] running on GCE node
I20260709 13:04:52.962992 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:52.963291 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:52.963524 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602292963499 us; error 0 us; skew 500 ppm
I20260709 13:04:52.964448 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:52.970582 21001 webserver.cc:533] Webserver started at http://127.20.130.126:46013/ using document root <none> and password file <none>
I20260709 13:04:52.971621 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:52.971863 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:52.972363 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:52.978866 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/master-0-root/instance:
uuid: "ba8a9816b8fb457dafb57b7051d66219"
format_stamp: "Formatted at 2026-07-09 13:04:52 on dist-test-slave-csvd"
I20260709 13:04:52.987632 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:04:52.993245 21016 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:52.994800 21001 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:52.995396 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/master-0-root
uuid: "ba8a9816b8fb457dafb57b7051d66219"
format_stamp: "Formatted at 2026-07-09 13:04:52 on dist-test-slave-csvd"
I20260709 13:04:52.995790 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:53.061741 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:53.063710 21001 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:04:53.064261 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:53.150354 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.126:45411
I20260709 13:04:53.150502 21067 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.126:45411 every 8 connection(s)
I20260709 13:04:53.159891 21068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.187053 21068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219: Bootstrap starting.
I20260709 13:04:53.193327 21068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.195324 21068 log.cc:826] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219: Log is configured to *not* fsync() on all Append() calls
I20260709 13:04:53.201529 21068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219: No bootstrap required, opened a new log
I20260709 13:04:53.225332 21068 raft_consensus.cc:359] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8a9816b8fb457dafb57b7051d66219" member_type: VOTER }
I20260709 13:04:53.226328 21068 raft_consensus.cc:385] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.226581 21068 raft_consensus.cc:740] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba8a9816b8fb457dafb57b7051d66219, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.227675 21068 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8a9816b8fb457dafb57b7051d66219" member_type: VOTER }
I20260709 13:04:53.228184 21068 raft_consensus.cc:399] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:53.228441 21068 raft_consensus.cc:493] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:53.228760 21068 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.233210 21068 raft_consensus.cc:515] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8a9816b8fb457dafb57b7051d66219" member_type: VOTER }
I20260709 13:04:53.234018 21068 leader_election.cc:304] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba8a9816b8fb457dafb57b7051d66219; no voters: 
I20260709 13:04:53.236109 21068 leader_election.cc:290] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:53.236419 21071 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.239464 21071 raft_consensus.cc:697] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [term 1 LEADER]: Becoming Leader. State: Replica: ba8a9816b8fb457dafb57b7051d66219, State: Running, Role: LEADER
I20260709 13:04:53.240602 21071 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8a9816b8fb457dafb57b7051d66219" member_type: VOTER }
I20260709 13:04:53.242842 21068 sys_catalog.cc:565] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:53.253959 21072 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba8a9816b8fb457dafb57b7051d66219" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8a9816b8fb457dafb57b7051d66219" member_type: VOTER } }
I20260709 13:04:53.254953 21072 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:53.257392 21073 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba8a9816b8fb457dafb57b7051d66219. Latest consensus state: current_term: 1 leader_uuid: "ba8a9816b8fb457dafb57b7051d66219" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8a9816b8fb457dafb57b7051d66219" member_type: VOTER } }
I20260709 13:04:53.257880 21073 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:53.260877 21081 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:53.274748 21081 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:53.277558 21001 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:53.293664 21081 catalog_manager.cc:1383] Generated new cluster ID: 75957bb33b20469b839f99206a8eceb7
I20260709 13:04:53.294127 21081 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:53.312357 21081 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:53.314798 21081 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:53.337296 21081 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219: Generated new TSK 0
I20260709 13:04:53.338548 21081 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:53.408723 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:53.418576 21090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:53.422175 21091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:53.424064 21001 server_base.cc:1061] running on GCE node
W20260709 13:04:53.424289 21093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:53.425370 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:53.425629 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:53.425825 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602293425809 us; error 0 us; skew 500 ppm
I20260709 13:04:53.426523 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:53.431702 21001 webserver.cc:533] Webserver started at http://127.20.130.65:40223/ using document root <none> and password file <none>
I20260709 13:04:53.432382 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:53.432636 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:53.433116 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:53.434470 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/ts-0-root/instance:
uuid: "a1ace56af4464767a75a93f621187536"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-csvd"
I20260709 13:04:53.440778 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:04:53.445662 21098 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.446570 21001 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:04:53.446895 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/ts-0-root
uuid: "a1ace56af4464767a75a93f621187536"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-csvd"
I20260709 13:04:53.447280 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:53.475807 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:53.477737 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:53.481629 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:53.487669 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:53.487913 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.488263 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:53.488420 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.607720 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.65:42943
I20260709 13:04:53.607826 21160 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.65:42943 every 8 connection(s)
I20260709 13:04:53.615527 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:53.625046 21165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:53.630743 21166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:53.643497 21001 server_base.cc:1061] running on GCE node
W20260709 13:04:53.643746 21168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:53.644855 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:53.645082 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:53.645300 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602293645264 us; error 0 us; skew 500 ppm
I20260709 13:04:53.646158 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:53.649725 21001 webserver.cc:533] Webserver started at http://127.20.130.66:46487/ using document root <none> and password file <none>
I20260709 13:04:53.650486 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:53.650755 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:53.651142 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:53.652426 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/ts-1-root/instance:
uuid: "4274cb9648234d91bc29ba5e188255ba"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-csvd"
I20260709 13:04:53.654452 21161 heartbeater.cc:344] Connected to a master server at 127.20.130.126:45411
I20260709 13:04:53.655058 21161 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:53.656308 21161 heartbeater.cc:507] Master 127.20.130.126:45411 requested a full tablet report, sending...
I20260709 13:04:53.659351 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:04:53.660251 21033 ts_manager.cc:194] Registered new tserver with Master: a1ace56af4464767a75a93f621187536 (127.20.130.65:42943)
I20260709 13:04:53.663378 21033 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39410
I20260709 13:04:53.665205 21173 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.666725 21001 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:04:53.667162 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/ts-1-root
uuid: "4274cb9648234d91bc29ba5e188255ba"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-csvd"
I20260709 13:04:53.667584 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:53.688527 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:53.689826 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:53.692035 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:53.695016 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:53.695241 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.695495 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:53.695683 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.789433 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.66:45699
I20260709 13:04:53.789657 21235 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.66:45699 every 8 connection(s)
I20260709 13:04:53.799175 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:53.807772 21239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:53.810912 21240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:53.813388 21236 heartbeater.cc:344] Connected to a master server at 127.20.130.126:45411
I20260709 13:04:53.813814 21236 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:53.815222 21236 heartbeater.cc:507] Master 127.20.130.126:45411 requested a full tablet report, sending...
I20260709 13:04:53.818306 21033 ts_manager.cc:194] Registered new tserver with Master: 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699)
W20260709 13:04:53.818615 21242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:53.819392 21001 server_base.cc:1061] running on GCE node
I20260709 13:04:53.820888 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:53.820910 21033 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39414
W20260709 13:04:53.821270 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:53.821498 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602293821479 us; error 0 us; skew 500 ppm
I20260709 13:04:53.822378 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:53.825731 21001 webserver.cc:533] Webserver started at http://127.20.130.67:42637/ using document root <none> and password file <none>
I20260709 13:04:53.826294 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:53.826503 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:53.826792 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:53.827884 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/ts-2-root/instance:
uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-csvd"
I20260709 13:04:53.832947 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:04:53.837194 21247 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.838240 21001 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:04:53.838567 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/ts-2-root
uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-csvd"
I20260709 13:04:53.838971 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602291548094-21001-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:53.863695 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:53.864988 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:53.866461 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:53.869490 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:53.869789 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.870059 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:53.870230 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.972110 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.67:35811
I20260709 13:04:53.972268 21309 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.67:35811 every 8 connection(s)
I20260709 13:04:53.993825 21310 heartbeater.cc:344] Connected to a master server at 127.20.130.126:45411
I20260709 13:04:53.994324 21310 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:53.995409 21310 heartbeater.cc:507] Master 127.20.130.126:45411 requested a full tablet report, sending...
I20260709 13:04:53.997889 21033 ts_manager.cc:194] Registered new tserver with Master: 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:53.998442 21001 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.020322517s
I20260709 13:04:53.999770 21033 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39430
I20260709 13:04:54.060626 21033 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39446:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:54.064508 21033 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:54.159691 21275 tablet_service.cc:1511] Processing CreateTablet for tablet 5627b62d64d4428ca840a5eabc7d7549 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:54.160005 21274 tablet_service.cc:1511] Processing CreateTablet for tablet e9ac2b3344bb407e81ef28b0052ea986 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:54.165498 21275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5627b62d64d4428ca840a5eabc7d7549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.166371 21274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9ac2b3344bb407e81ef28b0052ea986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.170300 21273 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd6e0e725ba4be990abd00ed0bb85cb (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:54.172205 21273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd6e0e725ba4be990abd00ed0bb85cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.176952 21272 tablet_service.cc:1511] Processing CreateTablet for tablet dccd087e9e5b48d086c2563b7f14fbe1 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:54.178520 21272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dccd087e9e5b48d086c2563b7f14fbe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.192803 21271 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8b68bb02054ac7a18f97bce8a3e151 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:54.195151 21271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8b68bb02054ac7a18f97bce8a3e151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.202080 21200 tablet_service.cc:1511] Processing CreateTablet for tablet e9ac2b3344bb407e81ef28b0052ea986 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:54.203778 21201 tablet_service.cc:1511] Processing CreateTablet for tablet 5627b62d64d4428ca840a5eabc7d7549 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:54.209075 21200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9ac2b3344bb407e81ef28b0052ea986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.203784 21198 tablet_service.cc:1511] Processing CreateTablet for tablet dccd087e9e5b48d086c2563b7f14fbe1 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:54.213243 21197 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8b68bb02054ac7a18f97bce8a3e151 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:54.213290 21199 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd6e0e725ba4be990abd00ed0bb85cb (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:54.210044 21270 tablet_service.cc:1511] Processing CreateTablet for tablet d3d042ef4b1d45beb7046c778c769383 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:54.221200 21196 tablet_service.cc:1511] Processing CreateTablet for tablet d3d042ef4b1d45beb7046c778c769383 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:54.219681 21270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3d042ef4b1d45beb7046c778c769383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.227332 21201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5627b62d64d4428ca840a5eabc7d7549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.230146 21196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3d042ef4b1d45beb7046c778c769383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.231973 21197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8b68bb02054ac7a18f97bce8a3e151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.234611 21198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dccd087e9e5b48d086c2563b7f14fbe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.238859 21199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd6e0e725ba4be990abd00ed0bb85cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.241242 21195 tablet_service.cc:1511] Processing CreateTablet for tablet a6dd1b14960b4478b321c6b33c40148d (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:54.247593 21195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6dd1b14960b4478b321c6b33c40148d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:54.267571 21080 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:54.270133 21328 tablet_bootstrap.cc:492] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f: Bootstrap starting.
I20260709 13:04:54.280185 21126 tablet_service.cc:1511] Processing CreateTablet for tablet 5627b62d64d4428ca840a5eabc7d7549 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:54.282600 21125 tablet_service.cc:1511] Processing CreateTablet for tablet e9ac2b3344bb407e81ef28b0052ea986 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:54.285010 21126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5627b62d64d4428ca840a5eabc7d7549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.294054 21125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9ac2b3344bb407e81ef28b0052ea986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.295653 21122 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8b68bb02054ac7a18f97bce8a3e151 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:54.298687 21121 tablet_service.cc:1511] Processing CreateTablet for tablet d3d042ef4b1d45beb7046c778c769383 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:54.297222 21123 tablet_service.cc:1511] Processing CreateTablet for tablet dccd087e9e5b48d086c2563b7f14fbe1 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:54.287616 21124 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd6e0e725ba4be990abd00ed0bb85cb (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:54.302614 21274 tablet_service.cc:1511] Processing CreateTablet for tablet a6dd1b14960b4478b321c6b33c40148d (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:54.306617 21274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6dd1b14960b4478b321c6b33c40148d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.305534 21122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8b68bb02054ac7a18f97bce8a3e151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.306330 21120 tablet_service.cc:1511] Processing CreateTablet for tablet a6dd1b14960b4478b321c6b33c40148d (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:54.310803 21121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3d042ef4b1d45beb7046c778c769383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.312633 21124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd6e0e725ba4be990abd00ed0bb85cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.314275 21120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6dd1b14960b4478b321c6b33c40148d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.317106 21123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dccd087e9e5b48d086c2563b7f14fbe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.334077 21119 tablet_service.cc:1511] Processing CreateTablet for tablet 45fe8c407c45467faeb534596e75a252 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:54.335548 21119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45fe8c407c45467faeb534596e75a252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.347703 21194 tablet_service.cc:1511] Processing CreateTablet for tablet 45fe8c407c45467faeb534596e75a252 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:54.353785 21194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45fe8c407c45467faeb534596e75a252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.363801 21328 tablet_bootstrap.cc:654] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.379654 21273 tablet_service.cc:1511] Processing CreateTablet for tablet 45fe8c407c45467faeb534596e75a252 (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:54.381022 21273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45fe8c407c45467faeb534596e75a252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.387581 21118 tablet_service.cc:1511] Processing CreateTablet for tablet c3e3fd611a184caa9d8418f9f781451a (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:54.389655 21118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3e3fd611a184caa9d8418f9f781451a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.392573 21272 tablet_service.cc:1511] Processing CreateTablet for tablet c3e3fd611a184caa9d8418f9f781451a (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:54.393884 21272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3e3fd611a184caa9d8418f9f781451a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.423030 21329 tablet_bootstrap.cc:492] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba: Bootstrap starting.
I20260709 13:04:54.427700 21198 tablet_service.cc:1511] Processing CreateTablet for tablet c3e3fd611a184caa9d8418f9f781451a (DEFAULT_TABLE table=test-workload [id=5eb33d5fecef4dddb204644b9ac62c5a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:54.438897 21198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3e3fd611a184caa9d8418f9f781451a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.459244 21330 tablet_bootstrap.cc:492] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536: Bootstrap starting.
I20260709 13:04:54.487178 21329 tablet_bootstrap.cc:654] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.491173 21328 tablet_bootstrap.cc:492] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f: No bootstrap required, opened a new log
I20260709 13:04:54.491706 21328 ts_tablet_manager.cc:1403] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent bootstrapping tablet: real 0.223s	user 0.024s	sys 0.024s
I20260709 13:04:54.495895 21328 raft_consensus.cc:359] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.496807 21328 raft_consensus.cc:385] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.496969 21330 tablet_bootstrap.cc:654] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.497290 21328 raft_consensus.cc:740] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.498275 21328 consensus_queue.cc:260] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.504237 21310 heartbeater.cc:499] Master 127.20.130.126:45411 was elected leader, sending a full tablet report...
I20260709 13:04:54.504283 21329 tablet_bootstrap.cc:492] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba: No bootstrap required, opened a new log
I20260709 13:04:54.504944 21329 ts_tablet_manager.cc:1403] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba: Time spent bootstrapping tablet: real 0.134s	user 0.011s	sys 0.007s
I20260709 13:04:54.505484 21328 ts_tablet_manager.cc:1434] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:04:54.506489 21328 tablet_bootstrap.cc:492] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f: Bootstrap starting.
I20260709 13:04:54.507946 21329 raft_consensus.cc:359] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.508684 21329 raft_consensus.cc:385] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.509032 21329 raft_consensus.cc:740] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.510576 21329 consensus_queue.cc:260] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.519527 21236 heartbeater.cc:499] Master 127.20.130.126:45411 was elected leader, sending a full tablet report...
I20260709 13:04:54.520732 21329 ts_tablet_manager.cc:1434] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba: Time spent starting tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:04:54.521737 21329 tablet_bootstrap.cc:492] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba: Bootstrap starting.
I20260709 13:04:54.522168 21330 tablet_bootstrap.cc:492] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536: No bootstrap required, opened a new log
I20260709 13:04:54.522670 21330 ts_tablet_manager.cc:1403] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.009s
I20260709 13:04:54.531152 21330 raft_consensus.cc:359] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.531970 21330 raft_consensus.cc:385] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.532301 21330 raft_consensus.cc:740] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ace56af4464767a75a93f621187536, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.533059 21329 tablet_bootstrap.cc:654] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.533059 21328 tablet_bootstrap.cc:654] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.535080 21330 consensus_queue.cc:260] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.543275 21161 heartbeater.cc:499] Master 127.20.130.126:45411 was elected leader, sending a full tablet report...
I20260709 13:04:54.550175 21329 tablet_bootstrap.cc:492] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba: No bootstrap required, opened a new log
W20260709 13:04:54.550660 21237 tablet.cc:2406] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:54.550774 21329 ts_tablet_manager.cc:1403] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba: Time spent bootstrapping tablet: real 0.029s	user 0.022s	sys 0.000s
I20260709 13:04:54.554303 21329 raft_consensus.cc:359] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.555255 21329 raft_consensus.cc:385] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.555552 21329 raft_consensus.cc:740] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.556480 21329 consensus_queue.cc:260] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.559140 21329 ts_tablet_manager.cc:1434] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:04:54.560249 21329 tablet_bootstrap.cc:492] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba: Bootstrap starting.
I20260709 13:04:54.563825 21330 ts_tablet_manager.cc:1434] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:04:54.565233 21330 tablet_bootstrap.cc:492] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536: Bootstrap starting.
I20260709 13:04:54.567195 21329 tablet_bootstrap.cc:654] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.575042 21330 tablet_bootstrap.cc:654] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.601055 21328 tablet_bootstrap.cc:492] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f: No bootstrap required, opened a new log
I20260709 13:04:54.601711 21328 ts_tablet_manager.cc:1403] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.011s
I20260709 13:04:54.603008 21329 tablet_bootstrap.cc:492] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba: No bootstrap required, opened a new log
I20260709 13:04:54.603507 21329 ts_tablet_manager.cc:1403] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.028s
I20260709 13:04:54.604815 21328 raft_consensus.cc:359] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:04:54.605611 21328 raft_consensus.cc:385] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.605906 21328 raft_consensus.cc:740] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.606158 21330 tablet_bootstrap.cc:492] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536: No bootstrap required, opened a new log
I20260709 13:04:54.606369 21329 raft_consensus.cc:359] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.606889 21330 ts_tablet_manager.cc:1403] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.010s
I20260709 13:04:54.606665 21328 consensus_queue.cc:260] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:04:54.607141 21329 raft_consensus.cc:385] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.607577 21329 raft_consensus.cc:740] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.608469 21329 consensus_queue.cc:260] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.610841 21329 ts_tablet_manager.cc:1434] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:54.611856 21329 tablet_bootstrap.cc:492] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba: Bootstrap starting.
I20260709 13:04:54.615549 21328 ts_tablet_manager.cc:1434] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:04:54.618546 21329 tablet_bootstrap.cc:654] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.620023 21330 raft_consensus.cc:359] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.620838 21330 raft_consensus.cc:385] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.621182 21330 raft_consensus.cc:740] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ace56af4464767a75a93f621187536, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.622099 21330 consensus_queue.cc:260] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.625943 21328 tablet_bootstrap.cc:492] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f: Bootstrap starting.
I20260709 13:04:54.628060 21330 ts_tablet_manager.cc:1434] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536: Time spent starting tablet: real 0.021s	user 0.000s	sys 0.006s
I20260709 13:04:54.629066 21330 tablet_bootstrap.cc:492] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536: Bootstrap starting.
I20260709 13:04:54.634111 21329 tablet_bootstrap.cc:492] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba: No bootstrap required, opened a new log
I20260709 13:04:54.634598 21329 ts_tablet_manager.cc:1403] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 13:04:54.638536 21330 tablet_bootstrap.cc:654] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.638417 21329 raft_consensus.cc:359] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.639076 21328 tablet_bootstrap.cc:654] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.639214 21329 raft_consensus.cc:385] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.639560 21329 raft_consensus.cc:740] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.640419 21329 consensus_queue.cc:260] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.642835 21329 ts_tablet_manager.cc:1434] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:54.643807 21329 tablet_bootstrap.cc:492] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba: Bootstrap starting.
I20260709 13:04:54.650601 21329 tablet_bootstrap.cc:654] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.651773 21335 raft_consensus.cc:493] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.652307 21335 raft_consensus.cc:515] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.655968 21335 leader_election.cc:290] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:54.667726 21329 tablet_bootstrap.cc:492] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba: No bootstrap required, opened a new log
I20260709 13:04:54.668129 21330 tablet_bootstrap.cc:492] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536: No bootstrap required, opened a new log
I20260709 13:04:54.668299 21329 ts_tablet_manager.cc:1403] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.007s
I20260709 13:04:54.668663 21330 ts_tablet_manager.cc:1403] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.008s
I20260709 13:04:54.672204 21330 raft_consensus.cc:359] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.672986 21330 raft_consensus.cc:385] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.672629 21329 raft_consensus.cc:359] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:04:54.673312 21330 raft_consensus.cc:740] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ace56af4464767a75a93f621187536, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.673441 21329 raft_consensus.cc:385] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.673799 21329 raft_consensus.cc:740] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.674142 21330 consensus_queue.cc:260] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.675300 21328 tablet_bootstrap.cc:492] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f: No bootstrap required, opened a new log
I20260709 13:04:54.675822 21328 ts_tablet_manager.cc:1403] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.005s
I20260709 13:04:54.676956 21136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8b68bb02054ac7a18f97bce8a3e151" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536" is_pre_election: true
I20260709 13:04:54.677767 21136 raft_consensus.cc:2468] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 0.
I20260709 13:04:54.678938 21328 raft_consensus.cc:359] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.679728 21328 raft_consensus.cc:385] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.679520 21176 leader_election.cc:304] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:54.680054 21328 raft_consensus.cc:740] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.681221 21330 ts_tablet_manager.cc:1434] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:04:54.680841 21328 consensus_queue.cc:260] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.682760 21335 raft_consensus.cc:2804] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.683107 21328 ts_tablet_manager.cc:1434] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:54.683149 21335 raft_consensus.cc:493] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.683629 21335 raft_consensus.cc:3060] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.684198 21328 tablet_bootstrap.cc:492] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f: Bootstrap starting.
I20260709 13:04:54.688228 21337 raft_consensus.cc:493] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.688804 21337 raft_consensus.cc:515] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.690886 21330 tablet_bootstrap.cc:492] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536: Bootstrap starting.
I20260709 13:04:54.694494 21335 raft_consensus.cc:515] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.674630 21329 consensus_queue.cc:260] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:04:54.695474 21337 leader_election.cc:290] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:54.708007 21328 tablet_bootstrap.cc:654] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.712675 21335 leader_election.cc:290] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:54.713762 21136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8b68bb02054ac7a18f97bce8a3e151" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:04:54.714354 21136 raft_consensus.cc:3060] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.722445 21329 ts_tablet_manager.cc:1434] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.002s
I20260709 13:04:54.723394 21136 raft_consensus.cc:2468] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 1.
I20260709 13:04:54.724852 21176 leader_election.cc:304] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:54.726012 21351 raft_consensus.cc:2804] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.726613 21351 raft_consensus.cc:697] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Becoming Leader. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:04:54.727521 21351 consensus_queue.cc:237] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.730013 21329 tablet_bootstrap.cc:492] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba: Bootstrap starting.
I20260709 13:04:54.725134 21330 tablet_bootstrap.cc:654] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.745391 21285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8b68bb02054ac7a18f97bce8a3e151" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" is_pre_election: true
W20260709 13:04:54.747685 21176 leader_election.cc:343] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.747926 21328 tablet_bootstrap.cc:492] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f: No bootstrap required, opened a new log
I20260709 13:04:54.748593 21328 ts_tablet_manager.cc:1403] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.004s
I20260709 13:04:54.748996 21285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8b68bb02054ac7a18f97bce8a3e151" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
W20260709 13:04:54.752303 21176 leader_election.cc:343] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.761420 21351 raft_consensus.cc:493] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.763481 21334 raft_consensus.cc:493] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.766695 21334 raft_consensus.cc:515] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:04:54.768944 21211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccd087e9e5b48d086c2563b7f14fbe1" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4274cb9648234d91bc29ba5e188255ba" is_pre_election: true
I20260709 13:04:54.762307 21351 raft_consensus.cc:515] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.770008 21285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccd087e9e5b48d086c2563b7f14fbe1" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" is_pre_election: true
I20260709 13:04:54.769932 21211 raft_consensus.cc:2468] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 0.
I20260709 13:04:54.774142 21285 raft_consensus.cc:2468] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 0.
I20260709 13:04:54.777679 21334 leader_election.cc:290] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699), a1ace56af4464767a75a93f621187536 (127.20.130.65:42943)
I20260709 13:04:54.781440 21351 leader_election.cc:290] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:54.782729 21100 leader_election.cc:304] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:54.784344 21337 raft_consensus.cc:2804] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.784840 21337 raft_consensus.cc:493] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.785039 21136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536" is_pre_election: true
I20260709 13:04:54.785332 21337 raft_consensus.cc:3060] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.786497 21329 tablet_bootstrap.cc:654] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.770797 21328 raft_consensus.cc:359] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.787811 21328 raft_consensus.cc:385] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.788131 21328 raft_consensus.cc:740] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.788837 21330 tablet_bootstrap.cc:492] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536: No bootstrap required, opened a new log
I20260709 13:04:54.790153 21330 ts_tablet_manager.cc:1403] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536: Time spent bootstrapping tablet: real 0.099s	user 0.009s	sys 0.022s
I20260709 13:04:54.785781 21136 raft_consensus.cc:2468] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 0.
I20260709 13:04:54.793093 21176 leader_election.cc:304] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:54.794414 21351 raft_consensus.cc:2804] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.794544 21285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" is_pre_election: true
I20260709 13:04:54.794813 21351 raft_consensus.cc:493] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.795255 21351 raft_consensus.cc:3060] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.788861 21328 consensus_queue.cc:260] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
W20260709 13:04:54.796260 21176 leader_election.cc:343] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.797953 21328 ts_tablet_manager.cc:1434] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:04:54.800029 21337 raft_consensus.cc:515] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.801452 21328 tablet_bootstrap.cc:492] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f: Bootstrap starting.
I20260709 13:04:54.803362 21211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccd087e9e5b48d086c2563b7f14fbe1" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
I20260709 13:04:54.804160 21211 raft_consensus.cc:3060] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.782761 21031 catalog_manager.cc:5697] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 4274cb9648234d91bc29ba5e188255ba (127.20.130.66). New cstate: current_term: 1 leader_uuid: "4274cb9648234d91bc29ba5e188255ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.811894 21330 raft_consensus.cc:359] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:04:54.812697 21330 raft_consensus.cc:385] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.813014 21330 raft_consensus.cc:740] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ace56af4464767a75a93f621187536, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.805202 21337 leader_election.cc:290] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 1 election: Requested vote from peers 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:54.814545 21211 raft_consensus.cc:2468] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 1.
I20260709 13:04:54.820112 21100 leader_election.cc:304] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:54.822137 21337 raft_consensus.cc:2804] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.817222 21330 consensus_queue.cc:260] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:04:54.825376 21285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccd087e9e5b48d086c2563b7f14fbe1" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:04:54.826864 21285 raft_consensus.cc:3060] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.828616 21335 raft_consensus.cc:493] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.829108 21335 raft_consensus.cc:515] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:04:54.829246 21351 raft_consensus.cc:515] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.831223 21351 leader_election.cc:290] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:54.833673 21136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:04:54.834255 21136 raft_consensus.cc:3060] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.834555 21328 tablet_bootstrap.cc:654] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.832414 21329 tablet_bootstrap.cc:492] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba: No bootstrap required, opened a new log
I20260709 13:04:54.839102 21335 leader_election.cc:290] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811), a1ace56af4464767a75a93f621187536 (127.20.130.65:42943)
I20260709 13:04:54.840534 21283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:04:54.838644 21329 ts_tablet_manager.cc:1403] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.007s
I20260709 13:04:54.839095 21284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" is_pre_election: true
I20260709 13:04:54.846701 21135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536" is_pre_election: true
I20260709 13:04:54.847631 21284 raft_consensus.cc:2468] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 0.
I20260709 13:04:54.847868 21135 raft_consensus.cc:2468] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 0.
W20260709 13:04:54.848603 21176 leader_election.cc:343] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.849669 21176 leader_election.cc:304] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:54.850713 21335 raft_consensus.cc:2804] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.851127 21335 raft_consensus.cc:493] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.851485 21335 raft_consensus.cc:3060] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.856494 21285 raft_consensus.cc:2468] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 1.
I20260709 13:04:54.856887 21136 raft_consensus.cc:2468] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 1.
I20260709 13:04:54.861960 21351 raft_consensus.cc:493] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.865765 21335 raft_consensus.cc:515] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:04:54.862666 21176 leader_election.cc:304] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 06cb0f3d9cb64d3089b42efa4fdda16f
I20260709 13:04:54.867843 21351 raft_consensus.cc:515] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.874857 21337 raft_consensus.cc:697] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 1 LEADER]: Becoming Leader. State: Replica: a1ace56af4464767a75a93f621187536, State: Running, Role: LEADER
I20260709 13:04:54.877187 21337 consensus_queue.cc:237] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.877573 21335 leader_election.cc:290] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 election: Requested vote from peers 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811), a1ace56af4464767a75a93f621187536 (127.20.130.65:42943)
I20260709 13:04:54.878950 21335 raft_consensus.cc:2804] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.879449 21335 raft_consensus.cc:697] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Becoming Leader. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:04:54.891727 21335 consensus_queue.cc:237] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.898859 21334 raft_consensus.cc:493] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.899677 21334 raft_consensus.cc:515] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.904039 21351 leader_election.cc:290] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:54.905968 21334 leader_election.cc:290] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699)
I20260709 13:04:54.908577 21330 ts_tablet_manager.cc:1434] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536: Time spent starting tablet: real 0.118s	user 0.021s	sys 0.017s
I20260709 13:04:54.908671 21329 raft_consensus.cc:359] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.909509 21329 raft_consensus.cc:385] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.909828 21329 raft_consensus.cc:740] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.909925 21330 tablet_bootstrap.cc:492] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536: Bootstrap starting.
W20260709 13:04:54.910863 21176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:42943, user_credentials={real_user=slave}} blocked reactor thread for 48404.1us
I20260709 13:04:54.913861 21285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:04:54.910985 21329 consensus_queue.cc:260] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.915581 21285 raft_consensus.cc:3060] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.916548 21134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:04:54.917712 21134 raft_consensus.cc:3060] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.918650 21211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4274cb9648234d91bc29ba5e188255ba" is_pre_election: true
I20260709 13:04:54.919574 21211 raft_consensus.cc:2393] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06cb0f3d9cb64d3089b42efa4fdda16f in current term 1: Already voted for candidate 4274cb9648234d91bc29ba5e188255ba in this term.
I20260709 13:04:54.913861 21136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536" is_pre_election: true
I20260709 13:04:54.914734 21135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536" is_pre_election: true
I20260709 13:04:54.922250 21284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" is_pre_election: true
I20260709 13:04:54.926482 21284 raft_consensus.cc:2468] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 0.
I20260709 13:04:54.926959 21133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536" is_pre_election: true
I20260709 13:04:54.930727 21249 leader_election.cc:304] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f; no voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536
I20260709 13:04:54.932466 21211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4274cb9648234d91bc29ba5e188255ba" is_pre_election: true
I20260709 13:04:54.933341 21211 raft_consensus.cc:2468] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in term 0.
W20260709 13:04:54.937659 21250 leader_election.cc:343] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1ace56af4464767a75a93f621187536 (127.20.130.65:42943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.938140 21329 ts_tablet_manager.cc:1434] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.005s
I20260709 13:04:54.941246 21329 tablet_bootstrap.cc:492] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba: Bootstrap starting.
I20260709 13:04:54.938797 21176 leader_election.cc:304] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, 4274cb9648234d91bc29ba5e188255ba; no voters: 
I20260709 13:04:54.943594 21351 raft_consensus.cc:2804] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.943970 21351 raft_consensus.cc:493] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.944082 21249 leader_election.cc:304] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, 4274cb9648234d91bc29ba5e188255ba; no voters: a1ace56af4464767a75a93f621187536
I20260709 13:04:54.944336 21351 raft_consensus.cc:3060] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.944481 21330 tablet_bootstrap.cc:654] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.947973 21134 raft_consensus.cc:2468] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 1.
W20260709 13:04:54.947417 21176 leader_election.cc:343] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1ace56af4464767a75a93f621187536 (127.20.130.65:42943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.954126 21328 tablet_bootstrap.cc:492] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f: No bootstrap required, opened a new log
I20260709 13:04:54.950404 21176 leader_election.cc:304] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:54.963728 21361 raft_consensus.cc:2804] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.968014 21328 ts_tablet_manager.cc:1403] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent bootstrapping tablet: real 0.167s	user 0.005s	sys 0.021s
I20260709 13:04:54.968171 21285 raft_consensus.cc:2468] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 1.
I20260709 13:04:54.969024 21334 raft_consensus.cc:2749] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.981071 21329 tablet_bootstrap.cc:654] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.987603 21334 raft_consensus.cc:2804] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.988189 21334 raft_consensus.cc:493] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.993757 21351 raft_consensus.cc:515] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.994562 21328 raft_consensus.cc:359] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:54.995592 21328 raft_consensus.cc:385] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.995972 21328 raft_consensus.cc:740] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.988618 21334 raft_consensus.cc:3060] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.997793 21134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536"
W20260709 13:04:54.999846 21176 leader_election.cc:343] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1ace56af4464767a75a93f621187536 (127.20.130.65:42943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.003453 21328 consensus_queue.cc:260] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.011726 21351 leader_election.cc:290] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:55.015128 21285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:04:55.017884 21361 raft_consensus.cc:697] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Becoming Leader. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
W20260709 13:04:55.013486 21249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:45699, user_credentials={real_user=slave}} blocked reactor thread for 69507.5us
I20260709 13:04:55.025555 21330 tablet_bootstrap.cc:492] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536: No bootstrap required, opened a new log
I20260709 13:04:55.026144 21330 ts_tablet_manager.cc:1403] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536: Time spent bootstrapping tablet: real 0.116s	user 0.019s	sys 0.029s
I20260709 13:04:55.024689 21361 consensus_queue.cc:237] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:04:55.026988 21328 ts_tablet_manager.cc:1434] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.005s
I20260709 13:04:55.028367 21328 tablet_bootstrap.cc:492] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f: Bootstrap starting.
I20260709 13:04:55.029469 21330 raft_consensus.cc:359] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.029402 21334 raft_consensus.cc:515] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.030483 21330 raft_consensus.cc:385] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.031032 21330 raft_consensus.cc:740] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ace56af4464767a75a93f621187536, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.031245 21285 raft_consensus.cc:2393] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4274cb9648234d91bc29ba5e188255ba in current term 1: Already voted for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in this term.
I20260709 13:04:55.032047 21330 consensus_queue.cc:260] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.036217 21134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:04:55.036911 21134 raft_consensus.cc:3060] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.040617 21328 tablet_bootstrap.cc:654] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.041149 21330 ts_tablet_manager.cc:1434] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:04:55.042759 21330 tablet_bootstrap.cc:492] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536: Bootstrap starting.
I20260709 13:04:55.046204 21211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
I20260709 13:04:55.047178 21211 raft_consensus.cc:2393] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 06cb0f3d9cb64d3089b42efa4fdda16f in current term 1: Already voted for candidate 4274cb9648234d91bc29ba5e188255ba in this term.
I20260709 13:04:55.048722 21334 leader_election.cc:290] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699)
I20260709 13:04:55.049940 21176 leader_election.cc:304] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba; no voters: 06cb0f3d9cb64d3089b42efa4fdda16f, a1ace56af4464767a75a93f621187536
I20260709 13:04:55.051255 21361 raft_consensus.cc:2749] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.052335 21134 raft_consensus.cc:2468] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in term 1.
I20260709 13:04:55.053588 21250 leader_election.cc:304] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, a1ace56af4464767a75a93f621187536; no voters: 4274cb9648234d91bc29ba5e188255ba
I20260709 13:04:55.055714 21330 tablet_bootstrap.cc:654] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.061527 21033 catalog_manager.cc:5697] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 4274cb9648234d91bc29ba5e188255ba (127.20.130.66). New cstate: current_term: 1 leader_uuid: "4274cb9648234d91bc29ba5e188255ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.058259 21032 catalog_manager.cc:5697] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1ace56af4464767a75a93f621187536 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "a1ace56af4464767a75a93f621187536" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.057627 21334 raft_consensus.cc:2804] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.067893 21334 raft_consensus.cc:697] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 LEADER]: Becoming Leader. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Running, Role: LEADER
I20260709 13:04:55.071022 21329 tablet_bootstrap.cc:492] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba: No bootstrap required, opened a new log
I20260709 13:04:55.071548 21329 ts_tablet_manager.cc:1403] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba: Time spent bootstrapping tablet: real 0.131s	user 0.012s	sys 0.014s
I20260709 13:04:55.068799 21334 consensus_queue.cc:237] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.081087 21328 tablet_bootstrap.cc:492] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f: No bootstrap required, opened a new log
I20260709 13:04:55.081743 21328 ts_tablet_manager.cc:1403] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.026s
I20260709 13:04:55.085035 21328 raft_consensus.cc:359] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.085985 21328 raft_consensus.cc:385] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.086479 21328 raft_consensus.cc:740] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.087230 21330 tablet_bootstrap.cc:492] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536: No bootstrap required, opened a new log
I20260709 13:04:55.087765 21330 ts_tablet_manager.cc:1403] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.001s
I20260709 13:04:55.087616 21328 consensus_queue.cc:260] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.090795 21328 ts_tablet_manager.cc:1434] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:55.092155 21328 tablet_bootstrap.cc:492] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f: Bootstrap starting.
I20260709 13:04:55.093178 21329 raft_consensus.cc:359] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.094451 21329 raft_consensus.cc:385] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.094830 21329 raft_consensus.cc:740] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.095796 21329 consensus_queue.cc:260] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.097208 21032 catalog_manager.cc:5697] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 4274cb9648234d91bc29ba5e188255ba (127.20.130.66). New cstate: current_term: 1 leader_uuid: "4274cb9648234d91bc29ba5e188255ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.090787 21330 raft_consensus.cc:359] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.102963 21329 ts_tablet_manager.cc:1434] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 13:04:55.099965 21328 tablet_bootstrap.cc:654] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.103201 21330 raft_consensus.cc:385] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.105129 21330 raft_consensus.cc:740] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ace56af4464767a75a93f621187536, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.104602 21033 catalog_manager.cc:5697] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f reported cstate change: term changed from 0 to 1, leader changed from <none> to 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67). New cstate: current_term: 1 leader_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.106043 21330 consensus_queue.cc:260] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.111840 21330 ts_tablet_manager.cc:1434] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:04:55.112994 21330 tablet_bootstrap.cc:492] T c3e3fd611a184caa9d8418f9f781451a P a1ace56af4464767a75a93f621187536: Bootstrap starting.
I20260709 13:04:55.120832 21330 tablet_bootstrap.cc:654] T c3e3fd611a184caa9d8418f9f781451a P a1ace56af4464767a75a93f621187536: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.104024 21329 tablet_bootstrap.cc:492] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba: Bootstrap starting.
I20260709 13:04:55.137475 21329 tablet_bootstrap.cc:654] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.145087 21361 consensus_queue.cc:1048] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.150554 21329 tablet_bootstrap.cc:492] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba: No bootstrap required, opened a new log
I20260709 13:04:55.151679 21329 ts_tablet_manager.cc:1403] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.004s
I20260709 13:04:55.155526 21329 raft_consensus.cc:359] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.156545 21329 raft_consensus.cc:385] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.156931 21329 raft_consensus.cc:740] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.160168 21329 consensus_queue.cc:260] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.162783 21329 ts_tablet_manager.cc:1434] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:04:55.163807 21329 tablet_bootstrap.cc:492] T c3e3fd611a184caa9d8418f9f781451a P 4274cb9648234d91bc29ba5e188255ba: Bootstrap starting.
I20260709 13:04:55.166335 21328 tablet_bootstrap.cc:492] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f: No bootstrap required, opened a new log
I20260709 13:04:55.166941 21328 ts_tablet_manager.cc:1403] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent bootstrapping tablet: real 0.075s	user 0.027s	sys 0.015s
I20260709 13:04:55.175297 21330 tablet_bootstrap.cc:492] T c3e3fd611a184caa9d8418f9f781451a P a1ace56af4464767a75a93f621187536: No bootstrap required, opened a new log
I20260709 13:04:55.176585 21330 ts_tablet_manager.cc:1403] T c3e3fd611a184caa9d8418f9f781451a P a1ace56af4464767a75a93f621187536: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.014s
I20260709 13:04:55.177721 21337 raft_consensus.cc:493] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.181324 21285 raft_consensus.cc:3060] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.182192 21337 raft_consensus.cc:515] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.183925 21330 raft_consensus.cc:359] T c3e3fd611a184caa9d8418f9f781451a P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.184360 21337 leader_election.cc:290] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:55.185199 21330 raft_consensus.cc:385] T c3e3fd611a184caa9d8418f9f781451a P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.180894 21328 raft_consensus.cc:359] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.188498 21211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d042ef4b1d45beb7046c778c769383" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4274cb9648234d91bc29ba5e188255ba" is_pre_election: true
I20260709 13:04:55.185526 21330 raft_consensus.cc:740] T c3e3fd611a184caa9d8418f9f781451a P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ace56af4464767a75a93f621187536, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.188164 21284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d042ef4b1d45beb7046c778c769383" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" is_pre_election: true
I20260709 13:04:55.189134 21211 raft_consensus.cc:2468] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 0.
I20260709 13:04:55.189462 21366 raft_consensus.cc:493] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.188671 21328 raft_consensus.cc:385] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.189839 21330 consensus_queue.cc:260] T c3e3fd611a184caa9d8418f9f781451a P a1ace56af4464767a75a93f621187536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.190442 21100 leader_election.cc:304] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:55.190016 21366 raft_consensus.cc:515] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.190702 21328 raft_consensus.cc:740] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.192153 21360 raft_consensus.cc:2804] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.192562 21360 raft_consensus.cc:493] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.192902 21360 raft_consensus.cc:3060] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.192945 21328 consensus_queue.cc:260] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.194640 21284 raft_consensus.cc:2468] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 0.
I20260709 13:04:55.203850 21211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4274cb9648234d91bc29ba5e188255ba" is_pre_election: true
I20260709 13:04:55.203969 21328 ts_tablet_manager.cc:1434] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.008s
I20260709 13:04:55.204265 21135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536" is_pre_election: true
I20260709 13:04:55.204546 21211 raft_consensus.cc:2468] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in term 0.
I20260709 13:04:55.205427 21360 raft_consensus.cc:515] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.205933 21249 leader_election.cc:304] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, 4274cb9648234d91bc29ba5e188255ba; no voters: 
I20260709 13:04:55.207600 21329 tablet_bootstrap.cc:654] T c3e3fd611a184caa9d8418f9f781451a P 4274cb9648234d91bc29ba5e188255ba: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:55.208272 21250 leader_election.cc:343] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1ace56af4464767a75a93f621187536 (127.20.130.65:42943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.209003 21328 tablet_bootstrap.cc:492] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f: Bootstrap starting.
I20260709 13:04:55.209775 21330 ts_tablet_manager.cc:1434] T c3e3fd611a184caa9d8418f9f781451a P a1ace56af4464767a75a93f621187536: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.003s
I20260709 13:04:55.208222 21366 leader_election.cc:290] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699)
I20260709 13:04:55.213558 21330 tablet_bootstrap.cc:492] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536: Bootstrap starting.
I20260709 13:04:55.213786 21334 raft_consensus.cc:493] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.214262 21334 raft_consensus.cc:515] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.217278 21211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d042ef4b1d45beb7046c778c769383" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
I20260709 13:04:55.217878 21211 raft_consensus.cc:3060] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.219812 21360 leader_election.cc:290] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 1 election: Requested vote from peers 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:55.221113 21334 leader_election.cc:290] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699)
I20260709 13:04:55.223106 21381 raft_consensus.cc:2804] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.223513 21381 raft_consensus.cc:493] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.227449 21135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8b68bb02054ac7a18f97bce8a3e151" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536" is_pre_election: true
I20260709 13:04:55.223873 21381 raft_consensus.cc:3060] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.228966 21351 consensus_queue.cc:1048] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.229050 21284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d042ef4b1d45beb7046c778c769383" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:04:55.234232 21284 raft_consensus.cc:3060] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.234371 21210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8b68bb02054ac7a18f97bce8a3e151" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4274cb9648234d91bc29ba5e188255ba" is_pre_election: true
I20260709 13:04:55.232369 21334 raft_consensus.cc:493] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.235301 21334 raft_consensus.cc:515] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.239511 21211 raft_consensus.cc:2468] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 1.
I20260709 13:04:55.240212 21328 tablet_bootstrap.cc:654] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.240811 21100 leader_election.cc:304] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:55.242640 21249 leader_election.cc:304] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f; no voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536
I20260709 13:04:55.243695 21360 raft_consensus.cc:2804] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.247803 21360 raft_consensus.cc:697] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 1 LEADER]: Becoming Leader. State: Replica: a1ace56af4464767a75a93f621187536, State: Running, Role: LEADER
I20260709 13:04:55.248773 21135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3fd611a184caa9d8418f9f781451a" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536" is_pre_election: true
I20260709 13:04:55.249537 21135 raft_consensus.cc:2468] T c3e3fd611a184caa9d8418f9f781451a P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in term 0.
I20260709 13:04:55.249198 21360 consensus_queue.cc:237] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.250995 21250 leader_election.cc:304] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:55.252643 21334 leader_election.cc:290] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699)
I20260709 13:04:55.254352 21284 raft_consensus.cc:2468] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 1.
I20260709 13:04:55.260105 21366 raft_consensus.cc:2749] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:55.262717 21211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3fd611a184caa9d8418f9f781451a" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4274cb9648234d91bc29ba5e188255ba" is_pre_election: true
I20260709 13:04:55.257892 21382 raft_consensus.cc:2804] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.264034 21382 raft_consensus.cc:493] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.264398 21382 raft_consensus.cc:3060] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:55.274691 21080 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:04:55.275523 21249 leader_election.cc:343] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.286036 21330 tablet_bootstrap.cc:654] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.290505 21382 raft_consensus.cc:515] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.290851 21381 raft_consensus.cc:515] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.293666 21329 tablet_bootstrap.cc:492] T c3e3fd611a184caa9d8418f9f781451a P 4274cb9648234d91bc29ba5e188255ba: No bootstrap required, opened a new log
I20260709 13:04:55.293666 21328 tablet_bootstrap.cc:492] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f: No bootstrap required, opened a new log
I20260709 13:04:55.293938 21135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3fd611a184caa9d8418f9f781451a" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:04:55.294277 21329 ts_tablet_manager.cc:1403] T c3e3fd611a184caa9d8418f9f781451a P 4274cb9648234d91bc29ba5e188255ba: Time spent bootstrapping tablet: real 0.131s	user 0.012s	sys 0.002s
I20260709 13:04:55.294277 21328 ts_tablet_manager.cc:1403] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.027s
I20260709 13:04:55.294556 21135 raft_consensus.cc:3060] T c3e3fd611a184caa9d8418f9f781451a P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.296195 21381 leader_election.cc:290] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699)
I20260709 13:04:55.298979 21211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
I20260709 13:04:55.299610 21211 raft_consensus.cc:3060] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.300531 21328 raft_consensus.cc:359] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.301204 21328 raft_consensus.cc:385] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.301476 21328 raft_consensus.cc:740] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.301844 21330 tablet_bootstrap.cc:492] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536: No bootstrap required, opened a new log
I20260709 13:04:55.302273 21330 ts_tablet_manager.cc:1403] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536: Time spent bootstrapping tablet: real 0.089s	user 0.007s	sys 0.006s
I20260709 13:04:55.285113 21033 catalog_manager.cc:5697] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1ace56af4464767a75a93f621187536 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "a1ace56af4464767a75a93f621187536" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.302215 21328 consensus_queue.cc:260] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.304291 21328 ts_tablet_manager.cc:1434] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 13:04:55.305259 21134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:04:55.305564 21328 tablet_bootstrap.cc:492] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f: Bootstrap starting.
I20260709 13:04:55.305851 21135 raft_consensus.cc:2468] T c3e3fd611a184caa9d8418f9f781451a P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in term 1.
I20260709 13:04:55.304241 21360 consensus_queue.cc:1048] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:04:55.306906 21250 leader_election.cc:343] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1ace56af4464767a75a93f621187536 (127.20.130.65:42943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.309304 21250 leader_election.cc:304] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:55.310386 21330 raft_consensus.cc:359] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.311090 21330 raft_consensus.cc:385] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.311359 21330 raft_consensus.cc:740] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ace56af4464767a75a93f621187536, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.312012 21330 consensus_queue.cc:260] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.312995 21329 raft_consensus.cc:359] T c3e3fd611a184caa9d8418f9f781451a P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.315109 21329 raft_consensus.cc:385] T c3e3fd611a184caa9d8418f9f781451a P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.317044 21329 raft_consensus.cc:740] T c3e3fd611a184caa9d8418f9f781451a P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.317220 21209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3e3fd611a184caa9d8418f9f781451a" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
I20260709 13:04:55.315196 21381 raft_consensus.cc:2804] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.315855 21285 raft_consensus.cc:3060] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.321496 21330 ts_tablet_manager.cc:1434] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:04:55.323671 21381 raft_consensus.cc:697] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 LEADER]: Becoming Leader. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Running, Role: LEADER
I20260709 13:04:55.324447 21330 tablet_bootstrap.cc:492] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536: Bootstrap starting.
I20260709 13:04:55.324564 21381 consensus_queue.cc:237] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.314885 21382 leader_election.cc:290] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699)
I20260709 13:04:55.323060 21328 tablet_bootstrap.cc:654] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.334656 21330 tablet_bootstrap.cc:654] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.335829 21211 raft_consensus.cc:2468] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in term 1.
I20260709 13:04:55.337877 21249 leader_election.cc:304] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, 4274cb9648234d91bc29ba5e188255ba; no voters: a1ace56af4464767a75a93f621187536
I20260709 13:04:55.339043 21382 raft_consensus.cc:2804] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.339752 21382 raft_consensus.cc:697] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 LEADER]: Becoming Leader. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Running, Role: LEADER
I20260709 13:04:55.341178 21382 consensus_queue.cc:237] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.317822 21329 consensus_queue.cc:260] T c3e3fd611a184caa9d8418f9f781451a P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.345860 21209 raft_consensus.cc:3060] T c3e3fd611a184caa9d8418f9f781451a P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.346043 21328 tablet_bootstrap.cc:492] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f: No bootstrap required, opened a new log
I20260709 13:04:55.346520 21328 ts_tablet_manager.cc:1403] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent bootstrapping tablet: real 0.041s	user 0.003s	sys 0.011s
I20260709 13:04:55.349629 21328 raft_consensus.cc:359] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.350405 21328 raft_consensus.cc:385] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.350703 21328 raft_consensus.cc:740] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.350788 21329 ts_tablet_manager.cc:1434] T c3e3fd611a184caa9d8418f9f781451a P 4274cb9648234d91bc29ba5e188255ba: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.003s
I20260709 13:04:55.351508 21328 consensus_queue.cc:260] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.353005 21351 consensus_queue.cc:1048] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.353540 21328 ts_tablet_manager.cc:1434] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:55.361020 21359 consensus_queue.cc:1048] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.370435 21209 raft_consensus.cc:2468] T c3e3fd611a184caa9d8418f9f781451a P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in term 1.
I20260709 13:04:55.397119 21351 consensus_queue.cc:1048] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.398574 21359 raft_consensus.cc:493] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.399324 21359 raft_consensus.cc:515] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.404740 21209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4274cb9648234d91bc29ba5e188255ba" is_pre_election: true
I20260709 13:04:55.405658 21359 leader_election.cc:290] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:55.409019 21209 raft_consensus.cc:2393] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1ace56af4464767a75a93f621187536 in current term 1: Already voted for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in this term.
I20260709 13:04:55.412972 21284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" is_pre_election: true
I20260709 13:04:55.417795 21101 leader_election.cc:304] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1ace56af4464767a75a93f621187536; no voters: 06cb0f3d9cb64d3089b42efa4fdda16f, 4274cb9648234d91bc29ba5e188255ba
I20260709 13:04:55.419616 21359 raft_consensus.cc:3060] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.420047 21330 tablet_bootstrap.cc:492] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536: No bootstrap required, opened a new log
I20260709 13:04:55.420500 21330 ts_tablet_manager.cc:1403] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.021s
I20260709 13:04:55.426661 21330 raft_consensus.cc:359] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.427384 21330 raft_consensus.cc:385] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.427683 21330 raft_consensus.cc:740] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ace56af4464767a75a93f621187536, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.428336 21330 consensus_queue.cc:260] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.429198 21359 raft_consensus.cc:2749] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.430441 21330 ts_tablet_manager.cc:1434] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:04:55.433996 21029 catalog_manager.cc:5697] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f reported cstate change: term changed from 0 to 1, leader changed from <none> to 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67). New cstate: current_term: 1 leader_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.437981 21029 catalog_manager.cc:5697] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f reported cstate change: term changed from 0 to 1, leader changed from <none> to 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67). New cstate: current_term: 1 leader_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.482352 21382 consensus_queue.cc:1048] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.495680 21381 consensus_queue.cc:1048] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.527954 21351 consensus_queue.cc:1048] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.535055 21351 raft_consensus.cc:493] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.535573 21351 raft_consensus.cc:515] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.537683 21351 leader_election.cc:290] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:55.540032 21135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fe8c407c45467faeb534596e75a252" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536" is_pre_election: true
I20260709 13:04:55.540688 21135 raft_consensus.cc:2468] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 0.
I20260709 13:04:55.541622 21284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fe8c407c45467faeb534596e75a252" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" is_pre_election: true
I20260709 13:04:55.541942 21176 leader_election.cc:304] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:55.542353 21284 raft_consensus.cc:2468] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 0.
I20260709 13:04:55.543488 21361 raft_consensus.cc:2804] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.544080 21361 raft_consensus.cc:493] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.544484 21361 raft_consensus.cc:3060] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.550581 21368 consensus_queue.cc:1048] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.554947 21361 raft_consensus.cc:515] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.557029 21361 leader_election.cc:290] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:55.558765 21135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fe8c407c45467faeb534596e75a252" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:04:55.559490 21283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fe8c407c45467faeb534596e75a252" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:04:55.559500 21135 raft_consensus.cc:3060] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.560091 21283 raft_consensus.cc:3060] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.569171 21283 raft_consensus.cc:2468] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 1.
I20260709 13:04:55.570307 21176 leader_election.cc:304] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, 4274cb9648234d91bc29ba5e188255ba; no voters: 
I20260709 13:04:55.571265 21361 raft_consensus.cc:2804] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.571350 21135 raft_consensus.cc:2468] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 1.
I20260709 13:04:55.571835 21361 raft_consensus.cc:697] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Becoming Leader. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:04:55.572710 21361 consensus_queue.cc:237] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:55.581023 21033 catalog_manager.cc:5697] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 4274cb9648234d91bc29ba5e188255ba (127.20.130.66). New cstate: current_term: 1 leader_uuid: "4274cb9648234d91bc29ba5e188255ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.633648 21359 consensus_queue.cc:1048] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.645331 21359 consensus_queue.cc:1048] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.681452 21209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549"
dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
mode: GRACEFUL
new_leader_uuid: "a1ace56af4464767a75a93f621187536"
 from {username='slave'} at 127.0.0.1:59404
I20260709 13:04:55.682185 21209 raft_consensus.cc:606] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Received request to transfer leadership to TS a1ace56af4464767a75a93f621187536
I20260709 13:04:55.695603 21283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986"
dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
mode: GRACEFUL
new_leader_uuid: "a1ace56af4464767a75a93f621187536"
 from {username='slave'} at 127.0.0.1:38286
I20260709 13:04:55.696264 21283 raft_consensus.cc:606] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 LEADER]: Received request to transfer leadership to TS a1ace56af4464767a75a93f621187536
I20260709 13:04:55.702101 21283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb"
dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
mode: GRACEFUL
new_leader_uuid: "a1ace56af4464767a75a93f621187536"
 from {username='slave'} at 127.0.0.1:38286
I20260709 13:04:55.702715 21283 raft_consensus.cc:606] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 LEADER]: Received request to transfer leadership to TS a1ace56af4464767a75a93f621187536
I20260709 13:04:55.722571 21135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3d042ef4b1d45beb7046c778c769383"
dest_uuid: "a1ace56af4464767a75a93f621187536"
mode: GRACEFUL
new_leader_uuid: "4274cb9648234d91bc29ba5e188255ba"
 from {username='slave'} at 127.0.0.1:55812
I20260709 13:04:55.723225 21135 raft_consensus.cc:606] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 1 LEADER]: Received request to transfer leadership to TS 4274cb9648234d91bc29ba5e188255ba
I20260709 13:04:55.830310 21381 consensus_queue.cc:1048] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.842330 21382 consensus_queue.cc:1048] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.965318 21366 consensus_queue.cc:1048] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.969172 21382 consensus_queue.cc:1048] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.973702 21381 raft_consensus.cc:993] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f: : Instructing follower a1ace56af4464767a75a93f621187536 to start an election
I20260709 13:04:55.975821 21366 raft_consensus.cc:1081] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 LEADER]: Signalling peer a1ace56af4464767a75a93f621187536 to start an election
I20260709 13:04:55.978480 21135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb"
dest_uuid: "a1ace56af4464767a75a93f621187536"
 from {username='slave'} at 127.0.0.1:45892
I20260709 13:04:55.979252 21135 raft_consensus.cc:493] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:55.979636 21135 raft_consensus.cc:3060] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.986958 21351 consensus_queue.cc:1048] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.991153 21135 raft_consensus.cc:515] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:56.004910 21134 raft_consensus.cc:1240] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Rejecting Update request from peer 06cb0f3d9cb64d3089b42efa4fdda16f for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.006582 21209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
I20260709 13:04:56.007287 21209 raft_consensus.cc:3060] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.009143 21382 raft_consensus.cc:993] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f: : Instructing follower a1ace56af4464767a75a93f621187536 to start an election
I20260709 13:04:56.009785 21382 raft_consensus.cc:1081] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 LEADER]: Signalling peer a1ace56af4464767a75a93f621187536 to start an election
I20260709 13:04:56.012763 21135 leader_election.cc:290] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 2 election: Requested vote from peers 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:56.013320 21284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:04:56.013875 21284 raft_consensus.cc:3055] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.014223 21284 raft_consensus.cc:740] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Running, Role: LEADER
I20260709 13:04:56.014153 21412 consensus_queue.cc:1059] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.014632 21361 consensus_queue.cc:1048] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.015681 21284 consensus_queue.cc:260] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:56.016738 21134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986"
dest_uuid: "a1ace56af4464767a75a93f621187536"
 from {username='slave'} at 127.0.0.1:45892
I20260709 13:04:56.017318 21134 raft_consensus.cc:493] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.017709 21134 raft_consensus.cc:3060] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.021277 21209 raft_consensus.cc:2468] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 2.
I20260709 13:04:56.022648 21100 leader_election.cc:304] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:56.023478 21359 raft_consensus.cc:2804] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.023955 21359 raft_consensus.cc:697] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Becoming Leader. State: Replica: a1ace56af4464767a75a93f621187536, State: Running, Role: LEADER
I20260709 13:04:56.024753 21359 consensus_queue.cc:237] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:56.024092 21284 raft_consensus.cc:3060] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.031739 21134 raft_consensus.cc:515] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:56.034847 21284 raft_consensus.cc:2468] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 2.
I20260709 13:04:56.044940 21134 leader_election.cc:290] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 2 election: Requested vote from peers 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:56.046200 21209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
I20260709 13:04:56.044864 21284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:04:56.047685 21209 raft_consensus.cc:3060] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.048089 21284 raft_consensus.cc:3055] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.048446 21284 raft_consensus.cc:740] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Running, Role: LEADER
I20260709 13:04:56.049463 21284 consensus_queue.cc:260] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:56.050756 21284 raft_consensus.cc:3060] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.042444 21032 catalog_manager.cc:5697] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 reported cstate change: term changed from 1 to 2, leader changed from 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67) to a1ace56af4464767a75a93f621187536 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "a1ace56af4464767a75a93f621187536" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.054124 21209 raft_consensus.cc:2468] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 2.
I20260709 13:04:56.055454 21100 leader_election.cc:304] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:56.056303 21359 raft_consensus.cc:2804] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.056793 21359 raft_consensus.cc:697] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Becoming Leader. State: Replica: a1ace56af4464767a75a93f621187536, State: Running, Role: LEADER
I20260709 13:04:56.057605 21359 consensus_queue.cc:237] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:56.058679 21284 raft_consensus.cc:2468] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 2.
I20260709 13:04:56.071943 21032 catalog_manager.cc:5697] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 reported cstate change: term changed from 1 to 2, leader changed from 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67) to a1ace56af4464767a75a93f621187536 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "a1ace56af4464767a75a93f621187536" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.077075 21361 raft_consensus.cc:993] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba: : Instructing follower a1ace56af4464767a75a93f621187536 to start an election
I20260709 13:04:56.077593 21351 raft_consensus.cc:1081] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Signalling peer a1ace56af4464767a75a93f621187536 to start an election
I20260709 13:04:56.079398 21134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549"
dest_uuid: "a1ace56af4464767a75a93f621187536"
 from {username='slave'} at 127.0.0.1:45876
I20260709 13:04:56.079861 21134 raft_consensus.cc:493] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.080210 21134 raft_consensus.cc:3060] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.085381 21134 raft_consensus.cc:515] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:04:56.087710 21134 leader_election.cc:290] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 2 election: Requested vote from peers 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811), 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699)
I20260709 13:04:56.088158 21284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:04:56.088379 21209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
I20260709 13:04:56.088800 21284 raft_consensus.cc:3060] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.089037 21209 raft_consensus.cc:3055] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.089493 21209 raft_consensus.cc:740] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:04:56.090296 21209 consensus_queue.cc:260] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:04:56.091286 21209 raft_consensus.cc:3060] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.095778 21209 raft_consensus.cc:2468] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 2.
I20260709 13:04:56.095800 21284 raft_consensus.cc:2468] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 2.
I20260709 13:04:56.097082 21100 leader_election.cc:304] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:56.097927 21359 raft_consensus.cc:2804] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.098415 21359 raft_consensus.cc:697] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Becoming Leader. State: Replica: a1ace56af4464767a75a93f621187536, State: Running, Role: LEADER
I20260709 13:04:56.099233 21359 consensus_queue.cc:237] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:04:56.106907 21032 catalog_manager.cc:5697] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 reported cstate change: term changed from 1 to 2, leader changed from 4274cb9648234d91bc29ba5e188255ba (127.20.130.66) to a1ace56af4464767a75a93f621187536 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "a1ace56af4464767a75a93f621187536" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.186077 21359 raft_consensus.cc:993] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536: : Instructing follower 4274cb9648234d91bc29ba5e188255ba to start an election
I20260709 13:04:56.186609 21337 raft_consensus.cc:1081] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 1 LEADER]: Signalling peer 4274cb9648234d91bc29ba5e188255ba to start an election
I20260709 13:04:56.188350 21209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3d042ef4b1d45beb7046c778c769383"
dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
 from {username='slave'} at 127.0.0.1:51380
I20260709 13:04:56.188977 21209 raft_consensus.cc:493] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.189384 21209 raft_consensus.cc:3060] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.195959 21209 raft_consensus.cc:515] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:56.197921 21209 leader_election.cc:290] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 2 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:56.199129 21284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d042ef4b1d45beb7046c778c769383" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:04:56.199056 21134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d042ef4b1d45beb7046c778c769383" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:04:56.199812 21284 raft_consensus.cc:3060] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.199856 21134 raft_consensus.cc:3055] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.200332 21134 raft_consensus.cc:740] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1ace56af4464767a75a93f621187536, State: Running, Role: LEADER
I20260709 13:04:56.201153 21134 consensus_queue.cc:260] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:56.202351 21134 raft_consensus.cc:3060] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.207428 21284 raft_consensus.cc:2468] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 2.
I20260709 13:04:56.208768 21176 leader_election.cc:304] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, 4274cb9648234d91bc29ba5e188255ba; no voters: 
I20260709 13:04:56.209581 21134 raft_consensus.cc:2468] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 2.
I20260709 13:04:56.209681 21361 raft_consensus.cc:2804] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.210255 21361 raft_consensus.cc:697] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [term 2 LEADER]: Becoming Leader. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:04:56.211200 21361 consensus_queue.cc:237] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:56.219290 21032 catalog_manager.cc:5697] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba reported cstate change: term changed from 1 to 2, leader changed from a1ace56af4464767a75a93f621187536 (127.20.130.65) to 4274cb9648234d91bc29ba5e188255ba (127.20.130.66). New cstate: current_term: 2 leader_uuid: "4274cb9648234d91bc29ba5e188255ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.425397 21284 raft_consensus.cc:1275] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Refusing update from remote peer a1ace56af4464767a75a93f621187536: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.426877 21337 consensus_queue.cc:1048] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.435150 21209 raft_consensus.cc:1275] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Refusing update from remote peer a1ace56af4464767a75a93f621187536: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.437412 21360 consensus_queue.cc:1048] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.481170 21284 raft_consensus.cc:1275] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Refusing update from remote peer a1ace56af4464767a75a93f621187536: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.482650 21360 consensus_queue.cc:1048] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.491511 21209 raft_consensus.cc:1275] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Refusing update from remote peer a1ace56af4464767a75a93f621187536: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.494355 21415 consensus_queue.cc:1048] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.616708 21134 raft_consensus.cc:1275] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Refusing update from remote peer 4274cb9648234d91bc29ba5e188255ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.618290 21351 consensus_queue.cc:1048] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.627172 21284 raft_consensus.cc:1275] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Refusing update from remote peer 4274cb9648234d91bc29ba5e188255ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.629530 21351 consensus_queue.cc:1048] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:56.697525 21284 raft_consensus.cc:1275] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Refusing update from remote peer a1ace56af4464767a75a93f621187536: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.698832 21415 consensus_queue.cc:1048] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.707993 21209 raft_consensus.cc:1275] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Refusing update from remote peer a1ace56af4464767a75a93f621187536: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.709687 21360 consensus_queue.cc:1048] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:58.764145 21001 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:04:58.766275 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:58.796741 21134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb"
dest_uuid: "a1ace56af4464767a75a93f621187536"
mode: GRACEFUL
new_leader_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
 from {username='slave'} at 127.0.0.1:55826
I20260709 13:04:58.797396 21134 raft_consensus.cc:606] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Received request to transfer leadership to TS 06cb0f3d9cb64d3089b42efa4fdda16f
I20260709 13:04:58.812579 21209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d"
dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
mode: GRACEFUL
new_leader_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
 from {username='slave'} at 127.0.0.1:59408
I20260709 13:04:58.813172 21209 raft_consensus.cc:606] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Received request to transfer leadership to TS 06cb0f3d9cb64d3089b42efa4fdda16f
I20260709 13:04:58.814527 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:58.815296 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:59.021064 21360 raft_consensus.cc:993] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536: : Instructing follower 06cb0f3d9cb64d3089b42efa4fdda16f to start an election
I20260709 13:04:59.021533 21420 raft_consensus.cc:1081] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Signalling peer 06cb0f3d9cb64d3089b42efa4fdda16f to start an election
I20260709 13:04:59.023156 21283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb"
dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
 from {username='slave'} at 127.0.0.1:33130
I20260709 13:04:59.023689 21283 raft_consensus.cc:493] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:59.023963 21283 raft_consensus.cc:3060] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.028681 21283 raft_consensus.cc:515] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:59.030398 21283 leader_election.cc:290] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 3 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699)
I20260709 13:04:59.031422 21134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:04:59.031486 21209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
I20260709 13:04:59.032225 21134 raft_consensus.cc:3055] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:59.032227 21209 raft_consensus.cc:3060] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.032785 21134 raft_consensus.cc:740] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1ace56af4464767a75a93f621187536, State: Running, Role: LEADER
I20260709 13:04:59.033648 21134 consensus_queue.cc:260] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:59.035423 21134 raft_consensus.cc:3060] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.041188 21209 raft_consensus.cc:2468] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in term 3.
I20260709 13:04:59.042590 21249 leader_election.cc:304] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, 4274cb9648234d91bc29ba5e188255ba; no voters: 
I20260709 13:04:59.043476 21382 raft_consensus.cc:2804] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:59.043326 21134 raft_consensus.cc:2468] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in term 3.
I20260709 13:04:59.045481 21382 raft_consensus.cc:697] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 LEADER]: Becoming Leader. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Running, Role: LEADER
I20260709 13:04:59.046547 21382 consensus_queue.cc:237] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:59.047729 21351 raft_consensus.cc:993] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba: : Instructing follower 06cb0f3d9cb64d3089b42efa4fdda16f to start an election
I20260709 13:04:59.048292 21425 raft_consensus.cc:1081] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Signalling peer 06cb0f3d9cb64d3089b42efa4fdda16f to start an election
I20260709 13:04:59.050390 21283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d"
dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:04:59.050995 21283 raft_consensus.cc:493] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:59.051447 21283 raft_consensus.cc:3060] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:59.058496 21283 raft_consensus.cc:515] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:59.060022 21033 catalog_manager.cc:5697] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f reported cstate change: term changed from 2 to 3, leader changed from a1ace56af4464767a75a93f621187536 (127.20.130.65) to 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67). New cstate: current_term: 3 leader_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:59.061193 21283 leader_election.cc:290] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 2 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699)
I20260709 13:04:59.061511 21134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:04:59.062289 21134 raft_consensus.cc:3060] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:59.061889 21209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
I20260709 13:04:59.063166 21209 raft_consensus.cc:3055] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:59.063510 21209 raft_consensus.cc:740] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:04:59.064448 21209 consensus_queue.cc:260] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:59.065688 21209 raft_consensus.cc:3060] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:59.069947 21134 raft_consensus.cc:2468] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in term 2.
I20260709 13:04:59.071347 21250 leader_election.cc:304] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:59.072196 21382 raft_consensus.cc:2804] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:59.072688 21382 raft_consensus.cc:697] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 LEADER]: Becoming Leader. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Running, Role: LEADER
I20260709 13:04:59.073082 21209 raft_consensus.cc:2468] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in term 2.
I20260709 13:04:59.073545 21382 consensus_queue.cc:237] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:59.087515 21033 catalog_manager.cc:5697] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f reported cstate change: term changed from 1 to 2, leader changed from 4274cb9648234d91bc29ba5e188255ba (127.20.130.66) to 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67). New cstate: current_term: 2 leader_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:59.472020 21134 raft_consensus.cc:1275] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Refusing update from remote peer 06cb0f3d9cb64d3089b42efa4fdda16f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:59.473275 21382 consensus_queue.cc:1048] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:59.483628 21209 raft_consensus.cc:1275] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Refusing update from remote peer 06cb0f3d9cb64d3089b42efa4fdda16f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:59.488119 21382 consensus_queue.cc:1048] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:59.560519 21209 raft_consensus.cc:1275] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 3 FOLLOWER]: Refusing update from remote peer 06cb0f3d9cb64d3089b42efa4fdda16f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:59.561856 21382 consensus_queue.cc:1048] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:59.570951 21134 raft_consensus.cc:1275] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 3 FOLLOWER]: Refusing update from remote peer 06cb0f3d9cb64d3089b42efa4fdda16f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:59.572558 21438 consensus_queue.cc:1048] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:59.816411 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:59.827075 21134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549"
dest_uuid: "a1ace56af4464767a75a93f621187536"
mode: GRACEFUL
new_leader_uuid: "4274cb9648234d91bc29ba5e188255ba"
 from {username='slave'} at 127.0.0.1:55812
I20260709 13:04:59.827581 21134 raft_consensus.cc:606] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Received request to transfer leadership to TS 4274cb9648234d91bc29ba5e188255ba
I20260709 13:04:59.833117 21134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986"
dest_uuid: "a1ace56af4464767a75a93f621187536"
mode: GRACEFUL
new_leader_uuid: "4274cb9648234d91bc29ba5e188255ba"
 from {username='slave'} at 127.0.0.1:55812
I20260709 13:04:59.833746 21134 raft_consensus.cc:606] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Received request to transfer leadership to TS 4274cb9648234d91bc29ba5e188255ba
I20260709 13:04:59.838881 21283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb"
dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
mode: GRACEFUL
new_leader_uuid: "4274cb9648234d91bc29ba5e188255ba"
 from {username='slave'} at 127.0.0.1:38286
I20260709 13:04:59.839502 21283 raft_consensus.cc:606] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 LEADER]: Received request to transfer leadership to TS 4274cb9648234d91bc29ba5e188255ba
I20260709 13:04:59.845118 21134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dccd087e9e5b48d086c2563b7f14fbe1"
dest_uuid: "a1ace56af4464767a75a93f621187536"
mode: GRACEFUL
new_leader_uuid: "4274cb9648234d91bc29ba5e188255ba"
 from {username='slave'} at 127.0.0.1:55812
I20260709 13:04:59.845685 21134 raft_consensus.cc:606] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 1 LEADER]: Received request to transfer leadership to TS 4274cb9648234d91bc29ba5e188255ba
I20260709 13:04:59.857344 21283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d"
dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
mode: GRACEFUL
new_leader_uuid: "4274cb9648234d91bc29ba5e188255ba"
 from {username='slave'} at 127.0.0.1:38286
I20260709 13:04:59.857945 21283 raft_consensus.cc:606] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 LEADER]: Received request to transfer leadership to TS 4274cb9648234d91bc29ba5e188255ba
I20260709 13:04:59.931916 21438 raft_consensus.cc:993] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f: : Instructing follower 4274cb9648234d91bc29ba5e188255ba to start an election
I20260709 13:04:59.932469 21382 raft_consensus.cc:1081] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 LEADER]: Signalling peer 4274cb9648234d91bc29ba5e188255ba to start an election
I20260709 13:04:59.934059 21209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d"
dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
 from {username='slave'} at 127.0.0.1:51390
I20260709 13:04:59.934625 21209 raft_consensus.cc:493] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:59.935063 21209 raft_consensus.cc:3060] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.939599 21209 raft_consensus.cc:515] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:59.941130 21209 leader_election.cc:290] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 3 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:04:59.942024 21134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:04:59.942394 21283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:04:59.942551 21134 raft_consensus.cc:3060] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.942975 21283 raft_consensus.cc:3055] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:59.943251 21283 raft_consensus.cc:740] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Running, Role: LEADER
I20260709 13:04:59.943928 21283 consensus_queue.cc:260] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:59.945063 21283 raft_consensus.cc:3060] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.947628 21134 raft_consensus.cc:2468] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 3.
I20260709 13:04:59.948724 21176 leader_election.cc:304] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:04:59.949577 21425 raft_consensus.cc:2804] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:59.950623 21425 raft_consensus.cc:697] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 3 LEADER]: Becoming Leader. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:04:59.950990 21283 raft_consensus.cc:2468] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 3.
I20260709 13:04:59.951591 21425 consensus_queue.cc:237] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:04:59.958143 21032 catalog_manager.cc:5697] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba reported cstate change: term changed from 2 to 3, leader changed from 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67) to 4274cb9648234d91bc29ba5e188255ba (127.20.130.66). New cstate: current_term: 3 leader_uuid: "4274cb9648234d91bc29ba5e188255ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.075598 21420 raft_consensus.cc:993] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536: : Instructing follower 4274cb9648234d91bc29ba5e188255ba to start an election
I20260709 13:05:00.076107 21439 raft_consensus.cc:1081] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Signalling peer 4274cb9648234d91bc29ba5e188255ba to start an election
I20260709 13:05:00.077746 21209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549"
dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
 from {username='slave'} at 127.0.0.1:51380
I20260709 13:05:00.078222 21209 raft_consensus.cc:493] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.078660 21209 raft_consensus.cc:3060] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.084174 21209 raft_consensus.cc:515] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:05:00.085747 21209 leader_election.cc:290] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 3 election: Requested vote from peers 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811), a1ace56af4464767a75a93f621187536 (127.20.130.65:42943)
I20260709 13:05:00.086725 21283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:05:00.087131 21134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:05:00.087473 21283 raft_consensus.cc:3060] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.087682 21134 raft_consensus.cc:3055] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:00.088022 21134 raft_consensus.cc:740] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1ace56af4464767a75a93f621187536, State: Running, Role: LEADER
I20260709 13:05:00.088770 21134 consensus_queue.cc:260] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:05:00.089870 21134 raft_consensus.cc:3060] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.094342 21382 raft_consensus.cc:993] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f: : Instructing follower 4274cb9648234d91bc29ba5e188255ba to start an election
I20260709 13:05:00.094813 21382 raft_consensus.cc:1081] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 LEADER]: Signalling peer 4274cb9648234d91bc29ba5e188255ba to start an election
I20260709 13:05:00.096069 21134 raft_consensus.cc:2468] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 3.
I20260709 13:05:00.096069 21283 raft_consensus.cc:2468] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 3.
I20260709 13:05:00.096786 21209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb"
dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
 from {username='slave'} at 127.0.0.1:51390
I20260709 13:05:00.097347 21209 raft_consensus.cc:493] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.097708 21209 raft_consensus.cc:3060] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:00.097558 21176 leader_election.cc:304] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:05:00.098343 21425 raft_consensus.cc:2804] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:00.098851 21425 raft_consensus.cc:697] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 3 LEADER]: Becoming Leader. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:05:00.099579 21425 consensus_queue.cc:237] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:05:00.102694 21209 raft_consensus.cc:515] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:00.104604 21209 leader_election.cc:290] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 4 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:05:00.105474 21134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:05:00.106025 21134 raft_consensus.cc:3060] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:00.107776 21283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6e0e725ba4be990abd00ed0bb85cb" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:05:00.107342 21032 catalog_manager.cc:5697] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba reported cstate change: term changed from 2 to 3, leader changed from a1ace56af4464767a75a93f621187536 (127.20.130.65) to 4274cb9648234d91bc29ba5e188255ba (127.20.130.66). New cstate: current_term: 3 leader_uuid: "4274cb9648234d91bc29ba5e188255ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.108451 21283 raft_consensus.cc:3055] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:00.108999 21283 raft_consensus.cc:740] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Running, Role: LEADER
I20260709 13:05:00.109802 21283 consensus_queue.cc:260] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:00.111064 21283 raft_consensus.cc:3060] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:00.111961 21134 raft_consensus.cc:2468] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 4.
I20260709 13:05:00.113415 21176 leader_election.cc:304] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:05:00.114773 21425 raft_consensus.cc:2804] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:00.115276 21425 raft_consensus.cc:697] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 4 LEADER]: Becoming Leader. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:05:00.116027 21425 consensus_queue.cc:237] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:00.118423 21283 raft_consensus.cc:2468] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 4.
I20260709 13:05:00.122201 21032 catalog_manager.cc:5697] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba reported cstate change: term changed from 3 to 4, leader changed from 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67) to 4274cb9648234d91bc29ba5e188255ba (127.20.130.66). New cstate: current_term: 4 leader_uuid: "4274cb9648234d91bc29ba5e188255ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.134342 21439 raft_consensus.cc:993] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536: : Instructing follower 4274cb9648234d91bc29ba5e188255ba to start an election
I20260709 13:05:00.134815 21420 raft_consensus.cc:1081] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 1 LEADER]: Signalling peer 4274cb9648234d91bc29ba5e188255ba to start an election
I20260709 13:05:00.136344 21209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dccd087e9e5b48d086c2563b7f14fbe1"
dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
 from {username='slave'} at 127.0.0.1:51380
I20260709 13:05:00.136791 21209 raft_consensus.cc:493] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.137012 21209 raft_consensus.cc:3060] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.141039 21209 raft_consensus.cc:515] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:00.142427 21209 leader_election.cc:290] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 2 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:05:00.143404 21134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccd087e9e5b48d086c2563b7f14fbe1" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:05:00.143570 21283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccd087e9e5b48d086c2563b7f14fbe1" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:05:00.143900 21134 raft_consensus.cc:3055] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.144119 21283 raft_consensus.cc:3060] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.144237 21134 raft_consensus.cc:740] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1ace56af4464767a75a93f621187536, State: Running, Role: LEADER
I20260709 13:05:00.144937 21134 consensus_queue.cc:260] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:00.145762 21134 raft_consensus.cc:3060] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.149334 21283 raft_consensus.cc:2468] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 2.
I20260709 13:05:00.149714 21134 raft_consensus.cc:2468] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 2.
I20260709 13:05:00.150843 21176 leader_election.cc:304] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, 4274cb9648234d91bc29ba5e188255ba; no voters: 
I20260709 13:05:00.151698 21425 raft_consensus.cc:2804] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.152144 21425 raft_consensus.cc:697] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [term 2 LEADER]: Becoming Leader. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:05:00.152877 21425 consensus_queue.cc:237] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:00.159166 21032 catalog_manager.cc:5697] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba reported cstate change: term changed from 1 to 2, leader changed from a1ace56af4464767a75a93f621187536 (127.20.130.65) to 4274cb9648234d91bc29ba5e188255ba (127.20.130.66). New cstate: current_term: 2 leader_uuid: "4274cb9648234d91bc29ba5e188255ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.195741 21439 raft_consensus.cc:993] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536: : Instructing follower 4274cb9648234d91bc29ba5e188255ba to start an election
I20260709 13:05:00.196139 21420 raft_consensus.cc:1081] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Signalling peer 4274cb9648234d91bc29ba5e188255ba to start an election
I20260709 13:05:00.197633 21209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986"
dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
 from {username='slave'} at 127.0.0.1:51380
I20260709 13:05:00.198081 21209 raft_consensus.cc:493] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.198351 21209 raft_consensus.cc:3060] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.202303 21209 raft_consensus.cc:515] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:00.203732 21209 leader_election.cc:290] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 3 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:05:00.204716 21134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:05:00.205060 21283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986" candidate_uuid: "4274cb9648234d91bc29ba5e188255ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:05:00.205298 21134 raft_consensus.cc:3055] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:00.205596 21134 raft_consensus.cc:740] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1ace56af4464767a75a93f621187536, State: Running, Role: LEADER
I20260709 13:05:00.205610 21283 raft_consensus.cc:3060] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.206432 21134 consensus_queue.cc:260] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:00.207563 21134 raft_consensus.cc:3060] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.212656 21283 raft_consensus.cc:2468] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 3.
I20260709 13:05:00.213819 21134 raft_consensus.cc:2468] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4274cb9648234d91bc29ba5e188255ba in term 3.
I20260709 13:05:00.213982 21176 leader_election.cc:304] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, 4274cb9648234d91bc29ba5e188255ba; no voters: 
I20260709 13:05:00.214944 21425 raft_consensus.cc:2804] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:00.215483 21425 raft_consensus.cc:697] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 3 LEADER]: Becoming Leader. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:05:00.216552 21425 consensus_queue.cc:237] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:00.223343 21032 catalog_manager.cc:5697] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba reported cstate change: term changed from 2 to 3, leader changed from a1ace56af4464767a75a93f621187536 (127.20.130.65) to 4274cb9648234d91bc29ba5e188255ba (127.20.130.66). New cstate: current_term: 3 leader_uuid: "4274cb9648234d91bc29ba5e188255ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.402623 21134 raft_consensus.cc:1275] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 3 FOLLOWER]: Refusing update from remote peer 4274cb9648234d91bc29ba5e188255ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:00.403877 21425 consensus_queue.cc:1048] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:00.415925 21283 raft_consensus.cc:1275] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 FOLLOWER]: Refusing update from remote peer 4274cb9648234d91bc29ba5e188255ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:00.417766 21425 consensus_queue.cc:1048] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:00.484925 21134 raft_consensus.cc:1275] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 3 FOLLOWER]: Refusing update from remote peer 4274cb9648234d91bc29ba5e188255ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:00.486316 21425 consensus_queue.cc:1048] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:00.497408 21283 raft_consensus.cc:1275] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 FOLLOWER]: Refusing update from remote peer 4274cb9648234d91bc29ba5e188255ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:00.498905 21452 consensus_queue.cc:1048] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:00.560025 21283 raft_consensus.cc:1275] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 FOLLOWER]: Refusing update from remote peer 4274cb9648234d91bc29ba5e188255ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:00.561510 21452 consensus_queue.cc:1048] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:00.570340 21134 raft_consensus.cc:1275] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 4 FOLLOWER]: Refusing update from remote peer 4274cb9648234d91bc29ba5e188255ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:00.572564 21452 consensus_queue.cc:1048] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:00.602794 21134 raft_consensus.cc:1275] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 3 FOLLOWER]: Refusing update from remote peer 4274cb9648234d91bc29ba5e188255ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:00.604223 21452 consensus_queue.cc:1048] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:00.612581 21283 raft_consensus.cc:1275] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 FOLLOWER]: Refusing update from remote peer 4274cb9648234d91bc29ba5e188255ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:00.613595 21133 raft_consensus.cc:1275] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Refusing update from remote peer 4274cb9648234d91bc29ba5e188255ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.615787 21441 consensus_queue.cc:1048] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:00.615826 21452 consensus_queue.cc:1048] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:00.630362 21283 raft_consensus.cc:1275] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Refusing update from remote peer 4274cb9648234d91bc29ba5e188255ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.632323 21452 consensus_queue.cc:1048] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:02.866333 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:02.874886 21209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45fe8c407c45467faeb534596e75a252"
dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
mode: GRACEFUL
new_leader_uuid: "a1ace56af4464767a75a93f621187536"
 from {username='slave'} at 127.0.0.1:59408
I20260709 13:05:02.875828 21209 raft_consensus.cc:606] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Received request to transfer leadership to TS a1ace56af4464767a75a93f621187536
I20260709 13:05:02.878991 21209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549"
dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
mode: GRACEFUL
new_leader_uuid: "a1ace56af4464767a75a93f621187536"
 from {username='slave'} at 127.0.0.1:59408
I20260709 13:05:02.879540 21209 raft_consensus.cc:606] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 3 LEADER]: Received request to transfer leadership to TS a1ace56af4464767a75a93f621187536
I20260709 13:05:02.882380 21209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f8b68bb02054ac7a18f97bce8a3e151"
dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
mode: GRACEFUL
new_leader_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
 from {username='slave'} at 127.0.0.1:59408
I20260709 13:05:02.882875 21209 raft_consensus.cc:606] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Received request to transfer leadership to TS 06cb0f3d9cb64d3089b42efa4fdda16f
I20260709 13:05:02.885991 21209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d"
dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
mode: GRACEFUL
new_leader_uuid: "a1ace56af4464767a75a93f621187536"
 from {username='slave'} at 127.0.0.1:59408
I20260709 13:05:02.886482 21209 raft_consensus.cc:606] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 3 LEADER]: Received request to transfer leadership to TS a1ace56af4464767a75a93f621187536
I20260709 13:05:02.889037 21209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986"
dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
mode: GRACEFUL
new_leader_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
 from {username='slave'} at 127.0.0.1:59408
I20260709 13:05:02.889750 21209 raft_consensus.cc:606] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 3 LEADER]: Received request to transfer leadership to TS 06cb0f3d9cb64d3089b42efa4fdda16f
I20260709 13:05:02.891251 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:02.891708 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:02.900914 21452 raft_consensus.cc:993] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba: : Instructing follower a1ace56af4464767a75a93f621187536 to start an election
I20260709 13:05:02.901438 21452 raft_consensus.cc:1081] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 3 LEADER]: Signalling peer a1ace56af4464767a75a93f621187536 to start an election
I20260709 13:05:02.903376 21133 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d"
dest_uuid: "a1ace56af4464767a75a93f621187536"
 from {username='slave'} at 127.0.0.1:45876
I20260709 13:05:02.903905 21133 raft_consensus.cc:493] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:02.904373 21133 raft_consensus.cc:3060] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:02.912614 21133 raft_consensus.cc:515] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:02.914652 21133 leader_election.cc:290] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 4 election: Requested vote from peers 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:05:02.915912 21209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
I20260709 13:05:02.916500 21284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dd1b14960b4478b321c6b33c40148d" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:05:02.916742 21209 raft_consensus.cc:3055] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:02.917107 21209 raft_consensus.cc:740] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:05:02.917126 21284 raft_consensus.cc:3060] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:02.917954 21209 consensus_queue.cc:260] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:02.918977 21209 raft_consensus.cc:3060] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:02.923233 21284 raft_consensus.cc:2468] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 4.
I20260709 13:05:02.923374 21209 raft_consensus.cc:2468] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 4.
I20260709 13:05:02.924788 21100 leader_election.cc:304] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4274cb9648234d91bc29ba5e188255ba, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:05:02.926421 21461 raft_consensus.cc:2804] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:02.927690 21461 raft_consensus.cc:697] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 4 LEADER]: Becoming Leader. State: Replica: a1ace56af4464767a75a93f621187536, State: Running, Role: LEADER
I20260709 13:05:02.929006 21461 consensus_queue.cc:237] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:02.937095 21032 catalog_manager.cc:5697] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 reported cstate change: term changed from 3 to 4, leader changed from 4274cb9648234d91bc29ba5e188255ba (127.20.130.66) to a1ace56af4464767a75a93f621187536 (127.20.130.65). New cstate: current_term: 4 leader_uuid: "a1ace56af4464767a75a93f621187536" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:02.954643 21460 raft_consensus.cc:993] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba: : Instructing follower a1ace56af4464767a75a93f621187536 to start an election
I20260709 13:05:02.955170 21452 raft_consensus.cc:1081] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 3 LEADER]: Signalling peer a1ace56af4464767a75a93f621187536 to start an election
I20260709 13:05:02.956744 21133 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549"
dest_uuid: "a1ace56af4464767a75a93f621187536"
 from {username='slave'} at 127.0.0.1:45876
I20260709 13:05:02.957355 21133 raft_consensus.cc:493] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:02.957664 21133 raft_consensus.cc:3060] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:02.963501 21133 raft_consensus.cc:515] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:05:02.965837 21133 leader_election.cc:290] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 4 election: Requested vote from peers 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811), 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699)
I20260709 13:05:02.966518 21284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:05:02.966840 21209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5627b62d64d4428ca840a5eabc7d7549" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
I20260709 13:05:02.967176 21284 raft_consensus.cc:3060] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:02.967479 21209 raft_consensus.cc:3055] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:02.967844 21209 raft_consensus.cc:740] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:05:02.968636 21209 consensus_queue.cc:260] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:05:02.970376 21209 raft_consensus.cc:3060] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:02.976271 21284 raft_consensus.cc:2468] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 4.
I20260709 13:05:02.978024 21101 leader_election.cc:304] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:05:02.978520 21209 raft_consensus.cc:2468] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 4.
I20260709 13:05:02.978869 21461 raft_consensus.cc:2804] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:02.979624 21461 raft_consensus.cc:697] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 4 LEADER]: Becoming Leader. State: Replica: a1ace56af4464767a75a93f621187536, State: Running, Role: LEADER
I20260709 13:05:02.980613 21461 consensus_queue.cc:237] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } }
I20260709 13:05:02.989478 21032 catalog_manager.cc:5697] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 reported cstate change: term changed from 3 to 4, leader changed from 4274cb9648234d91bc29ba5e188255ba (127.20.130.66) to a1ace56af4464767a75a93f621187536 (127.20.130.65). New cstate: current_term: 4 leader_uuid: "a1ace56af4464767a75a93f621187536" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.044035 21460 raft_consensus.cc:993] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba: : Instructing follower a1ace56af4464767a75a93f621187536 to start an election
I20260709 13:05:03.044484 21452 raft_consensus.cc:1081] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Signalling peer a1ace56af4464767a75a93f621187536 to start an election
I20260709 13:05:03.046231 21133 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45fe8c407c45467faeb534596e75a252"
dest_uuid: "a1ace56af4464767a75a93f621187536"
 from {username='slave'} at 127.0.0.1:45876
I20260709 13:05:03.046761 21133 raft_consensus.cc:493] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.047101 21133 raft_consensus.cc:3060] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.051904 21133 raft_consensus.cc:515] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:03.053633 21133 leader_election.cc:290] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 2 election: Requested vote from peers 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699), 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67:35811)
I20260709 13:05:03.054522 21209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fe8c407c45467faeb534596e75a252" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
I20260709 13:05:03.054801 21284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fe8c407c45467faeb534596e75a252" candidate_uuid: "a1ace56af4464767a75a93f621187536" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
I20260709 13:05:03.055083 21209 raft_consensus.cc:3055] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:03.055383 21284 raft_consensus.cc:3060] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.055402 21209 raft_consensus.cc:740] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:05:03.056187 21209 consensus_queue.cc:260] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:03.056967 21209 raft_consensus.cc:3060] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.060308 21284 raft_consensus.cc:2468] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 2.
I20260709 13:05:03.061008 21209 raft_consensus.cc:2468] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ace56af4464767a75a93f621187536 in term 2.
I20260709 13:05:03.061417 21101 leader_election.cc:304] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:05:03.062239 21461 raft_consensus.cc:2804] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:03.062633 21461 raft_consensus.cc:697] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Becoming Leader. State: Replica: a1ace56af4464767a75a93f621187536, State: Running, Role: LEADER
I20260709 13:05:03.063421 21461 consensus_queue.cc:237] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:03.070453 21032 catalog_manager.cc:5697] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 reported cstate change: term changed from 1 to 2, leader changed from 4274cb9648234d91bc29ba5e188255ba (127.20.130.66) to a1ace56af4464767a75a93f621187536 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "a1ace56af4464767a75a93f621187536" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.170675 21460 raft_consensus.cc:993] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba: : Instructing follower 06cb0f3d9cb64d3089b42efa4fdda16f to start an election
I20260709 13:05:03.171192 21460 raft_consensus.cc:1081] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 3 LEADER]: Signalling peer 06cb0f3d9cb64d3089b42efa4fdda16f to start an election
I20260709 13:05:03.173734 21284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986"
dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:05:03.174769 21284 raft_consensus.cc:493] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.175288 21284 raft_consensus.cc:3060] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.180123 21284 raft_consensus.cc:515] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:03.181890 21284 leader_election.cc:290] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 4 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699)
I20260709 13:05:03.183041 21209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
I20260709 13:05:03.183095 21133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ac2b3344bb407e81ef28b0052ea986" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:05:03.183720 21209 raft_consensus.cc:3055] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:03.183864 21133 raft_consensus.cc:3060] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.184001 21209 raft_consensus.cc:740] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:05:03.184885 21209 consensus_queue.cc:260] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:03.186089 21209 raft_consensus.cc:3060] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.189334 21133 raft_consensus.cc:2468] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in term 4.
I20260709 13:05:03.191028 21250 leader_election.cc:304] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:05:03.191291 21209 raft_consensus.cc:2468] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in term 4.
I20260709 13:05:03.192560 21382 raft_consensus.cc:2804] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:03.193727 21382 raft_consensus.cc:697] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 LEADER]: Becoming Leader. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Running, Role: LEADER
I20260709 13:05:03.194576 21382 consensus_queue.cc:237] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:03.203701 21032 catalog_manager.cc:5697] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f reported cstate change: term changed from 3 to 4, leader changed from 4274cb9648234d91bc29ba5e188255ba (127.20.130.66) to 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67). New cstate: current_term: 4 leader_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.253539 21452 raft_consensus.cc:993] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba: : Instructing follower 06cb0f3d9cb64d3089b42efa4fdda16f to start an election
I20260709 13:05:03.254025 21460 raft_consensus.cc:1081] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Signalling peer 06cb0f3d9cb64d3089b42efa4fdda16f to start an election
I20260709 13:05:03.255692 21284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f8b68bb02054ac7a18f97bce8a3e151"
dest_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f"
 from {username='slave'} at 127.0.0.1:33116
I20260709 13:05:03.256129 21284 raft_consensus.cc:493] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.256404 21284 raft_consensus.cc:3060] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.261703 21284 raft_consensus.cc:515] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:03.263499 21284 leader_election.cc:290] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 2 election: Requested vote from peers a1ace56af4464767a75a93f621187536 (127.20.130.65:42943), 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699)
I20260709 13:05:03.264357 21133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8b68bb02054ac7a18f97bce8a3e151" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1ace56af4464767a75a93f621187536"
I20260709 13:05:03.264496 21209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8b68bb02054ac7a18f97bce8a3e151" candidate_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4274cb9648234d91bc29ba5e188255ba"
I20260709 13:05:03.264925 21133 raft_consensus.cc:3060] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.265050 21209 raft_consensus.cc:3055] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:03.265377 21209 raft_consensus.cc:740] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4274cb9648234d91bc29ba5e188255ba, State: Running, Role: LEADER
I20260709 13:05:03.265973 21209 consensus_queue.cc:260] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:03.267288 21209 raft_consensus.cc:3060] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.270670 21133 raft_consensus.cc:2468] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in term 2.
I20260709 13:05:03.271838 21250 leader_election.cc:304] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cb0f3d9cb64d3089b42efa4fdda16f, a1ace56af4464767a75a93f621187536; no voters: 
I20260709 13:05:03.272691 21382 raft_consensus.cc:2804] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:03.273058 21209 raft_consensus.cc:2468] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06cb0f3d9cb64d3089b42efa4fdda16f in term 2.
I20260709 13:05:03.273077 21382 raft_consensus.cc:697] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 LEADER]: Becoming Leader. State: Replica: 06cb0f3d9cb64d3089b42efa4fdda16f, State: Running, Role: LEADER
I20260709 13:05:03.274803 21382 consensus_queue.cc:237] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } }
I20260709 13:05:03.282545 21032 catalog_manager.cc:5697] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f reported cstate change: term changed from 1 to 2, leader changed from 4274cb9648234d91bc29ba5e188255ba (127.20.130.66) to 06cb0f3d9cb64d3089b42efa4fdda16f (127.20.130.67). New cstate: current_term: 2 leader_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.381799 21284 raft_consensus.cc:1275] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 FOLLOWER]: Refusing update from remote peer a1ace56af4464767a75a93f621187536: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:03.383289 21461 consensus_queue.cc:1048] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:03.396180 21209 raft_consensus.cc:1275] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 4 FOLLOWER]: Refusing update from remote peer a1ace56af4464767a75a93f621187536: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:03.401440 21475 consensus_queue.cc:1048] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:03.423647 21209 raft_consensus.cc:1275] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 4 FOLLOWER]: Refusing update from remote peer a1ace56af4464767a75a93f621187536: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:03.424934 21475 consensus_queue.cc:1048] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:03.434832 21284 raft_consensus.cc:1275] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 FOLLOWER]: Refusing update from remote peer a1ace56af4464767a75a93f621187536: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:03.436322 21461 consensus_queue.cc:1048] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:03.600934 21209 raft_consensus.cc:1275] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 4 FOLLOWER]: Refusing update from remote peer 06cb0f3d9cb64d3089b42efa4fdda16f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:03.602421 21382 consensus_queue.cc:1048] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:03.612869 21133 raft_consensus.cc:1275] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 4 FOLLOWER]: Refusing update from remote peer 06cb0f3d9cb64d3089b42efa4fdda16f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:03.614720 21470 consensus_queue.cc:1048] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:03.670157 21209 raft_consensus.cc:1275] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Refusing update from remote peer a1ace56af4464767a75a93f621187536: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:03.671567 21461 consensus_queue.cc:1048] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:03.681185 21284 raft_consensus.cc:1275] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Refusing update from remote peer a1ace56af4464767a75a93f621187536: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:03.682644 21475 consensus_queue.cc:1048] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cb0f3d9cb64d3089b42efa4fdda16f" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:03.834806 21209 raft_consensus.cc:1275] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Refusing update from remote peer 06cb0f3d9cb64d3089b42efa4fdda16f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:03.836295 21470 consensus_queue.cc:1048] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4274cb9648234d91bc29ba5e188255ba" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:03.847440 21133 raft_consensus.cc:1275] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Refusing update from remote peer 06cb0f3d9cb64d3089b42efa4fdda16f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:03.850318 21482 consensus_queue.cc:1048] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ace56af4464767a75a93f621187536" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:03.892565 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:03.899027 21001 tablet_server.cc:179] TabletServer@127.20.130.65:0 shutting down...
W20260709 13:05:03.930796 21176 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:03.931495 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:03.932528 21001 tablet_replica.cc:333] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536: stopping tablet replica
I20260709 13:05:03.933271 21001 raft_consensus.cc:2243] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.933840 21001 raft_consensus.cc:2272] T 9cd6e0e725ba4be990abd00ed0bb85cb P a1ace56af4464767a75a93f621187536 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:03.935952 21176 consensus_peers.cc:597] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba -> Peer a1ace56af4464767a75a93f621187536 (127.20.130.65:42943): Couldn't send request to peer a1ace56af4464767a75a93f621187536. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.936718 21001 tablet_replica.cc:333] T c3e3fd611a184caa9d8418f9f781451a P a1ace56af4464767a75a93f621187536: stopping tablet replica
I20260709 13:05:03.937276 21001 raft_consensus.cc:2243] T c3e3fd611a184caa9d8418f9f781451a P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.937703 21001 raft_consensus.cc:2272] T c3e3fd611a184caa9d8418f9f781451a P a1ace56af4464767a75a93f621187536 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.939744 21001 tablet_replica.cc:333] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536: stopping tablet replica
I20260709 13:05:03.940321 21001 raft_consensus.cc:2243] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.940825 21001 raft_consensus.cc:2272] T d3d042ef4b1d45beb7046c778c769383 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.942902 21001 tablet_replica.cc:333] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536: stopping tablet replica
I20260709 13:05:03.943540 21001 raft_consensus.cc:2243] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.944311 21001 raft_consensus.cc:2272] T 5627b62d64d4428ca840a5eabc7d7549 P a1ace56af4464767a75a93f621187536 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.946584 21001 tablet_replica.cc:333] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536: stopping tablet replica
I20260709 13:05:03.947540 21001 raft_consensus.cc:2243] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.948225 21001 raft_consensus.cc:2272] T 9f8b68bb02054ac7a18f97bce8a3e151 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.950552 21001 tablet_replica.cc:333] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536: stopping tablet replica
I20260709 13:05:03.951177 21001 raft_consensus.cc:2243] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.951642 21001 raft_consensus.cc:2272] T e9ac2b3344bb407e81ef28b0052ea986 P a1ace56af4464767a75a93f621187536 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.953723 21001 tablet_replica.cc:333] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536: stopping tablet replica
I20260709 13:05:03.954231 21001 raft_consensus.cc:2243] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.954998 21001 raft_consensus.cc:2272] T 45fe8c407c45467faeb534596e75a252 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.956815 21001 tablet_replica.cc:333] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536: stopping tablet replica
I20260709 13:05:03.957300 21001 raft_consensus.cc:2243] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.957708 21001 raft_consensus.cc:2272] T dccd087e9e5b48d086c2563b7f14fbe1 P a1ace56af4464767a75a93f621187536 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.959444 21001 tablet_replica.cc:333] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536: stopping tablet replica
I20260709 13:05:03.959882 21001 raft_consensus.cc:2243] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.960561 21001 raft_consensus.cc:2272] T a6dd1b14960b4478b321c6b33c40148d P a1ace56af4464767a75a93f621187536 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.062516 21001 tablet_server.cc:196] TabletServer@127.20.130.65:0 shutdown complete.
I20260709 13:05:04.081883 21001 tablet_server.cc:179] TabletServer@127.20.130.66:0 shutting down...
I20260709 13:05:04.107410 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:04.108528 21001 tablet_replica.cc:333] T c3e3fd611a184caa9d8418f9f781451a P 4274cb9648234d91bc29ba5e188255ba: stopping tablet replica
I20260709 13:05:04.109233 21001 raft_consensus.cc:2243] T c3e3fd611a184caa9d8418f9f781451a P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.109685 21001 raft_consensus.cc:2272] T c3e3fd611a184caa9d8418f9f781451a P 4274cb9648234d91bc29ba5e188255ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.111845 21001 tablet_replica.cc:333] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba: stopping tablet replica
I20260709 13:05:04.112455 21001 raft_consensus.cc:2243] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:04.113139 21001 raft_consensus.cc:2272] T 9cd6e0e725ba4be990abd00ed0bb85cb P 4274cb9648234d91bc29ba5e188255ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.115043 21001 tablet_replica.cc:333] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba: stopping tablet replica
I20260709 13:05:04.115556 21001 raft_consensus.cc:2243] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:04.116318 21001 raft_consensus.cc:2272] T d3d042ef4b1d45beb7046c778c769383 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.118032 21001 tablet_replica.cc:333] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba: stopping tablet replica
I20260709 13:05:04.118551 21001 raft_consensus.cc:2243] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.119021 21001 raft_consensus.cc:2272] T 5627b62d64d4428ca840a5eabc7d7549 P 4274cb9648234d91bc29ba5e188255ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.121110 21001 tablet_replica.cc:333] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba: stopping tablet replica
I20260709 13:05:04.121693 21001 raft_consensus.cc:2243] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.122145 21001 raft_consensus.cc:2272] T 9f8b68bb02054ac7a18f97bce8a3e151 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.124650 21001 tablet_replica.cc:333] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba: stopping tablet replica
I20260709 13:05:04.125218 21001 raft_consensus.cc:2243] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.125785 21001 raft_consensus.cc:2272] T e9ac2b3344bb407e81ef28b0052ea986 P 4274cb9648234d91bc29ba5e188255ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.128304 21001 tablet_replica.cc:333] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba: stopping tablet replica
I20260709 13:05:04.128985 21001 raft_consensus.cc:2243] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.129418 21001 raft_consensus.cc:2272] T a6dd1b14960b4478b321c6b33c40148d P 4274cb9648234d91bc29ba5e188255ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.131644 21001 tablet_replica.cc:333] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba: stopping tablet replica
I20260709 13:05:04.132144 21001 raft_consensus.cc:2243] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.132544 21001 raft_consensus.cc:2272] T 45fe8c407c45467faeb534596e75a252 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.134493 21001 tablet_replica.cc:333] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba: stopping tablet replica
I20260709 13:05:04.135001 21001 raft_consensus.cc:2243] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:04.135833 21001 raft_consensus.cc:2272] T dccd087e9e5b48d086c2563b7f14fbe1 P 4274cb9648234d91bc29ba5e188255ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.165670 21001 tablet_server.cc:196] TabletServer@127.20.130.66:0 shutdown complete.
I20260709 13:05:04.187637 21001 tablet_server.cc:179] TabletServer@127.20.130.67:0 shutting down...
W20260709 13:05:04.187491 21250 consensus_peers.cc:597] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f -> Peer a1ace56af4464767a75a93f621187536 (127.20.130.65:42943): Couldn't send request to peer a1ace56af4464767a75a93f621187536. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:42943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:04.213845 21249 consensus_peers.cc:597] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f -> Peer 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699): Couldn't send request to peer 4274cb9648234d91bc29ba5e188255ba. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:45699: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:04.217267 21249 consensus_peers.cc:597] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f -> Peer 4274cb9648234d91bc29ba5e188255ba (127.20.130.66:45699): Couldn't send request to peer 4274cb9648234d91bc29ba5e188255ba. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:45699: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:04.219106 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:04.219837 21001 tablet_replica.cc:333] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f: stopping tablet replica
I20260709 13:05:04.220729 21001 raft_consensus.cc:2243] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.221365 21001 raft_consensus.cc:2272] T a6dd1b14960b4478b321c6b33c40148d P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.224272 21001 tablet_replica.cc:333] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f: stopping tablet replica
I20260709 13:05:04.224748 21001 raft_consensus.cc:2243] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:04.225458 21001 raft_consensus.cc:2272] T c3e3fd611a184caa9d8418f9f781451a P 06cb0f3d9cb64d3089b42efa4fdda16f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.227164 21001 tablet_replica.cc:333] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f: stopping tablet replica
I20260709 13:05:04.227648 21001 raft_consensus.cc:2243] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:04.228299 21001 raft_consensus.cc:2272] T e9ac2b3344bb407e81ef28b0052ea986 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.230203 21001 tablet_replica.cc:333] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f: stopping tablet replica
I20260709 13:05:04.230667 21001 raft_consensus.cc:2243] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:04.231415 21001 raft_consensus.cc:2272] T 9f8b68bb02054ac7a18f97bce8a3e151 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.233239 21001 tablet_replica.cc:333] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f: stopping tablet replica
I20260709 13:05:04.233680 21001 raft_consensus.cc:2243] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.234063 21001 raft_consensus.cc:2272] T 9cd6e0e725ba4be990abd00ed0bb85cb P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.235831 21001 tablet_replica.cc:333] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f: stopping tablet replica
I20260709 13:05:04.236294 21001 raft_consensus.cc:2243] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.236773 21001 raft_consensus.cc:2272] T d3d042ef4b1d45beb7046c778c769383 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.238355 21001 tablet_replica.cc:333] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f: stopping tablet replica
I20260709 13:05:04.238790 21001 raft_consensus.cc:2243] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.239271 21001 raft_consensus.cc:2272] T 5627b62d64d4428ca840a5eabc7d7549 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.241561 21001 tablet_replica.cc:333] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f: stopping tablet replica
I20260709 13:05:04.242057 21001 raft_consensus.cc:2243] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.242566 21001 raft_consensus.cc:2272] T 45fe8c407c45467faeb534596e75a252 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.245139 21001 tablet_replica.cc:333] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f: stopping tablet replica
I20260709 13:05:04.245703 21001 raft_consensus.cc:2243] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:04.246181 21001 raft_consensus.cc:2272] T dccd087e9e5b48d086c2563b7f14fbe1 P 06cb0f3d9cb64d3089b42efa4fdda16f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.274660 21001 tablet_server.cc:196] TabletServer@127.20.130.67:0 shutdown complete.
I20260709 13:05:04.293368 21001 master.cc:562] Master@127.20.130.126:45411 shutting down...
I20260709 13:05:04.412101 21088 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:05:04.441258 21001 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:04.441860 21001 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:04.442219 21001 tablet_replica.cc:333] T 00000000000000000000000000000000 P ba8a9816b8fb457dafb57b7051d66219: stopping tablet replica
I20260709 13:05:04.461292 21001 master.cc:584] Master@127.20.130.126:45411 shutdown complete.
06cb0f3d9cb64d3089b42efa4fdda16f  1
4274cb9648234d91bc29ba5e188255ba  4
a1ace56af4464767a75a93f621187536  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12789 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:05:04.505355 21001 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.130.126:45921
I20260709 13:05:04.506448 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:04.511981 21491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:04.512665 21492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:04.514323 21001 server_base.cc:1061] running on GCE node
W20260709 13:05:04.514365 21494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:04.515609 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:04.515789 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:04.515977 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602304515962 us; error 0 us; skew 500 ppm
I20260709 13:05:04.516538 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:04.519408 21001 webserver.cc:533] Webserver started at http://127.20.130.126:46541/ using document root <none> and password file <none>
I20260709 13:05:04.519937 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:04.520133 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:04.520429 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:04.521553 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/master-0-root/instance:
uuid: "6d88b635c7044a8d98780e7e8bafff3a"
format_stamp: "Formatted at 2026-07-09 13:05:04 on dist-test-slave-csvd"
I20260709 13:05:04.526346 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260709 13:05:04.530228 21499 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:04.531164 21001 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:05:04.531584 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/master-0-root
uuid: "6d88b635c7044a8d98780e7e8bafff3a"
format_stamp: "Formatted at 2026-07-09 13:05:04 on dist-test-slave-csvd"
I20260709 13:05:04.531895 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:04.565694 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:04.567049 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:04.611851 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.126:45921
I20260709 13:05:04.611980 21550 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.126:45921 every 8 connection(s)
I20260709 13:05:04.616439 21551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:04.628947 21551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a: Bootstrap starting.
I20260709 13:05:04.634450 21551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:04.638859 21551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a: No bootstrap required, opened a new log
I20260709 13:05:04.641053 21551 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d88b635c7044a8d98780e7e8bafff3a" member_type: VOTER }
I20260709 13:05:04.641466 21551 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:04.641791 21551 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d88b635c7044a8d98780e7e8bafff3a, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.642660 21551 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d88b635c7044a8d98780e7e8bafff3a" member_type: VOTER }
I20260709 13:05:04.643242 21551 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:04.643523 21551 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:04.643797 21551 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:04.648180 21551 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d88b635c7044a8d98780e7e8bafff3a" member_type: VOTER }
I20260709 13:05:04.648725 21551 leader_election.cc:304] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d88b635c7044a8d98780e7e8bafff3a; no voters: 
I20260709 13:05:04.650271 21551 leader_election.cc:290] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:04.650497 21554 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:04.652114 21554 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [term 1 LEADER]: Becoming Leader. State: Replica: 6d88b635c7044a8d98780e7e8bafff3a, State: Running, Role: LEADER
I20260709 13:05:04.652920 21554 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d88b635c7044a8d98780e7e8bafff3a" member_type: VOTER }
I20260709 13:05:04.653713 21551 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:04.658502 21556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d88b635c7044a8d98780e7e8bafff3a. Latest consensus state: current_term: 1 leader_uuid: "6d88b635c7044a8d98780e7e8bafff3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d88b635c7044a8d98780e7e8bafff3a" member_type: VOTER } }
I20260709 13:05:04.659349 21556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:04.660189 21555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d88b635c7044a8d98780e7e8bafff3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d88b635c7044a8d98780e7e8bafff3a" member_type: VOTER } }
I20260709 13:05:04.660926 21555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:04.661535 21562 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:04.668581 21562 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:04.670151 21001 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:04.679384 21562 catalog_manager.cc:1383] Generated new cluster ID: 282992348b4142daada56e94c736f386
I20260709 13:05:04.679724 21562 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:04.698109 21562 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:04.699430 21562 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:04.711860 21562 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a: Generated new TSK 0
I20260709 13:05:04.712517 21562 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:04.736647 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:04.742842 21572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:04.744140 21573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:04.745430 21575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:04.745929 21001 server_base.cc:1061] running on GCE node
I20260709 13:05:04.746809 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:04.747076 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:04.747256 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602304747240 us; error 0 us; skew 500 ppm
I20260709 13:05:04.747844 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:04.750269 21001 webserver.cc:533] Webserver started at http://127.20.130.65:36257/ using document root <none> and password file <none>
I20260709 13:05:04.750792 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:04.751014 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:04.751310 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:04.752353 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/ts-0-root/instance:
uuid: "6d9b9a10127e4f088dbe514926357864"
format_stamp: "Formatted at 2026-07-09 13:05:04 on dist-test-slave-csvd"
I20260709 13:05:04.756922 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:04.760283 21580 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:04.761096 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:05:04.761395 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/ts-0-root
uuid: "6d9b9a10127e4f088dbe514926357864"
format_stamp: "Formatted at 2026-07-09 13:05:04 on dist-test-slave-csvd"
I20260709 13:05:04.761698 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:04.777820 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:04.779748 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:04.781527 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:04.783977 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:04.784232 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:04.784484 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:04.784673 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:04.827144 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.65:42345
I20260709 13:05:04.827246 21642 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.65:42345 every 8 connection(s)
I20260709 13:05:04.832000 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:04.840219 21647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:04.841506 21648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:04.844108 21001 server_base.cc:1061] running on GCE node
W20260709 13:05:04.844347 21651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:04.845263 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:04.845460 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:04.845659 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602304845644 us; error 0 us; skew 500 ppm
I20260709 13:05:04.846220 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:04.849414 21001 webserver.cc:533] Webserver started at http://127.20.130.66:32793/ using document root <none> and password file <none>
I20260709 13:05:04.850036 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:04.850314 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:04.850602 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:04.851630 21643 heartbeater.cc:344] Connected to a master server at 127.20.130.126:45921
I20260709 13:05:04.852013 21643 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:04.851994 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/ts-1-root/instance:
uuid: "d37e337da87a45749c7826833fb1b583"
format_stamp: "Formatted at 2026-07-09 13:05:04 on dist-test-slave-csvd"
I20260709 13:05:04.852950 21643 heartbeater.cc:507] Master 127.20.130.126:45921 requested a full tablet report, sending...
I20260709 13:05:04.855461 21516 ts_manager.cc:194] Registered new tserver with Master: 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345)
I20260709 13:05:04.857223 21516 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35688
I20260709 13:05:04.857899 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:05:04.861922 21655 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:04.862814 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:04.863327 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/ts-1-root
uuid: "d37e337da87a45749c7826833fb1b583"
format_stamp: "Formatted at 2026-07-09 13:05:04 on dist-test-slave-csvd"
I20260709 13:05:04.863691 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:04.884245 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:04.885581 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:04.887338 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:04.889961 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:04.890293 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:04.890642 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:04.890842 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:04.933156 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.66:45879
I20260709 13:05:04.933372 21717 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.66:45879 every 8 connection(s)
I20260709 13:05:04.937817 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:04.944515 21721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:04.946803 21722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:04.948231 21724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:04.949414 21001 server_base.cc:1061] running on GCE node
I20260709 13:05:04.950311 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:04.950567 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:04.950757 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602304950740 us; error 0 us; skew 500 ppm
I20260709 13:05:04.951028 21718 heartbeater.cc:344] Connected to a master server at 127.20.130.126:45921
I20260709 13:05:04.951395 21718 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:04.951417 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:04.952296 21718 heartbeater.cc:507] Master 127.20.130.126:45921 requested a full tablet report, sending...
I20260709 13:05:04.954357 21001 webserver.cc:533] Webserver started at http://127.20.130.67:35443/ using document root <none> and password file <none>
I20260709 13:05:04.954782 21516 ts_manager.cc:194] Registered new tserver with Master: d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:04.955057 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:04.955382 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:04.955724 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:04.956647 21516 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35700
I20260709 13:05:04.957279 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/ts-2-root/instance:
uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
format_stamp: "Formatted at 2026-07-09 13:05:04 on dist-test-slave-csvd"
I20260709 13:05:04.961932 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:04.965955 21729 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:04.967344 21001 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:04.967630 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/ts-2-root
uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
format_stamp: "Formatted at 2026-07-09 13:05:04 on dist-test-slave-csvd"
I20260709 13:05:04.967905 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602291548094-21001-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:05.014981 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:05.016968 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:05.018841 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:05.021188 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:05.021384 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.021713 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:05.021854 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.069638 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.67:36647
I20260709 13:05:05.069793 21791 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.67:36647 every 8 connection(s)
I20260709 13:05:05.083969 21792 heartbeater.cc:344] Connected to a master server at 127.20.130.126:45921
I20260709 13:05:05.084365 21792 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:05.085109 21792 heartbeater.cc:507] Master 127.20.130.126:45921 requested a full tablet report, sending...
I20260709 13:05:05.087036 21516 ts_manager.cc:194] Registered new tserver with Master: 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:05.087489 21001 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014472046s
I20260709 13:05:05.088384 21516 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35714
I20260709 13:05:05.118228 21516 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35726:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:05.121251 21516 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:05.229882 21681 tablet_service.cc:1511] Processing CreateTablet for tablet 857d094231a549efbfda690583100fb9 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:05.231715 21678 tablet_service.cc:1511] Processing CreateTablet for tablet c6fd613927bb4530b775898e65c72430 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:05.230623 21682 tablet_service.cc:1511] Processing CreateTablet for tablet d3d0e027efbb403aa4aeeb5d6b2b90e8 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:05.233064 21680 tablet_service.cc:1511] Processing CreateTablet for tablet 64a11d5d07c0435a8f1d7f36c95850ae (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:05.234150 21677 tablet_service.cc:1511] Processing CreateTablet for tablet 55e442daca2c46a4896dfa44ed954344 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:05.231920 21683 tablet_service.cc:1511] Processing CreateTablet for tablet e08a4be38aa040e193dd87950f066533 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:05.231741 21681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857d094231a549efbfda690583100fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.235708 21679 tablet_service.cc:1511] Processing CreateTablet for tablet b9e3dfccb13c4df3b898f4fc2fc888ca (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:05.236799 21683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08a4be38aa040e193dd87950f066533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.238387 21682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3d0e027efbb403aa4aeeb5d6b2b90e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.239593 21678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6fd613927bb4530b775898e65c72430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.240006 21675 tablet_service.cc:1511] Processing CreateTablet for tablet 501a6bde36ca47feb95e4107b57663df (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:05.240134 21676 tablet_service.cc:1511] Processing CreateTablet for tablet dba35ac74cbe4f5fb913a4dce42aa511 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:05.241112 21607 tablet_service.cc:1511] Processing CreateTablet for tablet d3d0e027efbb403aa4aeeb5d6b2b90e8 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:05.241636 21675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501a6bde36ca47feb95e4107b57663df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.241904 21674 tablet_service.cc:1511] Processing CreateTablet for tablet 447f7fcdf8a34d10b0447b2a00801f0a (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:05.242573 21607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3d0e027efbb403aa4aeeb5d6b2b90e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.242182 21606 tablet_service.cc:1511] Processing CreateTablet for tablet 857d094231a549efbfda690583100fb9 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:05.243691 21606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857d094231a549efbfda690583100fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.244115 21608 tablet_service.cc:1511] Processing CreateTablet for tablet e08a4be38aa040e193dd87950f066533 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:05.245698 21676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba35ac74cbe4f5fb913a4dce42aa511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.246002 21608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08a4be38aa040e193dd87950f066533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.247011 21677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e442daca2c46a4896dfa44ed954344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.248418 21680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64a11d5d07c0435a8f1d7f36c95850ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.249323 21674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447f7fcdf8a34d10b0447b2a00801f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.250290 21679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e3dfccb13c4df3b898f4fc2fc888ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.254987 21605 tablet_service.cc:1511] Processing CreateTablet for tablet 64a11d5d07c0435a8f1d7f36c95850ae (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:05.256585 21605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64a11d5d07c0435a8f1d7f36c95850ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.256510 21601 tablet_service.cc:1511] Processing CreateTablet for tablet dba35ac74cbe4f5fb913a4dce42aa511 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:05.258325 21601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba35ac74cbe4f5fb913a4dce42aa511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.260170 21600 tablet_service.cc:1511] Processing CreateTablet for tablet 501a6bde36ca47feb95e4107b57663df (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:05.261603 21600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501a6bde36ca47feb95e4107b57663df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.262015 21603 tablet_service.cc:1511] Processing CreateTablet for tablet c6fd613927bb4530b775898e65c72430 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:05.263392 21603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6fd613927bb4530b775898e65c72430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.263809 21599 tablet_service.cc:1511] Processing CreateTablet for tablet 447f7fcdf8a34d10b0447b2a00801f0a (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:05.265180 21599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447f7fcdf8a34d10b0447b2a00801f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.265368 21602 tablet_service.cc:1511] Processing CreateTablet for tablet 55e442daca2c46a4896dfa44ed954344 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:05.260069 21604 tablet_service.cc:1511] Processing CreateTablet for tablet b9e3dfccb13c4df3b898f4fc2fc888ca (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:05.266871 21602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e442daca2c46a4896dfa44ed954344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.273782 21604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e3dfccb13c4df3b898f4fc2fc888ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.296232 21757 tablet_service.cc:1511] Processing CreateTablet for tablet e08a4be38aa040e193dd87950f066533 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:05.297914 21757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08a4be38aa040e193dd87950f066533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.300675 21756 tablet_service.cc:1511] Processing CreateTablet for tablet d3d0e027efbb403aa4aeeb5d6b2b90e8 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:05.302172 21756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3d0e027efbb403aa4aeeb5d6b2b90e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.304672 21755 tablet_service.cc:1511] Processing CreateTablet for tablet 857d094231a549efbfda690583100fb9 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:05.306089 21755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857d094231a549efbfda690583100fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.308629 21754 tablet_service.cc:1511] Processing CreateTablet for tablet 64a11d5d07c0435a8f1d7f36c95850ae (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:05.310202 21754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64a11d5d07c0435a8f1d7f36c95850ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.312906 21753 tablet_service.cc:1511] Processing CreateTablet for tablet b9e3dfccb13c4df3b898f4fc2fc888ca (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:05.314576 21753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e3dfccb13c4df3b898f4fc2fc888ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.317015 21752 tablet_service.cc:1511] Processing CreateTablet for tablet c6fd613927bb4530b775898e65c72430 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:05.318830 21752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6fd613927bb4530b775898e65c72430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.324247 21751 tablet_service.cc:1511] Processing CreateTablet for tablet 55e442daca2c46a4896dfa44ed954344 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:05.325776 21751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e442daca2c46a4896dfa44ed954344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.332343 21750 tablet_service.cc:1511] Processing CreateTablet for tablet dba35ac74cbe4f5fb913a4dce42aa511 (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:05.334012 21750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba35ac74cbe4f5fb913a4dce42aa511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.344465 21749 tablet_service.cc:1511] Processing CreateTablet for tablet 501a6bde36ca47feb95e4107b57663df (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:05.345927 21749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501a6bde36ca47feb95e4107b57663df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.354044 21748 tablet_service.cc:1511] Processing CreateTablet for tablet 447f7fcdf8a34d10b0447b2a00801f0a (DEFAULT_TABLE table=test-workload [id=40d0784b74094510b671770141e27cfe]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:05.355479 21748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447f7fcdf8a34d10b0447b2a00801f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.406032 21808 tablet_bootstrap.cc:492] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583: Bootstrap starting.
I20260709 13:05:05.420217 21808 tablet_bootstrap.cc:654] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.435019 21809 tablet_bootstrap.cc:492] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93: Bootstrap starting.
I20260709 13:05:05.449182 21809 tablet_bootstrap.cc:654] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.452073 21807 tablet_bootstrap.cc:492] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864: Bootstrap starting.
I20260709 13:05:05.460440 21808 tablet_bootstrap.cc:492] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583: No bootstrap required, opened a new log
I20260709 13:05:05.461127 21808 ts_tablet_manager.cc:1403] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583: Time spent bootstrapping tablet: real 0.055s	user 0.022s	sys 0.015s
I20260709 13:05:05.461356 21809 tablet_bootstrap.cc:492] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93: No bootstrap required, opened a new log
I20260709 13:05:05.461845 21809 ts_tablet_manager.cc:1403] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.008s
I20260709 13:05:05.463995 21807 tablet_bootstrap.cc:654] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.464704 21809 raft_consensus.cc:359] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.465565 21809 raft_consensus.cc:385] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.465186 21808 raft_consensus.cc:359] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.465895 21809 raft_consensus.cc:740] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.466022 21808 raft_consensus.cc:385] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.466410 21808 raft_consensus.cc:740] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d37e337da87a45749c7826833fb1b583, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.466804 21809 consensus_queue.cc:260] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.467533 21808 consensus_queue.cc:260] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.469740 21792 heartbeater.cc:499] Master 127.20.130.126:45921 was elected leader, sending a full tablet report...
I20260709 13:05:05.470082 21807 tablet_bootstrap.cc:492] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864: No bootstrap required, opened a new log
I20260709 13:05:05.470229 21809 ts_tablet_manager.cc:1434] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:05:05.470709 21807 ts_tablet_manager.cc:1403] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 13:05:05.471344 21809 tablet_bootstrap.cc:492] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93: Bootstrap starting.
I20260709 13:05:05.473886 21807 raft_consensus.cc:359] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.475037 21807 raft_consensus.cc:385] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.475437 21807 raft_consensus.cc:740] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.476609 21807 consensus_queue.cc:260] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.477993 21809 tablet_bootstrap.cc:654] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.480468 21718 heartbeater.cc:499] Master 127.20.130.126:45921 was elected leader, sending a full tablet report...
I20260709 13:05:05.481539 21808 ts_tablet_manager.cc:1434] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.006s
I20260709 13:05:05.486047 21808 tablet_bootstrap.cc:492] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583: Bootstrap starting.
I20260709 13:05:05.491783 21813 raft_consensus.cc:493] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.492857 21813 raft_consensus.cc:515] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.493660 21643 heartbeater.cc:499] Master 127.20.130.126:45921 was elected leader, sending a full tablet report...
I20260709 13:05:05.494781 21807 ts_tablet_manager.cc:1434] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.004s
I20260709 13:05:05.494900 21808 tablet_bootstrap.cc:654] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.496449 21807 tablet_bootstrap.cc:492] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864: Bootstrap starting.
I20260709 13:05:05.504467 21807 tablet_bootstrap.cc:654] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.511204 21808 tablet_bootstrap.cc:492] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583: No bootstrap required, opened a new log
I20260709 13:05:05.511914 21808 ts_tablet_manager.cc:1403] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.007s
I20260709 13:05:05.515539 21808 raft_consensus.cc:359] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.516280 21808 raft_consensus.cc:385] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.516577 21808 raft_consensus.cc:740] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d37e337da87a45749c7826833fb1b583, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.516927 21807 tablet_bootstrap.cc:492] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864: No bootstrap required, opened a new log
I20260709 13:05:05.517400 21807 ts_tablet_manager.cc:1403] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:05:05.520650 21807 raft_consensus.cc:359] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } }
I20260709 13:05:05.521579 21807 raft_consensus.cc:385] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.521898 21807 raft_consensus.cc:740] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.522750 21807 consensus_queue.cc:260] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } }
I20260709 13:05:05.525163 21807 ts_tablet_manager.cc:1434] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.008s
I20260709 13:05:05.526098 21807 tablet_bootstrap.cc:492] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864: Bootstrap starting.
I20260709 13:05:05.527408 21813 leader_election.cc:290] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:05.530035 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fd613927bb4530b775898e65c72430" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9b9a10127e4f088dbe514926357864" is_pre_election: true
W20260709 13:05:05.531900 21731 leader_election.cc:343] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:05.517537 21808 consensus_queue.cc:260] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.536540 21807 tablet_bootstrap.cc:654] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.537377 21808 ts_tablet_manager.cc:1434] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:05:05.538611 21808 tablet_bootstrap.cc:492] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583: Bootstrap starting.
I20260709 13:05:05.546721 21808 tablet_bootstrap.cc:654] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.546676 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fd613927bb4530b775898e65c72430" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583" is_pre_election: true
I20260709 13:05:05.548835 21807 tablet_bootstrap.cc:492] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864: No bootstrap required, opened a new log
W20260709 13:05:05.548905 21732 leader_election.cc:343] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:05.549497 21807 ts_tablet_manager.cc:1403] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 13:05:05.549571 21732 leader_election.cc:304] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93; no voters: 6d9b9a10127e4f088dbe514926357864, d37e337da87a45749c7826833fb1b583
I20260709 13:05:05.552611 21809 tablet_bootstrap.cc:492] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93: No bootstrap required, opened a new log
I20260709 13:05:05.553108 21809 ts_tablet_manager.cc:1403] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent bootstrapping tablet: real 0.082s	user 0.028s	sys 0.037s
I20260709 13:05:05.553031 21807 raft_consensus.cc:359] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.553839 21807 raft_consensus.cc:385] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.554142 21807 raft_consensus.cc:740] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.555188 21813 raft_consensus.cc:2749] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:05.555109 21807 consensus_queue.cc:260] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.557808 21809 raft_consensus.cc:359] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.558665 21807 ts_tablet_manager.cc:1434] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:05.558764 21809 raft_consensus.cc:385] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.559458 21809 raft_consensus.cc:740] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.560410 21807 tablet_bootstrap.cc:492] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864: Bootstrap starting.
I20260709 13:05:05.560401 21809 consensus_queue.cc:260] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.563334 21809 ts_tablet_manager.cc:1434] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:05:05.571421 21807 tablet_bootstrap.cc:654] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.573050 21809 tablet_bootstrap.cc:492] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93: Bootstrap starting.
I20260709 13:05:05.583076 21809 tablet_bootstrap.cc:654] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.593227 21815 raft_consensus.cc:493] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.593988 21815 raft_consensus.cc:515] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } }
I20260709 13:05:05.596038 21809 tablet_bootstrap.cc:492] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93: No bootstrap required, opened a new log
I20260709 13:05:05.596654 21809 ts_tablet_manager.cc:1403] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.005s
I20260709 13:05:05.600430 21813 raft_consensus.cc:493] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.600772 21807 tablet_bootstrap.cc:492] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864: No bootstrap required, opened a new log
I20260709 13:05:05.601276 21807 ts_tablet_manager.cc:1403] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.014s
I20260709 13:05:05.600991 21813 raft_consensus.cc:515] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.603101 21815 leader_election.cc:290] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647), d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:05.605190 21813 leader_election.cc:290] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:05.604955 21807 raft_consensus.cc:359] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.605371 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583" is_pre_election: true
I20260709 13:05:05.605826 21807 raft_consensus.cc:385] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.600179 21809 raft_consensus.cc:359] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.606210 21807 raft_consensus.cc:740] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.606691 21809 raft_consensus.cc:385] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:05.607074 21732 leader_election.cc:343] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:05.607182 21809 raft_consensus.cc:740] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.607273 21807 consensus_queue.cc:260] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.608345 21809 consensus_queue.cc:260] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.610585 21807 ts_tablet_manager.cc:1434] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:05.611584 21807 tablet_bootstrap.cc:492] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864: Bootstrap starting.
I20260709 13:05:05.611964 21808 tablet_bootstrap.cc:492] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583: No bootstrap required, opened a new log
I20260709 13:05:05.612430 21808 ts_tablet_manager.cc:1403] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583: Time spent bootstrapping tablet: real 0.074s	user 0.025s	sys 0.025s
I20260709 13:05:05.616909 21809 ts_tablet_manager.cc:1434] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:05:05.618037 21809 tablet_bootstrap.cc:492] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93: Bootstrap starting.
I20260709 13:05:05.620296 21767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08a4be38aa040e193dd87950f066533" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" is_pre_election: true
I20260709 13:05:05.620497 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9b9a10127e4f088dbe514926357864" is_pre_election: true
I20260709 13:05:05.621181 21618 raft_consensus.cc:2468] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 0.
I20260709 13:05:05.622359 21731 leader_election.cc:304] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: d37e337da87a45749c7826833fb1b583
I20260709 13:05:05.623831 21813 raft_consensus.cc:2804] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:05.624267 21813 raft_consensus.cc:493] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.624624 21813 raft_consensus.cc:3060] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:05.625104 21807 tablet_bootstrap.cc:654] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.625818 21809 tablet_bootstrap.cc:654] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:05.631995 21582 leader_election.cc:343] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:05.633885 21808 raft_consensus.cc:359] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.635442 21808 raft_consensus.cc:385] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.635754 21808 raft_consensus.cc:740] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d37e337da87a45749c7826833fb1b583, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.636792 21807 tablet_bootstrap.cc:492] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864: No bootstrap required, opened a new log
I20260709 13:05:05.637283 21807 ts_tablet_manager.cc:1403] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.009s
I20260709 13:05:05.637914 21809 tablet_bootstrap.cc:492] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93: No bootstrap required, opened a new log
I20260709 13:05:05.638433 21809 ts_tablet_manager.cc:1403] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:05:05.640241 21807 raft_consensus.cc:359] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.641027 21807 raft_consensus.cc:385] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.640724 21808 consensus_queue.cc:260] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.641340 21807 raft_consensus.cc:740] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.641727 21809 raft_consensus.cc:359] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.642612 21809 raft_consensus.cc:385] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.642239 21807 consensus_queue.cc:260] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.643023 21809 raft_consensus.cc:740] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.643939 21809 consensus_queue.cc:260] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.644666 21807 ts_tablet_manager.cc:1434] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:05:05.645603 21807 tablet_bootstrap.cc:492] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864: Bootstrap starting.
I20260709 13:05:05.652153 21807 tablet_bootstrap.cc:654] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.655692 21808 ts_tablet_manager.cc:1434] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.006s
I20260709 13:05:05.655859 21813 raft_consensus.cc:515] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.658388 21813 leader_election.cc:290] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 election: Requested vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:05.660429 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08a4be38aa040e193dd87950f066533" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583" is_pre_election: true
I20260709 13:05:05.662293 21808 tablet_bootstrap.cc:492] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583: Bootstrap starting.
I20260709 13:05:05.663094 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583"
W20260709 13:05:05.664852 21732 leader_election.cc:343] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:05.665027 21564 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:05.666373 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:05.667084 21618 raft_consensus.cc:3060] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:05.670821 21814 raft_consensus.cc:493] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.671734 21809 ts_tablet_manager.cc:1434] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.015s
I20260709 13:05:05.671551 21814 raft_consensus.cc:515] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.673432 21809 tablet_bootstrap.cc:492] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93: Bootstrap starting.
W20260709 13:05:05.674911 21583 leader_election.cc:343] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:05.675414 21583 leader_election.cc:304] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d9b9a10127e4f088dbe514926357864; no voters: 2d3491cd12b74f94973e92b6fd0c6e93, d37e337da87a45749c7826833fb1b583
I20260709 13:05:05.676245 21815 raft_consensus.cc:2749] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:05.680954 21809 tablet_bootstrap.cc:654] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.680795 21814 leader_election.cc:290] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:05.690155 21618 raft_consensus.cc:2468] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 1.
I20260709 13:05:05.694866 21807 tablet_bootstrap.cc:492] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864: No bootstrap required, opened a new log
I20260709 13:05:05.695425 21807 ts_tablet_manager.cc:1403] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.032s
I20260709 13:05:05.695622 21731 leader_election.cc:304] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: d37e337da87a45749c7826833fb1b583
I20260709 13:05:05.696750 21808 tablet_bootstrap.cc:654] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.696669 21828 raft_consensus.cc:2804] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:05.697597 21828 raft_consensus.cc:697] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Becoming Leader. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Running, Role: LEADER
I20260709 13:05:05.698729 21828 consensus_queue.cc:237] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.699332 21807 raft_consensus.cc:359] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.700310 21807 raft_consensus.cc:385] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.700634 21807 raft_consensus.cc:740] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.701377 21807 consensus_queue.cc:260] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.707744 21807 ts_tablet_manager.cc:1434] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:05:05.708807 21807 tablet_bootstrap.cc:492] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864: Bootstrap starting.
I20260709 13:05:05.715333 21807 tablet_bootstrap.cc:654] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.718461 21809 tablet_bootstrap.cc:492] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93: No bootstrap required, opened a new log
I20260709 13:05:05.719311 21809 ts_tablet_manager.cc:1403] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.009s
I20260709 13:05:05.724181 21809 raft_consensus.cc:359] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.728145 21809 raft_consensus.cc:385] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.728490 21809 raft_consensus.cc:740] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.729195 21809 consensus_queue.cc:260] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.731936 21809 ts_tablet_manager.cc:1434] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:05:05.732216 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64a11d5d07c0435a8f1d7f36c95850ae" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9b9a10127e4f088dbe514926357864" is_pre_election: true
I20260709 13:05:05.733109 21809 tablet_bootstrap.cc:492] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93: Bootstrap starting.
I20260709 13:05:05.732468 21515 catalog_manager.cc:5697] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:05.734043 21657 leader_election.cc:343] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:05.738345 21807 tablet_bootstrap.cc:492] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864: No bootstrap required, opened a new log
I20260709 13:05:05.738945 21807 ts_tablet_manager.cc:1403] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.008s
I20260709 13:05:05.738345 21808 tablet_bootstrap.cc:492] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583: No bootstrap required, opened a new log
I20260709 13:05:05.741559 21808 ts_tablet_manager.cc:1403] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.008s
I20260709 13:05:05.742080 21807 raft_consensus.cc:359] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.742523 21809 tablet_bootstrap.cc:654] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.742904 21807 raft_consensus.cc:385] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.743403 21807 raft_consensus.cc:740] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.744187 21807 consensus_queue.cc:260] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.746904 21807 ts_tablet_manager.cc:1434] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:05.747998 21807 tablet_bootstrap.cc:492] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864: Bootstrap starting.
I20260709 13:05:05.752910 21815 raft_consensus.cc:493] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.753455 21809 tablet_bootstrap.cc:492] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93: No bootstrap required, opened a new log
I20260709 13:05:05.753428 21815 raft_consensus.cc:515] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.754199 21809 ts_tablet_manager.cc:1403] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.007s
I20260709 13:05:05.754303 21807 tablet_bootstrap.cc:654] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.755774 21815 leader_election.cc:290] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:05.758150 21767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fd613927bb4530b775898e65c72430" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" is_pre_election: true
I20260709 13:05:05.760159 21767 raft_consensus.cc:2468] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 0.
I20260709 13:05:05.744855 21808 raft_consensus.cc:359] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.762046 21582 leader_election.cc:304] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: 
I20260709 13:05:05.762519 21808 raft_consensus.cc:385] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.762882 21808 raft_consensus.cc:740] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d37e337da87a45749c7826833fb1b583, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.763386 21815 raft_consensus.cc:2804] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:05.764024 21815 raft_consensus.cc:493] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.764505 21815 raft_consensus.cc:3060] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:05.765667 21808 consensus_queue.cc:260] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.766225 21767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64a11d5d07c0435a8f1d7f36c95850ae" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" is_pre_election: true
I20260709 13:05:05.758381 21809 raft_consensus.cc:359] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.759094 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fd613927bb4530b775898e65c72430" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583" is_pre_election: true
I20260709 13:05:05.768389 21693 raft_consensus.cc:2468] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 0.
I20260709 13:05:05.769424 21808 ts_tablet_manager.cc:1434] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.003s
I20260709 13:05:05.769546 21809 raft_consensus.cc:385] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.770566 21808 tablet_bootstrap.cc:492] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583: Bootstrap starting.
I20260709 13:05:05.770495 21809 raft_consensus.cc:740] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.771636 21809 consensus_queue.cc:260] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.772750 21767 raft_consensus.cc:2468] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d37e337da87a45749c7826833fb1b583 in term 0.
I20260709 13:05:05.774386 21809 ts_tablet_manager.cc:1434] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:05:05.775645 21809 tablet_bootstrap.cc:492] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93: Bootstrap starting.
I20260709 13:05:05.777941 21807 tablet_bootstrap.cc:492] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864: No bootstrap required, opened a new log
I20260709 13:05:05.778442 21807 ts_tablet_manager.cc:1403] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.008s
I20260709 13:05:05.778728 21808 tablet_bootstrap.cc:654] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.780958 21657 leader_election.cc:304] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, d37e337da87a45749c7826833fb1b583; no voters: 6d9b9a10127e4f088dbe514926357864
I20260709 13:05:05.781710 21807 raft_consensus.cc:359] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.782579 21807 raft_consensus.cc:385] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.782774 21814 raft_consensus.cc:2804] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:05.782990 21807 raft_consensus.cc:740] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.783283 21814 raft_consensus.cc:493] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.783519 21809 tablet_bootstrap.cc:654] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.783792 21814 raft_consensus.cc:3060] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:05.784196 21807 consensus_queue.cc:260] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.775463 21815 raft_consensus.cc:515] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.788479 21815 leader_election.cc:290] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 election: Requested vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:05.790244 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fd613927bb4530b775898e65c72430" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:05.791234 21766 raft_consensus.cc:3060] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:05.794781 21828 raft_consensus.cc:493] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.794855 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fd613927bb4530b775898e65c72430" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:05.795912 21693 raft_consensus.cc:3060] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:05.795651 21828 raft_consensus.cc:515] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.805050 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9b9a10127e4f088dbe514926357864" is_pre_election: true
I20260709 13:05:05.806015 21618 raft_consensus.cc:2468] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 0.
I20260709 13:05:05.800642 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583" is_pre_election: true
I20260709 13:05:05.811877 21731 leader_election.cc:304] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: 
W20260709 13:05:05.812851 21732 leader_election.cc:343] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:05.813182 21813 raft_consensus.cc:2804] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:05.813730 21813 raft_consensus.cc:493] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.814220 21813 raft_consensus.cc:3060] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:05.798626 21828 leader_election.cc:290] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:05.835845 21693 raft_consensus.cc:2468] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 1.
I20260709 13:05:05.837693 21583 leader_election.cc:304] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d9b9a10127e4f088dbe514926357864, d37e337da87a45749c7826833fb1b583; no voters: 
I20260709 13:05:05.838843 21815 raft_consensus.cc:2804] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:05.839512 21815 raft_consensus.cc:697] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Becoming Leader. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:05.840675 21815 consensus_queue.cc:237] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.845652 21844 raft_consensus.cc:493] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.846271 21813 raft_consensus.cc:515] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.846855 21844 raft_consensus.cc:515] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.848934 21844 leader_election.cc:290] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:05.849465 21844 raft_consensus.cc:493] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.848954 21814 raft_consensus.cc:515] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.849903 21844 raft_consensus.cc:515] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.851672 21814 leader_election.cc:290] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 1 election: Requested vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:05.853520 21813 leader_election.cc:290] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 election: Requested vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:05.856122 21807 ts_tablet_manager.cc:1434] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864: Time spent starting tablet: real 0.077s	user 0.014s	sys 0.024s
I20260709 13:05:05.851747 21844 leader_election.cc:290] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:05.856894 21767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64a11d5d07c0435a8f1d7f36c95850ae" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:05.857244 21807 tablet_bootstrap.cc:492] T 447f7fcdf8a34d10b0447b2a00801f0a P 6d9b9a10127e4f088dbe514926357864: Bootstrap starting.
I20260709 13:05:05.857510 21767 raft_consensus.cc:3060] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:05.858462 21808 tablet_bootstrap.cc:492] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583: No bootstrap required, opened a new log
I20260709 13:05:05.858969 21808 ts_tablet_manager.cc:1403] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583: Time spent bootstrapping tablet: real 0.089s	user 0.030s	sys 0.047s
I20260709 13:05:05.859282 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:05.859606 21809 tablet_bootstrap.cc:492] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93: No bootstrap required, opened a new log
I20260709 13:05:05.860087 21809 ts_tablet_manager.cc:1403] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent bootstrapping tablet: real 0.085s	user 0.027s	sys 0.017s
I20260709 13:05:05.861855 21808 raft_consensus.cc:359] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.862610 21808 raft_consensus.cc:385] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.862957 21808 raft_consensus.cc:740] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d37e337da87a45749c7826833fb1b583, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.862996 21809 raft_consensus.cc:359] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
W20260709 13:05:05.863646 21732 leader_election.cc:343] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:05.863770 21809 raft_consensus.cc:385] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.864359 21809 raft_consensus.cc:740] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.864156 21808 consensus_queue.cc:260] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.865262 21809 consensus_queue.cc:260] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.866005 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64a11d5d07c0435a8f1d7f36c95850ae" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:05.866411 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501a6bde36ca47feb95e4107b57663df" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" is_pre_election: true
I20260709 13:05:05.867746 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857d094231a549efbfda690583100fb9" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" is_pre_election: true
I20260709 13:05:05.867960 21809 ts_tablet_manager.cc:1434] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:05.868461 21764 raft_consensus.cc:2468] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 0.
I20260709 13:05:05.869130 21809 tablet_bootstrap.cc:492] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93: Bootstrap starting.
W20260709 13:05:05.869724 21657 leader_election.cc:343] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:05.870187 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501a6bde36ca47feb95e4107b57663df" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583" is_pre_election: true
I20260709 13:05:05.870811 21692 raft_consensus.cc:2468] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 0.
I20260709 13:05:05.879242 21766 raft_consensus.cc:2468] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 1.
W20260709 13:05:05.871454 21582 leader_election.cc:343] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:05.864374 21807 tablet_bootstrap.cc:654] T 447f7fcdf8a34d10b0447b2a00801f0a P 6d9b9a10127e4f088dbe514926357864: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.880414 21582 leader_election.cc:304] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: 
I20260709 13:05:05.881294 21844 raft_consensus.cc:2804] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:05.871626 21808 ts_tablet_manager.cc:1434] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:05:05.882822 21808 tablet_bootstrap.cc:492] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583: Bootstrap starting.
I20260709 13:05:05.885746 21807 tablet_bootstrap.cc:492] T 447f7fcdf8a34d10b0447b2a00801f0a P 6d9b9a10127e4f088dbe514926357864: No bootstrap required, opened a new log
I20260709 13:05:05.885607 21583 leader_election.cc:304] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d9b9a10127e4f088dbe514926357864, d37e337da87a45749c7826833fb1b583; no voters: 2d3491cd12b74f94973e92b6fd0c6e93
I20260709 13:05:05.886339 21807 ts_tablet_manager.cc:1403] T 447f7fcdf8a34d10b0447b2a00801f0a P 6d9b9a10127e4f088dbe514926357864: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.002s
I20260709 13:05:05.887086 21815 raft_consensus.cc:2804] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:05.887544 21815 raft_consensus.cc:493] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.887924 21815 raft_consensus.cc:3060] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:05.889302 21807 raft_consensus.cc:359] T 447f7fcdf8a34d10b0447b2a00801f0a P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.890054 21807 raft_consensus.cc:385] T 447f7fcdf8a34d10b0447b2a00801f0a P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.890434 21807 raft_consensus.cc:740] T 447f7fcdf8a34d10b0447b2a00801f0a P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.890762 21808 tablet_bootstrap.cc:654] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.891271 21807 consensus_queue.cc:260] T 447f7fcdf8a34d10b0447b2a00801f0a P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.893625 21807 ts_tablet_manager.cc:1434] T 447f7fcdf8a34d10b0447b2a00801f0a P 6d9b9a10127e4f088dbe514926357864: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:05:05.894578 21807 tablet_bootstrap.cc:492] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864: Bootstrap starting.
I20260709 13:05:05.897189 21514 catalog_manager.cc:5697] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d9b9a10127e4f088dbe514926357864 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "6d9b9a10127e4f088dbe514926357864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:05.898111 21815 raft_consensus.cc:515] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.900630 21807 tablet_bootstrap.cc:654] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.901958 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501a6bde36ca47feb95e4107b57663df" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:05.877028 21767 raft_consensus.cc:2468] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37e337da87a45749c7826833fb1b583 in term 1.
I20260709 13:05:05.878080 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:05.904354 21618 raft_consensus.cc:3060] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:05.904659 21693 raft_consensus.cc:3060] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:05.878167 21691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857d094231a549efbfda690583100fb9" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583" is_pre_election: true
I20260709 13:05:05.907953 21691 raft_consensus.cc:2468] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 0.
I20260709 13:05:05.881685 21844 raft_consensus.cc:493] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.909438 21844 raft_consensus.cc:3060] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:05.902719 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501a6bde36ca47feb95e4107b57663df" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:05.911342 21693 raft_consensus.cc:2468] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 1.
I20260709 13:05:05.911712 21618 raft_consensus.cc:2468] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 1.
I20260709 13:05:05.875488 21809 tablet_bootstrap.cc:654] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.903399 21815 leader_election.cc:290] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 election: Requested vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
W20260709 13:05:05.915364 21582 leader_election.cc:343] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:05.912968 21657 leader_election.cc:304] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, d37e337da87a45749c7826833fb1b583; no voters: 6d9b9a10127e4f088dbe514926357864
I20260709 13:05:05.926855 21814 raft_consensus.cc:2804] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:05.927067 21731 leader_election.cc:304] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: d37e337da87a45749c7826833fb1b583
I20260709 13:05:05.928893 21813 raft_consensus.cc:2804] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:05.930023 21813 raft_consensus.cc:697] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Becoming Leader. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Running, Role: LEADER
I20260709 13:05:05.931828 21813 consensus_queue.cc:237] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.939623 21583 leader_election.cc:304] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d9b9a10127e4f088dbe514926357864, d37e337da87a45749c7826833fb1b583; no voters: 2d3491cd12b74f94973e92b6fd0c6e93
I20260709 13:05:05.940994 21815 raft_consensus.cc:2804] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:05.941632 21815 raft_consensus.cc:697] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Becoming Leader. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:05.942691 21815 consensus_queue.cc:237] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.946746 21828 raft_consensus.cc:493] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.947424 21828 raft_consensus.cc:515] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.948774 21808 tablet_bootstrap.cc:492] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583: No bootstrap required, opened a new log
I20260709 13:05:05.949430 21808 ts_tablet_manager.cc:1403] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.022s
I20260709 13:05:05.945994 21844 raft_consensus.cc:515] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.952502 21828 leader_election.cc:290] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:05.952630 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f7fcdf8a34d10b0447b2a00801f0a" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583" is_pre_election: true
I20260709 13:05:05.953956 21844 leader_election.cc:290] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 election: Requested vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
W20260709 13:05:05.956254 21732 leader_election.cc:343] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:05.956466 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857d094231a549efbfda690583100fb9" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:05.957101 21766 raft_consensus.cc:3060] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:05.958494 21809 tablet_bootstrap.cc:492] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93: No bootstrap required, opened a new log
I20260709 13:05:05.958967 21809 ts_tablet_manager.cc:1403] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent bootstrapping tablet: real 0.090s	user 0.008s	sys 0.005s
I20260709 13:05:05.958091 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f7fcdf8a34d10b0447b2a00801f0a" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9b9a10127e4f088dbe514926357864" is_pre_election: true
I20260709 13:05:05.964524 21809 raft_consensus.cc:359] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.965246 21809 raft_consensus.cc:385] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.965510 21809 raft_consensus.cc:740] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.966035 21809 consensus_queue.cc:260] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.967732 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857d094231a549efbfda690583100fb9" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:05.968559 21693 raft_consensus.cc:3060] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:05.961884 21618 raft_consensus.cc:2468] T 447f7fcdf8a34d10b0447b2a00801f0a P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 0.
I20260709 13:05:05.955798 21814 raft_consensus.cc:697] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 1 LEADER]: Becoming Leader. State: Replica: d37e337da87a45749c7826833fb1b583, State: Running, Role: LEADER
I20260709 13:05:05.972780 21807 tablet_bootstrap.cc:492] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864: No bootstrap required, opened a new log
I20260709 13:05:05.973392 21807 ts_tablet_manager.cc:1403] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.012s
I20260709 13:05:05.976066 21809 ts_tablet_manager.cc:1434] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:05:05.976708 21813 raft_consensus.cc:493] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.976600 21808 raft_consensus.cc:359] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.976907 21807 raft_consensus.cc:359] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.977399 21808 raft_consensus.cc:385] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.977569 21807 raft_consensus.cc:385] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.977759 21808 raft_consensus.cc:740] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d37e337da87a45749c7826833fb1b583, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.977977 21807 raft_consensus.cc:740] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.977432 21813 raft_consensus.cc:515] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.978647 21808 consensus_queue.cc:260] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.973424 21514 catalog_manager.cc:5697] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:05.981271 21808 ts_tablet_manager.cc:1434] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:05:05.982332 21808 tablet_bootstrap.cc:492] T 447f7fcdf8a34d10b0447b2a00801f0a P d37e337da87a45749c7826833fb1b583: Bootstrap starting.
I20260709 13:05:05.982878 21691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583" is_pre_election: true
W20260709 13:05:05.984951 21732 leader_election.cc:343] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:05.985718 21813 leader_election.cc:290] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:05.986815 21809 tablet_bootstrap.cc:492] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93: Bootstrap starting.
I20260709 13:05:05.989414 21808 tablet_bootstrap.cc:654] T 447f7fcdf8a34d10b0447b2a00801f0a P d37e337da87a45749c7826833fb1b583: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.992980 21809 tablet_bootstrap.cc:654] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.993476 21766 raft_consensus.cc:2468] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 1.
I20260709 13:05:05.991559 21807 consensus_queue.cc:260] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:05.998647 21582 leader_election.cc:304] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: 
I20260709 13:05:05.973371 21814 consensus_queue.cc:237] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.000578 21731 leader_election.cc:304] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: d37e337da87a45749c7826833fb1b583
I20260709 13:05:06.000856 21844 raft_consensus.cc:2804] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.001287 21844 raft_consensus.cc:697] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Becoming Leader. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:06.001763 21813 raft_consensus.cc:2804] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.002136 21813 raft_consensus.cc:493] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.002110 21844 consensus_queue.cc:237] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.003952 21813 raft_consensus.cc:3060] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.004492 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9b9a10127e4f088dbe514926357864" is_pre_election: true
I20260709 13:05:06.004992 21807 ts_tablet_manager.cc:1434] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:05:06.005108 21618 raft_consensus.cc:2468] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 0.
I20260709 13:05:06.006379 21731 leader_election.cc:304] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: d37e337da87a45749c7826833fb1b583
I20260709 13:05:05.998425 21693 raft_consensus.cc:2468] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 1.
I20260709 13:05:06.008018 21828 raft_consensus.cc:2804] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.011583 21828 raft_consensus.cc:493] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.012377 21828 raft_consensus.cc:3060] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.015498 21813 raft_consensus.cc:515] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.020665 21813 leader_election.cc:290] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 election: Requested vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:06.022701 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f7fcdf8a34d10b0447b2a00801f0a" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:06.023324 21618 raft_consensus.cc:3060] T 447f7fcdf8a34d10b0447b2a00801f0a P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.023483 21808 tablet_bootstrap.cc:492] T 447f7fcdf8a34d10b0447b2a00801f0a P d37e337da87a45749c7826833fb1b583: No bootstrap required, opened a new log
I20260709 13:05:06.024015 21808 ts_tablet_manager.cc:1403] T 447f7fcdf8a34d10b0447b2a00801f0a P d37e337da87a45749c7826833fb1b583: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.016s
I20260709 13:05:06.024166 21514 catalog_manager.cc:5697] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d9b9a10127e4f088dbe514926357864 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "6d9b9a10127e4f088dbe514926357864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.025364 21809 tablet_bootstrap.cc:492] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93: No bootstrap required, opened a new log
I20260709 13:05:06.025883 21809 ts_tablet_manager.cc:1403] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.004s
I20260709 13:05:06.027038 21808 raft_consensus.cc:359] T 447f7fcdf8a34d10b0447b2a00801f0a P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.027478 21844 raft_consensus.cc:493] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.027774 21808 raft_consensus.cc:385] T 447f7fcdf8a34d10b0447b2a00801f0a P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.028107 21808 raft_consensus.cc:740] T 447f7fcdf8a34d10b0447b2a00801f0a P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d37e337da87a45749c7826833fb1b583, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.027935 21844 raft_consensus.cc:515] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.028863 21808 consensus_queue.cc:260] T 447f7fcdf8a34d10b0447b2a00801f0a P d37e337da87a45749c7826833fb1b583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.030088 21809 raft_consensus.cc:359] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.031421 21808 ts_tablet_manager.cc:1434] T 447f7fcdf8a34d10b0447b2a00801f0a P d37e337da87a45749c7826833fb1b583: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:06.031374 21815 raft_consensus.cc:493] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.031693 21809 raft_consensus.cc:385] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.031960 21815 raft_consensus.cc:515] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.033452 21808 tablet_bootstrap.cc:492] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583: Bootstrap starting.
I20260709 13:05:06.030570 21618 raft_consensus.cc:2468] T 447f7fcdf8a34d10b0447b2a00801f0a P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 1.
I20260709 13:05:06.036715 21844 leader_election.cc:290] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:06.032291 21691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d0e027efbb403aa4aeeb5d6b2b90e8" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583" is_pre_election: true
I20260709 13:05:06.037537 21851 raft_consensus.cc:493] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.037935 21815 leader_election.cc:290] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:06.035552 21809 raft_consensus.cc:740] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.047767 21851 raft_consensus.cc:515] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.048631 21809 consensus_queue.cc:260] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.043721 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d0e027efbb403aa4aeeb5d6b2b90e8" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" is_pre_election: true
I20260709 13:05:06.044487 21767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64a11d5d07c0435a8f1d7f36c95850ae" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" is_pre_election: true
I20260709 13:05:06.050129 21767 raft_consensus.cc:2393] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d9b9a10127e4f088dbe514926357864 in current term 1: Already voted for candidate d37e337da87a45749c7826833fb1b583 in this term.
I20260709 13:05:06.050161 21851 leader_election.cc:290] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:06.050745 21808 tablet_bootstrap.cc:654] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.043731 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64a11d5d07c0435a8f1d7f36c95850ae" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583" is_pre_election: true
I20260709 13:05:06.048064 21731 leader_election.cc:304] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: 
I20260709 13:05:06.052325 21813 raft_consensus.cc:2804] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.052922 21767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d0e027efbb403aa4aeeb5d6b2b90e8" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" is_pre_election: true
I20260709 13:05:06.053192 21691 raft_consensus.cc:2468] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 0.
I20260709 13:05:06.052348 21766 raft_consensus.cc:2468] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 0.
I20260709 13:05:06.038064 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f7fcdf8a34d10b0447b2a00801f0a" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:06.055146 21693 raft_consensus.cc:3060] T 447f7fcdf8a34d10b0447b2a00801f0a P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.056373 21582 leader_election.cc:304] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: 
I20260709 13:05:06.058256 21515 catalog_manager.cc:5697] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d9b9a10127e4f088dbe514926357864 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "6d9b9a10127e4f088dbe514926357864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.059517 21815 raft_consensus.cc:2804] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.059556 21583 leader_election.cc:304] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d9b9a10127e4f088dbe514926357864; no voters: 2d3491cd12b74f94973e92b6fd0c6e93, d37e337da87a45749c7826833fb1b583
I20260709 13:05:06.060107 21815 raft_consensus.cc:493] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.060473 21815 raft_consensus.cc:3060] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.060555 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d0e027efbb403aa4aeeb5d6b2b90e8" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9b9a10127e4f088dbe514926357864" is_pre_election: true
I20260709 13:05:06.061019 21842 raft_consensus.cc:3060] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.062314 21693 raft_consensus.cc:2468] T 447f7fcdf8a34d10b0447b2a00801f0a P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 1.
I20260709 13:05:06.042865 21828 raft_consensus.cc:515] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.068475 21828 leader_election.cc:290] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 election: Requested vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:06.070271 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:06.073460 21809 ts_tablet_manager.cc:1434] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:05:06.074262 21815 raft_consensus.cc:515] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.079085 21809 tablet_bootstrap.cc:492] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93: Bootstrap starting.
I20260709 13:05:06.084172 21618 raft_consensus.cc:2393] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d37e337da87a45749c7826833fb1b583 in current term 1: Already voted for candidate 6d9b9a10127e4f088dbe514926357864 in this term.
I20260709 13:05:06.083204 21513 catalog_manager.cc:5697] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 reported cstate change: term changed from 0 to 1, leader changed from <none> to d37e337da87a45749c7826833fb1b583 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "d37e337da87a45749c7826833fb1b583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:06.085803 21732 leader_election.cc:343] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.087106 21809 tablet_bootstrap.cc:654] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.087112 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d0e027efbb403aa4aeeb5d6b2b90e8" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:06.087733 21657 leader_election.cc:304] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d37e337da87a45749c7826833fb1b583; no voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864
I20260709 13:05:06.088371 21766 raft_consensus.cc:3060] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.070087 21842 raft_consensus.cc:2749] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:06.091498 21814 raft_consensus.cc:3060] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.092031 21813 raft_consensus.cc:697] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Becoming Leader. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Running, Role: LEADER
I20260709 13:05:06.092526 21815 leader_election.cc:290] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 election: Requested vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:06.093138 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:06.092969 21813 consensus_queue.cc:237] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.093672 21618 raft_consensus.cc:3060] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.097605 21766 raft_consensus.cc:2468] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 1.
I20260709 13:05:06.098299 21814 raft_consensus.cc:2749] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:06.091439 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d0e027efbb403aa4aeeb5d6b2b90e8" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:06.098909 21582 leader_election.cc:304] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: 
I20260709 13:05:06.099967 21815 raft_consensus.cc:2804] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.104598 21815 raft_consensus.cc:697] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Becoming Leader. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:06.106878 21815 consensus_queue.cc:237] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.101528 21808 tablet_bootstrap.cc:492] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583: No bootstrap required, opened a new log
I20260709 13:05:06.103585 21618 raft_consensus.cc:2468] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 1.
I20260709 13:05:06.110836 21808 ts_tablet_manager.cc:1403] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.007s
I20260709 13:05:06.111274 21731 leader_election.cc:304] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: d37e337da87a45749c7826833fb1b583
I20260709 13:05:06.112666 21858 raft_consensus.cc:2804] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.113157 21858 raft_consensus.cc:697] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Becoming Leader. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Running, Role: LEADER
I20260709 13:05:06.112486 21513 catalog_manager.cc:5697] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.113998 21858 consensus_queue.cc:237] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.114657 21808 raft_consensus.cc:359] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.116984 21808 raft_consensus.cc:385] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.117669 21808 raft_consensus.cc:740] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d37e337da87a45749c7826833fb1b583, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.118746 21808 consensus_queue.cc:260] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.120967 21809 tablet_bootstrap.cc:492] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93: No bootstrap required, opened a new log
I20260709 13:05:06.121582 21809 ts_tablet_manager.cc:1403] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent bootstrapping tablet: real 0.043s	user 0.005s	sys 0.013s
I20260709 13:05:06.122746 21808 ts_tablet_manager.cc:1434] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:05:06.124639 21808 tablet_bootstrap.cc:492] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583: Bootstrap starting.
I20260709 13:05:06.125183 21809 raft_consensus.cc:359] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } }
I20260709 13:05:06.126145 21809 raft_consensus.cc:385] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.126513 21809 raft_consensus.cc:740] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.128309 21809 consensus_queue.cc:260] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } }
I20260709 13:05:06.131326 21809 ts_tablet_manager.cc:1434] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.005s
I20260709 13:05:06.115247 21693 raft_consensus.cc:2468] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 1.
I20260709 13:05:06.135926 21808 tablet_bootstrap.cc:654] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.146296 21693 raft_consensus.cc:3060] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.146288 21514 catalog_manager.cc:5697] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d9b9a10127e4f088dbe514926357864 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "6d9b9a10127e4f088dbe514926357864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.147689 21808 tablet_bootstrap.cc:492] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583: No bootstrap required, opened a new log
I20260709 13:05:06.148118 21808 ts_tablet_manager.cc:1403] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.005s
I20260709 13:05:06.150314 21808 raft_consensus.cc:359] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.150959 21808 raft_consensus.cc:385] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.151235 21808 raft_consensus.cc:740] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d37e337da87a45749c7826833fb1b583, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.151855 21808 consensus_queue.cc:260] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.153860 21808 ts_tablet_manager.cc:1434] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:05:06.154875 21808 tablet_bootstrap.cc:492] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583: Bootstrap starting.
I20260709 13:05:06.155246 21858 consensus_queue.cc:1048] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.159957 21513 catalog_manager.cc:5697] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.160928 21808 tablet_bootstrap.cc:654] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.174970 21808 tablet_bootstrap.cc:492] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583: No bootstrap required, opened a new log
I20260709 13:05:06.175591 21808 ts_tablet_manager.cc:1403] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:05:06.178431 21808 raft_consensus.cc:359] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } }
I20260709 13:05:06.179236 21808 raft_consensus.cc:385] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.179512 21808 raft_consensus.cc:740] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d37e337da87a45749c7826833fb1b583, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.180110 21808 consensus_queue.cc:260] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } }
I20260709 13:05:06.182137 21808 ts_tablet_manager.cc:1434] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:06.182516 21828 consensus_queue.cc:1048] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.186638 21828 raft_consensus.cc:493] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.187173 21828 raft_consensus.cc:515] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } }
I20260709 13:05:06.189287 21828 leader_election.cc:290] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345)
I20260709 13:05:06.190189 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08a4be38aa040e193dd87950f066533" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583" is_pre_election: true
I20260709 13:05:06.190521 21617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08a4be38aa040e193dd87950f066533" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9b9a10127e4f088dbe514926357864" is_pre_election: true
I20260709 13:05:06.190829 21693 raft_consensus.cc:2468] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 0.
I20260709 13:05:06.191193 21617 raft_consensus.cc:2468] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 0.
I20260709 13:05:06.192934 21731 leader_election.cc:304] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: 
I20260709 13:05:06.195273 21858 raft_consensus.cc:2804] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.195653 21858 raft_consensus.cc:493] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.195982 21858 raft_consensus.cc:3060] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.200831 21858 raft_consensus.cc:515] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } }
I20260709 13:05:06.203534 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08a4be38aa040e193dd87950f066533" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:06.204178 21693 raft_consensus.cc:3060] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.203899 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08a4be38aa040e193dd87950f066533" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:06.205722 21858 leader_election.cc:290] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 election: Requested vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345)
I20260709 13:05:06.205765 21618 raft_consensus.cc:3060] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.211484 21693 raft_consensus.cc:2468] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 1.
I20260709 13:05:06.212730 21732 leader_election.cc:304] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, d37e337da87a45749c7826833fb1b583; no voters: 
I20260709 13:05:06.213280 21618 raft_consensus.cc:2468] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 1.
I20260709 13:05:06.213644 21858 raft_consensus.cc:2804] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.214176 21858 raft_consensus.cc:697] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Becoming Leader. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Running, Role: LEADER
I20260709 13:05:06.215040 21858 consensus_queue.cc:237] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } }
I20260709 13:05:06.221709 21513 catalog_manager.cc:5697] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.260308 21815 consensus_queue.cc:1048] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.272260 21814 raft_consensus.cc:493] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.272580 21815 consensus_queue.cc:1048] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:06.272848 21814 raft_consensus.cc:515] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.274999 21814 leader_election.cc:290] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:06.276806 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d9b9a10127e4f088dbe514926357864" is_pre_election: true
I20260709 13:05:06.277381 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" is_pre_election: true
I20260709 13:05:06.277921 21618 raft_consensus.cc:2393] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d37e337da87a45749c7826833fb1b583 in current term 1: Already voted for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in this term.
I20260709 13:05:06.279963 21657 leader_election.cc:304] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d37e337da87a45749c7826833fb1b583; no voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864
I20260709 13:05:06.280998 21814 raft_consensus.cc:3060] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.286271 21814 raft_consensus.cc:2749] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:06.337996 21858 consensus_queue.cc:1048] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.349402 21691 raft_consensus.cc:3060] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.353453 21815 consensus_queue.cc:1048] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:06.358179 21858 consensus_queue.cc:1048] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.367311 21766 raft_consensus.cc:3060] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.380007 21845 consensus_queue.cc:1048] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:06.390015 21766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e08a4be38aa040e193dd87950f066533"
dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
mode: GRACEFUL
new_leader_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:42808
I20260709 13:05:06.390683 21766 raft_consensus.cc:606] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Received request to transfer leadership to TS 6d9b9a10127e4f088dbe514926357864
I20260709 13:05:06.410758 21691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64a11d5d07c0435a8f1d7f36c95850ae"
dest_uuid: "d37e337da87a45749c7826833fb1b583"
mode: GRACEFUL
new_leader_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:54896
I20260709 13:05:06.411369 21691 raft_consensus.cc:606] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 1 LEADER]: Received request to transfer leadership to TS 6d9b9a10127e4f088dbe514926357864
I20260709 13:05:06.416604 21766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca"
dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
mode: GRACEFUL
new_leader_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:42808
I20260709 13:05:06.417088 21766 raft_consensus.cc:606] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Received request to transfer leadership to TS 6d9b9a10127e4f088dbe514926357864
I20260709 13:05:06.430346 21618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6fd613927bb4530b775898e65c72430"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
mode: GRACEFUL
new_leader_uuid: "d37e337da87a45749c7826833fb1b583"
 from {username='slave'} at 127.0.0.1:42094
I20260709 13:05:06.430888 21618 raft_consensus.cc:606] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Received request to transfer leadership to TS d37e337da87a45749c7826833fb1b583
I20260709 13:05:06.436568 21766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344"
dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
mode: GRACEFUL
new_leader_uuid: "d37e337da87a45749c7826833fb1b583"
 from {username='slave'} at 127.0.0.1:42808
I20260709 13:05:06.437112 21766 raft_consensus.cc:606] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Received request to transfer leadership to TS d37e337da87a45749c7826833fb1b583
I20260709 13:05:06.442185 21766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511"
dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
mode: GRACEFUL
new_leader_uuid: "d37e337da87a45749c7826833fb1b583"
 from {username='slave'} at 127.0.0.1:42808
I20260709 13:05:06.442706 21766 raft_consensus.cc:606] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Received request to transfer leadership to TS d37e337da87a45749c7826833fb1b583
I20260709 13:05:06.448122 21618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "501a6bde36ca47feb95e4107b57663df"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
mode: GRACEFUL
new_leader_uuid: "d37e337da87a45749c7826833fb1b583"
 from {username='slave'} at 127.0.0.1:42094
I20260709 13:05:06.448721 21618 raft_consensus.cc:606] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Received request to transfer leadership to TS d37e337da87a45749c7826833fb1b583
I20260709 13:05:06.471192 21845 consensus_queue.cc:1048] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:06.482210 21883 consensus_queue.cc:1048] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:06.537983 21858 consensus_queue.cc:1048] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.541002 21814 consensus_queue.cc:1048] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.546604 21813 raft_consensus.cc:993] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93: : Instructing follower 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:06.547211 21813 raft_consensus.cc:1081] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Signalling peer 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:06.550642 21618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:35308
I20260709 13:05:06.550958 21814 raft_consensus.cc:993] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583: : Instructing follower 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:06.551373 21618 raft_consensus.cc:493] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:06.551990 21618 raft_consensus.cc:3060] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.551435 21814 raft_consensus.cc:1081] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 1 LEADER]: Signalling peer 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:06.554085 21858 consensus_queue.cc:1048] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.560062 21618 raft_consensus.cc:515] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.560781 21617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64a11d5d07c0435a8f1d7f36c95850ae"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:42078
I20260709 13:05:06.561342 21617 raft_consensus.cc:493] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:06.561736 21617 raft_consensus.cc:3060] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.563017 21618 leader_election.cc:290] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 2 election: Requested vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:06.563220 21691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:06.563822 21691 raft_consensus.cc:3060] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.564872 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:06.565478 21766 raft_consensus.cc:3055] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:06.565788 21766 raft_consensus.cc:740] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Running, Role: LEADER
I20260709 13:05:06.566591 21766 consensus_queue.cc:260] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.567688 21766 raft_consensus.cc:3060] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.567592 21814 consensus_queue.cc:1048] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.569532 21617 raft_consensus.cc:515] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.573112 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64a11d5d07c0435a8f1d7f36c95850ae" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:06.573601 21691 raft_consensus.cc:2468] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 2.
I20260709 13:05:06.574699 21693 raft_consensus.cc:1240] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Rejecting Update request from peer 2d3491cd12b74f94973e92b6fd0c6e93 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:05:06.574913 21617 leader_election.cc:290] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 2 election: Requested vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:06.575367 21766 raft_consensus.cc:2468] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 2.
I20260709 13:05:06.576584 21582 leader_election.cc:304] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: 
I20260709 13:05:06.577544 21883 raft_consensus.cc:2804] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:06.577980 21883 raft_consensus.cc:697] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 2 LEADER]: Becoming Leader. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:06.578749 21883 consensus_queue.cc:237] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.582639 21691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64a11d5d07c0435a8f1d7f36c95850ae" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:06.583276 21691 raft_consensus.cc:3055] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:06.584816 21691 raft_consensus.cc:740] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d37e337da87a45749c7826833fb1b583, State: Running, Role: LEADER
I20260709 13:05:06.585750 21691 consensus_queue.cc:260] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.587090 21691 raft_consensus.cc:3060] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.587987 21858 raft_consensus.cc:993] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93: : Instructing follower d37e337da87a45749c7826833fb1b583 to start an election
I20260709 13:05:06.588429 21828 raft_consensus.cc:1081] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Signalling peer d37e337da87a45749c7826833fb1b583 to start an election
I20260709 13:05:06.590030 21693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344"
dest_uuid: "d37e337da87a45749c7826833fb1b583"
 from {username='slave'} at 127.0.0.1:46138
I20260709 13:05:06.587488 21513 catalog_manager.cc:5697] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 reported cstate change: term changed from 1 to 2, leader changed from 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67) to 6d9b9a10127e4f088dbe514926357864 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "6d9b9a10127e4f088dbe514926357864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.590610 21693 raft_consensus.cc:493] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:06.591064 21693 raft_consensus.cc:3060] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.597421 21691 raft_consensus.cc:2468] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 2.
I20260709 13:05:06.598516 21583 leader_election.cc:304] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d9b9a10127e4f088dbe514926357864, d37e337da87a45749c7826833fb1b583; no voters: 2d3491cd12b74f94973e92b6fd0c6e93
I20260709 13:05:06.599702 21883 raft_consensus.cc:2804] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:06.600220 21883 raft_consensus.cc:697] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [term 2 LEADER]: Becoming Leader. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:06.600941 21828 consensus_queue.cc:1048] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.601140 21883 consensus_queue.cc:237] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.602296 21828 consensus_queue.cc:1048] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.604486 21693 raft_consensus.cc:515] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.606642 21693 leader_election.cc:290] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 2 election: Requested vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:06.607638 21616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:06.608327 21616 raft_consensus.cc:3060] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.614127 21767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:06.614337 21616 raft_consensus.cc:2468] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37e337da87a45749c7826833fb1b583 in term 2.
I20260709 13:05:06.614769 21767 raft_consensus.cc:3055] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:06.615253 21767 raft_consensus.cc:740] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Running, Role: LEADER
I20260709 13:05:06.615590 21657 leader_election.cc:304] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d9b9a10127e4f088dbe514926357864, d37e337da87a45749c7826833fb1b583; no voters: 
I20260709 13:05:06.614986 21515 catalog_manager.cc:5697] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 reported cstate change: term changed from 1 to 2, leader changed from d37e337da87a45749c7826833fb1b583 (127.20.130.66) to 6d9b9a10127e4f088dbe514926357864 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "6d9b9a10127e4f088dbe514926357864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.616464 21814 raft_consensus.cc:2804] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:06.616058 21767 consensus_queue.cc:260] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.617187 21814 raft_consensus.cc:697] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Becoming Leader. State: Replica: d37e337da87a45749c7826833fb1b583, State: Running, Role: LEADER
I20260709 13:05:06.617506 21858 raft_consensus.cc:993] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93: : Instructing follower 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:06.617595 21767 raft_consensus.cc:3060] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.618474 21813 raft_consensus.cc:1081] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Signalling peer 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:06.618079 21814 consensus_queue.cc:237] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.624114 21618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e08a4be38aa040e193dd87950f066533"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:35308
I20260709 13:05:06.624732 21618 raft_consensus.cc:493] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:06.624981 21767 raft_consensus.cc:2468] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37e337da87a45749c7826833fb1b583 in term 2.
I20260709 13:05:06.625201 21618 raft_consensus.cc:3060] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.627573 21513 catalog_manager.cc:5697] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 reported cstate change: term changed from 1 to 2, leader changed from 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67) to d37e337da87a45749c7826833fb1b583 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "d37e337da87a45749c7826833fb1b583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.634774 21813 consensus_queue.cc:1048] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:06.637583 21618 raft_consensus.cc:515] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } }
I20260709 13:05:06.639267 21616 raft_consensus.cc:1240] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Rejecting Update request from peer 2d3491cd12b74f94973e92b6fd0c6e93 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:06.641422 21883 consensus_queue.cc:1048] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.641572 21890 consensus_queue.cc:1048] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.643922 21618 leader_election.cc:290] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 2 election: Requested vote from peers 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647), d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:06.645269 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08a4be38aa040e193dd87950f066533" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:06.646804 21813 consensus_queue.cc:1059] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.647882 21813 raft_consensus.cc:3055] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:06.648202 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08a4be38aa040e193dd87950f066533" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:06.648221 21813 raft_consensus.cc:740] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Running, Role: LEADER
I20260709 13:05:06.649673 21813 consensus_queue.cc:260] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } }
I20260709 13:05:06.650720 21813 raft_consensus.cc:3060] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.662253 21842 consensus_queue.cc:1048] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.681941 21766 raft_consensus.cc:2468] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 2.
I20260709 13:05:06.683773 21582 leader_election.cc:304] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: d37e337da87a45749c7826833fb1b583
I20260709 13:05:06.684603 21883 raft_consensus.cc:2804] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:06.686331 21883 raft_consensus.cc:697] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 2 LEADER]: Becoming Leader. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:06.687177 21883 consensus_queue.cc:237] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } }
I20260709 13:05:06.697925 21512 catalog_manager.cc:5697] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 reported cstate change: term changed from 1 to 2, leader changed from 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67) to 6d9b9a10127e4f088dbe514926357864 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "6d9b9a10127e4f088dbe514926357864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.798379 21842 raft_consensus.cc:993] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864: : Instructing follower d37e337da87a45749c7826833fb1b583 to start an election
I20260709 13:05:06.798810 21883 raft_consensus.cc:1081] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Signalling peer d37e337da87a45749c7826833fb1b583 to start an election
I20260709 13:05:06.800544 21692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6fd613927bb4530b775898e65c72430"
dest_uuid: "d37e337da87a45749c7826833fb1b583"
 from {username='slave'} at 127.0.0.1:46154
I20260709 13:05:06.801030 21692 raft_consensus.cc:493] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:06.801388 21692 raft_consensus.cc:3060] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.806798 21692 raft_consensus.cc:515] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.808372 21692 leader_election.cc:290] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 2 election: Requested vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:06.809188 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fd613927bb4530b775898e65c72430" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:06.809350 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fd613927bb4530b775898e65c72430" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:06.809798 21618 raft_consensus.cc:3055] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:06.809857 21766 raft_consensus.cc:3060] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.810106 21618 raft_consensus.cc:740] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:06.810760 21618 consensus_queue.cc:260] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.811681 21618 raft_consensus.cc:3060] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.814567 21766 raft_consensus.cc:2468] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37e337da87a45749c7826833fb1b583 in term 2.
I20260709 13:05:06.815743 21657 leader_election.cc:304] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, d37e337da87a45749c7826833fb1b583; no voters: 
I20260709 13:05:06.816150 21618 raft_consensus.cc:2468] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37e337da87a45749c7826833fb1b583 in term 2.
I20260709 13:05:06.816426 21814 raft_consensus.cc:2804] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:06.816937 21814 raft_consensus.cc:697] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Becoming Leader. State: Replica: d37e337da87a45749c7826833fb1b583, State: Running, Role: LEADER
I20260709 13:05:06.817637 21814 consensus_queue.cc:237] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.824163 21516 catalog_manager.cc:5697] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 reported cstate change: term changed from 1 to 2, leader changed from 6d9b9a10127e4f088dbe514926357864 (127.20.130.65) to d37e337da87a45749c7826833fb1b583 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "d37e337da87a45749c7826833fb1b583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.920343 21842 raft_consensus.cc:993] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864: : Instructing follower d37e337da87a45749c7826833fb1b583 to start an election
I20260709 13:05:06.920789 21883 raft_consensus.cc:1081] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Signalling peer d37e337da87a45749c7826833fb1b583 to start an election
I20260709 13:05:06.922302 21692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "501a6bde36ca47feb95e4107b57663df"
dest_uuid: "d37e337da87a45749c7826833fb1b583"
 from {username='slave'} at 127.0.0.1:46154
I20260709 13:05:06.922788 21692 raft_consensus.cc:493] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:06.923154 21692 raft_consensus.cc:3060] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.927860 21692 raft_consensus.cc:515] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.929420 21692 leader_election.cc:290] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 2 election: Requested vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:06.930845 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501a6bde36ca47feb95e4107b57663df" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:06.930881 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501a6bde36ca47feb95e4107b57663df" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:06.931535 21618 raft_consensus.cc:3055] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:06.931583 21766 raft_consensus.cc:3060] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.931891 21618 raft_consensus.cc:740] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:06.932616 21618 consensus_queue.cc:260] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.933552 21618 raft_consensus.cc:3060] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.936537 21766 raft_consensus.cc:2468] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37e337da87a45749c7826833fb1b583 in term 2.
I20260709 13:05:06.937641 21657 leader_election.cc:304] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, d37e337da87a45749c7826833fb1b583; no voters: 
I20260709 13:05:06.938267 21618 raft_consensus.cc:2468] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37e337da87a45749c7826833fb1b583 in term 2.
I20260709 13:05:06.938359 21814 raft_consensus.cc:2804] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:06.938894 21814 raft_consensus.cc:697] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Becoming Leader. State: Replica: d37e337da87a45749c7826833fb1b583, State: Running, Role: LEADER
I20260709 13:05:06.939714 21814 consensus_queue.cc:237] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.945744 21516 catalog_manager.cc:5697] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 reported cstate change: term changed from 1 to 2, leader changed from 6d9b9a10127e4f088dbe514926357864 (127.20.130.65) to d37e337da87a45749c7826833fb1b583 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "d37e337da87a45749c7826833fb1b583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.982376 21813 raft_consensus.cc:993] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93: : Instructing follower d37e337da87a45749c7826833fb1b583 to start an election
I20260709 13:05:06.982863 21890 raft_consensus.cc:1081] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Signalling peer d37e337da87a45749c7826833fb1b583 to start an election
I20260709 13:05:06.984539 21692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511"
dest_uuid: "d37e337da87a45749c7826833fb1b583"
 from {username='slave'} at 127.0.0.1:46138
I20260709 13:05:06.985030 21692 raft_consensus.cc:493] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:06.985342 21692 raft_consensus.cc:3060] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.989935 21692 raft_consensus.cc:515] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.991662 21692 leader_election.cc:290] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 2 election: Requested vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:06.992437 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:06.992648 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:06.992976 21618 raft_consensus.cc:3060] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.993186 21766 raft_consensus.cc:3055] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:06.993531 21766 raft_consensus.cc:740] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Running, Role: LEADER
I20260709 13:05:06.994168 21766 consensus_queue.cc:260] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:06.995076 21766 raft_consensus.cc:3060] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.998083 21618 raft_consensus.cc:2468] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37e337da87a45749c7826833fb1b583 in term 2.
I20260709 13:05:06.999205 21657 leader_election.cc:304] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d9b9a10127e4f088dbe514926357864, d37e337da87a45749c7826833fb1b583; no voters: 
I20260709 13:05:07.000037 21814 raft_consensus.cc:2804] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.000238 21766 raft_consensus.cc:2468] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37e337da87a45749c7826833fb1b583 in term 2.
I20260709 13:05:07.000712 21814 raft_consensus.cc:697] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Becoming Leader. State: Replica: d37e337da87a45749c7826833fb1b583, State: Running, Role: LEADER
I20260709 13:05:07.001677 21814 consensus_queue.cc:237] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:07.008078 21516 catalog_manager.cc:5697] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 reported cstate change: term changed from 1 to 2, leader changed from 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67) to d37e337da87a45749c7826833fb1b583 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "d37e337da87a45749c7826833fb1b583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.039505 21692 raft_consensus.cc:1275] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.040750 21815 consensus_queue.cc:1048] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.051012 21766 raft_consensus.cc:1275] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.052614 21764 raft_consensus.cc:3060] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.052731 21815 consensus_queue.cc:1048] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.061035 21764 raft_consensus.cc:1275] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.062358 21815 consensus_queue.cc:1048] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.071244 21692 raft_consensus.cc:1275] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.073091 21815 consensus_queue.cc:1048] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.080889 21618 raft_consensus.cc:1275] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Refusing update from remote peer d37e337da87a45749c7826833fb1b583: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.080865 21764 raft_consensus.cc:1275] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.083374 21842 consensus_queue.cc:1048] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.084731 21814 consensus_queue.cc:1048] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.097903 21766 raft_consensus.cc:1275] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Refusing update from remote peer d37e337da87a45749c7826833fb1b583: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.098209 21692 raft_consensus.cc:3060] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.101895 21814 consensus_queue.cc:1048] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.106323 21692 raft_consensus.cc:1275] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.107877 21883 consensus_queue.cc:1048] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.290452 21618 raft_consensus.cc:1275] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Refusing update from remote peer d37e337da87a45749c7826833fb1b583: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.291810 21897 consensus_queue.cc:1048] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.300662 21766 raft_consensus.cc:1275] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Refusing update from remote peer d37e337da87a45749c7826833fb1b583: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.302179 21897 consensus_queue.cc:1048] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.381215 21766 raft_consensus.cc:1275] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Refusing update from remote peer d37e337da87a45749c7826833fb1b583: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.382421 21897 consensus_queue.cc:1048] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.390234 21618 raft_consensus.cc:1275] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Refusing update from remote peer d37e337da87a45749c7826833fb1b583: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.392302 21897 consensus_queue.cc:1048] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.397281 21766 raft_consensus.cc:1275] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Refusing update from remote peer d37e337da87a45749c7826833fb1b583: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.398465 21897 consensus_queue.cc:1048] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.411417 21618 raft_consensus.cc:1275] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Refusing update from remote peer d37e337da87a45749c7826833fb1b583: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.412688 21897 consensus_queue.cc:1048] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:08.978998 21547 debug-util.cc:398] Leaking SignalData structure 0x7b0800051ac0 after lost signal to thread 21004
W20260709 13:05:08.979964 21547 debug-util.cc:398] Leaking SignalData structure 0x7b08000531a0 after lost signal to thread 21550
W20260709 13:05:08.980890 21547 debug-util.cc:398] Leaking SignalData structure 0x7b08000b2c80 after lost signal to thread 21642
W20260709 13:05:08.981590 21547 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb1a0 after lost signal to thread 21717
W20260709 13:05:08.982254 21547 debug-util.cc:398] Leaking SignalData structure 0x7b08000d1520 after lost signal to thread 21791
I20260709 13:05:09.494725 21001 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:05:09.495572 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:09.513953 21616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "857d094231a549efbfda690583100fb9"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
mode: GRACEFUL
new_leader_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
 from {username='slave'} at 127.0.0.1:42110
I20260709 13:05:09.514658 21616 raft_consensus.cc:606] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Received request to transfer leadership to TS 2d3491cd12b74f94973e92b6fd0c6e93
I20260709 13:05:09.517386 21616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
mode: GRACEFUL
new_leader_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
 from {username='slave'} at 127.0.0.1:42110
I20260709 13:05:09.518003 21616 raft_consensus.cc:606] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 2 LEADER]: Received request to transfer leadership to TS 2d3491cd12b74f94973e92b6fd0c6e93
I20260709 13:05:09.519510 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:09.520123 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:09.529455 21909 raft_consensus.cc:993] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864: : Instructing follower 2d3491cd12b74f94973e92b6fd0c6e93 to start an election
I20260709 13:05:09.529966 21815 raft_consensus.cc:1081] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 2 LEADER]: Signalling peer 2d3491cd12b74f94973e92b6fd0c6e93 to start an election
I20260709 13:05:09.531625 21766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca"
dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
 from {username='slave'} at 127.0.0.1:34184
I20260709 13:05:09.532225 21766 raft_consensus.cc:493] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:09.532589 21766 raft_consensus.cc:3060] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:09.534091 21815 raft_consensus.cc:993] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864: : Instructing follower 2d3491cd12b74f94973e92b6fd0c6e93 to start an election
I20260709 13:05:09.534605 21909 raft_consensus.cc:1081] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Signalling peer 2d3491cd12b74f94973e92b6fd0c6e93 to start an election
I20260709 13:05:09.536446 21764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "857d094231a549efbfda690583100fb9"
dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
 from {username='slave'} at 127.0.0.1:34184
I20260709 13:05:09.537078 21764 raft_consensus.cc:493] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:09.537484 21764 raft_consensus.cc:3060] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.538595 21766 raft_consensus.cc:515] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:09.541623 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:09.542210 21693 raft_consensus.cc:3060] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:09.545904 21616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:09.546466 21616 raft_consensus.cc:3055] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:09.546728 21616 raft_consensus.cc:740] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:09.547495 21616 consensus_queue.cc:260] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:09.547896 21764 raft_consensus.cc:515] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:09.548532 21616 raft_consensus.cc:3060] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:09.550143 21764 leader_election.cc:290] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 2 election: Requested vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:09.551210 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857d094231a549efbfda690583100fb9" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:09.551796 21618 raft_consensus.cc:3055] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:09.552090 21618 raft_consensus.cc:740] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:09.552835 21618 consensus_queue.cc:260] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:09.553601 21691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857d094231a549efbfda690583100fb9" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:09.553961 21618 raft_consensus.cc:3060] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.554255 21691 raft_consensus.cc:3060] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.559806 21616 raft_consensus.cc:2468] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 3.
I20260709 13:05:09.562762 21618 raft_consensus.cc:2468] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 2.
I20260709 13:05:09.563061 21731 leader_election.cc:304] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: 
I20260709 13:05:09.561357 21693 raft_consensus.cc:2468] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 3.
I20260709 13:05:09.564273 21731 leader_election.cc:304] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: 
I20260709 13:05:09.561782 21766 leader_election.cc:290] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 3 election: Requested vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:09.564726 21890 raft_consensus.cc:2804] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:09.572008 21911 raft_consensus.cc:2804] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:09.573401 21890 raft_consensus.cc:697] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 LEADER]: Becoming Leader. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Running, Role: LEADER
I20260709 13:05:09.574545 21890 consensus_queue.cc:237] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:09.580155 21911 raft_consensus.cc:697] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 LEADER]: Becoming Leader. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Running, Role: LEADER
I20260709 13:05:09.573028 21691 raft_consensus.cc:2468] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 2.
I20260709 13:05:09.582409 21911 consensus_queue.cc:237] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:09.595611 21516 catalog_manager.cc:5697] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 reported cstate change: term changed from 2 to 3, leader changed from 6d9b9a10127e4f088dbe514926357864 (127.20.130.65) to 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67). New cstate: current_term: 3 leader_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.615053 21516 catalog_manager.cc:5697] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 reported cstate change: term changed from 1 to 2, leader changed from 6d9b9a10127e4f088dbe514926357864 (127.20.130.65) to 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67). New cstate: current_term: 2 leader_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.962073 21616 raft_consensus.cc:1275] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Refusing update from remote peer 2d3491cd12b74f94973e92b6fd0c6e93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:09.963779 21890 consensus_queue.cc:1048] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:09.980976 21691 raft_consensus.cc:1275] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Refusing update from remote peer 2d3491cd12b74f94973e92b6fd0c6e93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:09.982702 21890 consensus_queue.cc:1048] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:10.162420 21616 raft_consensus.cc:1275] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Refusing update from remote peer 2d3491cd12b74f94973e92b6fd0c6e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:10.164058 21890 consensus_queue.cc:1048] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:10.177443 21693 raft_consensus.cc:1275] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Refusing update from remote peer 2d3491cd12b74f94973e92b6fd0c6e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:10.179242 21912 consensus_queue.cc:1048] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:10.521078 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:10.542580 21764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "857d094231a549efbfda690583100fb9"
dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
mode: GRACEFUL
new_leader_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:42808
I20260709 13:05:10.543301 21764 raft_consensus.cc:606] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 LEADER]: Received request to transfer leadership to TS 6d9b9a10127e4f088dbe514926357864
I20260709 13:05:10.553203 21764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca"
dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
mode: GRACEFUL
new_leader_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:42808
I20260709 13:05:10.553908 21764 raft_consensus.cc:606] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 LEADER]: Received request to transfer leadership to TS 6d9b9a10127e4f088dbe514926357864
I20260709 13:05:10.560010 21693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6fd613927bb4530b775898e65c72430"
dest_uuid: "d37e337da87a45749c7826833fb1b583"
mode: GRACEFUL
new_leader_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:54896
I20260709 13:05:10.560724 21693 raft_consensus.cc:606] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Received request to transfer leadership to TS 6d9b9a10127e4f088dbe514926357864
I20260709 13:05:10.566589 21693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344"
dest_uuid: "d37e337da87a45749c7826833fb1b583"
mode: GRACEFUL
new_leader_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:54896
I20260709 13:05:10.567291 21693 raft_consensus.cc:606] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Received request to transfer leadership to TS 6d9b9a10127e4f088dbe514926357864
I20260709 13:05:10.573388 21693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511"
dest_uuid: "d37e337da87a45749c7826833fb1b583"
mode: GRACEFUL
new_leader_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:54896
I20260709 13:05:10.573972 21693 raft_consensus.cc:606] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Received request to transfer leadership to TS 6d9b9a10127e4f088dbe514926357864
I20260709 13:05:10.779050 21890 raft_consensus.cc:993] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93: : Instructing follower 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:10.779553 21912 raft_consensus.cc:1081] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 LEADER]: Signalling peer 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:10.781061 21616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "857d094231a549efbfda690583100fb9"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:35308
I20260709 13:05:10.781764 21616 raft_consensus.cc:493] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.782193 21616 raft_consensus.cc:3060] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.790149 21616 raft_consensus.cc:515] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:10.792435 21616 leader_election.cc:290] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 3 election: Requested vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:10.793074 21691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857d094231a549efbfda690583100fb9" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:10.793676 21691 raft_consensus.cc:3060] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.793876 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857d094231a549efbfda690583100fb9" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:10.794422 21764 raft_consensus.cc:3055] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:10.794792 21764 raft_consensus.cc:740] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Running, Role: LEADER
I20260709 13:05:10.795612 21764 consensus_queue.cc:260] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:10.796801 21764 raft_consensus.cc:3060] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.800554 21691 raft_consensus.cc:2468] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 3.
I20260709 13:05:10.801930 21583 leader_election.cc:304] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d9b9a10127e4f088dbe514926357864, d37e337da87a45749c7826833fb1b583; no voters: 
I20260709 13:05:10.802731 21909 raft_consensus.cc:2804] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:10.803635 21764 raft_consensus.cc:2468] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 3.
I20260709 13:05:10.803938 21909 raft_consensus.cc:697] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 3 LEADER]: Becoming Leader. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:10.805068 21909 consensus_queue.cc:237] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:10.812232 21516 catalog_manager.cc:5697] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 reported cstate change: term changed from 2 to 3, leader changed from 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67) to 6d9b9a10127e4f088dbe514926357864 (127.20.130.65). New cstate: current_term: 3 leader_uuid: "6d9b9a10127e4f088dbe514926357864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.856196 21906 raft_consensus.cc:993] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583: : Instructing follower 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:10.857889 21906 raft_consensus.cc:1081] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Signalling peer 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:10.859903 21616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:42078
I20260709 13:05:10.860585 21616 raft_consensus.cc:493] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.860909 21932 raft_consensus.cc:993] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583: : Instructing follower 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:10.861019 21616 raft_consensus.cc:3060] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.861523 21926 raft_consensus.cc:1081] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Signalling peer 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:10.863046 21618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6fd613927bb4530b775898e65c72430"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:42078
I20260709 13:05:10.863497 21618 raft_consensus.cc:493] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.863821 21618 raft_consensus.cc:3060] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.868091 21618 raft_consensus.cc:515] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:10.869158 21616 raft_consensus.cc:515] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:10.870484 21691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fd613927bb4530b775898e65c72430" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:10.870592 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fd613927bb4530b775898e65c72430" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:10.871184 21691 raft_consensus.cc:3055] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:10.871244 21764 raft_consensus.cc:3060] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.871619 21691 raft_consensus.cc:740] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d37e337da87a45749c7826833fb1b583, State: Running, Role: LEADER
I20260709 13:05:10.872430 21691 consensus_queue.cc:260] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:10.873683 21691 raft_consensus.cc:3060] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.875293 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:10.875872 21693 raft_consensus.cc:3055] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:10.875973 21616 leader_election.cc:290] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 3 election: Requested vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:10.876225 21693 raft_consensus.cc:740] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d37e337da87a45749c7826833fb1b583, State: Running, Role: LEADER
I20260709 13:05:10.877147 21693 consensus_queue.cc:260] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:10.880487 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:10.881036 21766 raft_consensus.cc:3060] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.881093 21691 raft_consensus.cc:2468] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 3.
I20260709 13:05:10.881793 21764 raft_consensus.cc:2468] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 3.
I20260709 13:05:10.882390 21583 leader_election.cc:304] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d9b9a10127e4f088dbe514926357864, d37e337da87a45749c7826833fb1b583; no voters: 
I20260709 13:05:10.882602 21618 leader_election.cc:290] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 3 election: Requested vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:10.883324 21909 raft_consensus.cc:2804] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:10.883785 21909 raft_consensus.cc:697] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 3 LEADER]: Becoming Leader. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:10.884740 21909 consensus_queue.cc:237] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:10.878291 21693 raft_consensus.cc:3060] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.887768 21766 raft_consensus.cc:2468] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 3.
I20260709 13:05:10.889220 21582 leader_election.cc:304] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: 
I20260709 13:05:10.890662 21927 raft_consensus.cc:2804] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:10.897941 21516 catalog_manager.cc:5697] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 reported cstate change: term changed from 2 to 3, leader changed from d37e337da87a45749c7826833fb1b583 (127.20.130.66) to 6d9b9a10127e4f088dbe514926357864 (127.20.130.65). New cstate: current_term: 3 leader_uuid: "6d9b9a10127e4f088dbe514926357864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.901991 21927 raft_consensus.cc:697] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 3 LEADER]: Becoming Leader. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:10.902954 21927 consensus_queue.cc:237] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:10.900199 21693 raft_consensus.cc:2468] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 3.
I20260709 13:05:10.913718 21890 raft_consensus.cc:993] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93: : Instructing follower 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:10.914186 21890 raft_consensus.cc:1081] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 LEADER]: Signalling peer 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:10.915848 21618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:35308
I20260709 13:05:10.916474 21618 raft_consensus.cc:493] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.917035 21618 raft_consensus.cc:3060] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:10.917109 21516 catalog_manager.cc:5697] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 reported cstate change: term changed from 2 to 3, leader changed from d37e337da87a45749c7826833fb1b583 (127.20.130.66) to 6d9b9a10127e4f088dbe514926357864 (127.20.130.65). New cstate: current_term: 3 leader_uuid: "6d9b9a10127e4f088dbe514926357864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.924943 21618 raft_consensus.cc:515] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:10.927779 21618 leader_election.cc:290] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 4 election: Requested vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:10.928023 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:10.928341 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:10.928598 21693 raft_consensus.cc:3060] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:10.928820 21766 raft_consensus.cc:3055] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:10.929097 21766 raft_consensus.cc:740] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Running, Role: LEADER
I20260709 13:05:10.929817 21766 consensus_queue.cc:260] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:10.930886 21766 raft_consensus.cc:3060] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:10.935312 21693 raft_consensus.cc:2468] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 4.
I20260709 13:05:10.937773 21766 raft_consensus.cc:2468] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 4.
I20260709 13:05:10.938848 21583 leader_election.cc:304] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d9b9a10127e4f088dbe514926357864, d37e337da87a45749c7826833fb1b583; no voters: 
I20260709 13:05:10.940382 21927 raft_consensus.cc:2804] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:10.940937 21927 raft_consensus.cc:697] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 4 LEADER]: Becoming Leader. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:10.941831 21927 consensus_queue.cc:237] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:10.948565 21516 catalog_manager.cc:5697] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 reported cstate change: term changed from 3 to 4, leader changed from 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67) to 6d9b9a10127e4f088dbe514926357864 (127.20.130.65). New cstate: current_term: 4 leader_uuid: "6d9b9a10127e4f088dbe514926357864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.955628 21926 raft_consensus.cc:993] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583: : Instructing follower 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:10.956149 21926 raft_consensus.cc:1081] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Signalling peer 6d9b9a10127e4f088dbe514926357864 to start an election
I20260709 13:05:10.957945 21618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
 from {username='slave'} at 127.0.0.1:42078
I20260709 13:05:10.958575 21618 raft_consensus.cc:493] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.958990 21618 raft_consensus.cc:3060] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.967146 21618 raft_consensus.cc:515] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:10.969208 21618 leader_election.cc:290] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 3 election: Requested vote from peers d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:10.970118 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:10.970286 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511" candidate_uuid: "6d9b9a10127e4f088dbe514926357864" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:10.970729 21693 raft_consensus.cc:3055] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:10.970892 21766 raft_consensus.cc:3060] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.971103 21693 raft_consensus.cc:740] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d37e337da87a45749c7826833fb1b583, State: Running, Role: LEADER
I20260709 13:05:10.971853 21693 consensus_queue.cc:260] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:10.972934 21693 raft_consensus.cc:3060] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.977730 21766 raft_consensus.cc:2468] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 3.
I20260709 13:05:10.979112 21582 leader_election.cc:304] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: 
I20260709 13:05:10.979876 21693 raft_consensus.cc:2468] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d9b9a10127e4f088dbe514926357864 in term 3.
I20260709 13:05:10.980067 21927 raft_consensus.cc:2804] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:10.980913 21927 raft_consensus.cc:697] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 3 LEADER]: Becoming Leader. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:10.981837 21927 consensus_queue.cc:237] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:10.989744 21516 catalog_manager.cc:5697] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 reported cstate change: term changed from 2 to 3, leader changed from d37e337da87a45749c7826833fb1b583 (127.20.130.66) to 6d9b9a10127e4f088dbe514926357864 (127.20.130.65). New cstate: current_term: 3 leader_uuid: "6d9b9a10127e4f088dbe514926357864" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.227417 21693 raft_consensus.cc:1275] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.228952 21927 consensus_queue.cc:1048] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:11.244165 21766 raft_consensus.cc:1275] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.245849 21927 consensus_queue.cc:1048] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:11.269264 21766 raft_consensus.cc:1275] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.270486 21927 consensus_queue.cc:1048] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:11.279929 21693 raft_consensus.cc:1275] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.281492 21909 consensus_queue.cc:1048] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:11.331194 21693 raft_consensus.cc:1275] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.332738 21909 consensus_queue.cc:1048] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:11.344851 21766 raft_consensus.cc:1275] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.346382 21935 consensus_queue.cc:1048] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:11.366340 21693 raft_consensus.cc:1275] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 4 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:11.367966 21935 consensus_queue.cc:1048] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:11.378775 21766 raft_consensus.cc:1275] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 4 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:11.380625 21935 consensus_queue.cc:1048] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:11.511919 21766 raft_consensus.cc:1275] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.513252 21935 consensus_queue.cc:1048] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:11.523434 21693 raft_consensus.cc:1275] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Refusing update from remote peer 6d9b9a10127e4f088dbe514926357864: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.525650 21927 consensus_queue.cc:1048] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:13.582810 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:13.591425 21618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
mode: GRACEFUL
new_leader_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
 from {username='slave'} at 127.0.0.1:42110
I20260709 13:05:13.592176 21618 raft_consensus.cc:606] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 3 LEADER]: Received request to transfer leadership to TS 2d3491cd12b74f94973e92b6fd0c6e93
I20260709 13:05:13.594846 21618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
mode: GRACEFUL
new_leader_uuid: "d37e337da87a45749c7826833fb1b583"
 from {username='slave'} at 127.0.0.1:42110
I20260709 13:05:13.595427 21618 raft_consensus.cc:606] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 4 LEADER]: Received request to transfer leadership to TS d37e337da87a45749c7826833fb1b583
I20260709 13:05:13.597828 21618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3d0e027efbb403aa4aeeb5d6b2b90e8"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
mode: GRACEFUL
new_leader_uuid: "d37e337da87a45749c7826833fb1b583"
 from {username='slave'} at 127.0.0.1:42110
I20260709 13:05:13.598320 21618 raft_consensus.cc:606] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Received request to transfer leadership to TS d37e337da87a45749c7826833fb1b583
I20260709 13:05:13.600660 21618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511"
dest_uuid: "6d9b9a10127e4f088dbe514926357864"
mode: GRACEFUL
new_leader_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
 from {username='slave'} at 127.0.0.1:42110
I20260709 13:05:13.601291 21618 raft_consensus.cc:606] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 3 LEADER]: Received request to transfer leadership to TS 2d3491cd12b74f94973e92b6fd0c6e93
I20260709 13:05:13.602295 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:13.602698 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:13.686141 21927 raft_consensus.cc:993] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864: : Instructing follower 2d3491cd12b74f94973e92b6fd0c6e93 to start an election
I20260709 13:05:13.686856 21955 raft_consensus.cc:1081] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 3 LEADER]: Signalling peer 2d3491cd12b74f94973e92b6fd0c6e93 to start an election
I20260709 13:05:13.688544 21766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511"
dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
 from {username='slave'} at 127.0.0.1:34184
I20260709 13:05:13.689180 21766 raft_consensus.cc:493] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.689498 21766 raft_consensus.cc:3060] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:13.696095 21766 raft_consensus.cc:515] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:13.697700 21766 leader_election.cc:290] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 4 election: Requested vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:13.698762 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:13.698966 21691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba35ac74cbe4f5fb913a4dce42aa511" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:13.699535 21618 raft_consensus.cc:3055] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:13.699592 21691 raft_consensus.cc:3060] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:13.699811 21618 raft_consensus.cc:740] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:13.700637 21618 consensus_queue.cc:260] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:13.701678 21618 raft_consensus.cc:3060] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:13.706362 21691 raft_consensus.cc:2468] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 4.
I20260709 13:05:13.707664 21618 raft_consensus.cc:2468] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 4.
I20260709 13:05:13.707966 21732 leader_election.cc:304] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, d37e337da87a45749c7826833fb1b583; no voters: 
I20260709 13:05:13.708922 21912 raft_consensus.cc:2804] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:13.710075 21912 raft_consensus.cc:697] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 4 LEADER]: Becoming Leader. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Running, Role: LEADER
I20260709 13:05:13.711093 21912 consensus_queue.cc:237] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:13.718364 21516 catalog_manager.cc:5697] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 reported cstate change: term changed from 3 to 4, leader changed from 6d9b9a10127e4f088dbe514926357864 (127.20.130.65) to 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67). New cstate: current_term: 4 leader_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:13.948894 21954 raft_consensus.cc:993] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864: : Instructing follower d37e337da87a45749c7826833fb1b583 to start an election
I20260709 13:05:13.949409 21955 raft_consensus.cc:1081] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 4 LEADER]: Signalling peer d37e337da87a45749c7826833fb1b583 to start an election
I20260709 13:05:13.951116 21691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca"
dest_uuid: "d37e337da87a45749c7826833fb1b583"
 from {username='slave'} at 127.0.0.1:46154
I20260709 13:05:13.951622 21691 raft_consensus.cc:493] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.951942 21691 raft_consensus.cc:3060] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:13.957374 21691 raft_consensus.cc:515] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:13.959316 21691 leader_election.cc:290] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 5 election: Requested vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:13.960211 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:13.960467 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e3dfccb13c4df3b898f4fc2fc888ca" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:13.960772 21618 raft_consensus.cc:3055] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:13.961014 21766 raft_consensus.cc:3060] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:13.961135 21618 raft_consensus.cc:740] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:13.961844 21618 consensus_queue.cc:260] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:13.962761 21618 raft_consensus.cc:3060] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:13.966174 21766 raft_consensus.cc:2468] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37e337da87a45749c7826833fb1b583 in term 5.
I20260709 13:05:13.967077 21618 raft_consensus.cc:2468] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37e337da87a45749c7826833fb1b583 in term 5.
I20260709 13:05:13.967558 21657 leader_election.cc:304] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, d37e337da87a45749c7826833fb1b583; no voters: 
I20260709 13:05:13.968428 21926 raft_consensus.cc:2804] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:13.969626 21926 raft_consensus.cc:697] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 5 LEADER]: Becoming Leader. State: Replica: d37e337da87a45749c7826833fb1b583, State: Running, Role: LEADER
I20260709 13:05:13.970532 21926 consensus_queue.cc:237] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:13.977170 21516 catalog_manager.cc:5697] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 reported cstate change: term changed from 4 to 5, leader changed from 6d9b9a10127e4f088dbe514926357864 (127.20.130.65) to d37e337da87a45749c7826833fb1b583 (127.20.130.66). New cstate: current_term: 5 leader_uuid: "d37e337da87a45749c7826833fb1b583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:14.090694 21954 raft_consensus.cc:993] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864: : Instructing follower d37e337da87a45749c7826833fb1b583 to start an election
I20260709 13:05:14.091198 21955 raft_consensus.cc:1081] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Signalling peer d37e337da87a45749c7826833fb1b583 to start an election
I20260709 13:05:14.092895 21691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3d0e027efbb403aa4aeeb5d6b2b90e8"
dest_uuid: "d37e337da87a45749c7826833fb1b583"
 from {username='slave'} at 127.0.0.1:46154
I20260709 13:05:14.093397 21691 raft_consensus.cc:493] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:14.093673 21691 raft_consensus.cc:3060] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.098393 21691 raft_consensus.cc:515] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:14.100039 21691 leader_election.cc:290] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 2 election: Requested vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67:36647)
I20260709 13:05:14.100917 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d0e027efbb403aa4aeeb5d6b2b90e8" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:14.101159 21766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d0e027efbb403aa4aeeb5d6b2b90e8" candidate_uuid: "d37e337da87a45749c7826833fb1b583" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
I20260709 13:05:14.101550 21618 raft_consensus.cc:3055] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:14.101683 21766 raft_consensus.cc:3060] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.101835 21618 raft_consensus.cc:740] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:14.102584 21618 consensus_queue.cc:260] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:14.103528 21618 raft_consensus.cc:3060] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.106180 21766 raft_consensus.cc:2468] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37e337da87a45749c7826833fb1b583 in term 2.
I20260709 13:05:14.107197 21657 leader_election.cc:304] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, d37e337da87a45749c7826833fb1b583; no voters: 
I20260709 13:05:14.108048 21926 raft_consensus.cc:2804] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:14.108255 21618 raft_consensus.cc:2468] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37e337da87a45749c7826833fb1b583 in term 2.
I20260709 13:05:14.108539 21926 raft_consensus.cc:697] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Becoming Leader. State: Replica: d37e337da87a45749c7826833fb1b583, State: Running, Role: LEADER
I20260709 13:05:14.109431 21926 consensus_queue.cc:237] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:14.111241 21618 raft_consensus.cc:1275] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 4 FOLLOWER]: Refusing update from remote peer 2d3491cd12b74f94973e92b6fd0c6e93: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:14.112651 21912 consensus_queue.cc:1048] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:14.115679 21954 raft_consensus.cc:993] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864: : Instructing follower 2d3491cd12b74f94973e92b6fd0c6e93 to start an election
I20260709 13:05:14.116175 21954 raft_consensus.cc:1081] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 3 LEADER]: Signalling peer 2d3491cd12b74f94973e92b6fd0c6e93 to start an election
I20260709 13:05:14.117920 21766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344"
dest_uuid: "2d3491cd12b74f94973e92b6fd0c6e93"
 from {username='slave'} at 127.0.0.1:34184
I20260709 13:05:14.118252 21516 catalog_manager.cc:5697] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 reported cstate change: term changed from 1 to 2, leader changed from 6d9b9a10127e4f088dbe514926357864 (127.20.130.65) to d37e337da87a45749c7826833fb1b583 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "d37e337da87a45749c7826833fb1b583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:14.119292 21766 raft_consensus.cc:493] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:14.119742 21766 raft_consensus.cc:3060] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:14.126538 21766 raft_consensus.cc:515] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:14.132040 21616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6d9b9a10127e4f088dbe514926357864"
I20260709 13:05:14.132953 21616 raft_consensus.cc:3055] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:14.133369 21616 raft_consensus.cc:740] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d9b9a10127e4f088dbe514926357864, State: Running, Role: LEADER
I20260709 13:05:14.134243 21616 consensus_queue.cc:260] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:14.135622 21616 raft_consensus.cc:3060] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:14.141359 21616 raft_consensus.cc:2468] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 4.
I20260709 13:05:14.142395 21766 leader_election.cc:290] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 4 election: Requested vote from peers 6d9b9a10127e4f088dbe514926357864 (127.20.130.65:42345), d37e337da87a45749c7826833fb1b583 (127.20.130.66:45879)
I20260709 13:05:14.143709 21691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e442daca2c46a4896dfa44ed954344" candidate_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d37e337da87a45749c7826833fb1b583"
I20260709 13:05:14.144351 21691 raft_consensus.cc:3060] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:14.144495 21731 leader_election.cc:304] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3491cd12b74f94973e92b6fd0c6e93, 6d9b9a10127e4f088dbe514926357864; no voters: 
I20260709 13:05:14.145607 21956 raft_consensus.cc:2804] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:14.145921 21693 raft_consensus.cc:1275] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 4 FOLLOWER]: Refusing update from remote peer 2d3491cd12b74f94973e92b6fd0c6e93: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:14.146098 21956 raft_consensus.cc:697] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 4 LEADER]: Becoming Leader. State: Replica: 2d3491cd12b74f94973e92b6fd0c6e93, State: Running, Role: LEADER
I20260709 13:05:14.147071 21956 consensus_queue.cc:237] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } }
I20260709 13:05:14.147871 21912 consensus_queue.cc:1048] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:14.152839 21691 raft_consensus.cc:2468] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3491cd12b74f94973e92b6fd0c6e93 in term 4.
I20260709 13:05:14.157877 21516 catalog_manager.cc:5697] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 reported cstate change: term changed from 3 to 4, leader changed from 6d9b9a10127e4f088dbe514926357864 (127.20.130.65) to 2d3491cd12b74f94973e92b6fd0c6e93 (127.20.130.67). New cstate: current_term: 4 leader_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:14.360994 21616 raft_consensus.cc:1275] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 5 FOLLOWER]: Refusing update from remote peer d37e337da87a45749c7826833fb1b583: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:14.362315 21926 consensus_queue.cc:1048] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:14.372047 21766 raft_consensus.cc:1275] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 5 FOLLOWER]: Refusing update from remote peer d37e337da87a45749c7826833fb1b583: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:14.373451 21926 consensus_queue.cc:1048] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:14.566094 21693 raft_consensus.cc:1275] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 4 FOLLOWER]: Refusing update from remote peer 2d3491cd12b74f94973e92b6fd0c6e93: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:14.567524 21912 consensus_queue.cc:1048] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37e337da87a45749c7826833fb1b583" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:14.576532 21616 raft_consensus.cc:1275] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 4 FOLLOWER]: Refusing update from remote peer 2d3491cd12b74f94973e92b6fd0c6e93: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:14.577903 21912 consensus_queue.cc:1048] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:14.600101 21616 raft_consensus.cc:1275] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Refusing update from remote peer d37e337da87a45749c7826833fb1b583: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.601392 21926 consensus_queue.cc:1048] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d9b9a10127e4f088dbe514926357864" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.603499 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:14.615170 21766 raft_consensus.cc:1275] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Refusing update from remote peer d37e337da87a45749c7826833fb1b583: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.617244 21973 consensus_queue.cc:1048] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3491cd12b74f94973e92b6fd0c6e93" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 36647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.618237 21001 tablet_server.cc:179] TabletServer@127.20.130.65:0 shutting down...
I20260709 13:05:14.653698 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:14.654524 21001 tablet_replica.cc:333] T 447f7fcdf8a34d10b0447b2a00801f0a P 6d9b9a10127e4f088dbe514926357864: stopping tablet replica
I20260709 13:05:14.655581 21001 raft_consensus.cc:2243] T 447f7fcdf8a34d10b0447b2a00801f0a P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.656049 21001 raft_consensus.cc:2272] T 447f7fcdf8a34d10b0447b2a00801f0a P 6d9b9a10127e4f088dbe514926357864 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.657868 21001 tablet_replica.cc:333] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864: stopping tablet replica
I20260709 13:05:14.658385 21001 raft_consensus.cc:2243] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.658740 21001 raft_consensus.cc:2272] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.660859 21001 tablet_replica.cc:333] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864: stopping tablet replica
I20260709 13:05:14.661445 21001 raft_consensus.cc:2243] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.662190 21001 raft_consensus.cc:2272] T 64a11d5d07c0435a8f1d7f36c95850ae P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.664126 21001 tablet_replica.cc:333] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864: stopping tablet replica
I20260709 13:05:14.664789 21001 raft_consensus.cc:2243] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.665586 21001 raft_consensus.cc:2272] T 857d094231a549efbfda690583100fb9 P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.667508 21001 tablet_replica.cc:333] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864: stopping tablet replica
I20260709 13:05:14.668033 21001 raft_consensus.cc:2243] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.668936 21001 raft_consensus.cc:2272] T c6fd613927bb4530b775898e65c72430 P 6d9b9a10127e4f088dbe514926357864 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.671281 21001 tablet_replica.cc:333] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864: stopping tablet replica
I20260709 13:05:14.671904 21001 raft_consensus.cc:2243] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.672269 21001 raft_consensus.cc:2272] T b9e3dfccb13c4df3b898f4fc2fc888ca P 6d9b9a10127e4f088dbe514926357864 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.674304 21001 tablet_replica.cc:333] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864: stopping tablet replica
I20260709 13:05:14.674775 21001 raft_consensus.cc:2243] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.675874 21001 raft_consensus.cc:2272] T e08a4be38aa040e193dd87950f066533 P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.677625 21001 tablet_replica.cc:333] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864: stopping tablet replica
I20260709 13:05:14.678050 21001 raft_consensus.cc:2243] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.678413 21001 raft_consensus.cc:2272] T 501a6bde36ca47feb95e4107b57663df P 6d9b9a10127e4f088dbe514926357864 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.680058 21001 tablet_replica.cc:333] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864: stopping tablet replica
I20260709 13:05:14.680460 21001 raft_consensus.cc:2243] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.680787 21001 raft_consensus.cc:2272] T dba35ac74cbe4f5fb913a4dce42aa511 P 6d9b9a10127e4f088dbe514926357864 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.682679 21001 tablet_replica.cc:333] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864: stopping tablet replica
I20260709 13:05:14.683169 21001 raft_consensus.cc:2243] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.683509 21001 raft_consensus.cc:2272] T 55e442daca2c46a4896dfa44ed954344 P 6d9b9a10127e4f088dbe514926357864 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.712462 21001 tablet_server.cc:196] TabletServer@127.20.130.65:0 shutdown complete.
I20260709 13:05:14.731280 21001 tablet_server.cc:179] TabletServer@127.20.130.66:0 shutting down...
I20260709 13:05:14.754412 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:14.755391 21001 tablet_replica.cc:333] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583: stopping tablet replica
I20260709 13:05:14.756345 21001 raft_consensus.cc:2243] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.757026 21001 raft_consensus.cc:2272] T e08a4be38aa040e193dd87950f066533 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.759112 21001 tablet_replica.cc:333] T 447f7fcdf8a34d10b0447b2a00801f0a P d37e337da87a45749c7826833fb1b583: stopping tablet replica
I20260709 13:05:14.759629 21001 raft_consensus.cc:2243] T 447f7fcdf8a34d10b0447b2a00801f0a P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.760073 21001 raft_consensus.cc:2272] T 447f7fcdf8a34d10b0447b2a00801f0a P d37e337da87a45749c7826833fb1b583 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.761781 21001 tablet_replica.cc:333] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583: stopping tablet replica
I20260709 13:05:14.762288 21001 raft_consensus.cc:2243] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.762708 21001 raft_consensus.cc:2272] T 55e442daca2c46a4896dfa44ed954344 P d37e337da87a45749c7826833fb1b583 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.764910 21001 tablet_replica.cc:333] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583: stopping tablet replica
I20260709 13:05:14.765443 21001 raft_consensus.cc:2243] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.765868 21001 raft_consensus.cc:2272] T dba35ac74cbe4f5fb913a4dce42aa511 P d37e337da87a45749c7826833fb1b583 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.767931 21001 tablet_replica.cc:333] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583: stopping tablet replica
I20260709 13:05:14.768441 21001 raft_consensus.cc:2243] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.769146 21001 raft_consensus.cc:2272] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.771044 21001 tablet_replica.cc:333] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583: stopping tablet replica
I20260709 13:05:14.771545 21001 raft_consensus.cc:2243] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.772349 21001 raft_consensus.cc:2272] T 501a6bde36ca47feb95e4107b57663df P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.774161 21001 tablet_replica.cc:333] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583: stopping tablet replica
I20260709 13:05:14.774636 21001 raft_consensus.cc:2243] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.775413 21001 raft_consensus.cc:2272] T b9e3dfccb13c4df3b898f4fc2fc888ca P d37e337da87a45749c7826833fb1b583 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.777197 21001 tablet_replica.cc:333] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583: stopping tablet replica
I20260709 13:05:14.777631 21001 raft_consensus.cc:2243] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.777976 21001 raft_consensus.cc:2272] T c6fd613927bb4530b775898e65c72430 P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.779636 21001 tablet_replica.cc:333] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583: stopping tablet replica
I20260709 13:05:14.780040 21001 raft_consensus.cc:2243] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.780402 21001 raft_consensus.cc:2272] T 857d094231a549efbfda690583100fb9 P d37e337da87a45749c7826833fb1b583 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.782035 21001 tablet_replica.cc:333] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583: stopping tablet replica
I20260709 13:05:14.782433 21001 raft_consensus.cc:2243] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.782784 21001 raft_consensus.cc:2272] T 64a11d5d07c0435a8f1d7f36c95850ae P d37e337da87a45749c7826833fb1b583 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.811892 21001 tablet_server.cc:196] TabletServer@127.20.130.66:0 shutdown complete.
I20260709 13:05:14.831626 21001 tablet_server.cc:179] TabletServer@127.20.130.67:0 shutting down...
I20260709 13:05:14.858213 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:14.859079 21001 tablet_replica.cc:333] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93: stopping tablet replica
I20260709 13:05:14.859686 21001 raft_consensus.cc:2243] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.860183 21001 raft_consensus.cc:2272] T e08a4be38aa040e193dd87950f066533 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.861915 21001 tablet_replica.cc:333] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93: stopping tablet replica
I20260709 13:05:14.862430 21001 raft_consensus.cc:2243] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.862849 21001 raft_consensus.cc:2272] T d3d0e027efbb403aa4aeeb5d6b2b90e8 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.865186 21001 tablet_replica.cc:333] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93: stopping tablet replica
I20260709 13:05:14.865741 21001 raft_consensus.cc:2243] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.866160 21001 raft_consensus.cc:2272] T 501a6bde36ca47feb95e4107b57663df P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.867921 21001 tablet_replica.cc:333] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93: stopping tablet replica
I20260709 13:05:14.868451 21001 raft_consensus.cc:2243] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.868853 21001 raft_consensus.cc:2272] T 857d094231a549efbfda690583100fb9 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.870484 21001 tablet_replica.cc:333] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93: stopping tablet replica
I20260709 13:05:14.871065 21001 raft_consensus.cc:2243] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.871515 21001 raft_consensus.cc:2272] T 64a11d5d07c0435a8f1d7f36c95850ae P 2d3491cd12b74f94973e92b6fd0c6e93 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.873196 21001 tablet_replica.cc:333] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93: stopping tablet replica
I20260709 13:05:14.873713 21001 raft_consensus.cc:2243] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.874426 21001 raft_consensus.cc:2272] T 447f7fcdf8a34d10b0447b2a00801f0a P 2d3491cd12b74f94973e92b6fd0c6e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.876116 21001 tablet_replica.cc:333] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93: stopping tablet replica
I20260709 13:05:14.876607 21001 raft_consensus.cc:2243] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.877028 21001 raft_consensus.cc:2272] T c6fd613927bb4530b775898e65c72430 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.878787 21001 tablet_replica.cc:333] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93: stopping tablet replica
I20260709 13:05:14.879345 21001 raft_consensus.cc:2243] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:14.879779 21001 raft_consensus.cc:2272] T b9e3dfccb13c4df3b898f4fc2fc888ca P 2d3491cd12b74f94973e92b6fd0c6e93 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.881790 21001 tablet_replica.cc:333] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93: stopping tablet replica
I20260709 13:05:14.882280 21001 raft_consensus.cc:2243] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.883049 21001 raft_consensus.cc:2272] T 55e442daca2c46a4896dfa44ed954344 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.884969 21001 tablet_replica.cc:333] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93: stopping tablet replica
I20260709 13:05:14.885442 21001 raft_consensus.cc:2243] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.886129 21001 raft_consensus.cc:2272] T dba35ac74cbe4f5fb913a4dce42aa511 P 2d3491cd12b74f94973e92b6fd0c6e93 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.914708 21001 tablet_server.cc:196] TabletServer@127.20.130.67:0 shutdown complete.
I20260709 13:05:14.935314 21001 master.cc:562] Master@127.20.130.126:45921 shutting down...
I20260709 13:05:14.955837 21001 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:14.956399 21001 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:14.956765 21001 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6d88b635c7044a8d98780e7e8bafff3a: stopping tablet replica
I20260709 13:05:14.993957 21001 master.cc:584] Master@127.20.130.126:45921 shutdown complete.
2d3491cd12b74f94973e92b6fd0c6e93  1
6d9b9a10127e4f088dbe514926357864  5
d37e337da87a45749c7826833fb1b583  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10529 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:05:15.034905 21001 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.130.126:34457
I20260709 13:05:15.036041 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:15.042680 21982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:15.042691 21980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:15.042733 21979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:15.043215 21001 server_base.cc:1061] running on GCE node
I20260709 13:05:15.044443 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:15.044627 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:15.044739 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602315044727 us; error 0 us; skew 500 ppm
I20260709 13:05:15.045200 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:15.047617 21001 webserver.cc:533] Webserver started at http://127.20.130.126:40361/ using document root <none> and password file <none>
I20260709 13:05:15.048058 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:15.048218 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:15.048441 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:15.049486 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/master-0-root/instance:
uuid: "7bace290edae4f6bba4eb0d6a5b7d8c9"
format_stamp: "Formatted at 2026-07-09 13:05:15 on dist-test-slave-csvd"
I20260709 13:05:15.054109 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:05:15.057749 21987 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:15.058610 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:15.058944 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/master-0-root
uuid: "7bace290edae4f6bba4eb0d6a5b7d8c9"
format_stamp: "Formatted at 2026-07-09 13:05:15 on dist-test-slave-csvd"
I20260709 13:05:15.059239 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:15.069828 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:15.071147 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:15.108798 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.126:34457
I20260709 13:05:15.108903 22038 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.126:34457 every 8 connection(s)
I20260709 13:05:15.112833 22039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.122627 22039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9: Bootstrap starting.
I20260709 13:05:15.127564 22039 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.131980 22039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9: No bootstrap required, opened a new log
I20260709 13:05:15.134097 22039 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bace290edae4f6bba4eb0d6a5b7d8c9" member_type: VOTER }
I20260709 13:05:15.134477 22039 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.134747 22039 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bace290edae4f6bba4eb0d6a5b7d8c9, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.135334 22039 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bace290edae4f6bba4eb0d6a5b7d8c9" member_type: VOTER }
I20260709 13:05:15.135779 22039 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:15.135993 22039 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:15.136270 22039 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.140481 22039 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bace290edae4f6bba4eb0d6a5b7d8c9" member_type: VOTER }
I20260709 13:05:15.141052 22039 leader_election.cc:304] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7bace290edae4f6bba4eb0d6a5b7d8c9; no voters: 
I20260709 13:05:15.142274 22039 leader_election.cc:290] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:15.142707 22042 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.144315 22042 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [term 1 LEADER]: Becoming Leader. State: Replica: 7bace290edae4f6bba4eb0d6a5b7d8c9, State: Running, Role: LEADER
I20260709 13:05:15.145165 22039 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:15.145102 22042 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bace290edae4f6bba4eb0d6a5b7d8c9" member_type: VOTER }
I20260709 13:05:15.150724 22043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7bace290edae4f6bba4eb0d6a5b7d8c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bace290edae4f6bba4eb0d6a5b7d8c9" member_type: VOTER } }
I20260709 13:05:15.150974 22044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7bace290edae4f6bba4eb0d6a5b7d8c9. Latest consensus state: current_term: 1 leader_uuid: "7bace290edae4f6bba4eb0d6a5b7d8c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bace290edae4f6bba4eb0d6a5b7d8c9" member_type: VOTER } }
I20260709 13:05:15.151607 22043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:15.151634 22044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:15.154560 22050 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:15.162649 22050 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:15.163625 21001 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:15.171788 22050 catalog_manager.cc:1383] Generated new cluster ID: c2a71e8964fb4badb6de78daf72cccfd
I20260709 13:05:15.172097 22050 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:15.214500 22050 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:15.215808 22050 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:15.229794 22050 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9: Generated new TSK 0
I20260709 13:05:15.230409 22050 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:15.294546 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:15.301054 22060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:15.302204 22061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:15.303840 22063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:15.304476 21001 server_base.cc:1061] running on GCE node
I20260709 13:05:15.305343 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:15.305568 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:15.305734 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602315305713 us; error 0 us; skew 500 ppm
I20260709 13:05:15.306249 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:15.308718 21001 webserver.cc:533] Webserver started at http://127.20.130.65:35923/ using document root <none> and password file <none>
I20260709 13:05:15.309280 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:15.309511 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:15.309832 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:15.311075 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/instance:
uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
format_stamp: "Formatted at 2026-07-09 13:05:15 on dist-test-slave-csvd"
I20260709 13:05:15.315778 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:05:15.319300 22068 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:15.320144 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:15.320465 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root
uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
format_stamp: "Formatted at 2026-07-09 13:05:15 on dist-test-slave-csvd"
I20260709 13:05:15.320722 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:15.338212 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:15.339483 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:15.340899 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:15.343140 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:15.343317 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:15.343607 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:15.343786 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:15.384469 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.65:33421
I20260709 13:05:15.384563 22130 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.65:33421 every 8 connection(s)
I20260709 13:05:15.389379 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:15.397265 22135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:15.398358 22136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:15.401278 21001 server_base.cc:1061] running on GCE node
W20260709 13:05:15.401163 22138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:15.402906 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:15.403215 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:15.403401 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602315403383 us; error 0 us; skew 500 ppm
I20260709 13:05:15.404150 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:15.407829 21001 webserver.cc:533] Webserver started at http://127.20.130.66:36469/ using document root <none> and password file <none>
I20260709 13:05:15.408478 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:15.408731 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:15.408849 22131 heartbeater.cc:344] Connected to a master server at 127.20.130.126:34457
I20260709 13:05:15.409068 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:15.409287 22131 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:15.410024 22131 heartbeater.cc:507] Master 127.20.130.126:34457 requested a full tablet report, sending...
I20260709 13:05:15.410440 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/instance:
uuid: "79683575881f4334bd4dc6d9bdbb45c3"
format_stamp: "Formatted at 2026-07-09 13:05:15 on dist-test-slave-csvd"
I20260709 13:05:15.412135 22004 ts_manager.cc:194] Registered new tserver with Master: c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:15.413872 22004 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40924
I20260709 13:05:15.415418 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:05:15.419059 22143 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:15.419836 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:15.420138 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root
uuid: "79683575881f4334bd4dc6d9bdbb45c3"
format_stamp: "Formatted at 2026-07-09 13:05:15 on dist-test-slave-csvd"
I20260709 13:05:15.420445 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:15.437469 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:15.438822 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:15.440326 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:15.442538 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:15.442770 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:15.443029 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:15.443207 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:15.483877 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.66:42399
I20260709 13:05:15.483999 22205 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.66:42399 every 8 connection(s)
I20260709 13:05:15.488582 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:15.496445 22210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:15.497370 22209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:15.498440 21001 server_base.cc:1061] running on GCE node
W20260709 13:05:15.498541 22212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:15.499840 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:15.500041 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:15.500265 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602315500231 us; error 0 us; skew 500 ppm
I20260709 13:05:15.500818 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:15.503715 22206 heartbeater.cc:344] Connected to a master server at 127.20.130.126:34457
I20260709 13:05:15.503854 21001 webserver.cc:533] Webserver started at http://127.20.130.67:46719/ using document root <none> and password file <none>
I20260709 13:05:15.504230 22206 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:15.504498 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:15.504740 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:15.505012 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:15.505136 22206 heartbeater.cc:507] Master 127.20.130.126:34457 requested a full tablet report, sending...
I20260709 13:05:15.506300 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-2-root/instance:
uuid: "765d912bde9e48959e50d9efec3c26b6"
format_stamp: "Formatted at 2026-07-09 13:05:15 on dist-test-slave-csvd"
I20260709 13:05:15.507548 22004 ts_manager.cc:194] Registered new tserver with Master: 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:15.509332 22004 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40934
I20260709 13:05:15.512163 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.008s
I20260709 13:05:15.515477 22217 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:15.516266 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:15.516556 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-2-root
uuid: "765d912bde9e48959e50d9efec3c26b6"
format_stamp: "Formatted at 2026-07-09 13:05:15 on dist-test-slave-csvd"
I20260709 13:05:15.516819 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:15.532743 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:15.533905 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:15.535370 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:15.537617 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:15.537803 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:15.538059 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:15.538259 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:15.581823 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.67:42273
I20260709 13:05:15.581923 22279 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.67:42273 every 8 connection(s)
I20260709 13:05:15.596158 22280 heartbeater.cc:344] Connected to a master server at 127.20.130.126:34457
I20260709 13:05:15.596541 22280 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:15.597402 22280 heartbeater.cc:507] Master 127.20.130.126:34457 requested a full tablet report, sending...
I20260709 13:05:15.599417 22004 ts_manager.cc:194] Registered new tserver with Master: 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:15.599711 21001 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01480726s
I20260709 13:05:15.601187 22004 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40946
I20260709 13:05:15.627436 22004 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40960:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:15.633737 22004 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:15.839092 22245 tablet_service.cc:1511] Processing CreateTablet for tablet 16e48ec055f940c49e01d5a5d77581aa (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:15.840622 22245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16e48ec055f940c49e01d5a5d77581aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.844004 22244 tablet_service.cc:1511] Processing CreateTablet for tablet 2f8d3d512e804f4bbd58ae1baf74c000 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:15.845472 22244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f8d3d512e804f4bbd58ae1baf74c000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.848126 22243 tablet_service.cc:1511] Processing CreateTablet for tablet 5d6633743ea44146a5164f64185db9a6 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:15.849539 22243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d6633743ea44146a5164f64185db9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.852101 22242 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4e641637cf41118865c96aec55b340 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:15.853466 22242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4e641637cf41118865c96aec55b340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.855361 22241 tablet_service.cc:1511] Processing CreateTablet for tablet 9be7e328170d4837bbaade0fb02dead2 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:15.856812 22241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be7e328170d4837bbaade0fb02dead2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.857461 22240 tablet_service.cc:1511] Processing CreateTablet for tablet 62d62f92be1345e38ad2eeb98d958d91 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:15.860430 22239 tablet_service.cc:1511] Processing CreateTablet for tablet efc23a012ae0497797e82803613f3835 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:15.861002 22238 tablet_service.cc:1511] Processing CreateTablet for tablet ee2b1eeb3bb341638b56bf74c37e2045 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:15.862833 22240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d62f92be1345e38ad2eeb98d958d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.863876 22238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee2b1eeb3bb341638b56bf74c37e2045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.864986 22239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc23a012ae0497797e82803613f3835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.866849 22237 tablet_service.cc:1511] Processing CreateTablet for tablet 5ed3b0d7588c4652991dbe99eb204ae2 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:15.868796 22237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed3b0d7588c4652991dbe99eb204ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.885496 22171 tablet_service.cc:1511] Processing CreateTablet for tablet 16e48ec055f940c49e01d5a5d77581aa (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:15.887006 22171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16e48ec055f940c49e01d5a5d77581aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.892426 22170 tablet_service.cc:1511] Processing CreateTablet for tablet 2f8d3d512e804f4bbd58ae1baf74c000 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:15.893877 22170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f8d3d512e804f4bbd58ae1baf74c000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.896073 22236 tablet_service.cc:1511] Processing CreateTablet for tablet cbe9d18a693340a29f852081a41a74f1 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:15.895709 22240 tablet_service.cc:1511] Processing CreateTablet for tablet 9c6cd0878342413eb24e0e69b3a96aa0 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:15.897756 22236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe9d18a693340a29f852081a41a74f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.900228 22169 tablet_service.cc:1511] Processing CreateTablet for tablet 5d6633743ea44146a5164f64185db9a6 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:15.901702 22169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d6633743ea44146a5164f64185db9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.904714 22168 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4e641637cf41118865c96aec55b340 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:15.906584 22168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4e641637cf41118865c96aec55b340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.908252 22166 tablet_service.cc:1511] Processing CreateTablet for tablet 62d62f92be1345e38ad2eeb98d958d91 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:15.909595 22166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d62f92be1345e38ad2eeb98d958d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.912160 22167 tablet_service.cc:1511] Processing CreateTablet for tablet 9be7e328170d4837bbaade0fb02dead2 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:15.913650 22167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be7e328170d4837bbaade0fb02dead2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.918015 22096 tablet_service.cc:1511] Processing CreateTablet for tablet 16e48ec055f940c49e01d5a5d77581aa (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:15.919471 22096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16e48ec055f940c49e01d5a5d77581aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.919857 22165 tablet_service.cc:1511] Processing CreateTablet for tablet efc23a012ae0497797e82803613f3835 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:15.921155 22165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc23a012ae0497797e82803613f3835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.924880 22164 tablet_service.cc:1511] Processing CreateTablet for tablet ee2b1eeb3bb341638b56bf74c37e2045 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:15.926472 22164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee2b1eeb3bb341638b56bf74c37e2045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.928515 22163 tablet_service.cc:1511] Processing CreateTablet for tablet 5ed3b0d7588c4652991dbe99eb204ae2 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:15.929982 22163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed3b0d7588c4652991dbe99eb204ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.928418 22095 tablet_service.cc:1511] Processing CreateTablet for tablet 2f8d3d512e804f4bbd58ae1baf74c000 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:15.931085 22094 tablet_service.cc:1511] Processing CreateTablet for tablet 5d6633743ea44146a5164f64185db9a6 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:15.931773 22095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f8d3d512e804f4bbd58ae1baf74c000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.932494 22094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d6633743ea44146a5164f64185db9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.934320 22162 tablet_service.cc:1511] Processing CreateTablet for tablet cbe9d18a693340a29f852081a41a74f1 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:15.935734 22162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe9d18a693340a29f852081a41a74f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.940613 22093 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4e641637cf41118865c96aec55b340 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:15.942081 22093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4e641637cf41118865c96aec55b340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.958119 22092 tablet_service.cc:1511] Processing CreateTablet for tablet 9be7e328170d4837bbaade0fb02dead2 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:15.959760 22092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be7e328170d4837bbaade0fb02dead2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.967674 22091 tablet_service.cc:1511] Processing CreateTablet for tablet 62d62f92be1345e38ad2eeb98d958d91 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:15.969154 22091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d62f92be1345e38ad2eeb98d958d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.985514 22241 tablet_service.cc:1511] Processing CreateTablet for tablet 57adaf54eaf24c778165ac40cc629c38 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:15.985203 22238 tablet_service.cc:1511] Processing CreateTablet for tablet 79d645cd970b4b2789be5374cc2005aa (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:15.988288 22237 tablet_service.cc:1511] Processing CreateTablet for tablet 9235083e4800460ca0b4619abda2917b (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:15.993422 22245 tablet_service.cc:1511] Processing CreateTablet for tablet 7e0f44b43c1a477e9c7c66c034c8844a (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:15.994700 22245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e0f44b43c1a477e9c7c66c034c8844a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.000348 22244 tablet_service.cc:1511] Processing CreateTablet for tablet 38574701043e46cb978340cb6753faae (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:16.001675 22244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38574701043e46cb978340cb6753faae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.008677 22238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d645cd970b4b2789be5374cc2005aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.009882 22240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6cd0878342413eb24e0e69b3a96aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.016644 22237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9235083e4800460ca0b4619abda2917b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.017382 22241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57adaf54eaf24c778165ac40cc629c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.006183 22243 tablet_service.cc:1511] Processing CreateTablet for tablet 77137a3a1cee4b55ae36e0a368f7e363 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:16.035686 22089 tablet_service.cc:1511] Processing CreateTablet for tablet ee2b1eeb3bb341638b56bf74c37e2045 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:16.041394 22089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee2b1eeb3bb341638b56bf74c37e2045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.035511 22090 tablet_service.cc:1511] Processing CreateTablet for tablet efc23a012ae0497797e82803613f3835 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:16.043988 22090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc23a012ae0497797e82803613f3835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.077170 22088 tablet_service.cc:1511] Processing CreateTablet for tablet 5ed3b0d7588c4652991dbe99eb204ae2 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:16.080582 22087 tablet_service.cc:1511] Processing CreateTablet for tablet cbe9d18a693340a29f852081a41a74f1 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:16.083392 22088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed3b0d7588c4652991dbe99eb204ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.097894 22295 tablet_bootstrap.cc:492] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:16.098071 22243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77137a3a1cee4b55ae36e0a368f7e363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.102152 22091 tablet_service.cc:1511] Processing CreateTablet for tablet d38b6e6d2d3741e9b61d5a743ca099a2 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:16.103401 22297 tablet_bootstrap.cc:492] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:16.108237 22166 tablet_service.cc:1511] Processing CreateTablet for tablet 38574701043e46cb978340cb6753faae (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:16.109642 22166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38574701043e46cb978340cb6753faae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.110041 22236 tablet_service.cc:1511] Processing CreateTablet for tablet bbbed7673fb44214a4548960bdacf99b (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:16.110841 22087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe9d18a693340a29f852081a41a74f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.125746 22167 tablet_service.cc:1511] Processing CreateTablet for tablet 9235083e4800460ca0b4619abda2917b (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:16.128407 22239 tablet_service.cc:1511] Processing CreateTablet for tablet f27e0e0f167848adb3889027a46ee857 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:16.112761 22236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbbed7673fb44214a4548960bdacf99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.138073 22242 tablet_service.cc:1511] Processing CreateTablet for tablet c80e8c56632c46d9a35c63a2ca8a532f (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:16.147979 22092 tablet_service.cc:1511] Processing CreateTablet for tablet 57adaf54eaf24c778165ac40cc629c38 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:16.150215 22167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9235083e4800460ca0b4619abda2917b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.124347 22164 tablet_service.cc:1511] Processing CreateTablet for tablet 9c6cd0878342413eb24e0e69b3a96aa0 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:16.155905 22164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6cd0878342413eb24e0e69b3a96aa0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:16.157464 22052 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:16.160447 22162 tablet_service.cc:1511] Processing CreateTablet for tablet 79d645cd970b4b2789be5374cc2005aa (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:16.161803 22162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d645cd970b4b2789be5374cc2005aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.161990 22094 tablet_service.cc:1511] Processing CreateTablet for tablet 9c6cd0878342413eb24e0e69b3a96aa0 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:16.130873 22237 tablet_service.cc:1511] Processing CreateTablet for tablet 688b3a79146a41e2b683e0642b986d9a (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:16.168637 22169 tablet_service.cc:1511] Processing CreateTablet for tablet 57adaf54eaf24c778165ac40cc629c38 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:16.170650 22169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57adaf54eaf24c778165ac40cc629c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.169737 22295 tablet_bootstrap.cc:654] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.172570 22168 tablet_service.cc:1511] Processing CreateTablet for tablet 7e0f44b43c1a477e9c7c66c034c8844a (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:16.173849 22168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e0f44b43c1a477e9c7c66c034c8844a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.179458 22091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d38b6e6d2d3741e9b61d5a743ca099a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.190856 22165 tablet_service.cc:1511] Processing CreateTablet for tablet 77137a3a1cee4b55ae36e0a368f7e363 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:16.192535 22165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77137a3a1cee4b55ae36e0a368f7e363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.208494 22092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57adaf54eaf24c778165ac40cc629c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.209861 22089 tablet_service.cc:1511] Processing CreateTablet for tablet 79d645cd970b4b2789be5374cc2005aa (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:16.213186 22093 tablet_service.cc:1511] Processing CreateTablet for tablet 9235083e4800460ca0b4619abda2917b (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:16.215341 22096 tablet_service.cc:1511] Processing CreateTablet for tablet 7e0f44b43c1a477e9c7c66c034c8844a (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:16.217417 22095 tablet_service.cc:1511] Processing CreateTablet for tablet 38574701043e46cb978340cb6753faae (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:16.219754 22089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d645cd970b4b2789be5374cc2005aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.219483 22090 tablet_service.cc:1511] Processing CreateTablet for tablet 77137a3a1cee4b55ae36e0a368f7e363 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:16.223332 22094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6cd0878342413eb24e0e69b3a96aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.225912 22092 tablet_service.cc:1511] Processing CreateTablet for tablet 688b3a79146a41e2b683e0642b986d9a (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:16.226263 22171 tablet_service.cc:1511] Processing CreateTablet for tablet f27e0e0f167848adb3889027a46ee857 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:16.227221 22092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 688b3a79146a41e2b683e0642b986d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.228075 22171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27e0e0f167848adb3889027a46ee857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.228193 22090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77137a3a1cee4b55ae36e0a368f7e363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.231268 22095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38574701043e46cb978340cb6753faae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.231601 22239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27e0e0f167848adb3889027a46ee857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.233120 22241 tablet_service.cc:1511] Processing CreateTablet for tablet 394d042ced1042eb99ada43cc8ab55ba (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:16.234371 22241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394d042ced1042eb99ada43cc8ab55ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.236034 22297 tablet_bootstrap.cc:700] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent opening tablet: real 0.128s	user 0.002s	sys 0.000s
I20260709 13:05:16.236872 22297 tablet_bootstrap.cc:654] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.237181 22240 tablet_service.cc:1511] Processing CreateTablet for tablet 6b85b002ea7945719057edb66d543287 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:16.238503 22240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b85b002ea7945719057edb66d543287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.240815 22245 tablet_service.cc:1511] Processing CreateTablet for tablet 00e5bf29367f432285b4e873ecccea9e (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:16.241861 22096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e0f44b43c1a477e9c7c66c034c8844a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.241964 22242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c80e8c56632c46d9a35c63a2ca8a532f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.247084 22237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 688b3a79146a41e2b683e0642b986d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.237181 22236 tablet_service.cc:1511] Processing CreateTablet for tablet 0232d828f8664f348df823432990379b (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:16.251053 22236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0232d828f8664f348df823432990379b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.251816 22088 tablet_service.cc:1511] Processing CreateTablet for tablet bbbed7673fb44214a4548960bdacf99b (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:16.255432 22093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9235083e4800460ca0b4619abda2917b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.256991 22245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e5bf29367f432285b4e873ecccea9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.238631 22238 tablet_service.cc:1511] Processing CreateTablet for tablet f5e8334eaf044d0ba6d7817e7e9b2fd9 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:16.267159 22238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5e8334eaf044d0ba6d7817e7e9b2fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.267822 22169 tablet_service.cc:1511] Processing CreateTablet for tablet bbbed7673fb44214a4548960bdacf99b (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:16.268460 22244 tablet_service.cc:1511] Processing CreateTablet for tablet d38b6e6d2d3741e9b61d5a743ca099a2 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:16.265817 22164 tablet_service.cc:1511] Processing CreateTablet for tablet 394d042ced1042eb99ada43cc8ab55ba (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:16.281076 22088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbbed7673fb44214a4548960bdacf99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.282480 22296 tablet_bootstrap.cc:492] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:16.283094 22295 tablet_bootstrap.cc:492] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:16.283576 22295 ts_tablet_manager.cc:1403] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.187s	user 0.048s	sys 0.018s
I20260709 13:05:16.290944 22094 tablet_service.cc:1511] Processing CreateTablet for tablet f27e0e0f167848adb3889027a46ee857 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:16.291498 22169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbbed7673fb44214a4548960bdacf99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.292268 22094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27e0e0f167848adb3889027a46ee857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.296959 22244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d38b6e6d2d3741e9b61d5a743ca099a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.286592 22295 raft_consensus.cc:359] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:16.310808 22295 raft_consensus.cc:385] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.310576 22091 tablet_service.cc:1511] Processing CreateTablet for tablet c80e8c56632c46d9a35c63a2ca8a532f (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:16.312186 22091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c80e8c56632c46d9a35c63a2ca8a532f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.311220 22295 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.316927 22089 tablet_service.cc:1511] Processing CreateTablet for tablet 6b85b002ea7945719057edb66d543287 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:16.318833 22089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b85b002ea7945719057edb66d543287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.322500 22296 tablet_bootstrap.cc:654] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.326704 22088 tablet_service.cc:1511] Processing CreateTablet for tablet 0232d828f8664f348df823432990379b (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:16.328190 22088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0232d828f8664f348df823432990379b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.347560 22163 tablet_service.cc:1511] Processing CreateTablet for tablet 688b3a79146a41e2b683e0642b986d9a (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:16.345415 22094 tablet_service.cc:1511] Processing CreateTablet for tablet f5e8334eaf044d0ba6d7817e7e9b2fd9 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:16.350831 22094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5e8334eaf044d0ba6d7817e7e9b2fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.351501 22164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394d042ced1042eb99ada43cc8ab55ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.371471 22170 tablet_service.cc:1511] Processing CreateTablet for tablet c80e8c56632c46d9a35c63a2ca8a532f (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:16.376320 22165 tablet_service.cc:1511] Processing CreateTablet for tablet 6b85b002ea7945719057edb66d543287 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:16.377373 22297 tablet_bootstrap.cc:492] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:16.377969 22297 ts_tablet_manager.cc:1403] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.281s	user 0.015s	sys 0.000s
I20260709 13:05:16.378829 22091 tablet_service.cc:1511] Processing CreateTablet for tablet 00e5bf29367f432285b4e873ecccea9e (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:16.380134 22091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e5bf29367f432285b4e873ecccea9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.369016 22092 tablet_service.cc:1511] Processing CreateTablet for tablet 394d042ced1042eb99ada43cc8ab55ba (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:16.390857 22088 tablet_service.cc:1511] Processing CreateTablet for tablet dd0d86a3e0d843d0a468840a4f90cbf4 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:16.354653 22243 tablet_service.cc:1511] Processing CreateTablet for tablet dd0d86a3e0d843d0a468840a4f90cbf4 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:16.411782 22243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd0d86a3e0d843d0a468840a4f90cbf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.413240 22091 tablet_service.cc:1511] Processing CreateTablet for tablet ebf4c9a0fe314a8db203637fffd1dc52 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:16.364338 22295 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:16.416563 22131 heartbeater.cc:499] Master 127.20.130.126:34457 was elected leader, sending a full tablet report...
I20260709 13:05:16.419495 22239 tablet_service.cc:1511] Processing CreateTablet for tablet ebf4c9a0fe314a8db203637fffd1dc52 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:16.420794 22239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebf4c9a0fe314a8db203637fffd1dc52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.429296 22245 tablet_service.cc:1511] Processing CreateTablet for tablet a37c5a7045b24e5f8f89b17248cb9529 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:16.433583 22167 tablet_service.cc:1511] Processing CreateTablet for tablet f5e8334eaf044d0ba6d7817e7e9b2fd9 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:16.437726 22168 tablet_service.cc:1511] Processing CreateTablet for tablet 00e5bf29367f432285b4e873ecccea9e (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:16.395186 22163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 688b3a79146a41e2b683e0642b986d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.392731 22092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394d042ced1042eb99ada43cc8ab55ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.397840 22166 tablet_service.cc:1511] Processing CreateTablet for tablet 0232d828f8664f348df823432990379b (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:16.456391 22166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0232d828f8664f348df823432990379b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.457674 22087 tablet_service.cc:1511] Processing CreateTablet for tablet 7a567384a18d40a09c5a3e09e6c15ef6 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:16.459424 22170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c80e8c56632c46d9a35c63a2ca8a532f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.440697 22245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a37c5a7045b24e5f8f89b17248cb9529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.447252 22088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd0d86a3e0d843d0a468840a4f90cbf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.474766 22165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b85b002ea7945719057edb66d543287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.479420 22096 tablet_service.cc:1511] Processing CreateTablet for tablet db1364cdaa794f9fb4739365dc79d393 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:16.481312 22168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e5bf29367f432285b4e873ecccea9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.422006 22238 tablet_service.cc:1511] Processing CreateTablet for tablet db1364cdaa794f9fb4739365dc79d393 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:16.483076 22238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1364cdaa794f9fb4739365dc79d393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.490280 22167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5e8334eaf044d0ba6d7817e7e9b2fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.491050 22087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a567384a18d40a09c5a3e09e6c15ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.400877 22297 raft_consensus.cc:359] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:16.495209 22297 raft_consensus.cc:385] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.495674 22297 raft_consensus.cc:740] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.496883 22297 consensus_queue.cc:260] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:16.501895 22162 tablet_service.cc:1511] Processing CreateTablet for tablet dd0d86a3e0d843d0a468840a4f90cbf4 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:16.503348 22162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd0d86a3e0d843d0a468840a4f90cbf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.508600 22296 tablet_bootstrap.cc:492] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:16.509122 22296 ts_tablet_manager.cc:1403] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.227s	user 0.043s	sys 0.056s
I20260709 13:05:16.513824 22206 heartbeater.cc:499] Master 127.20.130.126:34457 was elected leader, sending a full tablet report...
I20260709 13:05:16.522703 22241 tablet_service.cc:1511] Processing CreateTablet for tablet c42ecdbc6a0d4ed88048a3ea9bc6b893 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:16.524008 22241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42ecdbc6a0d4ed88048a3ea9bc6b893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.515301 22280 heartbeater.cc:499] Master 127.20.130.126:34457 was elected leader, sending a full tablet report...
I20260709 13:05:16.519423 22244 tablet_service.cc:1511] Processing CreateTablet for tablet 7a567384a18d40a09c5a3e09e6c15ef6 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:16.528309 22096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1364cdaa794f9fb4739365dc79d393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.528278 22244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a567384a18d40a09c5a3e09e6c15ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.398823 22094 tablet_service.cc:1511] Processing CreateTablet for tablet d958965f6f1e46f7917ee6e8a28078ba (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:16.390872 22236 tablet_service.cc:1511] Processing CreateTablet for tablet d958965f6f1e46f7917ee6e8a28078ba (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:16.546728 22296 raft_consensus.cc:359] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:16.547716 22296 raft_consensus.cc:385] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.548048 22296 raft_consensus.cc:740] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.548949 22296 consensus_queue.cc:260] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:16.553001 22163 tablet_service.cc:1511] Processing CreateTablet for tablet d38b6e6d2d3741e9b61d5a743ca099a2 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:16.554909 22240 tablet_service.cc:1511] Processing CreateTablet for tablet f79004ff583f4b278afa2453c7088bf7 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:16.556219 22240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f79004ff583f4b278afa2453c7088bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.558233 22163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d38b6e6d2d3741e9b61d5a743ca099a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.560122 22295 ts_tablet_manager.cc:1434] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.276s	user 0.025s	sys 0.034s
I20260709 13:05:16.561427 22295 tablet_bootstrap.cc:492] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:16.551082 22091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebf4c9a0fe314a8db203637fffd1dc52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.561522 22242 tablet_service.cc:1511] Processing CreateTablet for tablet 96aa7e0b91bf482db9b8977df7574baf (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:16.563912 22243 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1a2136ffa84255b65c2f9037b0e55d (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:16.565431 22090 tablet_service.cc:1511] Processing CreateTablet for tablet c42ecdbc6a0d4ed88048a3ea9bc6b893 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:16.572602 22237 tablet_service.cc:1511] Processing CreateTablet for tablet 252049d2bcdd4f329ca5015bf10c1b19 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:16.562832 22171 tablet_service.cc:1511] Processing CreateTablet for tablet d958965f6f1e46f7917ee6e8a28078ba (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:16.575780 22171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d958965f6f1e46f7917ee6e8a28078ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.581068 22245 tablet_service.cc:1511] Processing CreateTablet for tablet b53b5061ddba43b7ae5a93ea344b61ca (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:16.584088 22297 ts_tablet_manager.cc:1434] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.206s	user 0.010s	sys 0.005s
I20260709 13:05:16.585083 22297 tablet_bootstrap.cc:492] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:16.585013 22162 tablet_service.cc:1511] Processing CreateTablet for tablet ebf4c9a0fe314a8db203637fffd1dc52 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:16.586421 22162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebf4c9a0fe314a8db203637fffd1dc52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.563839 22242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96aa7e0b91bf482db9b8977df7574baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.587689 22243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1a2136ffa84255b65c2f9037b0e55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.552235 22239 tablet_service.cc:1511] Processing CreateTablet for tablet 00aee6f5c28c45b0841b480190d2c555 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:16.562884 22094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d958965f6f1e46f7917ee6e8a28078ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.452261 22093 tablet_service.cc:1511] Processing CreateTablet for tablet a37c5a7045b24e5f8f89b17248cb9529 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:16.588847 22090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42ecdbc6a0d4ed88048a3ea9bc6b893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.589594 22093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a37c5a7045b24e5f8f89b17248cb9529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.590562 22169 tablet_service.cc:1511] Processing CreateTablet for tablet db1364cdaa794f9fb4739365dc79d393 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:16.591895 22169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1364cdaa794f9fb4739365dc79d393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.588644 22239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00aee6f5c28c45b0841b480190d2c555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.597695 22095 tablet_service.cc:1511] Processing CreateTablet for tablet 00aee6f5c28c45b0841b480190d2c555 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:16.598992 22089 tablet_service.cc:1511] Processing CreateTablet for tablet 96aa7e0b91bf482db9b8977df7574baf (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:16.601498 22164 tablet_service.cc:1511] Processing CreateTablet for tablet a37c5a7045b24e5f8f89b17248cb9529 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:16.602846 22164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a37c5a7045b24e5f8f89b17248cb9529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.611579 22296 ts_tablet_manager.cc:1434] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.102s	user 0.008s	sys 0.005s
I20260709 13:05:16.617981 22092 tablet_service.cc:1511] Processing CreateTablet for tablet f79004ff583f4b278afa2453c7088bf7 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:16.622865 22170 tablet_service.cc:1511] Processing CreateTablet for tablet 7a567384a18d40a09c5a3e09e6c15ef6 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:16.624341 22170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a567384a18d40a09c5a3e09e6c15ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.627856 22296 tablet_bootstrap.cc:492] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:16.629793 22295 tablet_bootstrap.cc:654] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.639060 22095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00aee6f5c28c45b0841b480190d2c555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.639750 22089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96aa7e0b91bf482db9b8977df7574baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.643115 22096 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1a2136ffa84255b65c2f9037b0e55d (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:16.597711 22245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53b5061ddba43b7ae5a93ea344b61ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.648342 22236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d958965f6f1e46f7917ee6e8a28078ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.651252 22237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252049d2bcdd4f329ca5015bf10c1b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.654810 22301 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.655414 22301 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:16.639703 22165 tablet_service.cc:1511] Processing CreateTablet for tablet 96aa7e0b91bf482db9b8977df7574baf (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:16.670437 22169 tablet_service.cc:1511] Processing CreateTablet for tablet c42ecdbc6a0d4ed88048a3ea9bc6b893 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:16.684697 22088 tablet_service.cc:1511] Processing CreateTablet for tablet b53b5061ddba43b7ae5a93ea344b61ca (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:16.687712 22239 tablet_service.cc:1511] Processing CreateTablet for tablet 931a6490a0ea49419e07ac75f5c84030 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:16.689272 22239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931a6490a0ea49419e07ac75f5c84030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.699651 22297 tablet_bootstrap.cc:654] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.664686 22301 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:16.710551 22168 tablet_service.cc:1511] Processing CreateTablet for tablet f79004ff583f4b278afa2453c7088bf7 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:16.713085 22163 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1a2136ffa84255b65c2f9037b0e55d (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:16.715842 22163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1a2136ffa84255b65c2f9037b0e55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.730547 22238 tablet_service.cc:1511] Processing CreateTablet for tablet ea960f06fa1940d49afea738c7cd0e94 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:16.731372 22165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96aa7e0b91bf482db9b8977df7574baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.731980 22238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea960f06fa1940d49afea738c7cd0e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.735220 22168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f79004ff583f4b278afa2453c7088bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.705597 22092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f79004ff583f4b278afa2453c7088bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.754127 22239 tablet_service.cc:1511] Processing CreateTablet for tablet 5d674bb7c45c407e8aa9767c7438a39e (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:16.755090 22167 tablet_service.cc:1511] Processing CreateTablet for tablet 00aee6f5c28c45b0841b480190d2c555 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:16.755774 22239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d674bb7c45c407e8aa9767c7438a39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.756569 22167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00aee6f5c28c45b0841b480190d2c555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.793002 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:05:16.795375 22218 leader_election.cc:343] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.795710 22087 tablet_service.cc:1511] Processing CreateTablet for tablet 931a6490a0ea49419e07ac75f5c84030 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:16.798653 22093 tablet_service.cc:1511] Processing CreateTablet for tablet ea960f06fa1940d49afea738c7cd0e94 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:16.800786 22168 tablet_service.cc:1511] Processing CreateTablet for tablet 931a6490a0ea49419e07ac75f5c84030 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:16.807677 22169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42ecdbc6a0d4ed88048a3ea9bc6b893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.813076 22088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53b5061ddba43b7ae5a93ea344b61ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.822844 22166 tablet_service.cc:1511] Processing CreateTablet for tablet b53b5061ddba43b7ae5a93ea344b61ca (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:16.823807 22303 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.824369 22303 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:16.826521 22240 tablet_service.cc:1511] Processing CreateTablet for tablet 0911b6e64ffb48bd9fc4968f8f52860c (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:16.774587 22091 tablet_service.cc:1511] Processing CreateTablet for tablet 252049d2bcdd4f329ca5015bf10c1b19 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:16.833884 22236 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac896e940b543ae8dc989463d3c33a8 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:16.843727 22091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252049d2bcdd4f329ca5015bf10c1b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.823673 22242 tablet_service.cc:1511] Processing CreateTablet for tablet ef905e474cc543dc9b0f2de05a3807c6 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:16.859366 22303 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:16.839823 22168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931a6490a0ea49419e07ac75f5c84030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.869972 22295 tablet_bootstrap.cc:492] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:16.870167 22236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac896e940b543ae8dc989463d3c33a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.870524 22295 ts_tablet_manager.cc:1403] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.309s	user 0.011s	sys 0.010s
I20260709 13:05:16.873559 22295 raft_consensus.cc:359] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:16.874298 22295 raft_consensus.cc:385] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.874601 22295 raft_consensus.cc:740] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.875530 22240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0911b6e64ffb48bd9fc4968f8f52860c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.846665 22162 tablet_service.cc:1511] Processing CreateTablet for tablet 252049d2bcdd4f329ca5015bf10c1b19 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:16.879770 22244 tablet_service.cc:1511] Processing CreateTablet for tablet 6617a460ae364f94b826785a9e77ec86 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:16.886966 22242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef905e474cc543dc9b0f2de05a3807c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.887275 22297 tablet_bootstrap.cc:492] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:16.887804 22297 ts_tablet_manager.cc:1403] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.303s	user 0.009s	sys 0.036s
I20260709 13:05:16.879817 22096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1a2136ffa84255b65c2f9037b0e55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.896222 22241 tablet_service.cc:1511] Processing CreateTablet for tablet 663cabb59b2041f98e811d0b49faf5da (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:16.897655 22241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663cabb59b2041f98e811d0b49faf5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.901275 22237 tablet_service.cc:1511] Processing CreateTablet for tablet 5f9abb5a83ca4007a03cd4613544f2eb (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:16.902707 22237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9abb5a83ca4007a03cd4613544f2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.908036 22243 tablet_service.cc:1511] Processing CreateTablet for tablet 116931ff9e08478dadc7bdc9e917454a (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:16.908792 22171 tablet_service.cc:1511] Processing CreateTablet for tablet ea960f06fa1940d49afea738c7cd0e94 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:16.911767 22093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea960f06fa1940d49afea738c7cd0e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.916589 22091 tablet_service.cc:1511] Processing CreateTablet for tablet ef905e474cc543dc9b0f2de05a3807c6 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:16.890566 22297 raft_consensus.cc:359] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:05:16.927320 22297 raft_consensus.cc:385] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.927690 22297 raft_consensus.cc:740] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.928969 22243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 116931ff9e08478dadc7bdc9e917454a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.930946 22087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931a6490a0ea49419e07ac75f5c84030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.931820 22244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6617a460ae364f94b826785a9e77ec86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.935312 22245 tablet_service.cc:1511] Processing CreateTablet for tablet 0f980cc59e6c41d7b5d29d438419c0d1 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:16.937019 22245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f980cc59e6c41d7b5d29d438419c0d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.902410 22094 tablet_service.cc:1511] Processing CreateTablet for tablet 5d674bb7c45c407e8aa9767c7438a39e (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:16.941871 22296 tablet_bootstrap.cc:654] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.934239 22091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef905e474cc543dc9b0f2de05a3807c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.971266 22094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d674bb7c45c407e8aa9767c7438a39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.978899 22302 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.979507 22302 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:16.984287 22302 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:16.987926 22166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53b5061ddba43b7ae5a93ea344b61ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.982867 22295 consensus_queue.cc:260] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:16.982357 22297 consensus_queue.cc:260] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:05:17.005676 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:17.025178 22164 tablet_service.cc:1511] Processing CreateTablet for tablet 5d674bb7c45c407e8aa9767c7438a39e (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:17.015297 22162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252049d2bcdd4f329ca5015bf10c1b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.040278 22169 tablet_service.cc:1511] Processing CreateTablet for tablet ef905e474cc543dc9b0f2de05a3807c6 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:17.051702 22297 ts_tablet_manager.cc:1434] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.164s	user 0.007s	sys 0.013s
I20260709 13:05:17.052882 22297 tablet_bootstrap.cc:492] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:17.063264 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:17.063890 22295 ts_tablet_manager.cc:1434] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.193s	user 0.007s	sys 0.001s
W20260709 13:05:17.064994 22071 leader_election.cc:343] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.069747 22090 tablet_service.cc:1511] Processing CreateTablet for tablet 6617a460ae364f94b826785a9e77ec86 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:17.075021 22163 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac896e940b543ae8dc989463d3c33a8 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:17.077695 22171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea960f06fa1940d49afea738c7cd0e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.064939 22295 tablet_bootstrap.cc:492] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:17.023048 22092 tablet_service.cc:1511] Processing CreateTablet for tablet 0911b6e64ffb48bd9fc4968f8f52860c (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:17.079397 22164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d674bb7c45c407e8aa9767c7438a39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.080029 22092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0911b6e64ffb48bd9fc4968f8f52860c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.080861 22169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef905e474cc543dc9b0f2de05a3807c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.083894 22090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6617a460ae364f94b826785a9e77ec86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.088701 22302 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.089677 22302 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:05:17.091874 22302 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:17.095692 22170 tablet_service.cc:1511] Processing CreateTablet for tablet 0911b6e64ffb48bd9fc4968f8f52860c (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:17.095889 22167 tablet_service.cc:1511] Processing CreateTablet for tablet 6617a460ae364f94b826785a9e77ec86 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:17.111085 22093 tablet_service.cc:1511] Processing CreateTablet for tablet 116931ff9e08478dadc7bdc9e917454a (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:17.112512 22093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 116931ff9e08478dadc7bdc9e917454a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.116602 22163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac896e940b543ae8dc989463d3c33a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.120635 22236 tablet_service.cc:1511] Processing CreateTablet for tablet 6b965624a67d4adb87e9787782f1715c (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:17.120884 22242 tablet_service.cc:1511] Processing CreateTablet for tablet 03ed5952f28c46d8b66e87a9d1b03981 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:17.120666 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:17.122133 22236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b965624a67d4adb87e9787782f1715c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.123237 22242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ed5952f28c46d8b66e87a9d1b03981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.123996 22165 tablet_service.cc:1511] Processing CreateTablet for tablet 116931ff9e08478dadc7bdc9e917454a (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:17.139708 22089 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac896e940b543ae8dc989463d3c33a8 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:17.140969 22089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac896e940b543ae8dc989463d3c33a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.128403 22240 tablet_service.cc:1511] Processing CreateTablet for tablet 8f5e08d4c24545e18b620e33800d39d3 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:17.130213 22297 tablet_bootstrap.cc:654] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:17.131116 22220 leader_election.cc:343] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.134538 22095 tablet_service.cc:1511] Processing CreateTablet for tablet 5f9abb5a83ca4007a03cd4613544f2eb (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:05:17.135974 22072 leader_election.cc:343] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.136976 22295 tablet_bootstrap.cc:654] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.146834 22072 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:17.151335 22240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f5e08d4c24545e18b620e33800d39d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.151505 22303 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.151350 22167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6617a460ae364f94b826785a9e77ec86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.157917 22165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 116931ff9e08478dadc7bdc9e917454a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.159255 22170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0911b6e64ffb48bd9fc4968f8f52860c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:17.163475 22052 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:17.167001 22094 tablet_service.cc:1511] Processing CreateTablet for tablet 0f980cc59e6c41d7b5d29d438419c0d1 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:17.177320 22088 tablet_service.cc:1511] Processing CreateTablet for tablet 663cabb59b2041f98e811d0b49faf5da (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:17.180518 22243 tablet_service.cc:1511] Processing CreateTablet for tablet 383c9bd275674f7d8d5cdf16a1456960 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:17.224066 22096 tablet_service.cc:1511] Processing CreateTablet for tablet 6f8407607d7441c7bdac45e1dadc700d (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:17.165464 22220 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:17.224848 22243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383c9bd275674f7d8d5cdf16a1456960. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:17.225507 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 123148us
I20260709 13:05:17.227217 22301 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.227530 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:17.228128 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:17.191963 22241 tablet_service.cc:1511] Processing CreateTablet for tablet 6f8407607d7441c7bdac45e1dadc700d (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:17.229723 22241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8407607d7441c7bdac45e1dadc700d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.231328 22166 tablet_service.cc:1511] Processing CreateTablet for tablet 03ed5952f28c46d8b66e87a9d1b03981 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:17.232648 22166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ed5952f28c46d8b66e87a9d1b03981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.195041 22169 tablet_service.cc:1511] Processing CreateTablet for tablet 663cabb59b2041f98e811d0b49faf5da (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:17.235764 22169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663cabb59b2041f98e811d0b49faf5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.237926 22163 tablet_service.cc:1511] Processing CreateTablet for tablet 8f5e08d4c24545e18b620e33800d39d3 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:17.196750 22162 tablet_service.cc:1511] Processing CreateTablet for tablet 5f9abb5a83ca4007a03cd4613544f2eb (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:17.199813 22167 tablet_service.cc:1511] Processing CreateTablet for tablet 0f980cc59e6c41d7b5d29d438419c0d1 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:17.200438 22296 tablet_bootstrap.cc:492] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:17.239655 22296 ts_tablet_manager.cc:1403] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.612s	user 0.020s	sys 0.010s
W20260709 13:05:17.240854 22147 leader_election.cc:343] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:17.241566 22147 leader_election.cc:343] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.169116 22245 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3869ae617b42c89768d68043d44be2 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:17.223654 22095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9abb5a83ca4007a03cd4613544f2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.224063 22087 tablet_service.cc:1511] Processing CreateTablet for tablet 6b965624a67d4adb87e9787782f1715c (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:17.207141 22165 tablet_service.cc:1511] Processing CreateTablet for tablet 6b965624a67d4adb87e9787782f1715c (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:17.249464 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:17.249931 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:17.242692 22296 raft_consensus.cc:359] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:17.251317 22144 leader_election.cc:343] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.251798 22144 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:17.251587 22168 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3869ae617b42c89768d68043d44be2 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:17.251643 22296 raft_consensus.cc:385] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.254364 22302 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.257952 22088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663cabb59b2041f98e811d0b49faf5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.258653 22087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b965624a67d4adb87e9787782f1715c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:17.255354 22144 leader_election.cc:343] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.259440 22144 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:17.260546 22302 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.264629 22096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8407607d7441c7bdac45e1dadc700d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.254351 22296 raft_consensus.cc:740] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.267256 22094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f980cc59e6c41d7b5d29d438419c0d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.267617 22296 consensus_queue.cc:260] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.269797 22296 ts_tablet_manager.cc:1434] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:05:17.273974 22240 tablet_service.cc:1511] Processing CreateTablet for tablet 12ac70b72e5d452ca6dd020f9ccb0541 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:17.275341 22240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ac70b72e5d452ca6dd020f9ccb0541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.277411 22295 tablet_bootstrap.cc:492] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:17.278323 22295 ts_tablet_manager.cc:1403] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.214s	user 0.010s	sys 0.014s
I20260709 13:05:17.256982 22163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f5e08d4c24545e18b620e33800d39d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.292493 22162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9abb5a83ca4007a03cd4613544f2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.293360 22167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f980cc59e6c41d7b5d29d438419c0d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.294313 22168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3869ae617b42c89768d68043d44be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.294767 22171 tablet_service.cc:1511] Processing CreateTablet for tablet 6f8407607d7441c7bdac45e1dadc700d (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:17.298401 22171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8407607d7441c7bdac45e1dadc700d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.301409 22165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b965624a67d4adb87e9787782f1715c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.283890 22089 tablet_service.cc:1511] Processing CreateTablet for tablet 03ed5952f28c46d8b66e87a9d1b03981 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:17.302592 22089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ed5952f28c46d8b66e87a9d1b03981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.307022 22245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3869ae617b42c89768d68043d44be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.312096 22091 tablet_service.cc:1511] Processing CreateTablet for tablet 8f5e08d4c24545e18b620e33800d39d3 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:17.313469 22091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f5e08d4c24545e18b620e33800d39d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.315183 22296 tablet_bootstrap.cc:492] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:17.291319 22243 tablet_service.cc:1511] Processing CreateTablet for tablet 6d938b9c784244a59de8b48c3136eb3f (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:17.327003 22171 tablet_service.cc:1511] Processing CreateTablet for tablet 12ac70b72e5d452ca6dd020f9ccb0541 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:17.331341 22171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ac70b72e5d452ca6dd020f9ccb0541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.328058 22243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d938b9c784244a59de8b48c3136eb3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.332173 22087 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3869ae617b42c89768d68043d44be2 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:17.329948 22164 tablet_service.cc:1511] Processing CreateTablet for tablet 6d938b9c784244a59de8b48c3136eb3f (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:17.334213 22087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3869ae617b42c89768d68043d44be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.334230 22164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d938b9c784244a59de8b48c3136eb3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.338862 22090 tablet_service.cc:1511] Processing CreateTablet for tablet 383c9bd275674f7d8d5cdf16a1456960 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:17.340689 22090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383c9bd275674f7d8d5cdf16a1456960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.322841 22170 tablet_service.cc:1511] Processing CreateTablet for tablet 383c9bd275674f7d8d5cdf16a1456960 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:17.355000 22170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383c9bd275674f7d8d5cdf16a1456960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.373786 22296 tablet_bootstrap.cc:654] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.390838 22087 tablet_service.cc:1511] Processing CreateTablet for tablet 12ac70b72e5d452ca6dd020f9ccb0541 (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:17.391940 22297 tablet_bootstrap.cc:492] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:17.392238 22087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ac70b72e5d452ca6dd020f9ccb0541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.392423 22297 ts_tablet_manager.cc:1403] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.340s	user 0.010s	sys 0.015s
I20260709 13:05:17.393473 22295 raft_consensus.cc:359] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.394285 22295 raft_consensus.cc:385] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.394620 22295 raft_consensus.cc:740] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.395463 22297 raft_consensus.cc:359] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.396224 22297 raft_consensus.cc:385] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.396545 22297 raft_consensus.cc:740] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.397336 22297 consensus_queue.cc:260] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.400305 22092 tablet_service.cc:1511] Processing CreateTablet for tablet 6d938b9c784244a59de8b48c3136eb3f (DEFAULT_TABLE table=test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:17.415951 22092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d938b9c784244a59de8b48c3136eb3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.395488 22295 consensus_queue.cc:260] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.418701 22295 ts_tablet_manager.cc:1434] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.140s	user 0.006s	sys 0.002s
I20260709 13:05:17.429996 22295 tablet_bootstrap.cc:492] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:17.420246 22297 ts_tablet_manager.cc:1434] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.005s
I20260709 13:05:17.435849 22297 tablet_bootstrap.cc:492] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:17.449769 22301 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.450459 22301 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.454246 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:17.454331 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:17.454805 22301 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:17.455035 22105 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:17.456660 22181 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:17.457032 22218 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:17.458879 22301 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.459254 22301 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.459602 22301 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.459789 22295 tablet_bootstrap.cc:654] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.468927 22296 tablet_bootstrap.cc:492] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:17.469476 22296 ts_tablet_manager.cc:1403] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.178s	user 0.016s	sys 0.025s
I20260709 13:05:17.473187 22296 raft_consensus.cc:359] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.473977 22296 raft_consensus.cc:385] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.474303 22296 raft_consensus.cc:740] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.475096 22296 consensus_queue.cc:260] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.478426 22301 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.480063 22296 ts_tablet_manager.cc:1434] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:05:17.481180 22296 tablet_bootstrap.cc:492] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:17.485280 22297 tablet_bootstrap.cc:654] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.490223 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:17.490872 22105 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.487107 22295 tablet_bootstrap.cc:492] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:17.487177 22296 tablet_bootstrap.cc:654] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.495718 22295 ts_tablet_manager.cc:1403] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.000s
I20260709 13:05:17.506765 22105 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:17.508284 22218 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:17.509442 22295 raft_consensus.cc:359] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.510303 22296 tablet_bootstrap.cc:492] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:17.502635 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:17.501261 22301 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:17.510812 22181 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.511351 22296 ts_tablet_manager.cc:1403] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 13:05:17.514254 22296 raft_consensus.cc:359] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.510250 22295 raft_consensus.cc:385] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.516276 22295 raft_consensus.cc:740] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.517207 22301 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.517067 22295 consensus_queue.cc:260] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.517671 22301 raft_consensus.cc:697] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:17.518313 22297 tablet_bootstrap.cc:492] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:17.518639 22296 raft_consensus.cc:385] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.518569 22301 consensus_queue.cc:237] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.519013 22297 ts_tablet_manager.cc:1403] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.083s	user 0.007s	sys 0.014s
I20260709 13:05:17.519073 22296 raft_consensus.cc:740] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.520103 22296 consensus_queue.cc:260] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.522039 22181 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:17.522697 22297 raft_consensus.cc:359] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.523440 22297 raft_consensus.cc:385] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.523720 22297 raft_consensus.cc:740] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.524518 22297 consensus_queue.cc:260] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.524086 22296 ts_tablet_manager.cc:1434] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:05:17.526082 22296 tablet_bootstrap.cc:492] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:17.527138 22297 ts_tablet_manager.cc:1434] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:05:17.528537 22297 tablet_bootstrap.cc:492] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:17.533649 22324 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.534173 22324 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.536448 22324 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:17.537307 22297 tablet_bootstrap.cc:654] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.543397 22296 tablet_bootstrap.cc:654] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.553306 22303 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.554061 22303 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.558274 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:17.559295 22180 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:17.559513 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:17.560329 22181 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:17.561194 22071 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:17.563187 22220 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:17.564255 22324 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.564673 22324 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.565069 22324 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.569602 22303 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:17.571091 22303 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.572461 22303 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.573015 22303 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.575299 22297 tablet_bootstrap.cc:492] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:17.575151 22324 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.575924 22297 ts_tablet_manager.cc:1403] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.024s
I20260709 13:05:17.576855 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:17.577507 22105 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:17.579183 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:17.579759 22181 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.580469 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:17.581136 22255 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:17.580955 22297 raft_consensus.cc:359] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.581875 22297 raft_consensus.cc:385] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.579828 22295 ts_tablet_manager.cc:1434] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.076s	user 0.014s	sys 0.012s
I20260709 13:05:17.582252 22297 raft_consensus.cc:740] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.582908 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:17.583204 22295 tablet_bootstrap.cc:492] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:17.583496 22105 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.583362 22297 consensus_queue.cc:260] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.588704 22297 ts_tablet_manager.cc:1434] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:05:17.589792 22297 tablet_bootstrap.cc:492] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:17.590386 22295 tablet_bootstrap.cc:654] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.591017 22105 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:17.578001 22324 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:17.593822 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:17.596618 22002 catalog_manager.cc:5697] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.599125 22324 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.599643 22324 raft_consensus.cc:697] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:17.600456 22324 consensus_queue.cc:237] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.604628 22181 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:17.605048 22296 tablet_bootstrap.cc:492] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:17.605530 22296 ts_tablet_manager.cc:1403] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.006s
I20260709 13:05:17.609174 22297 tablet_bootstrap.cc:654] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.608960 22296 raft_consensus.cc:359] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.609719 22296 raft_consensus.cc:385] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.610023 22296 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.610720 22296 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:17.611747 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 50728.3us
I20260709 13:05:17.613026 22296 ts_tablet_manager.cc:1434] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:05:17.616688 22303 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.618841 22296 tablet_bootstrap.cc:492] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:17.620847 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:17.621618 22181 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.621799 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:17.622408 22255 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.625061 22295 tablet_bootstrap.cc:492] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:17.625622 22295 ts_tablet_manager.cc:1403] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.007s
I20260709 13:05:17.629688 22181 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:17.630002 22255 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:17.631342 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:17.632220 22303 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:17.632835 22303 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.633206 22303 raft_consensus.cc:697] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:17.633936 22303 consensus_queue.cc:237] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.636643 22296 tablet_bootstrap.cc:654] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.638432 22297 tablet_bootstrap.cc:492] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:17.638978 22297 ts_tablet_manager.cc:1403] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.007s
I20260709 13:05:17.629729 22295 raft_consensus.cc:359] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.639971 22295 raft_consensus.cc:385] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.640269 22295 raft_consensus.cc:740] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.641124 22295 consensus_queue.cc:260] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.641976 22297 raft_consensus.cc:359] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.642679 22297 raft_consensus.cc:385] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.642998 22297 raft_consensus.cc:740] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.643378 22295 ts_tablet_manager.cc:1434] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.002s
I20260709 13:05:17.643723 22297 consensus_queue.cc:260] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.644357 22295 tablet_bootstrap.cc:492] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:17.648114 22297 ts_tablet_manager.cc:1434] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:05:17.649205 22297 tablet_bootstrap.cc:492] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:17.650372 22302 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.650846 22302 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.652915 22302 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:17.654107 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:17.654958 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:17.656095 22144 leader_election.cc:343] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:17.657182 22147 leader_election.cc:343] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.657634 22147 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:17.658800 22302 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.659507 22297 tablet_bootstrap.cc:654] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.662302 22296 tablet_bootstrap.cc:492] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:17.663381 22296 ts_tablet_manager.cc:1403] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.010s
I20260709 13:05:17.644196 22003 catalog_manager.cc:5697] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.666477 22296 raft_consensus.cc:359] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:05:17.667233 22296 raft_consensus.cc:385] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.667511 22296 raft_consensus.cc:740] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.668375 22296 consensus_queue.cc:260] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:05:17.671754 22295 tablet_bootstrap.cc:654] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.673728 22296 ts_tablet_manager.cc:1434] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:05:17.675287 22296 tablet_bootstrap.cc:492] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:17.676991 22297 tablet_bootstrap.cc:492] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:17.677479 22297 ts_tablet_manager.cc:1403] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.009s
I20260709 13:05:17.680644 22297 raft_consensus.cc:359] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.681419 22297 raft_consensus.cc:385] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.681811 22297 raft_consensus.cc:740] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.682758 22297 consensus_queue.cc:260] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.685667 22297 ts_tablet_manager.cc:1434] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:17.686859 22297 tablet_bootstrap.cc:492] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:17.687768 22296 tablet_bootstrap.cc:654] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.690016 22295 tablet_bootstrap.cc:492] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:17.690478 22295 ts_tablet_manager.cc:1403] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.001s
I20260709 13:05:17.693732 22297 tablet_bootstrap.cc:654] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.693326 22295 raft_consensus.cc:359] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:05:17.695106 22295 raft_consensus.cc:385] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.695554 22295 raft_consensus.cc:740] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.696499 22295 consensus_queue.cc:260] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:05:17.699533 22295 ts_tablet_manager.cc:1434] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:17.700737 22295 tablet_bootstrap.cc:492] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:17.702909 22296 tablet_bootstrap.cc:492] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:17.703528 22296 ts_tablet_manager.cc:1403] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.007s
I20260709 13:05:17.704793 22302 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.705451 22302 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.706815 22296 raft_consensus.cc:359] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.707484 22295 tablet_bootstrap.cc:654] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.707752 22296 raft_consensus.cc:385] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.708132 22296 raft_consensus.cc:740] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.708964 22296 consensus_queue.cc:260] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.712105 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:17.712165 22003 catalog_manager.cc:5697] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.709312 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:17.713629 22105 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:17.714869 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:05:17.717060 22147 leader_election.cc:343] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.710595 22302 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:17.719210 22297 tablet_bootstrap.cc:492] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:17.720566 22297 ts_tablet_manager.cc:1403] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.011s
I20260709 13:05:17.720016 22296 ts_tablet_manager.cc:1434] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.005s
I20260709 13:05:17.719278 22302 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.721899 22302 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.722374 22302 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.723004 22296 tablet_bootstrap.cc:492] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:17.728790 22297 raft_consensus.cc:359] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.729493 22297 raft_consensus.cc:385] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.729779 22297 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.730511 22297 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.732554 22297 ts_tablet_manager.cc:1434] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:05:17.732584 22296 tablet_bootstrap.cc:654] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.733493 22297 tablet_bootstrap.cc:492] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:17.739435 22297 tablet_bootstrap.cc:654] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.744306 22295 tablet_bootstrap.cc:492] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:17.744763 22295 ts_tablet_manager.cc:1403] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.030s
I20260709 13:05:17.747005 22295 raft_consensus.cc:359] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.747759 22295 raft_consensus.cc:385] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.748468 22295 raft_consensus.cc:740] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.749612 22296 tablet_bootstrap.cc:492] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:17.749327 22295 consensus_queue.cc:260] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.750165 22296 ts_tablet_manager.cc:1403] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.009s
I20260709 13:05:17.751837 22295 ts_tablet_manager.cc:1434] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:05:17.752789 22295 tablet_bootstrap.cc:492] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:17.752826 22296 raft_consensus.cc:359] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.753654 22296 raft_consensus.cc:385] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.753959 22296 raft_consensus.cc:740] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.754763 22296 consensus_queue.cc:260] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.758049 22297 tablet_bootstrap.cc:492] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:17.759548 22295 tablet_bootstrap.cc:654] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.760322 22297 ts_tablet_manager.cc:1403] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.012s
I20260709 13:05:17.760916 22302 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.759826 22296 ts_tablet_manager.cc:1434] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:17.763083 22296 tablet_bootstrap.cc:492] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:17.763209 22297 raft_consensus.cc:359] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.763922 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:05:17.765733 22147 leader_election.cc:343] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.763929 22297 raft_consensus.cc:385] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.766544 22297 raft_consensus.cc:740] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.767201 22297 consensus_queue.cc:260] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.769095 22297 ts_tablet_manager.cc:1434] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:05:17.769943 22297 tablet_bootstrap.cc:492] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
W20260709 13:05:17.771834 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 57053.6us
I20260709 13:05:17.773469 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:17.774061 22105 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.775540 22297 tablet_bootstrap.cc:654] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.780597 22296 tablet_bootstrap.cc:654] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.798525 22324 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.799472 22302 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:17.799401 22324 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.803015 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:17.803272 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:17.803686 22106 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:17.805039 22218 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:17.805460 22324 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:17.805956 22301 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.798431 22105 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:17.806708 22301 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.807145 22301 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.807647 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:05:17.808481 22220 leader_election.cc:343] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.808768 22302 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.810083 22302 raft_consensus.cc:697] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:17.806731 22296 tablet_bootstrap.cc:492] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:17.811062 22302 consensus_queue.cc:237] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.812150 22297 tablet_bootstrap.cc:492] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:17.812599 22297 ts_tablet_manager.cc:1403] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.023s
I20260709 13:05:17.812165 22296 ts_tablet_manager.cc:1403] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.002s
I20260709 13:05:17.815215 22297 raft_consensus.cc:359] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.815898 22297 raft_consensus.cc:385] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.816197 22297 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.816987 22297 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.817750 22301 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.815686 22296 raft_consensus.cc:359] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.821113 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:17.821355 22296 raft_consensus.cc:385] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.819311 22297 ts_tablet_manager.cc:1434] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:17.821825 22105 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.821743 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:17.822875 22297 tablet_bootstrap.cc:492] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
W20260709 13:05:17.823494 22220 leader_election.cc:343] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.821765 22296 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.824925 22296 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.819978 22324 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.820115 22301 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:17.829371 22105 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:17.821014 22295 tablet_bootstrap.cc:492] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:17.829260 22004 catalog_manager.cc:5697] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.830219 22295 ts_tablet_manager.cc:1403] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.078s	user 0.024s	sys 0.022s
I20260709 13:05:17.830693 22218 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:17.831132 22296 ts_tablet_manager.cc:1434] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:05:17.831898 22301 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.832141 22296 tablet_bootstrap.cc:492] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:17.832382 22301 raft_consensus.cc:697] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:17.833030 22295 raft_consensus.cc:359] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.833212 22301 consensus_queue.cc:237] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.833590 22303 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.829540 22324 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.834173 22303 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:05:17.836158 22324 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:17.836278 22303 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:17.833727 22295 raft_consensus.cc:385] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.836944 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:17.837284 22295 raft_consensus.cc:740] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.837679 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:17.838109 22295 consensus_queue.cc:260] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.838418 22181 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
W20260709 13:05:17.839829 22218 leader_election.cc:343] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.840344 22295 ts_tablet_manager.cc:1434] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:17.840370 22220 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:17.840945 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:17.841387 22295 tablet_bootstrap.cc:492] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:17.841580 22255 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:17.841948 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:17.842523 22181 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:17.842795 22326 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.843182 22326 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.843592 22326 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.847255 22071 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:17.848876 22303 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.849624 22303 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.850054 22303 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.851619 22296 tablet_bootstrap.cc:654] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.853104 22326 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.855439 22295 tablet_bootstrap.cc:654] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.829264 22297 tablet_bootstrap.cc:654] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.856300 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:05:17.857671 22218 leader_election.cc:343] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.860916 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:17.861104 22303 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:05:17.861557 22181 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.862444 22326 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:17.870201 22181 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:17.871632 22220 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:17.873241 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:17.873914 22255 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.874284 22303 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:17.875279 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:17.875859 22181 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.876390 22004 catalog_manager.cc:5697] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.881745 22255 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:17.882301 22295 tablet_bootstrap.cc:492] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:17.882622 22301 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.882795 22295 ts_tablet_manager.cc:1403] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.007s
I20260709 13:05:17.883212 22181 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:17.883783 22072 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:17.884666 22303 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.885109 22303 raft_consensus.cc:697] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:17.885459 22296 tablet_bootstrap.cc:492] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:17.885907 22296 ts_tablet_manager.cc:1403] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.007s
I20260709 13:05:17.886013 22303 consensus_queue.cc:237] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:05:17.887882 22295 raft_consensus.cc:359] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.888546 22295 raft_consensus.cc:385] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.888463 22296 raft_consensus.cc:359] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.888890 22295 raft_consensus.cc:740] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.889190 22296 raft_consensus.cc:385] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.889503 22296 raft_consensus.cc:740] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.889714 22295 consensus_queue.cc:260] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.883819 22301 raft_consensus.cc:697] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:17.891517 22297 tablet_bootstrap.cc:492] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:17.892021 22297 ts_tablet_manager.cc:1403] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.000s
I20260709 13:05:17.891445 22301 consensus_queue.cc:237] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.892354 22295 ts_tablet_manager.cc:1434] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:17.893307 22295 tablet_bootstrap.cc:492] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:17.894793 22297 raft_consensus.cc:359] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.896618 22297 raft_consensus.cc:385] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.896888 22297 raft_consensus.cc:740] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.897615 22297 consensus_queue.cc:260] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.899115 22295 tablet_bootstrap.cc:654] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.899621 22297 ts_tablet_manager.cc:1434] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:17.900873 22296 consensus_queue.cc:260] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.901273 22297 tablet_bootstrap.cc:492] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:17.903029 22296 ts_tablet_manager.cc:1434] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:05:17.903963 22296 tablet_bootstrap.cc:492] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:17.904042 22004 catalog_manager.cc:5697] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.911077 22302 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.911602 22302 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.911885 22296 tablet_bootstrap.cc:654] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.913664 22302 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:17.920703 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:17.922910 22147 leader_election.cc:343] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.923841 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:17.924522 22105 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:17.925810 22144 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:17.927102 22346 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.927554 22346 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.929664 22346 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:17.930130 22346 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.930464 22346 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.932868 22297 tablet_bootstrap.cc:654] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.935108 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:17.937069 22147 leader_election.cc:343] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.938271 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:17.939388 22105 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:17.930773 22346 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.944748 22297 tablet_bootstrap.cc:492] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:17.910023 22002 catalog_manager.cc:5697] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.945267 22297 ts_tablet_manager.cc:1403] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.000s
I20260709 13:05:17.947402 22144 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:17.948624 22302 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.948551 22297 raft_consensus.cc:359] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.949101 22302 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.949361 22297 raft_consensus.cc:385] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.949534 22302 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.949693 22297 raft_consensus.cc:740] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.950567 22297 consensus_queue.cc:260] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.956996 22301 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:17.960055 22297 ts_tablet_manager.cc:1434] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:05:17.965565 22297 tablet_bootstrap.cc:492] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:17.971762 22297 tablet_bootstrap.cc:654] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:17.977263 22358 log.cc:927] Time spent T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:05:17.985968 22346 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.986840 22297 tablet_bootstrap.cc:492] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:17.987322 22297 ts_tablet_manager.cc:1403] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 13:05:17.989637 22302 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.990095 22297 raft_consensus.cc:359] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.990765 22297 raft_consensus.cc:385] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.991091 22297 raft_consensus.cc:740] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.991912 22297 consensus_queue.cc:260] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:17.996876 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:17.997516 22105 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.006382 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:05:18.008033 22147 leader_election.cc:343] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.009397 22297 ts_tablet_manager.cc:1434] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:05:18.010561 22297 tablet_bootstrap.cc:492] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:18.014005 22303 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.015069 22303 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.018024 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:18.019183 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:18.019804 22106 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.018878 22181 raft_consensus.cc:2393] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 1: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:05:18.022986 22303 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:18.024613 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:18.027079 22346 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:18.026821 22072 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:18.028141 22303 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.028182 22324 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.029827 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:18.032132 22302 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:18.033859 22324 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.034425 22324 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.038163 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:05:18.039426 22147 leader_election.cc:343] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.039614 22104 raft_consensus.cc:2393] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 1: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:05:18.042181 22303 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.043116 22324 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:18.043220 22329 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.043761 22329 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.045994 22329 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:18.046120 22106 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:18.047335 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:18.048506 22105 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:18.049659 22144 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:18.050390 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:18.050558 22346 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.051050 22255 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:18.051327 22346 raft_consensus.cc:697] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:18.051496 22144 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:18.052364 22072 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:18.052982 22362 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.052740 22346 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.053472 22362 raft_consensus.cc:697] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:18.054301 22220 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:18.053444 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:18.054736 22362 consensus_queue.cc:237] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.055549 22329 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.057085 22329 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.057497 22329 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.055334 22180 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:18.058394 22295 tablet_bootstrap.cc:492] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:18.058861 22295 ts_tablet_manager.cc:1403] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.166s	user 0.016s	sys 0.114s
I20260709 13:05:18.060199 22296 tablet_bootstrap.cc:492] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:18.060374 22301 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.066063 22296 ts_tablet_manager.cc:1403] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.162s	user 0.035s	sys 0.055s
I20260709 13:05:18.070662 22296 raft_consensus.cc:359] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.072604 22296 raft_consensus.cc:385] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.073695 22301 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.074362 22296 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.061843 22295 raft_consensus.cc:359] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.075275 22303 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.075554 22295 raft_consensus.cc:385] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.076112 22295 raft_consensus.cc:740] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.070518 22329 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.076427 22297 tablet_bootstrap.cc:654] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.077132 22295 consensus_queue.cc:260] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.078338 22329 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:18.079111 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:18.079752 22181 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.081419 22295 ts_tablet_manager.cc:1434] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.002s
I20260709 13:05:18.082481 22295 tablet_bootstrap.cc:492] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:18.082543 22297 tablet_bootstrap.cc:492] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:18.083144 22297 ts_tablet_manager.cc:1403] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.000s
I20260709 13:05:18.084131 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:18.084794 22255 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.085829 22297 raft_consensus.cc:359] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.086583 22297 raft_consensus.cc:385] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.087010 22297 raft_consensus.cc:740] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.086632 22296 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.088099 22297 consensus_queue.cc:260] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.091058 22297 ts_tablet_manager.cc:1434] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:18.092098 22297 tablet_bootstrap.cc:492] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:18.093010 22295 tablet_bootstrap.cc:654] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.095537 22181 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:18.096942 22071 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:18.097877 22329 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.098430 22329 raft_consensus.cc:697] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:18.098764 22297 tablet_bootstrap.cc:654] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.099574 22296 ts_tablet_manager.cc:1434] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:05:18.099366 22329 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.100688 22296 tablet_bootstrap.cc:492] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:18.115123 22295 tablet_bootstrap.cc:492] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:18.115790 22295 ts_tablet_manager.cc:1403] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 13:05:18.115950 22297 tablet_bootstrap.cc:492] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:18.116454 22297 ts_tablet_manager.cc:1403] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.003s
I20260709 13:05:18.116979 22296 tablet_bootstrap.cc:654] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.118906 22295 raft_consensus.cc:359] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.119378 22297 raft_consensus.cc:359] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.119882 22295 raft_consensus.cc:385] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.120280 22297 raft_consensus.cc:385] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.120398 22295 raft_consensus.cc:740] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.120687 22297 raft_consensus.cc:740] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.121311 22295 consensus_queue.cc:260] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.121447 22297 consensus_queue.cc:260] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.123921 22295 ts_tablet_manager.cc:1434] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:18.124691 22297 ts_tablet_manager.cc:1434] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:18.124934 22295 tablet_bootstrap.cc:492] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:18.125706 22297 tablet_bootstrap.cc:492] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:18.128597 22255 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:18.138425 22297 tablet_bootstrap.cc:654] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.141996 22295 tablet_bootstrap.cc:654] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.135648 22003 catalog_manager.cc:5697] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.152894 22362 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.153527 22362 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.157259 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:05:18.160235 22144 leader_election.cc:343] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.161320 22297 tablet_bootstrap.cc:492] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:18.161881 22297 ts_tablet_manager.cc:1403] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.004s
I20260709 13:05:18.164067 22362 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:18.167205 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:18.168998 22147 leader_election.cc:343] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.169420 22147 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:18.169469 22297 raft_consensus.cc:359] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.170173 22297 raft_consensus.cc:385] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.170241 22362 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.170449 22297 raft_consensus.cc:740] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.171324 22297 consensus_queue.cc:260] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.173532 22297 ts_tablet_manager.cc:1434] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:05:18.182124 22297 tablet_bootstrap.cc:492] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
W20260709 13:05:18.184373 22052 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:18.191309 22297 tablet_bootstrap.cc:654] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.190189 22001 catalog_manager.cc:5697] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.191881 22369 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:05:18.194641 22296 tablet_bootstrap.cc:492] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:18.195132 22296 ts_tablet_manager.cc:1403] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.095s	user 0.026s	sys 0.026s
I20260709 13:05:18.195218 22295 tablet_bootstrap.cc:492] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:18.195654 22295 ts_tablet_manager.cc:1403] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.007s
I20260709 13:05:18.197597 22296 raft_consensus.cc:359] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.198191 22295 raft_consensus.cc:359] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.198866 22295 raft_consensus.cc:385] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.199167 22295 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.198320 22296 raft_consensus.cc:385] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.199997 22296 raft_consensus.cc:740] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.199787 22295 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.199468 22001 catalog_manager.cc:5697] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.200736 22296 consensus_queue.cc:260] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.202643 22296 ts_tablet_manager.cc:1434] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:05:18.204600 22301 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.205879 22296 tablet_bootstrap.cc:492] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:18.212500 22296 tablet_bootstrap.cc:654] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.214970 22346 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.216733 22301 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.220577 22295 ts_tablet_manager.cc:1434] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:05:18.221828 22295 tablet_bootstrap.cc:492] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:18.226758 22297 tablet_bootstrap.cc:492] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:18.227725 22297 ts_tablet_manager.cc:1403] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.010s
I20260709 13:05:18.229966 22295 tablet_bootstrap.cc:654] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.230571 22297 raft_consensus.cc:359] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.231477 22297 raft_consensus.cc:385] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.231799 22297 raft_consensus.cc:740] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.239465 22297 consensus_queue.cc:260] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.244462 22297 ts_tablet_manager.cc:1434] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:05:18.245245 22297 tablet_bootstrap.cc:492] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:18.254645 22297 tablet_bootstrap.cc:654] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.258322 22326 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.259982 22326 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.262183 22296 tablet_bootstrap.cc:492] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:18.262477 22326 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:18.262727 22296 ts_tablet_manager.cc:1403] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.034s
I20260709 13:05:18.263091 22324 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.263697 22324 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.264359 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:18.264987 22180 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:18.266259 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:18.266407 22220 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:18.267400 22301 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.267756 22301 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.268098 22301 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.269752 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:18.270551 22104 raft_consensus.cc:2393] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 1: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:05:18.271509 22302 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.272943 22295 tablet_bootstrap.cc:492] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:18.273411 22295 ts_tablet_manager.cc:1403] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.001s
I20260709 13:05:18.276028 22301 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.276201 22295 raft_consensus.cc:359] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.277733 22295 raft_consensus.cc:385] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.278051 22295 raft_consensus.cc:740] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.278708 22295 consensus_queue.cc:260] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.279878 22297 tablet_bootstrap.cc:492] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:18.280344 22297 ts_tablet_manager.cc:1403] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.001s
I20260709 13:05:18.285815 22297 raft_consensus.cc:359] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.286509 22297 raft_consensus.cc:385] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.286762 22297 raft_consensus.cc:740] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.287408 22297 consensus_queue.cc:260] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.288846 22297 ts_tablet_manager.cc:1434] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:18.290222 22296 raft_consensus.cc:359] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.291349 22296 raft_consensus.cc:385] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.291808 22296 raft_consensus.cc:740] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.292914 22296 consensus_queue.cc:260] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.285503 22301 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:18.296386 22297 tablet_bootstrap.cc:492] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:18.296916 22372 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.297631 22372 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.304667 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:18.316530 22296 ts_tablet_manager.cc:1434] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.002s
I20260709 13:05:18.317963 22296 tablet_bootstrap.cc:492] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:18.315600 22346 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.330662 22296 tablet_bootstrap.cc:654] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.315598 22324 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:18.321246 22346 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:18.323889 22071 leader_election.cc:343] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.338640 22391 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.339427 22391 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.342360 22391 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:18.345923 22346 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:18.346498 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:18.347299 22105 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 1: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:05:18.334417 22372 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:18.358434 22297 tablet_bootstrap.cc:654] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.359102 22295 ts_tablet_manager.cc:1434] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.085s	user 0.020s	sys 0.040s
W20260709 13:05:18.358106 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 78944us
W20260709 13:05:18.361958 22218 leader_election.cc:343] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.368422 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:18.368515 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:18.368922 22346 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.369418 22346 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.370007 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:18.371006 22106 raft_consensus.cc:2393] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 1: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:05:18.373664 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:18.374473 22106 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:18.379096 22144 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:18.379762 22295 tablet_bootstrap.cc:492] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:18.379971 22362 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.380499 22362 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.380831 22362 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.383332 22346 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:18.383684 22072 leader_election.cc:343] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.384996 22072 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:18.386629 22369 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.387329 22369 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.389979 22389 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:18.389851 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 116502us
W20260709 13:05:18.390605 22218 leader_election.cc:343] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.396502 22389 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.399129 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:18.399231 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:18.402310 22372 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.404441 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:18.406307 22181 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.412652 22220 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:18.413511 22326 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.410856 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:18.407579 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:18.411103 22372 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.417650 22372 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:18.418148 22220 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:18.411739 22179 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.418982 22301 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.419945 22362 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.420857 22252 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:18.422464 22362 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:18.422806 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:18.422853 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:18.418166 22147 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:18.423506 22180 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:18.423595 22104 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.424777 22071 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:18.425405 22372 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.425781 22372 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.426983 22372 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.428237 22297 tablet_bootstrap.cc:492] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:18.428563 22297 ts_tablet_manager.cc:1403] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.139s	user 0.011s	sys 0.003s
I20260709 13:05:18.429354 22391 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.433010 22297 raft_consensus.cc:359] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.433717 22297 raft_consensus.cc:385] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.433979 22297 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.435178 22372 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.438141 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:18.438090 22297 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.440191 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:18.440514 22297 ts_tablet_manager.cc:1434] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:05:18.440754 22180 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.441428 22297 tablet_bootstrap.cc:492] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:18.443342 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:05:18.443874 22072 leader_election.cc:343] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.442741 22181 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:18.445842 22252 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.454573 22220 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:18.455263 22303 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.456868 22389 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:18.459499 22296 tablet_bootstrap.cc:492] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:18.459997 22296 ts_tablet_manager.cc:1403] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.142s	user 0.020s	sys 0.021s
I20260709 13:05:18.446328 22391 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:05:18.461288 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:18.461773 22372 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:18.462177 22302 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.461812 22346 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.464255 22346 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.473217 22252 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:18.474210 22301 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.474342 22389 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.475385 22389 raft_consensus.cc:697] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:18.476608 22180 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:18.476250 22389 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.496809 22302 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:18.499449 22218 leader_election.cc:343] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.499293 22302 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.500622 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:18.501405 22302 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:18.501902 22072 leader_election.cc:343] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.502424 22326 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.503368 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:18.504244 22180 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:18.503283 22071 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:18.505800 22372 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.506322 22372 raft_consensus.cc:697] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:18.506898 22147 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:18.507210 22372 consensus_queue.cc:237] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.508411 22302 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.508322 22220 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:18.511816 22362 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.514171 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:18.514384 22326 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.514899 22326 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.515487 22295 tablet_bootstrap.cc:654] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:18.515746 22147 leader_election.cc:343] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.515354 22326 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.517786 22391 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:18.525913 22296 raft_consensus.cc:359] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.526454 22296 raft_consensus.cc:385] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.526684 22296 raft_consensus.cc:740] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.527384 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:18.529218 22296 consensus_queue.cc:260] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.528013 22362 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.525286 22302 raft_consensus.cc:697] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:18.531971 22362 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.534818 22362 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:18.535754 22144 leader_election.cc:343] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.536295 22144 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:18.537539 22329 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.537964 22326 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.539548 22362 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.530570 22391 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.541179 22297 tablet_bootstrap.cc:654] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.540977 22326 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:18.561677 22296 ts_tablet_manager.cc:1434] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.002s
I20260709 13:05:18.624917 22296 tablet_bootstrap.cc:492] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:18.577687 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:18.541925 22104 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:18.604439 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:18.545825 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:18.563504 22346 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:18.665277 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:18.666004 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:18.666551 22329 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.667063 22329 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.669404 22179 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.559026 22302 consensus_queue.cc:237] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.676103 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:18.687795 22329 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:18.688455 22218 leader_election.cc:343] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:18.686023 22144 leader_election.cc:343] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:18.715171 22397 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:05:18.697127 22147 leader_election.cc:343] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.699849 22102 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
W20260709 13:05:18.740116 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 58945.6us
W20260709 13:05:18.742636 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 45556.8us
W20260709 13:05:18.777748 22399 log.cc:927] Time spent T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:05:18.782413 22295 tablet_bootstrap.cc:492] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:18.776131 22362 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.783277 22295 ts_tablet_manager.cc:1403] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.404s	user 0.026s	sys 0.022s
I20260709 13:05:18.778682 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:18.775193 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:18.779955 22147 leader_election.cc:343] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.787772 22144 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:18.795143 22147 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:18.798240 22398 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.786212 22362 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.785808 22346 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:05:18.801558 22362 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:18.802641 22398 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.804714 22296 tablet_bootstrap.cc:654] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:18.804934 22072 leader_election.cc:343] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.807638 22362 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.808143 22362 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.808574 22362 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.818025 22179 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
W20260709 13:05:18.828186 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 44025.2us
I20260709 13:05:18.832177 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:18.833922 22003 catalog_manager.cc:5697] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.839455 22220 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:05:18.845209 22071 leader_election.cc:343] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.845309 22324 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.845829 22071 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:18.846154 22324 raft_consensus.cc:697] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:18.846946 22303 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:18.847268 22144 leader_election.cc:343] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.847052 22324 consensus_queue.cc:237] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.845019 22398 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.851138 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:18.856922 22303 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.861860 22295 raft_consensus.cc:359] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.862896 22295 raft_consensus.cc:385] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:18.863538 22407 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:05:18.863193 22295 raft_consensus.cc:740] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.865298 22295 consensus_queue.cc:260] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.866410 22254 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:18.867297 22362 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.870864 22295 ts_tablet_manager.cc:1434] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.004s
I20260709 13:05:18.873274 22295 tablet_bootstrap.cc:492] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:18.900523 22297 tablet_bootstrap.cc:492] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:18.901213 22297 ts_tablet_manager.cc:1403] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.460s	user 0.031s	sys 0.067s
I20260709 13:05:18.907991 22147 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:18.914848 22408 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.915503 22408 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.915985 22408 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.916918 22297 raft_consensus.cc:359] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.917905 22297 raft_consensus.cc:385] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.918278 22297 raft_consensus.cc:740] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.934487 22362 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:18.937891 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:18.940393 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:18.941114 22104 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.944540 22295 tablet_bootstrap.cc:654] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.919238 22297 consensus_queue.cc:260] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.950569 22104 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
W20260709 13:05:18.953390 22147 leader_election.cc:343] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:18.954613 22072 consensus_peers.cc:597] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:18.971585 22297 ts_tablet_manager.cc:1434] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.070s	user 0.010s	sys 0.001s
I20260709 13:05:18.972631 22297 tablet_bootstrap.cc:492] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:18.973475 22144 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:18.974225 22408 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:18.977016 22408 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:18.982430 22402 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.982590 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:18.983089 22402 raft_consensus.cc:697] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:18.984040 22402 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:18.984494 22144 leader_election.cc:343] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.980792 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:18.992918 22254 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.998658 22296 tablet_bootstrap.cc:492] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:18.999213 22296 ts_tablet_manager.cc:1403] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.375s	user 0.015s	sys 0.004s
I20260709 13:05:18.997855 22372 consensus_queue.cc:1048] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.005810 22296 raft_consensus.cc:359] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.006618 22296 raft_consensus.cc:385] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.006959 22296 raft_consensus.cc:740] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.009919 22296 consensus_queue.cc:260] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.016031 22296 ts_tablet_manager.cc:1434] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:05:19.018316 22296 tablet_bootstrap.cc:492] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:19.016021 22254 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:19.021176 22147 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:19.022625 22402 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:19.023569 22402 raft_consensus.cc:697] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:19.029304 22402 consensus_queue.cc:237] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.036815 22297 tablet_bootstrap.cc:654] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:19.037468 22218 consensus_peers.cc:597] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.048704 22296 tablet_bootstrap.cc:654] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.053495 22295 tablet_bootstrap.cc:492] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:19.054034 22295 ts_tablet_manager.cc:1403] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.181s	user 0.019s	sys 0.018s
I20260709 13:05:19.057567 22324 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:19.060194 22295 raft_consensus.cc:359] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.060959 22295 raft_consensus.cc:385] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.061259 22295 raft_consensus.cc:740] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.065214 22295 consensus_queue.cc:260] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.076277 22001 catalog_manager.cc:5697] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.095984 22297 tablet_bootstrap.cc:492] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:19.096174 22295 ts_tablet_manager.cc:1434] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.042s	user 0.002s	sys 0.005s
I20260709 13:05:19.096487 22297 ts_tablet_manager.cc:1403] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.124s	user 0.031s	sys 0.017s
I20260709 13:05:19.097090 22295 tablet_bootstrap.cc:492] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:19.099025 22297 raft_consensus.cc:359] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.099745 22297 raft_consensus.cc:385] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.099542 22002 catalog_manager.cc:5697] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.100078 22297 raft_consensus.cc:740] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.101035 22297 consensus_queue.cc:260] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.103791 22297 ts_tablet_manager.cc:1434] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:19.104776 22297 tablet_bootstrap.cc:492] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:19.105189 22296 tablet_bootstrap.cc:492] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:19.105625 22296 ts_tablet_manager.cc:1403] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.000s
I20260709 13:05:19.108206 22296 raft_consensus.cc:359] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.108909 22296 raft_consensus.cc:385] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.109176 22296 raft_consensus.cc:740] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.109817 22296 consensus_queue.cc:260] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.112486 22296 ts_tablet_manager.cc:1434] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:05:19.113469 22296 tablet_bootstrap.cc:492] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:19.118628 22297 tablet_bootstrap.cc:654] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.119360 22296 tablet_bootstrap.cc:654] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.120756 22295 tablet_bootstrap.cc:654] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.137530 22001 catalog_manager.cc:5697] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.139564 22295 tablet_bootstrap.cc:492] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:19.140100 22295 ts_tablet_manager.cc:1403] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.004s
I20260709 13:05:19.141562 22297 tablet_bootstrap.cc:492] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:19.142001 22297 ts_tablet_manager.cc:1403] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.003s
I20260709 13:05:19.138589 22296 tablet_bootstrap.cc:492] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:19.142577 22296 ts_tablet_manager.cc:1403] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.000s
I20260709 13:05:19.145116 22295 raft_consensus.cc:359] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.146634 22296 raft_consensus.cc:359] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.146555 22297 raft_consensus.cc:359] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.147436 22295 raft_consensus.cc:385] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.147737 22297 raft_consensus.cc:385] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.147851 22295 raft_consensus.cc:740] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.148072 22297 raft_consensus.cc:740] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.148079 22296 raft_consensus.cc:385] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.148650 22296 raft_consensus.cc:740] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.148989 22297 consensus_queue.cc:260] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.149369 22296 consensus_queue.cc:260] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.151209 22297 ts_tablet_manager.cc:1434] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:05:19.151611 22296 ts_tablet_manager.cc:1434] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:19.148990 22295 consensus_queue.cc:260] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.152247 22297 tablet_bootstrap.cc:492] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:19.152568 22296 tablet_bootstrap.cc:492] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:19.153801 22295 ts_tablet_manager.cc:1434] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:05:19.154860 22295 tablet_bootstrap.cc:492] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:19.158034 22002 catalog_manager.cc:5697] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.159178 22296 tablet_bootstrap.cc:654] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.160225 22297 tablet_bootstrap.cc:654] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.160934 22402 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.160676 22002 catalog_manager.cc:5697] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.192334 22402 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.193161 22402 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.197309 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:19.198338 22105 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:19.200083 22144 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:05:19.200894 22052 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:19.201359 22362 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:19.205694 22362 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.205997 22362 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.204633 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:19.210978 22402 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:19.212260 22147 leader_election.cc:343] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.213829 22362 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.217417 22362 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:19.221596 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:19.223583 22105 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.224373 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:05:19.225831 22147 leader_election.cc:343] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.228274 22295 tablet_bootstrap.cc:654] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.234761 22402 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:19.236112 22297 tablet_bootstrap.cc:492] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:19.236614 22297 ts_tablet_manager.cc:1403] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.085s	user 0.030s	sys 0.036s
I20260709 13:05:19.239236 22297 raft_consensus.cc:359] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.240072 22297 raft_consensus.cc:385] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.240399 22297 raft_consensus.cc:740] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.241235 22297 consensus_queue.cc:260] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.243299 22297 ts_tablet_manager.cc:1434] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:19.244222 22297 tablet_bootstrap.cc:492] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:19.245806 22295 tablet_bootstrap.cc:492] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:19.246320 22295 ts_tablet_manager.cc:1403] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.000s
I20260709 13:05:19.249173 22295 raft_consensus.cc:359] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.249887 22295 raft_consensus.cc:385] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.250181 22295 raft_consensus.cc:740] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.251091 22295 consensus_queue.cc:260] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.251534 22297 tablet_bootstrap.cc:654] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.253937 22295 ts_tablet_manager.cc:1434] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:19.255010 22295 tablet_bootstrap.cc:492] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:19.257480 22296 tablet_bootstrap.cc:492] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:19.257966 22296 ts_tablet_manager.cc:1403] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.106s	user 0.008s	sys 0.042s
I20260709 13:05:19.260754 22296 raft_consensus.cc:359] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.261507 22296 raft_consensus.cc:385] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.261791 22296 raft_consensus.cc:740] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.262532 22296 consensus_queue.cc:260] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.261811 22105 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:19.264380 22144 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:19.265439 22362 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:19.266137 22362 raft_consensus.cc:697] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:19.267729 22296 ts_tablet_manager.cc:1434] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:19.269318 22296 tablet_bootstrap.cc:492] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:19.275792 22296 tablet_bootstrap.cc:654] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.267395 22362 consensus_queue.cc:237] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.299284 22402 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.299800 22402 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.301856 22402 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:19.303516 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:05:19.305365 22144 leader_election.cc:343] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.298452 22001 catalog_manager.cc:5697] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.315755 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:19.317905 22147 leader_election.cc:343] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.318521 22147 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:19.320305 22402 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:19.323928 22295 tablet_bootstrap.cc:654] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.325495 22297 tablet_bootstrap.cc:492] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:19.325582 22372 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.326130 22297 ts_tablet_manager.cc:1403] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.082s	user 0.037s	sys 0.024s
I20260709 13:05:19.326088 22372 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.328501 22372 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:19.329252 22297 raft_consensus.cc:359] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.330080 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:19.330457 22297 raft_consensus.cc:385] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.330878 22297 raft_consensus.cc:740] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.332343 22297 consensus_queue.cc:260] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.332692 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:19.334573 22301 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:19.335891 22297 ts_tablet_manager.cc:1434] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:19.336611 22254 raft_consensus.cc:2393] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 1: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:05:19.338163 22072 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:19.340144 22303 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.340540 22372 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.341089 22372 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.344280 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:19.344566 22297 tablet_bootstrap.cc:492] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:19.344738 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:19.344969 22177 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:19.346472 22071 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:19.347498 22329 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:19.347898 22329 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.348289 22329 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:19.349089 22072 leader_election.cc:343] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.346568 22372 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:19.353458 22218 consensus_peers.cc:597] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.363279 22297 tablet_bootstrap.cc:654] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.364238 22296 tablet_bootstrap.cc:492] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:19.364765 22296 ts_tablet_manager.cc:1403] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.096s	user 0.028s	sys 0.030s
I20260709 13:05:19.367609 22296 raft_consensus.cc:359] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.368289 22296 raft_consensus.cc:385] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.368566 22296 raft_consensus.cc:740] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.369062 22303 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:19.369705 22295 tablet_bootstrap.cc:492] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:19.370203 22295 ts_tablet_manager.cc:1403] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.115s	user 0.018s	sys 0.006s
I20260709 13:05:19.377825 22295 raft_consensus.cc:359] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.378572 22295 raft_consensus.cc:385] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.378862 22295 raft_consensus.cc:740] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.369112 22329 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.384207 22301 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.384785 22301 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.386615 22295 consensus_queue.cc:260] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.388114 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:19.388114 22301 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:19.390077 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:19.391180 22295 ts_tablet_manager.cc:1434] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:05:19.392128 22295 tablet_bootstrap.cc:492] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:19.392380 22218 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:19.393743 22301 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:19.396629 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:19.397210 22179 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.398003 22329 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:19.400058 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:19.401810 22296 consensus_queue.cc:260] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:19.403882 22072 leader_election.cc:343] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.403993 22179 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:19.404831 22296 ts_tablet_manager.cc:1434] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:05:19.405376 22071 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:19.406373 22303 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:19.406834 22303 raft_consensus.cc:697] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:19.407665 22303 consensus_queue.cc:237] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.410261 22296 tablet_bootstrap.cc:492] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:19.419492 22295 tablet_bootstrap.cc:654] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.420213 22296 tablet_bootstrap.cc:654] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.428092 22295 tablet_bootstrap.cc:492] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:19.428718 22295 ts_tablet_manager.cc:1403] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.000s
I20260709 13:05:19.434350 22408 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.436240 22296 tablet_bootstrap.cc:492] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:19.436866 22296 ts_tablet_manager.cc:1403] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.004s
I20260709 13:05:19.440383 22296 raft_consensus.cc:359] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.441299 22296 raft_consensus.cc:385] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.441638 22296 raft_consensus.cc:740] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.444249 22295 raft_consensus.cc:359] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.445688 22295 raft_consensus.cc:385] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.442483 22296 consensus_queue.cc:260] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.445963 22295 raft_consensus.cc:740] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.448263 22296 ts_tablet_manager.cc:1434] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.005s
W20260709 13:05:19.448401 22147 consensus_peers.cc:597] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.449169 22296 tablet_bootstrap.cc:492] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:19.448493 22297 tablet_bootstrap.cc:492] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:19.449996 22297 ts_tablet_manager.cc:1403] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.112s	user 0.032s	sys 0.052s
I20260709 13:05:19.449077 22295 consensus_queue.cc:260] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.452658 22297 raft_consensus.cc:359] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.453281 22297 raft_consensus.cc:385] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.453320 22295 ts_tablet_manager.cc:1434] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:05:19.453595 22297 raft_consensus.cc:740] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.454483 22297 consensus_queue.cc:260] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.455777 22296 tablet_bootstrap.cc:654] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.455428 22001 catalog_manager.cc:5697] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.456673 22297 ts_tablet_manager.cc:1434] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:19.457489 22297 tablet_bootstrap.cc:492] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:19.463310 22297 tablet_bootstrap.cc:654] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.467967 22362 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.468719 22362 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.472432 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:05:19.474684 22144 leader_election.cc:343] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.484697 22297 tablet_bootstrap.cc:492] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:19.485155 22297 ts_tablet_manager.cc:1403] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.011s
I20260709 13:05:19.486871 22296 tablet_bootstrap.cc:492] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:19.487377 22296 ts_tablet_manager.cc:1403] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.038s	user 0.031s	sys 0.005s
I20260709 13:05:19.488375 22297 raft_consensus.cc:359] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.489080 22297 raft_consensus.cc:385] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.489343 22297 raft_consensus.cc:740] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.489919 22296 raft_consensus.cc:359] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.489960 22297 consensus_queue.cc:260] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.490675 22296 raft_consensus.cc:385] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.491005 22296 raft_consensus.cc:740] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.491114 22362 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:19.491737 22296 consensus_queue.cc:260] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.492559 22297 ts_tablet_manager.cc:1434] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:19.493515 22297 tablet_bootstrap.cc:492] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:19.493873 22296 ts_tablet_manager.cc:1434] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:05:19.494782 22296 tablet_bootstrap.cc:492] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:19.497880 22301 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.498375 22301 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.499245 22297 tablet_bootstrap.cc:654] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.500237 22296 tablet_bootstrap.cc:654] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.500517 22301 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:19.502394 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:05:19.506026 22218 leader_election.cc:343] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.508848 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:19.509796 22179 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:19.511461 22220 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:19.513025 22301 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:19.513516 22301 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.513969 22301 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.515579 22252 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.519626 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:19.522107 22362 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.522791 22362 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:19.531026 22147 leader_election.cc:343] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.531759 22147 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:19.533229 22408 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:19.538642 22301 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.542484 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:19.543452 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:19.544382 22105 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:19.546108 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:05:19.547300 22218 leader_election.cc:343] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.547425 22408 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:19.548123 22408 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.548816 22408 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.555962 22326 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.556655 22326 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.557112 22362 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:19.559484 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:19.561906 22326 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:05:19.562315 22147 leader_election.cc:343] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.564178 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:19.567065 22301 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:19.569854 22408 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.571460 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:19.572293 22177 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.574318 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:19.575299 22105 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.575418 22179 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:19.577257 22220 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:19.586810 22105 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:19.587188 22301 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:19.587939 22301 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.588475 22301 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.588760 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:19.590126 22362 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:19.590868 22362 raft_consensus.cc:697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:19.591338 22303 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.592048 22303 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.592136 22362 consensus_queue.cc:237] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.595989 22295 tablet_bootstrap.cc:492] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:19.598580 22408 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:19.618718 22296 tablet_bootstrap.cc:492] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:19.619594 22296 ts_tablet_manager.cc:1403] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.125s	user 0.044s	sys 0.075s
I20260709 13:05:19.619781 22398 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:19.622864 22296 raft_consensus.cc:359] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.623584 22296 raft_consensus.cc:385] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.623840 22296 raft_consensus.cc:740] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.624404 22296 consensus_queue.cc:260] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.626765 22296 ts_tablet_manager.cc:1434] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:05:19.586668 22177 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:19.628458 22220 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:19.629621 22326 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:19.630265 22326 raft_consensus.cc:697] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:19.630517 22003 catalog_manager.cc:5697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.631727 22326 consensus_queue.cc:237] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.636971 22296 tablet_bootstrap.cc:492] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:19.655710 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:19.642743 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:19.657131 22105 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:19.661012 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:19.664620 22408 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.665601 22297 tablet_bootstrap.cc:492] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:19.666146 22297 ts_tablet_manager.cc:1403] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.173s	user 0.045s	sys 0.110s
W20260709 13:05:19.666749 22071 leader_election.cc:343] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.674546 22296 tablet_bootstrap.cc:654] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.679046 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:19.679980 22253 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:19.680224 22297 raft_consensus.cc:359] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.681070 22297 raft_consensus.cc:385] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.681399 22297 raft_consensus.cc:740] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.682228 22297 consensus_queue.cc:260] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.657704 22303 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:19.684897 22147 leader_election.cc:343] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.685343 22301 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.688792 22297 ts_tablet_manager.cc:1434] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 13:05:19.689735 22297 tablet_bootstrap.cc:492] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:19.695173 22072 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:19.695989 22303 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:19.696352 22303 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.696688 22303 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.700830 22301 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:19.700989 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:19.701869 22105 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.705742 22295 tablet_bootstrap.cc:654] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.701020 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:19.706378 22178 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.717752 22369 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.718430 22369 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.719301 22001 catalog_manager.cc:5697] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.721750 22369 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:19.721788 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:19.722677 22177 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:19.724738 22071 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:19.725922 22369 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:19.726352 22369 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.726683 22369 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.731818 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:19.734620 22297 tablet_bootstrap.cc:654] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.740515 22303 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.742901 22105 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:19.749639 22453 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.750396 22453 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.762566 22453 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:19.769357 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:19.770063 22177 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:19.771353 22220 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:19.772239 22453 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:19.772615 22453 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.772972 22453 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.780246 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:19.777150 22218 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:19.782167 22301 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:19.782400 22071 leader_election.cc:343] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.767619 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:19.782680 22301 raft_consensus.cc:697] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:19.783459 22362 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.784341 22303 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:19.767462 22178 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
W20260709 13:05:19.785885 22218 leader_election.cc:343] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.788110 22296 tablet_bootstrap.cc:492] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:19.788539 22296 ts_tablet_manager.cc:1403] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.154s	user 0.015s	sys 0.008s
I20260709 13:05:19.783847 22301 consensus_queue.cc:237] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.789739 22362 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.790190 22362 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.793077 22296 raft_consensus.cc:359] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.793500 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:19.793807 22296 raft_consensus.cc:385] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.794175 22296 raft_consensus.cc:740] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
W20260709 13:05:19.794884 22144 leader_election.cc:343] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.794947 22296 consensus_queue.cc:260] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.799012 22296 ts_tablet_manager.cc:1434] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:19.799304 22453 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.800822 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:19.801067 22101 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:19.802181 22147 leader_election.cc:343] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.802114 22453 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:19.802687 22147 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:19.803471 22408 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:19.804558 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:19.805152 22178 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.805116 22296 tablet_bootstrap.cc:492] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:19.797241 22362 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:19.814955 22369 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:19.816938 22072 leader_election.cc:343] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.817124 22369 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:19.819185 22295 tablet_bootstrap.cc:492] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:19.819931 22295 ts_tablet_manager.cc:1403] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.224s	user 0.017s	sys 0.015s
I20260709 13:05:19.820894 22303 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.823693 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:19.824160 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:19.828662 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:19.831223 22177 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.827499 22303 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.838013 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:19.843344 22295 raft_consensus.cc:359] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.844627 22295 raft_consensus.cc:385] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.844900 22295 raft_consensus.cc:740] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.838438 22252 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.848654 22297 tablet_bootstrap.cc:492] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:19.849148 22297 ts_tablet_manager.cc:1403] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.160s	user 0.017s	sys 0.017s
I20260709 13:05:19.849530 22295 consensus_queue.cc:260] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.852910 22178 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:19.853796 22297 raft_consensus.cc:359] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.854532 22297 raft_consensus.cc:385] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.854859 22297 raft_consensus.cc:740] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
W20260709 13:05:19.856738 22147 consensus_peers.cc:597] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:19.841776 22218 leader_election.cc:343] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.857786 22220 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:19.857990 22252 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:19.858817 22326 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:19.859472 22326 raft_consensus.cc:697] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:19.860374 22297 consensus_queue.cc:260] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.860335 22326 consensus_queue.cc:237] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.864586 22104 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.867137 22297 ts_tablet_manager.cc:1434] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.001s
I20260709 13:05:19.868075 22297 tablet_bootstrap.cc:492] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:19.863201 22001 catalog_manager.cc:5697] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:19.871801 22072 leader_election.cc:343] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.872704 22072 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:19.875617 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:19.876534 22296 tablet_bootstrap.cc:654] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.879758 22295 ts_tablet_manager.cc:1434] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.003s
I20260709 13:05:19.879989 22177 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:19.880801 22295 tablet_bootstrap.cc:492] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:19.881259 22071 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:19.881857 22303 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:19.884961 22329 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:19.890383 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:19.895884 22072 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:19.899461 22297 tablet_bootstrap.cc:654] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.900571 22001 catalog_manager.cc:5697] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.901722 22295 tablet_bootstrap.cc:654] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.908624 22329 raft_consensus.cc:697] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:19.911927 22372 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:19.910030 22329 consensus_queue.cc:237] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.956593 22296 tablet_bootstrap.cc:492] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:19.986634 22296 ts_tablet_manager.cc:1403] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.182s	user 0.011s	sys 0.013s
I20260709 13:05:19.985167 22369 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:19.999956 22369 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:19.977584 22362 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.956842 22372 raft_consensus.cc:697] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:05:19.993518 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 112341us
I20260709 13:05:20.030185 22297 tablet_bootstrap.cc:492] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:20.031488 22297 ts_tablet_manager.cc:1403] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.164s	user 0.018s	sys 0.047s
I20260709 13:05:20.014921 22362 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.048256 22295 tablet_bootstrap.cc:492] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:20.048686 22295 ts_tablet_manager.cc:1403] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.168s	user 0.014s	sys 0.001s
I20260709 13:05:20.043548 22465 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.058305 22453 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.058847 22453 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.060895 22453 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:20.063980 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:20.064970 22177 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 1: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:05:20.066869 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:20.062137 22296 raft_consensus.cc:359] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.068120 22296 raft_consensus.cc:385] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.068419 22296 raft_consensus.cc:740] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.069015 22296 consensus_queue.cc:260] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.075217 22218 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:20.076535 22301 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.038317 22372 consensus_queue.cc:237] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.074771 22295 raft_consensus.cc:359] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.080544 22295 raft_consensus.cc:385] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.080955 22295 raft_consensus.cc:740] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.081867 22295 consensus_queue.cc:260] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.085116 22295 ts_tablet_manager.cc:1434] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:05:20.086499 22295 tablet_bootstrap.cc:492] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:20.090662 22296 ts_tablet_manager.cc:1434] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.103s	user 0.005s	sys 0.002s
W20260709 13:05:20.091544 22072 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.094884 22296 tablet_bootstrap.cc:492] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:20.096683 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:20.097059 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:05:20.100907 22147 leader_election.cc:343] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:20.104084 22144 leader_election.cc:343] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.104597 22369 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:20.104557 22144 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:20.105443 22408 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:20.108386 22218 consensus_peers.cc:597] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.095116 22362 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:20.121632 22297 raft_consensus.cc:359] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.122207 22295 tablet_bootstrap.cc:654] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.123764 22301 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.122397 22297 raft_consensus.cc:385] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.125190 22297 raft_consensus.cc:740] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.125880 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:20.126060 22297 consensus_queue.cc:260] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.127301 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:20.130796 22297 ts_tablet_manager.cc:1434] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.001s
I20260709 13:05:20.130901 22296 tablet_bootstrap.cc:654] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.132074 22297 tablet_bootstrap.cc:492] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:20.133728 22071 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:20.134783 22463 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:20.137430 22463 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:20.139127 22297 tablet_bootstrap.cc:654] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.164245 22297 tablet_bootstrap.cc:492] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:20.164911 22297 ts_tablet_manager.cc:1403] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.012s
I20260709 13:05:20.167339 22408 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.168103 22408 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.176894 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:20.177897 22104 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:20.180997 22144 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:20.181924 22346 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.182783 22346 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.183386 22346 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.185287 22001 catalog_manager.cc:5697] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.187158 22398 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.186903 22001 catalog_manager.cc:5697] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.187883 22398 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.192360 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:20.195036 22324 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:20.195832 22297 raft_consensus.cc:359] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.197258 22297 raft_consensus.cc:385] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.197602 22297 raft_consensus.cc:740] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.198634 22297 consensus_queue.cc:260] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.207304 22324 consensus_queue.cc:1048] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:20.209424 22295 tablet_bootstrap.cc:492] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:20.203024 22398 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:20.210557 22295 ts_tablet_manager.cc:1403] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.124s	user 0.008s	sys 0.008s
I20260709 13:05:20.202003 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:20.230175 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:20.220952 22295 raft_consensus.cc:359] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.208549 22408 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:20.232769 22295 raft_consensus.cc:385] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.235311 22295 raft_consensus.cc:740] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.236331 22295 consensus_queue.cc:260] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.230875 22252 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 1: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:05:20.246683 22295 ts_tablet_manager.cc:1434] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:05:20.248935 22295 tablet_bootstrap.cc:492] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:20.264648 22346 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.270809 22297 ts_tablet_manager.cc:1434] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.105s	user 0.024s	sys 0.036s
I20260709 13:05:20.273095 22297 tablet_bootstrap.cc:492] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
W20260709 13:05:20.269359 22147 consensus_peers.cc:597] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.278991 22147 leader_election.cc:343] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.284577 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:20.284889 22147 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:20.287508 22362 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:20.289491 22147 leader_election.cc:343] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.268836 22346 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:20.289721 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:20.290871 22105 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.293704 22408 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:20.294265 22296 tablet_bootstrap.cc:492] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:20.294736 22296 ts_tablet_manager.cc:1403] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.200s	user 0.024s	sys 0.027s
I20260709 13:05:20.296473 22295 tablet_bootstrap.cc:654] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.299885 22296 raft_consensus.cc:359] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.300642 22296 raft_consensus.cc:385] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.300940 22296 raft_consensus.cc:740] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.301577 22296 consensus_queue.cc:260] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.301972 22105 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:20.303351 22144 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:20.303929 22296 ts_tablet_manager.cc:1434] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:20.304363 22408 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.304945 22408 raft_consensus.cc:697] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:20.307917 22296 tablet_bootstrap.cc:492] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:20.308766 22408 consensus_queue.cc:237] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.317816 22362 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.319500 22301 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:20.370260 22297 tablet_bootstrap.cc:654] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.391157 22253 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:20.402426 22052 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:20.406847 22301 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:20.428565 22003 catalog_manager.cc:5697] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:20.429163 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 85056.5us
I20260709 13:05:20.443387 22296 tablet_bootstrap.cc:654] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.451035 22295 tablet_bootstrap.cc:492] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:20.452446 22295 ts_tablet_manager.cc:1403] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.204s	user 0.020s	sys 0.003s
I20260709 13:05:20.472738 22106 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.476234 22295 raft_consensus.cc:359] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.477008 22295 raft_consensus.cc:385] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.477288 22295 raft_consensus.cc:740] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.485108 22295 consensus_queue.cc:260] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.495646 22295 ts_tablet_manager.cc:1434] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 13:05:20.496644 22295 tablet_bootstrap.cc:492] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:20.500106 22369 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.500839 22369 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.500976 22372 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:20.516288 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:20.516775 22369 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:20.517035 22181 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:20.515686 22324 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:20.518553 22071 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:20.521661 22297 tablet_bootstrap.cc:492] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:20.523069 22297 ts_tablet_manager.cc:1403] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.251s	user 0.014s	sys 0.013s
I20260709 13:05:20.525740 22369 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.526211 22369 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.526573 22369 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.526396 22297 raft_consensus.cc:359] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.527221 22297 raft_consensus.cc:385] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.527448 22297 raft_consensus.cc:740] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.527915 22297 consensus_queue.cc:260] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.530867 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:20.541320 22295 tablet_bootstrap.cc:654] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.561502 22296 tablet_bootstrap.cc:492] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:20.562147 22296 ts_tablet_manager.cc:1403] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.254s	user 0.017s	sys 0.005s
I20260709 13:05:20.561546 22297 ts_tablet_manager.cc:1434] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:05:20.564074 22297 tablet_bootstrap.cc:492] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:20.570262 22369 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.577710 22296 raft_consensus.cc:359] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.578512 22296 raft_consensus.cc:385] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.578873 22296 raft_consensus.cc:740] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.579721 22296 consensus_queue.cc:260] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.580173 22369 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:20.584775 22297 tablet_bootstrap.cc:654] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.588191 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:20.589046 22178 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.586735 22295 tablet_bootstrap.cc:492] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:20.587452 22296 ts_tablet_manager.cc:1434] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:05:20.588104 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:20.591607 22295 ts_tablet_manager.cc:1403] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.007s
I20260709 13:05:20.595396 22295 raft_consensus.cc:359] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.596396 22295 raft_consensus.cc:385] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.596778 22295 raft_consensus.cc:740] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.597801 22295 consensus_queue.cc:260] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.600392 22296 tablet_bootstrap.cc:492] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:20.605325 22326 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.605851 22326 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.607266 22297 tablet_bootstrap.cc:492] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:20.607820 22297 ts_tablet_manager.cc:1403] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.006s
I20260709 13:05:20.608208 22326 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:20.608512 22296 tablet_bootstrap.cc:654] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.609946 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:20.611035 22295 ts_tablet_manager.cc:1434] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:05:20.604537 22178 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:20.612186 22295 tablet_bootstrap.cc:492] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:20.613237 22329 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.613811 22329 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.613128 22071 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:20.615679 22369 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.616170 22369 raft_consensus.cc:697] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:20.617192 22369 consensus_queue.cc:237] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.618976 22329 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:20.620028 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:05:20.628458 22072 leader_election.cc:343] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.628629 22297 raft_consensus.cc:359] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.629506 22297 raft_consensus.cc:385] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.629850 22297 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
W20260709 13:05:20.630105 22072 leader_election.cc:343] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.630769 22297 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.631021 22463 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:20.632831 22463 consensus_queue.cc:1048] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:20.620496 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:20.633270 22297 ts_tablet_manager.cc:1434] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:05:20.635483 22297 tablet_bootstrap.cc:492] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:20.637176 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:20.639811 22362 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.640376 22362 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.642143 22296 tablet_bootstrap.cc:492] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:20.653105 22296 ts_tablet_manager.cc:1403] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.020s
I20260709 13:05:20.644104 22218 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:20.655905 22296 raft_consensus.cc:359] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.656932 22296 raft_consensus.cc:385] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.657297 22296 raft_consensus.cc:740] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.658046 22296 consensus_queue.cc:260] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.644788 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:20.661088 22296 ts_tablet_manager.cc:1434] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:20.662046 22326 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.662312 22296 tablet_bootstrap.cc:492] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:20.668810 22296 tablet_bootstrap.cc:654] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.672039 22106 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.645267 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:05:20.676236 22147 leader_election.cc:343] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.676538 22453 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.677300 22453 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:20.677713 22144 leader_election.cc:343] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.678347 22144 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:20.679950 22408 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.681785 22295 tablet_bootstrap.cc:654] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.682179 22453 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:20.683305 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:20.684006 22329 consensus_queue.cc:1048] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:20.689782 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:20.697852 22408 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.646787 22072 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:20.642513 22297 tablet_bootstrap.cc:654] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.698498 22408 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.645949 22362 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:20.704041 22218 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:20.704633 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:05:20.699452 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 52800.8us
I20260709 13:05:20.705495 22453 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:20.706581 22144 leader_election.cc:343] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.706760 22408 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:20.707037 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:20.708997 22147 leader_election.cc:343] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.709457 22147 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:20.725901 22296 tablet_bootstrap.cc:492] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:20.729847 22296 ts_tablet_manager.cc:1403] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.068s	user 0.019s	sys 0.014s
I20260709 13:05:20.733776 22329 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:20.718693 22408 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.748872 22296 raft_consensus.cc:359] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.750089 22296 raft_consensus.cc:385] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.749842 22362 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.750532 22296 raft_consensus.cc:740] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.751313 22296 consensus_queue.cc:260] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.750869 22362 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.756265 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:20.757007 22453 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.757656 22296 ts_tablet_manager.cc:1434] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:05:20.758170 22297 tablet_bootstrap.cc:492] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:20.759296 22297 ts_tablet_manager.cc:1403] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.015s
W20260709 13:05:20.760761 22144 leader_election.cc:343] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.759874 22296 tablet_bootstrap.cc:492] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:20.760692 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:20.757521 22453 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:20.763440 22147 leader_election.cc:343] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.763911 22147 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:20.764721 22408 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.766242 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:20.767167 22105 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 1: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:05:20.767493 22362 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:20.770092 22453 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:20.770388 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:20.770911 22297 raft_consensus.cc:359] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.771646 22297 raft_consensus.cc:385] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.771934 22297 raft_consensus.cc:740] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.773469 22252 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.772578 22297 consensus_queue.cc:260] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.782541 22297 ts_tablet_manager.cc:1434] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:05:20.783514 22297 tablet_bootstrap.cc:492] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:20.772467 22220 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:20.784793 22453 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.785917 22296 tablet_bootstrap.cc:654] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.786301 22001 catalog_manager.cc:5697] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.790009 22295 tablet_bootstrap.cc:492] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:20.790527 22295 ts_tablet_manager.cc:1403] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.179s	user 0.014s	sys 0.002s
I20260709 13:05:20.792374 22453 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.796788 22296 tablet_bootstrap.cc:492] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:20.797271 22296 ts_tablet_manager.cc:1403] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.001s
I20260709 13:05:20.799377 22295 raft_consensus.cc:359] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.800117 22295 raft_consensus.cc:385] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.800403 22295 raft_consensus.cc:740] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.801082 22295 consensus_queue.cc:260] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.803669 22295 ts_tablet_manager.cc:1434] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:05:20.805181 22295 tablet_bootstrap.cc:492] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:20.807087 22296 raft_consensus.cc:359] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.807798 22296 raft_consensus.cc:385] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.808044 22296 raft_consensus.cc:740] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.808802 22296 consensus_queue.cc:260] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.811400 22296 ts_tablet_manager.cc:1434] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:05:20.812320 22296 tablet_bootstrap.cc:492] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:20.813191 22295 tablet_bootstrap.cc:654] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.819885 22296 tablet_bootstrap.cc:654] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.819892 22297 tablet_bootstrap.cc:654] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.827857 22295 tablet_bootstrap.cc:492] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:20.828541 22295 ts_tablet_manager.cc:1403] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:05:20.828977 22296 tablet_bootstrap.cc:492] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:20.829507 22296 ts_tablet_manager.cc:1403] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:05:20.832301 22295 raft_consensus.cc:359] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.832675 22296 raft_consensus.cc:359] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.833294 22295 raft_consensus.cc:385] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.833565 22296 raft_consensus.cc:385] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.833702 22295 raft_consensus.cc:740] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.834008 22296 raft_consensus.cc:740] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.834962 22296 consensus_queue.cc:260] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.834893 22295 consensus_queue.cc:260] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.837393 22296 ts_tablet_manager.cc:1434] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:20.838449 22296 tablet_bootstrap.cc:492] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:20.842960 22295 ts_tablet_manager.cc:1434] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:05:20.844342 22295 tablet_bootstrap.cc:492] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:20.844704 22296 tablet_bootstrap.cc:654] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.853540 22471 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.854158 22471 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.855973 22362 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.856575 22471 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:20.856508 22362 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.858438 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:20.859148 22178 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:20.860693 22071 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:20.860873 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:20.858620 22362 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:20.861423 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:20.862380 22252 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
W20260709 13:05:20.862993 22144 leader_election.cc:343] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.864033 22471 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.864445 22471 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.866641 22471 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.867389 22295 tablet_bootstrap.cc:654] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.865165 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:20.868839 22408 consensus_queue.cc:1048] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:20.869236 22147 leader_election.cc:343] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.869659 22147 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:20.870209 22408 consensus_queue.cc:1048] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:20.870422 22346 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.882301 22295 tablet_bootstrap.cc:492] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:20.882879 22295 ts_tablet_manager.cc:1403] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.006s
I20260709 13:05:20.884961 22297 tablet_bootstrap.cc:492] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:20.885460 22297 ts_tablet_manager.cc:1403] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.102s	user 0.018s	sys 0.018s
I20260709 13:05:20.886354 22295 raft_consensus.cc:359] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.887070 22295 raft_consensus.cc:385] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.887356 22295 raft_consensus.cc:740] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.888187 22295 consensus_queue.cc:260] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.889459 22297 raft_consensus.cc:359] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.890139 22297 raft_consensus.cc:385] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.890400 22297 raft_consensus.cc:740] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.890604 22295 ts_tablet_manager.cc:1434] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:20.883420 22471 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.891894 22295 tablet_bootstrap.cc:492] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:20.896271 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:20.896973 22179 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.899276 22295 tablet_bootstrap.cc:654] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.900601 22324 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.901103 22324 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.906909 22324 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:20.907119 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:20.907816 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:20.908197 22181 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:20.908478 22105 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:20.909897 22218 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:20.914037 22179 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:20.915122 22324 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.915711 22324 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.916100 22324 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.916532 22295 tablet_bootstrap.cc:492] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:20.917013 22295 ts_tablet_manager.cc:1403] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.005s
I20260709 13:05:20.919080 22254 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.919973 22295 raft_consensus.cc:359] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.920701 22295 raft_consensus.cc:385] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.920984 22295 raft_consensus.cc:740] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.921782 22295 consensus_queue.cc:260] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.923947 22295 ts_tablet_manager.cc:1434] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:20.925014 22295 tablet_bootstrap.cc:492] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:20.931167 22295 tablet_bootstrap.cc:654] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.934166 22071 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:20.935545 22329 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.936197 22329 raft_consensus.cc:697] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:20.936606 22296 tablet_bootstrap.cc:492] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:20.937134 22296 ts_tablet_manager.cc:1403] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.009s
I20260709 13:05:20.937410 22329 consensus_queue.cc:237] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.942862 22295 tablet_bootstrap.cc:492] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:20.943387 22295 ts_tablet_manager.cc:1403] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:05:20.943622 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:20.944226 22251 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.946089 22295 raft_consensus.cc:359] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.946846 22295 raft_consensus.cc:385] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.947149 22295 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.948048 22295 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.949692 22295 ts_tablet_manager.cc:1434] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:05:20.956321 22296 raft_consensus.cc:359] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.963794 22296 raft_consensus.cc:385] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.963654 22297 consensus_queue.cc:260] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.964229 22296 raft_consensus.cc:740] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.965157 22296 consensus_queue.cc:260] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.965907 22297 ts_tablet_manager.cc:1434] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.001s
I20260709 13:05:20.960165 22251 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:20.958114 22295 tablet_bootstrap.cc:492] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:20.960623 22471 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:20.966611 22324 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.971200 22296 ts_tablet_manager.cc:1434] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:05:20.973553 22297 tablet_bootstrap.cc:492] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:20.973608 22296 tablet_bootstrap.cc:492] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:20.975417 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:20.976089 22105 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.976405 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:20.977028 22181 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.982442 22296 tablet_bootstrap.cc:654] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.985015 22181 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:20.989048 22220 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:20.990218 22326 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.990842 22326 raft_consensus.cc:697] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:20.992528 22297 tablet_bootstrap.cc:654] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.992012 22326 consensus_queue.cc:237] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:20.984578 22329 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.999397 22329 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.003968 22329 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.011395 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:21.015254 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:05:21.018359 22072 leader_election.cc:343] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:21.022650 22071 leader_election.cc:343] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.023388 22071 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:21.028045 22465 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.031569 22296 tablet_bootstrap.cc:492] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:21.031868 22297 tablet_bootstrap.cc:492] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:21.032696 22296 ts_tablet_manager.cc:1403] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.059s	user 0.021s	sys 0.023s
I20260709 13:05:20.985884 22295 tablet_bootstrap.cc:654] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.035698 22296 raft_consensus.cc:359] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.037111 22296 raft_consensus.cc:385] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.037611 22296 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.038640 22296 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.032784 22297 ts_tablet_manager.cc:1403] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.059s	user 0.024s	sys 0.015s
I20260709 13:05:21.044116 22297 raft_consensus.cc:359] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.047223 22297 raft_consensus.cc:385] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.047758 22297 raft_consensus.cc:740] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.048780 22297 consensus_queue.cc:260] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.046679 22296 ts_tablet_manager.cc:1434] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:05:20.985649 22324 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:21.051097 22296 tablet_bootstrap.cc:492] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:20.994591 22105 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:21.055897 22346 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.056380 22346 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.059533 22346 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.061169 22297 ts_tablet_manager.cc:1434] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:05:21.062404 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:21.063733 22465 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.062579 22297 tablet_bootstrap.cc:492] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:21.064211 22465 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:21.067272 22147 leader_election.cc:343] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.068496 22296 tablet_bootstrap.cc:654] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.068073 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:21.071616 22105 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:21.072925 22144 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:21.074050 22479 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.074419 22479 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.074764 22479 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.077600 22297 tablet_bootstrap.cc:654] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.078619 22295 tablet_bootstrap.cc:492] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:21.079294 22295 ts_tablet_manager.cc:1403] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.121s	user 0.026s	sys 0.020s
I20260709 13:05:21.082814 22324 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.083664 22346 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.083612 22324 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.084268 22346 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.082019 22479 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.086635 22324 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:21.082631 22295 raft_consensus.cc:359] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.098870 22295 raft_consensus.cc:385] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.099366 22295 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.099843 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:21.100253 22295 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.101287 22329 consensus_queue.cc:1048] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.101821 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:21.103533 22147 leader_election.cc:343] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.103688 22295 ts_tablet_manager.cc:1434] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.005s
W20260709 13:05:21.104622 22147 leader_election.cc:343] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.105525 22295 tablet_bootstrap.cc:492] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:21.107020 22297 tablet_bootstrap.cc:492] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:21.087481 22346 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.107589 22297 ts_tablet_manager.cc:1403] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.011s
I20260709 13:05:21.087879 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:05:21.109158 22144 leader_election.cc:343] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.109688 22144 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:21.088649 22465 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.091323 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:21.091395 22479 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.111536 22479 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.094553 22296 tablet_bootstrap.cc:492] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:21.112773 22104 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:21.112998 22296 ts_tablet_manager.cc:1403] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.009s
I20260709 13:05:21.094026 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:21.114462 22179 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:21.082059 22004 catalog_manager.cc:5697] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.115710 22296 raft_consensus.cc:359] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.115859 22297 raft_consensus.cc:359] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.116396 22296 raft_consensus.cc:385] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.116732 22296 raft_consensus.cc:740] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.091733 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:21.117309 22101 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.116454 22297 raft_consensus.cc:385] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.117401 22296 consensus_queue.cc:260] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.118047 22297 raft_consensus.cc:740] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.118192 22251 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.094674 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:21.118665 22297 consensus_queue.cc:260] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.119428 22178 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:21.121181 22297 ts_tablet_manager.cc:1434] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:21.088207 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:21.122483 22297 tablet_bootstrap.cc:492] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:21.124928 22296 ts_tablet_manager.cc:1434] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:05:21.126096 22296 tablet_bootstrap.cc:492] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:21.126715 22101 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:21.128628 22295 tablet_bootstrap.cc:654] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.135982 22297 tablet_bootstrap.cc:654] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.135821 22071 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:21.136849 22329 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.137257 22329 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.137638 22329 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.141057 22144 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:21.117460 22218 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:21.143555 22324 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:21.143816 22072 leader_election.cc:343] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.144791 22479 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.145377 22479 raft_consensus.cc:697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:21.145081 22471 consensus_queue.cc:1048] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:21.144004 22324 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.147246 22324 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.146466 22479 consensus_queue.cc:237] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.154644 22324 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.155845 22296 tablet_bootstrap.cc:654] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.161863 22002 catalog_manager.cc:5697] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.182252 22295 tablet_bootstrap.cc:492] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:21.183099 22295 ts_tablet_manager.cc:1403] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.004s
I20260709 13:05:21.193254 22295 raft_consensus.cc:359] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.194310 22295 raft_consensus.cc:385] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.194715 22295 raft_consensus.cc:740] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.195839 22295 consensus_queue.cc:260] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.197400 22001 catalog_manager.cc:5697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.199075 22295 ts_tablet_manager.cc:1434] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.004s
I20260709 13:05:21.200374 22295 tablet_bootstrap.cc:492] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:21.203619 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:21.204656 22101 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.169566 22329 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.209231 22329 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.209784 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:21.220963 22178 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.210513 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:21.221648 22296 tablet_bootstrap.cc:492] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:21.222239 22296 ts_tablet_manager.cc:1403] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.096s	user 0.018s	sys 0.030s
W20260709 13:05:21.223444 22072 leader_election.cc:343] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.225072 22296 raft_consensus.cc:359] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.225814 22296 raft_consensus.cc:385] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.226089 22296 raft_consensus.cc:740] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.226712 22296 consensus_queue.cc:260] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.228271 22296 ts_tablet_manager.cc:1434] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:05:21.228577 22178 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:21.229153 22296 tablet_bootstrap.cc:492] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:21.229859 22071 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:21.211828 22324 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:21.212327 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:21.230710 22326 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.231154 22179 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.231287 22326 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.233497 22326 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:21.212635 22471 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.234228 22471 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.235733 22296 tablet_bootstrap.cc:654] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.236213 22471 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.238533 22179 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:21.239718 22220 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:21.240803 22324 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.240693 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:21.241513 22324 raft_consensus.cc:697] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:21.242027 22181 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:21.243953 22297 tablet_bootstrap.cc:492] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:21.219352 22295 tablet_bootstrap.cc:654] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.246735 22220 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:21.247402 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:21.244208 22324 consensus_queue.cc:237] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.251220 22297 ts_tablet_manager.cc:1403] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.129s	user 0.015s	sys 0.038s
I20260709 13:05:21.251605 22391 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.252020 22391 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.252386 22391 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.252502 22295 tablet_bootstrap.cc:492] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:21.252801 22465 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.253036 22295 ts_tablet_manager.cc:1403] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.000s
W20260709 13:05:21.254602 22218 leader_election.cc:343] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.253288 22465 raft_consensus.cc:697] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:21.255961 22465 consensus_queue.cc:237] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.216560 22101 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:21.259336 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:21.266784 22295 raft_consensus.cc:359] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.271484 22295 raft_consensus.cc:385] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.272958 22295 raft_consensus.cc:740] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.274461 22181 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:21.293967 22071 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:21.277571 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:21.299994 22453 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.300660 22453 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.303565 22453 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:21.307641 22329 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.308207 22329 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.308616 22329 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.310039 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:21.311088 22181 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:21.312815 22220 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:21.291100 22297 raft_consensus.cc:359] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.316146 22297 raft_consensus.cc:385] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.316525 22297 raft_consensus.cc:740] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.317374 22297 consensus_queue.cc:260] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.314848 22295 consensus_queue.cc:260] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.340281 22297 ts_tablet_manager.cc:1434] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.000s
I20260709 13:05:21.342840 22297 tablet_bootstrap.cc:492] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:21.357491 22471 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.358090 22471 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.359014 22372 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:21.360950 22471 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.363166 22296 tablet_bootstrap.cc:492] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:21.363655 22296 ts_tablet_manager.cc:1403] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.135s	user 0.031s	sys 0.041s
I20260709 13:05:21.372115 22297 tablet_bootstrap.cc:654] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.376749 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:21.377424 22181 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:21.369686 22326 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:21.363699 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 93682.2us
I20260709 13:05:21.415628 22296 raft_consensus.cc:359] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.416414 22296 raft_consensus.cc:385] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.416707 22296 raft_consensus.cc:740] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.417371 22296 consensus_queue.cc:260] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.417686 22536 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.418318 22536 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.420397 22296 ts_tablet_manager.cc:1434] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:05:21.421763 22296 tablet_bootstrap.cc:492] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:21.423146 22295 ts_tablet_manager.cc:1434] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.170s	user 0.019s	sys 0.003s
I20260709 13:05:21.424405 22295 tablet_bootstrap.cc:492] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:21.414551 22326 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.434369 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:21.436327 22326 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.437162 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:21.457062 22004 catalog_manager.cc:5697] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.450762 22542 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.437408 22071 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:21.453147 22536 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:21.453385 22105 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:21.452597 22391 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.472308 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:21.473750 22391 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:21.475080 22471 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:21.475225 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 44611.5us
I20260709 13:05:21.475549 22471 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:21.464133 22072 leader_election.cc:343] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.477691 22471 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.467583 22542 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.491343 22542 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:21.489707 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:21.494372 22329 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.495397 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:21.496048 22180 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.503335 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:21.504391 22181 raft_consensus.cc:2393] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 1: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:05:21.508152 22296 tablet_bootstrap.cc:654] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.511206 22297 tablet_bootstrap.cc:492] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:21.511412 22465 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.511732 22297 ts_tablet_manager.cc:1403] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.169s	user 0.011s	sys 0.011s
I20260709 13:05:21.520051 22329 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.514561 22001 catalog_manager.cc:5697] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.522831 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:21.525005 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:21.525668 22177 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.511950 22465 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.534516 22545 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.554621 22254 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.557219 22465 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.539935 22218 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:21.568795 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:21.569875 22179 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:21.574438 22180 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:21.547749 22471 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.541441 22545 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.621304 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:21.627848 22180 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.628911 22326 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.630141 22252 raft_consensus.cc:2393] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 1: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:05:21.633957 22326 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:21.616835 22471 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:21.619544 22218 leader_election.cc:343] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.636106 22297 raft_consensus.cc:359] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.634720 22180 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:21.639047 22071 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:21.640211 22295 tablet_bootstrap.cc:654] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.641273 22297 raft_consensus.cc:385] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.643047 22297 raft_consensus.cc:740] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.644133 22465 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.644520 22465 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.644845 22465 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.646410 22372 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.646800 22071 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:21.646906 22372 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.648850 22463 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.649302 22372 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.651147 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:21.651405 22220 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:21.649303 22463 raft_consensus.cc:697] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:21.652808 22541 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.653908 22297 consensus_queue.cc:260] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.653327 22541 raft_consensus.cc:697] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:21.653004 22463 consensus_queue.cc:237] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.644898 22545 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.655486 22541 consensus_queue.cc:237] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.659930 22297 ts_tablet_manager.cc:1434] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.148s	user 0.005s	sys 0.003s
I20260709 13:05:21.660765 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:21.662140 22297 tablet_bootstrap.cc:492] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:21.662441 22296 tablet_bootstrap.cc:492] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:21.662945 22296 ts_tablet_manager.cc:1403] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.241s	user 0.007s	sys 0.008s
I20260709 13:05:21.664381 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:05:21.665604 22144 leader_election.cc:343] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:21.668366 22052 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:21.669732 22465 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.672577 22296 raft_consensus.cc:359] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.673362 22296 raft_consensus.cc:385] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.673745 22296 raft_consensus.cc:740] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.673693 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:21.674597 22178 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.674819 22296 consensus_queue.cc:260] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.656699 22177 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:21.681710 22071 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:21.683662 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:21.679591 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:21.686055 22372 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.688612 22372 raft_consensus.cc:697] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:21.696286 22296 ts_tablet_manager.cc:1434] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
W20260709 13:05:21.696022 22071 leader_election.cc:343] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.699658 22296 tablet_bootstrap.cc:492] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:21.700595 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:21.704741 22538 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:21.707547 22465 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.716650 22372 consensus_queue.cc:237] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.719434 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:21.727597 22180 raft_consensus.cc:2393] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 1: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:05:21.726375 22001 catalog_manager.cc:5697] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:21.728509 22147 leader_election.cc:343] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.729015 22147 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:21.732558 22408 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.733929 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:21.733289 22545 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.736162 22545 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.732195 22178 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:21.747120 22453 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.747972 22465 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:21.755779 22147 consensus_peers.cc:597] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:21.753698 22465 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.758100 22297 tablet_bootstrap.cc:654] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.762681 22071 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:21.765018 22346 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:21.766885 22463 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.767460 22463 raft_consensus.cc:697] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:21.768023 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:21.768656 22178 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:21.768581 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:21.772167 22295 tablet_bootstrap.cc:492] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:21.768494 22463 consensus_queue.cc:237] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.758798 22465 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.772982 22295 ts_tablet_manager.cc:1403] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.349s	user 0.013s	sys 0.006s
I20260709 13:05:21.789594 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:21.787763 22545 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.796698 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:21.774576 22254 raft_consensus.cc:2393] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 1: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:05:21.792312 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:21.802995 22106 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:21.802708 22295 raft_consensus.cc:359] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.807204 22295 raft_consensus.cc:385] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.807476 22295 raft_consensus.cc:740] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
W20260709 13:05:21.790143 22547 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:05:21.811175 22295 consensus_queue.cc:260] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.804416 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:21.813944 22295 ts_tablet_manager.cc:1434] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:05:21.815411 22295 tablet_bootstrap.cc:492] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:21.783874 22071 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:21.816054 22002 catalog_manager.cc:5697] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.819980 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:21.820952 22253 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.822515 22465 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.822947 22465 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.823279 22465 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:21.823803 22072 leader_election.cc:343] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.823710 22369 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.827062 22545 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.827484 22545 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.827829 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:21.827865 22545 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:21.829030 22072 leader_election.cc:343] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:21.814509 22147 leader_election.cc:343] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:21.834453 22072 leader_election.cc:343] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.834899 22072 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:21.844952 22296 tablet_bootstrap.cc:654] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.839205 22471 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.852553 22218 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:21.854661 22538 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.858161 22326 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.861745 22369 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.864567 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:21.866385 22453 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:21.865934 22542 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.885032 22297 tablet_bootstrap.cc:492] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:21.885571 22297 ts_tablet_manager.cc:1403] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.224s	user 0.012s	sys 0.014s
I20260709 13:05:21.888806 22297 raft_consensus.cc:359] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.889484 22297 raft_consensus.cc:385] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.889773 22297 raft_consensus.cc:740] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
W20260709 13:05:21.890425 22553 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.051s	user 0.003s	sys 0.000s
I20260709 13:05:21.894906 22295 tablet_bootstrap.cc:654] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.892858 22453 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:05:21.896775 22545 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.890616 22297 consensus_queue.cc:260] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.903421 22297 ts_tablet_manager.cc:1434] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:05:21.904064 22545 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.904256 22297 tablet_bootstrap.cc:492] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:21.907320 22465 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.909456 22296 tablet_bootstrap.cc:492] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:21.909662 22465 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:21.909976 22296 ts_tablet_manager.cc:1403] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.211s	user 0.011s	sys 0.005s
I20260709 13:05:21.963378 22479 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.961787 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:21.979144 22479 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:21.962818 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:21.974143 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:05:21.987533 22072 leader_election.cc:343] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.991289 22104 raft_consensus.cc:2393] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 1: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:05:21.997339 22295 tablet_bootstrap.cc:492] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:21.998361 22295 ts_tablet_manager.cc:1403] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.183s	user 0.017s	sys 0.002s
W20260709 13:05:22.000427 22147 leader_election.cc:343] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.001058 22147 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:22.003141 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:22.005645 22180 raft_consensus.cc:2393] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 1: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:05:22.009624 22545 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.010789 22479 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:22.011674 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:22.013875 22102 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
W20260709 13:05:22.017565 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 70798.1us
I20260709 13:05:22.019536 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:22.021515 22147 leader_election.cc:343] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.028409 22144 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:22.031678 22362 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:22.037617 22297 tablet_bootstrap.cc:654] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.033336 22362 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.041726 22362 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:22.045270 22072 leader_election.cc:343] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.056037 22465 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:22.056887 22072 leader_election.cc:343] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.057507 22072 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:22.058670 22369 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.063982 22295 raft_consensus.cc:359] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.073673 22295 raft_consensus.cc:385] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.074098 22295 raft_consensus.cc:740] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.075786 22296 raft_consensus.cc:359] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.076676 22296 raft_consensus.cc:385] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.076974 22296 raft_consensus.cc:740] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.079653 22295 consensus_queue.cc:260] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.080991 22542 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.081496 22542 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.084687 22296 consensus_queue.cc:260] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.098820 22542 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:22.102560 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:22.104000 22102 raft_consensus.cc:2393] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 1: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:05:22.106048 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:22.107048 22179 raft_consensus.cc:2393] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 1: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:05:22.108443 22220 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:22.110095 22538 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.113933 22296 ts_tablet_manager.cc:1434] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.147s	user 0.008s	sys 0.001s
I20260709 13:05:22.118330 22295 ts_tablet_manager.cc:1434] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.006s
I20260709 13:05:22.118456 22002 catalog_manager.cc:5697] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.119371 22296 tablet_bootstrap.cc:492] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:22.123317 22369 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:22.124964 22538 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.121994 22002 catalog_manager.cc:5697] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.123327 22295 tablet_bootstrap.cc:492] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:22.114262 22362 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.138872 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:05:22.141865 22147 leader_election.cc:343] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.145990 22463 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:22.146165 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:22.147881 22101 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.150277 22295 tablet_bootstrap.cc:654] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.150358 22362 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:22.171578 22296 tablet_bootstrap.cc:654] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.198333 22297 tablet_bootstrap.cc:492] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:22.219188 22297 ts_tablet_manager.cc:1403] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.315s	user 0.011s	sys 0.009s
I20260709 13:05:22.222566 22101 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
W20260709 13:05:22.224243 22072 consensus_peers.cc:597] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.224906 22144 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:22.228008 22295 tablet_bootstrap.cc:492] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:22.228574 22295 ts_tablet_manager.cc:1403] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.106s	user 0.024s	sys 0.020s
I20260709 13:05:22.230603 22297 raft_consensus.cc:359] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.231407 22297 raft_consensus.cc:385] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.231673 22297 raft_consensus.cc:740] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.232386 22297 consensus_queue.cc:260] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.232969 22537 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:22.239347 22072 consensus_peers.cc:597] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.239969 22297 ts_tablet_manager.cc:1434] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:05:22.240108 22362 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:22.240017 22218 consensus_peers.cc:597] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.247543 22362 raft_consensus.cc:697] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:22.248567 22362 consensus_queue.cc:237] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.250010 22471 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:22.241436 22297 tablet_bootstrap.cc:492] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:22.242117 22542 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.241982 22295 raft_consensus.cc:359] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.259217 22296 tablet_bootstrap.cc:492] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:22.259333 22295 raft_consensus.cc:385] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.259714 22296 ts_tablet_manager.cc:1403] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.141s	user 0.013s	sys 0.031s
I20260709 13:05:22.259867 22295 raft_consensus.cc:740] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.260905 22295 consensus_queue.cc:260] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.262769 22295 ts_tablet_manager.cc:1434] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.004s
I20260709 13:05:22.268061 22295 tablet_bootstrap.cc:492] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:22.259357 22542 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.276963 22297 tablet_bootstrap.cc:654] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.276866 22296 raft_consensus.cc:359] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.278275 22296 raft_consensus.cc:385] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.278595 22296 raft_consensus.cc:740] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.279240 22296 consensus_queue.cc:260] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.281888 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:22.279778 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:05:22.284468 22218 leader_election.cc:343] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:22.285427 22220 leader_election.cc:343] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.280256 22542 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:22.285802 22296 ts_tablet_manager.cc:1434] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:05:22.285868 22220 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:22.295042 22471 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:22.295514 22542 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.303498 22296 tablet_bootstrap.cc:492] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:22.315199 22295 tablet_bootstrap.cc:654] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.333241 22463 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.333817 22463 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.340924 22463 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:22.342895 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:22.349737 22072 leader_election.cc:343] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.359483 22296 tablet_bootstrap.cc:654] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.359614 22297 tablet_bootstrap.cc:492] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:22.360157 22297 ts_tablet_manager.cc:1403] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.119s	user 0.022s	sys 0.018s
I20260709 13:05:22.365064 22002 catalog_manager.cc:5697] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.367985 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:05:22.371796 22071 leader_election.cc:343] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.372298 22071 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:22.373070 22471 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.393501 22297 raft_consensus.cc:359] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.394263 22297 raft_consensus.cc:385] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.395167 22295 tablet_bootstrap.cc:492] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:22.395658 22295 ts_tablet_manager.cc:1403] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.128s	user 0.013s	sys 0.019s
I20260709 13:05:22.396875 22296 tablet_bootstrap.cc:492] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:22.397373 22296 ts_tablet_manager.cc:1403] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.098s	user 0.006s	sys 0.013s
I20260709 13:05:22.398294 22295 raft_consensus.cc:359] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.399026 22295 raft_consensus.cc:385] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.399314 22295 raft_consensus.cc:740] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.401298 22295 consensus_queue.cc:260] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.400339 22296 raft_consensus.cc:359] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.404409 22295 ts_tablet_manager.cc:1434] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:22.404441 22296 raft_consensus.cc:385] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.404911 22296 raft_consensus.cc:740] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.405735 22295 tablet_bootstrap.cc:492] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:22.405684 22296 consensus_queue.cc:260] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.408499 22296 ts_tablet_manager.cc:1434] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:05:22.394549 22297 raft_consensus.cc:740] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.409343 22297 consensus_queue.cc:260] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.409907 22296 tablet_bootstrap.cc:492] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:22.411541 22297 ts_tablet_manager.cc:1434] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.002s
I20260709 13:05:22.412984 22297 tablet_bootstrap.cc:492] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:22.417966 22296 tablet_bootstrap.cc:654] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.425428 22295 tablet_bootstrap.cc:654] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.438627 22296 tablet_bootstrap.cc:492] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:22.439208 22296 ts_tablet_manager.cc:1403] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.008s
I20260709 13:05:22.441955 22296 raft_consensus.cc:359] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.442728 22296 raft_consensus.cc:385] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.443395 22296 raft_consensus.cc:740] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.444540 22296 consensus_queue.cc:260] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.447228 22297 tablet_bootstrap.cc:654] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.447975 22295 tablet_bootstrap.cc:492] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:22.448325 22296 ts_tablet_manager.cc:1434] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:22.448413 22295 ts_tablet_manager.cc:1403] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.001s
I20260709 13:05:22.449594 22296 tablet_bootstrap.cc:492] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:22.451332 22295 raft_consensus.cc:359] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.451990 22295 raft_consensus.cc:385] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.452271 22295 raft_consensus.cc:740] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.453095 22295 consensus_queue.cc:260] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.456950 22295 ts_tablet_manager.cc:1434] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:05:22.458348 22295 tablet_bootstrap.cc:492] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:22.461225 22296 tablet_bootstrap.cc:654] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.464357 22295 tablet_bootstrap.cc:654] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.466818 22297 tablet_bootstrap.cc:492] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:22.467475 22297 ts_tablet_manager.cc:1403] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.055s	user 0.005s	sys 0.009s
I20260709 13:05:22.468689 22471 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.469193 22471 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.470990 22297 raft_consensus.cc:359] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.471761 22297 raft_consensus.cc:385] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.472101 22297 raft_consensus.cc:740] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.473076 22297 consensus_queue.cc:260] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.473497 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:22.474139 22178 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:22.476384 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:22.477890 22071 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:22.478950 22372 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:22.479485 22372 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.479957 22372 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.483256 22479 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:22.483489 22072 leader_election.cc:343] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.471325 22471 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:22.483822 22479 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.485503 22295 tablet_bootstrap.cc:492] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:22.485659 22296 tablet_bootstrap.cc:492] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:22.485980 22295 ts_tablet_manager.cc:1403] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.011s
I20260709 13:05:22.486024 22296 ts_tablet_manager.cc:1403] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.000s
I20260709 13:05:22.487470 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:22.487808 22372 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.488899 22296 raft_consensus.cc:359] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.489037 22295 raft_consensus.cc:359] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.489588 22296 raft_consensus.cc:385] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.489631 22295 raft_consensus.cc:385] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.489807 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:22.490061 22295 raft_consensus.cc:740] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
W20260709 13:05:22.490314 22144 leader_election.cc:343] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.490020 22296 raft_consensus.cc:740] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.490999 22295 consensus_queue.cc:260] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:22.491397 22147 leader_election.cc:343] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.491904 22147 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:22.486074 22479 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:22.492054 22296 consensus_queue.cc:260] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.492918 22362 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.494465 22296 ts_tablet_manager.cc:1434] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:05:22.495141 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:22.495741 22178 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.496335 22295 ts_tablet_manager.cc:1434] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:05:22.497450 22295 tablet_bootstrap.cc:492] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:22.501560 22297 ts_tablet_manager.cc:1434] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.034s	user 0.001s	sys 0.005s
I20260709 13:05:22.502763 22295 tablet_bootstrap.cc:654] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.506218 22296 tablet_bootstrap.cc:492] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:22.513582 22296 tablet_bootstrap.cc:654] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.517710 22178 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:22.519217 22071 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:22.520083 22471 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:22.520539 22471 raft_consensus.cc:697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:22.521395 22471 consensus_queue.cc:237] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.532495 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:22.533133 22255 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.542201 22297 tablet_bootstrap.cc:492] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:22.547003 22372 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:22.553047 22255 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:22.554309 22297 tablet_bootstrap.cc:654] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.554900 22296 tablet_bootstrap.cc:492] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:22.558460 22296 ts_tablet_manager.cc:1403] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.008s
I20260709 13:05:22.562366 22296 raft_consensus.cc:359] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.563516 22296 raft_consensus.cc:385] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.563942 22296 raft_consensus.cc:740] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.565034 22296 consensus_queue.cc:260] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.568092 22296 ts_tablet_manager.cc:1434] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:22.569361 22296 tablet_bootstrap.cc:492] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:22.569893 22297 tablet_bootstrap.cc:492] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:22.570379 22297 ts_tablet_manager.cc:1403] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.004s
I20260709 13:05:22.573189 22297 raft_consensus.cc:359] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.573937 22297 raft_consensus.cc:385] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.574213 22297 raft_consensus.cc:740] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.574852 22297 consensus_queue.cc:260] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.575855 22004 catalog_manager.cc:5697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.576967 22297 ts_tablet_manager.cc:1434] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:05:22.579258 22296 tablet_bootstrap.cc:654] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.579720 22295 tablet_bootstrap.cc:492] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:22.580197 22295 ts_tablet_manager.cc:1403] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.083s	user 0.019s	sys 0.021s
I20260709 13:05:22.583352 22295 raft_consensus.cc:359] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.584154 22295 raft_consensus.cc:385] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.584416 22295 raft_consensus.cc:740] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.585069 22295 consensus_queue.cc:260] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.585990 22296 tablet_bootstrap.cc:492] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:22.586476 22296 ts_tablet_manager.cc:1403] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.002s
I20260709 13:05:22.587141 22295 ts_tablet_manager.cc:1434] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:22.588142 22295 tablet_bootstrap.cc:492] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:22.589018 22297 tablet_bootstrap.cc:492] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:22.594297 22295 tablet_bootstrap.cc:654] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.594098 22296 raft_consensus.cc:359] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.595521 22296 raft_consensus.cc:385] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.595800 22296 raft_consensus.cc:740] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.596485 22296 consensus_queue.cc:260] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.598558 22296 ts_tablet_manager.cc:1434] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:05:22.599807 22296 tablet_bootstrap.cc:492] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:22.601907 22297 tablet_bootstrap.cc:654] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.605192 22101 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.605902 22296 tablet_bootstrap.cc:654] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.606302 22295 tablet_bootstrap.cc:492] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:22.613780 22479 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.614559 22479 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.618325 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:22.618597 22479 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:22.620945 22144 leader_election.cc:343] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.623389 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:22.625545 22295 ts_tablet_manager.cc:1403] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.014s
I20260709 13:05:22.628551 22295 raft_consensus.cc:359] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.629647 22295 raft_consensus.cc:385] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.630002 22295 raft_consensus.cc:740] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.630748 22295 consensus_queue.cc:260] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:22.634145 22147 leader_election.cc:343] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.634815 22147 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:22.634828 22471 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.636997 22296 tablet_bootstrap.cc:492] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:22.636541 22471 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.637566 22538 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.638067 22538 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.639645 22362 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.637566 22296 ts_tablet_manager.cc:1403] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.024s
I20260709 13:05:22.684489 22471 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:22.687125 22471 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.687603 22471 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.688585 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:22.689739 22471 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:22.692315 22471 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.692786 22471 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.694473 22297 tablet_bootstrap.cc:492] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:22.694314 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:22.694943 22297 ts_tablet_manager.cc:1403] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.007s
I20260709 13:05:22.696202 22538 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:22.698321 22297 raft_consensus.cc:359] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.699127 22297 raft_consensus.cc:385] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.699394 22297 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.700090 22453 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.700047 22297 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.700706 22453 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.702739 22297 ts_tablet_manager.cc:1434] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:05:22.703118 22453 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:22.704088 22297 tablet_bootstrap.cc:492] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:22.704269 22471 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:22.705441 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:22.698731 22295 ts_tablet_manager.cc:1434] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 13:05:22.709172 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:22.709903 22537 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.711432 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:22.711884 22296 raft_consensus.cc:359] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.712100 22178 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:22.712116 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:22.712560 22296 raft_consensus.cc:385] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.712875 22296 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.712908 22180 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:22.713634 22296 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.716756 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:22.716636 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:22.717450 22255 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:22.717788 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:22.719837 22296 ts_tablet_manager.cc:1434] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.079s	user 0.013s	sys 0.029s
I20260709 13:05:22.720877 22296 tablet_bootstrap.cc:492] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:22.723090 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:22.723800 22254 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:22.724386 22071 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:22.725394 22329 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:22.725435 22071 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:22.725663 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:22.725875 22329 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.726279 22329 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.727092 22372 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:22.727470 22372 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.727840 22372 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.728412 22295 tablet_bootstrap.cc:492] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
W20260709 13:05:22.729087 22072 leader_election.cc:343] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.733945 22329 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:22.726694 22071 leader_election.cc:343] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.736097 22329 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:22.735949 22072 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:22.736829 22372 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.737730 22218 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:22.741685 22255 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.742014 22297 tablet_bootstrap.cc:654] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.741622 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:22.742501 22180 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.747267 22537 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.747704 22296 tablet_bootstrap.cc:654] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.747982 22537 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.748541 22537 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.750702 22537 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:22.750815 22372 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:22.751449 22372 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:22.751564 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:22.751834 22372 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.752031 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:22.752234 22178 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.752231 22372 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.756155 22295 tablet_bootstrap.cc:654] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.759387 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:22.763672 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:22.764345 22254 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.766846 22178 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:22.768112 22071 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:22.769026 22471 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:22.769500 22471 raft_consensus.cc:697] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:22.770336 22471 consensus_queue.cc:237] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.750667 22180 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
W20260709 13:05:22.778604 22072 leader_election.cc:343] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.780942 22071 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:22.781962 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:22.787477 22252 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.790433 22253 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.799001 22101 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 1: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:05:22.798880 22465 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:22.800545 22465 raft_consensus.cc:697] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:22.802594 22362 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.803215 22362 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.806147 22465 consensus_queue.cc:237] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.809268 22346 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.809793 22346 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.811901 22346 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:22.805495 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:22.813457 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:22.798542 22329 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.822247 22362 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:22.834486 22296 tablet_bootstrap.cc:492] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:22.835039 22296 ts_tablet_manager.cc:1403] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.114s	user 0.015s	sys 0.018s
I20260709 13:05:22.836254 22295 tablet_bootstrap.cc:492] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:22.837257 22295 ts_tablet_manager.cc:1403] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.017s
I20260709 13:05:22.837692 22296 raft_consensus.cc:359] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.838387 22296 raft_consensus.cc:385] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.838634 22296 raft_consensus.cc:740] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.839397 22296 consensus_queue.cc:260] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.840934 22296 ts_tablet_manager.cc:1434] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:22.841771 22296 tablet_bootstrap.cc:492] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:22.843176 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:22.844172 22297 tablet_bootstrap.cc:492] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:22.830996 22329 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:22.859135 22147 leader_election.cc:343] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.860508 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:22.860787 22250 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.887415 22297 ts_tablet_manager.cc:1403] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.184s	user 0.008s	sys 0.020s
W20260709 13:05:22.888109 22144 leader_election.cc:343] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.889658 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:22.900679 22295 raft_consensus.cc:359] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.905676 22295 raft_consensus.cc:385] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.907085 22295 raft_consensus.cc:740] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.893757 22329 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:22.895604 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 93920us
I20260709 13:05:22.907433 22101 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:22.921547 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:22.923375 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:22.924326 22295 consensus_queue.cc:260] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.926455 22295 ts_tablet_manager.cc:1434] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.002s
I20260709 13:05:22.927577 22296 tablet_bootstrap.cc:654] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:22.928102 22295 tablet_bootstrap.cc:492] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:22.901813 22144 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:22.932982 22297 raft_consensus.cc:359] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.934121 22297 raft_consensus.cc:385] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:22.937638 22297 raft_consensus.cc:740] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.912559 22254 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
W20260709 13:05:22.934789 22052 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:05:22.936461 22071 leader_election.cc:343] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.942245 22297 consensus_queue.cc:260] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.922068 22372 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.951109 22362 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:22.950875 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 83813.5us
I20260709 13:05:22.971937 22144 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:22.974341 22362 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:22.974503 22372 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:22.974956 22362 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.975462 22362 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:22.976194 22538 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:22.979158 22346 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:22.981885 22297 ts_tablet_manager.cc:1434] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.094s	user 0.003s	sys 0.004s
W20260709 13:05:22.985554 22147 leader_election.cc:343] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:22.996847 22362 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:22.999539 22297 tablet_bootstrap.cc:492] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:22.999644 22362 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.000221 22362 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.999794 22004 catalog_manager.cc:5697] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.002038 22004 catalog_manager.cc:5697] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.003309 22296 tablet_bootstrap.cc:492] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:23.004292 22296 ts_tablet_manager.cc:1403] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.163s	user 0.026s	sys 0.029s
W20260709 13:05:23.017143 22072 leader_election.cc:343] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.017658 22072 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:23.017915 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:23.018568 22102 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.019235 22463 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:23.025580 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:23.026459 22249 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.049196 22295 tablet_bootstrap.cc:654] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.049573 22297 tablet_bootstrap.cc:654] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.054592 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:05:23.064682 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 43891.5us
W20260709 13:05:23.065609 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 67656.9us
I20260709 13:05:23.066617 22179 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.084635 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:23.085439 22249 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:23.093909 22102 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:23.089704 22465 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.099712 22465 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.100659 22072 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:23.101315 22463 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.101776 22465 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.102484 22144 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:23.101801 22463 raft_consensus.cc:697] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:23.103878 22362 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.103824 22463 consensus_queue.cc:237] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.105521 22362 raft_consensus.cc:697] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:23.105504 22471 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:23.106668 22362 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:23.108449 22147 leader_election.cc:343] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.108284 22296 raft_consensus.cc:359] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.110159 22296 raft_consensus.cc:385] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.110564 22296 raft_consensus.cc:740] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.119460 22296 consensus_queue.cc:260] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.128041 22296 ts_tablet_manager.cc:1434] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.123s	user 0.013s	sys 0.010s
I20260709 13:05:23.126044 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:23.137815 22072 leader_election.cc:343] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.138746 22002 catalog_manager.cc:5697] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.165534 22296 tablet_bootstrap.cc:492] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:23.202684 22296 tablet_bootstrap.cc:654] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.189749 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:23.206470 22181 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:23.214975 22297 tablet_bootstrap.cc:492] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:23.215459 22297 ts_tablet_manager.cc:1403] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.221s	user 0.022s	sys 0.026s
I20260709 13:05:23.217713 22071 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:23.219341 22329 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.219709 22329 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.220055 22329 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.220467 22295 tablet_bootstrap.cc:492] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:23.220160 22297 raft_consensus.cc:359] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.221041 22297 raft_consensus.cc:385] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.221385 22297 raft_consensus.cc:740] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.222325 22297 consensus_queue.cc:260] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.220906 22295 ts_tablet_manager.cc:1403] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.293s	user 0.026s	sys 0.019s
I20260709 13:05:23.223532 22597 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:05:23.224997 22297 ts_tablet_manager.cc:1434] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:23.213598 22463 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.227420 22463 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.232522 22295 raft_consensus.cc:359] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.233559 22295 raft_consensus.cc:385] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.234486 22295 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.236042 22295 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.236773 22463 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.238953 22297 tablet_bootstrap.cc:492] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:23.239161 22295 ts_tablet_manager.cc:1434] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:05:23.239507 22179 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:23.240208 22295 tablet_bootstrap.cc:492] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:23.241096 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:23.241734 22178 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:23.248435 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:23.253765 22072 leader_election.cc:343] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.264122 22071 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:23.265861 22297 tablet_bootstrap.cc:654] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.266006 22463 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.261951 22004 catalog_manager.cc:5697] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.266400 22463 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.267594 22463 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.271132 22296 tablet_bootstrap.cc:492] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:23.271746 22296 ts_tablet_manager.cc:1403] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.119s	user 0.019s	sys 0.005s
I20260709 13:05:23.270421 22329 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.275755 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:05:23.278863 22072 leader_election.cc:343] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.279811 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:23.280396 22178 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:23.283227 22608 log.cc:927] Time spent T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:05:23.283484 22329 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.292323 22295 tablet_bootstrap.cc:654] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.300781 22296 raft_consensus.cc:359] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.301664 22296 raft_consensus.cc:385] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.302062 22296 raft_consensus.cc:740] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.305361 22463 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.308012 22178 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:23.309345 22296 consensus_queue.cc:260] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.311833 22296 ts_tablet_manager.cc:1434] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:05:23.311707 22071 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:23.312986 22296 tablet_bootstrap.cc:492] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:23.313796 22369 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.314308 22369 raft_consensus.cc:697] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:23.315171 22369 consensus_queue.cc:237] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.328559 22463 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.329134 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:23.329859 22178 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.330267 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:05:23.338189 22072 leader_election.cc:343] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.339208 22465 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:23.344689 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 62109.4us
I20260709 13:05:23.345793 22178 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:23.354346 22296 tablet_bootstrap.cc:654] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.356639 22297 tablet_bootstrap.cc:492] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:23.357132 22297 ts_tablet_manager.cc:1403] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.118s	user 0.022s	sys 0.013s
I20260709 13:05:23.359516 22297 raft_consensus.cc:359] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.359972 22297 raft_consensus.cc:385] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.360132 22297 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.360947 22296 tablet_bootstrap.cc:492] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:23.360692 22297 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.361490 22296 ts_tablet_manager.cc:1403] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.004s
I20260709 13:05:23.363524 22297 ts_tablet_manager.cc:1434] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:23.364480 22297 tablet_bootstrap.cc:492] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:23.364125 22296 raft_consensus.cc:359] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.364938 22296 raft_consensus.cc:385] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.365296 22296 raft_consensus.cc:740] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.365971 22296 consensus_queue.cc:260] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.366914 22369 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.367076 22071 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:23.368229 22465 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.368722 22465 raft_consensus.cc:697] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:23.369699 22295 tablet_bootstrap.cc:492] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:23.369549 22465 consensus_queue.cc:237] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.370183 22295 ts_tablet_manager.cc:1403] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.130s	user 0.010s	sys 0.008s
I20260709 13:05:23.373376 22297 tablet_bootstrap.cc:654] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.375363 22296 ts_tablet_manager.cc:1434] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:05:23.379490 22296 tablet_bootstrap.cc:492] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:23.385859 22296 tablet_bootstrap.cc:654] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.372951 22295 raft_consensus.cc:359] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.386265 22295 raft_consensus.cc:385] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.386530 22295 raft_consensus.cc:740] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.387197 22295 consensus_queue.cc:260] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.389340 22295 ts_tablet_manager.cc:1434] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.002s
I20260709 13:05:23.390298 22295 tablet_bootstrap.cc:492] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:23.403846 22295 tablet_bootstrap.cc:654] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.410440 22254 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.410457 22329 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:05:23.424518 22601 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.425060 22601 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.427471 22601 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:23.430583 22372 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.431298 22372 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.434211 22372 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.439883 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:23.440873 22178 raft_consensus.cc:2393] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 1: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:05:23.442373 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:23.445050 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:05:23.450572 22071 leader_election.cc:343] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.450287 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:23.453209 22538 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.454777 22296 tablet_bootstrap.cc:492] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:23.455386 22296 ts_tablet_manager.cc:1403] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.076s	user 0.018s	sys 0.015s
I20260709 13:05:23.458943 22296 raft_consensus.cc:359] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.459698 22296 raft_consensus.cc:385] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.460841 22296 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.462076 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:23.462185 22296 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.465440 22296 ts_tablet_manager.cc:1434] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
W20260709 13:05:23.467374 22626 log.cc:927] Time spent T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:05:23.468504 22296 tablet_bootstrap.cc:492] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
W20260709 13:05:23.474061 22072 leader_election.cc:343] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.474579 22072 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:23.418628 22004 catalog_manager.cc:5697] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.477830 22463 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:23.483428 22601 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.483982 22601 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.486061 22297 tablet_bootstrap.cc:492] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:23.486568 22297 ts_tablet_manager.cc:1403] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.122s	user 0.027s	sys 0.026s
I20260709 13:05:23.487421 22295 tablet_bootstrap.cc:492] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:23.488090 22601 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:23.490583 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:23.493788 22597 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.494288 22295 ts_tablet_manager.cc:1403] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.104s	user 0.040s	sys 0.000s
I20260709 13:05:23.496891 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:23.498392 22220 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:23.499543 22601 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:23.500469 22538 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:23.500748 22296 tablet_bootstrap.cc:654] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.501030 22295 raft_consensus.cc:359] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.501390 22297 raft_consensus.cc:359] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.507138 22295 raft_consensus.cc:385] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.507242 22297 raft_consensus.cc:385] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.507512 22295 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.507575 22297 raft_consensus.cc:740] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.508273 22297 consensus_queue.cc:260] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.508423 22295 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.510325 22295 ts_tablet_manager.cc:1434] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:05:23.514779 22297 ts_tablet_manager.cc:1434] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.008s
I20260709 13:05:23.515828 22297 tablet_bootstrap.cc:492] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:23.517550 22346 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.527084 22297 tablet_bootstrap.cc:654] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.528425 22620 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.533929 22620 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.536453 22620 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.537355 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:23.537508 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:23.538894 22147 leader_election.cc:343] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:23.539386 22144 leader_election.cc:343] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.539882 22144 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:23.541002 22296 tablet_bootstrap.cc:492] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:23.541102 22620 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:23.531091 22295 tablet_bootstrap.cc:492] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:23.525290 22002 catalog_manager.cc:5697] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.546337 22296 ts_tablet_manager.cc:1403] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.002s
I20260709 13:05:23.549495 22296 raft_consensus.cc:359] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.560815 22250 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.570706 22295 tablet_bootstrap.cc:654] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.583125 22296 raft_consensus.cc:385] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.583536 22296 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.583452 22614 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:23.584384 22296 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.586491 22597 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.587153 22296 ts_tablet_manager.cc:1434] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:05:23.589349 22296 tablet_bootstrap.cc:492] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:23.593011 22295 tablet_bootstrap.cc:492] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:23.593477 22295 ts_tablet_manager.cc:1403] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.005s
I20260709 13:05:23.595661 22296 tablet_bootstrap.cc:654] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.595913 22295 raft_consensus.cc:359] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.596634 22295 raft_consensus.cc:385] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.602303 22295 raft_consensus.cc:740] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.603385 22295 consensus_queue.cc:260] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.604323 22297 tablet_bootstrap.cc:492] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:23.604977 22297 ts_tablet_manager.cc:1403] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.089s	user 0.020s	sys 0.025s
I20260709 13:05:23.608224 22297 raft_consensus.cc:359] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.608927 22297 raft_consensus.cc:385] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.609206 22297 raft_consensus.cc:740] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.609295 22295 ts_tablet_manager.cc:1434] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:05:23.610323 22295 tablet_bootstrap.cc:492] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:23.609891 22297 consensus_queue.cc:260] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.612183 22297 ts_tablet_manager.cc:1434] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:23.613229 22297 tablet_bootstrap.cc:492] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:23.615321 22614 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.619976 22295 tablet_bootstrap.cc:654] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.615852 22614 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.633620 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:23.634268 22105 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:23.637948 22597 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:05:23.641775 22144 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:23.641829 22614 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.646421 22465 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.652508 22619 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.653110 22619 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.653554 22619 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.651932 22465 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.670390 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:23.670790 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:23.671067 22253 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:23.671368 22178 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:23.672180 22072 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:23.676342 22463 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:23.678009 22463 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.678493 22463 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.667783 22465 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.669696 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:23.686285 22614 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.686852 22614 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.689131 22614 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.690232 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:23.692526 22253 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:23.694228 22147 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:23.696933 22614 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.698433 22614 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.700318 22614 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.700984 22296 tablet_bootstrap.cc:492] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:23.700986 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:23.695618 22250 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:23.701536 22296 ts_tablet_manager.cc:1403] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.027s
I20260709 13:05:23.701673 22105 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:23.705070 22297 tablet_bootstrap.cc:654] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.711086 22295 tablet_bootstrap.cc:492] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:23.711555 22295 ts_tablet_manager.cc:1403] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.101s	user 0.031s	sys 0.021s
I20260709 13:05:23.712038 22296 raft_consensus.cc:359] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.712775 22296 raft_consensus.cc:385] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.713060 22296 raft_consensus.cc:740] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.715998 22296 consensus_queue.cc:260] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.717528 22614 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.709494 22597 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:05:23.726125 22296 ts_tablet_manager.cc:1434] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:05:23.730679 22597 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.734519 22295 raft_consensus.cc:359] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.735350 22597 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.736505 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:23.737040 22105 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.737816 22597 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.735371 22295 raft_consensus.cc:385] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.744091 22105 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:23.743814 22295 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.743340 22463 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.748035 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:23.711807 22619 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.749104 22296 tablet_bootstrap.cc:492] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
W20260709 13:05:23.749967 22071 leader_election.cc:343] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.750290 22604 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.750566 22614 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.751026 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:23.751750 22463 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.750816 22604 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.752475 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:23.752650 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:23.753854 22250 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.754127 22255 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.755180 22604 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.756275 22614 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.757205 22614 raft_consensus.cc:697] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:23.763310 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:23.764092 22105 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:23.767535 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:23.768059 22178 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.766939 22144 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:23.770895 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:23.772331 22147 leader_election.cc:343] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.776989 22295 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.758203 22614 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.774509 22604 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.769668 22250 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:23.780364 22604 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.782060 22604 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.780721 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:23.789680 22178 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
W20260709 13:05:23.791790 22072 leader_election.cc:343] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.791957 22071 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:23.792194 22072 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:23.792550 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:23.792836 22597 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:23.793159 22105 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.793334 22597 raft_consensus.cc:697] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:23.793438 22604 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.794726 22465 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:23.794330 22597 consensus_queue.cc:237] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.802531 22296 tablet_bootstrap.cc:654] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.799544 22255 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:23.800038 22295 ts_tablet_manager.cc:1434] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.088s	user 0.010s	sys 0.002s
I20260709 13:05:23.802385 22105 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:23.804862 22144 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:23.803439 22619 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.805684 22620 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.806173 22620 raft_consensus.cc:697] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:23.806982 22620 consensus_queue.cc:237] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.807298 22369 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.808531 22369 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.808944 22369 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.810423 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:23.810976 22369 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.812692 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:23.813575 22297 tablet_bootstrap.cc:492] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:23.814101 22297 ts_tablet_manager.cc:1403] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.201s	user 0.015s	sys 0.002s
I20260709 13:05:23.811031 22250 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:23.815128 22071 leader_election.cc:343] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.818508 22295 tablet_bootstrap.cc:492] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:23.826225 22369 consensus_queue.cc:1048] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:23.835498 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:23.836069 22105 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.841777 22105 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:23.835469 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:23.848356 22144 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:05:23.852360 22072 leader_election.cc:343] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.852803 22072 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:23.860973 22619 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.860960 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:23.865384 22295 tablet_bootstrap.cc:654] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.865250 22002 catalog_manager.cc:5697] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 2, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:23.867959 22147 leader_election.cc:343] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:23.856012 22369 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:23.857335 22604 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:23.889284 22003 catalog_manager.cc:5697] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.894544 22297 raft_consensus.cc:359] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.895315 22297 raft_consensus.cc:385] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.895557 22297 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.896189 22297 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.899387 22297 ts_tablet_manager.cc:1434] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.000s
I20260709 13:05:23.898558 22250 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:23.905145 22296 tablet_bootstrap.cc:492] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:23.905601 22296 ts_tablet_manager.cc:1403] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.159s	user 0.017s	sys 0.007s
I20260709 13:05:23.906213 22297 tablet_bootstrap.cc:492] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:23.905006 22619 raft_consensus.cc:697] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:23.910470 22619 consensus_queue.cc:237] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:23.924731 22072 consensus_peers.cc:597] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.929273 22296 raft_consensus.cc:359] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.930106 22296 raft_consensus.cc:385] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.930524 22297 tablet_bootstrap.cc:654] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.930444 22296 raft_consensus.cc:740] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.931283 22296 consensus_queue.cc:260] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.936837 22296 ts_tablet_manager.cc:1434] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:05:23.937518 22295 tablet_bootstrap.cc:492] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:23.937959 22295 ts_tablet_manager.cc:1403] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.000s
I20260709 13:05:23.944883 22296 tablet_bootstrap.cc:492] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:23.943150 22295 raft_consensus.cc:359] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.948576 22295 raft_consensus.cc:385] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:23.948969 22295 raft_consensus.cc:740] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:23.949579 22295 consensus_queue.cc:260] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.951025 22296 tablet_bootstrap.cc:654] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.953542 22538 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.954020 22538 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.956043 22538 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:23.957719 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:23.958308 22105 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:23.959453 22218 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:23.960188 22601 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:23.960528 22601 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.960844 22601 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.961405 22295 ts_tablet_manager.cc:1434] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:05:23.968626 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:23.971402 22176 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:23.973121 22295 tablet_bootstrap.cc:492] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:23.969733 22601 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:23.976992 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:23.977309 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:23.978070 22178 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.977576 22105 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:23.981694 22295 tablet_bootstrap.cc:654] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:23.989549 22178 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:23.968554 22003 catalog_manager.cc:5697] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.991387 22220 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:23.992355 22538 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:23.992823 22538 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:23.993618 22538 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.001542 22105 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:24.004688 22601 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:24.013767 22295 tablet_bootstrap.cc:492] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:23.993124 22003 catalog_manager.cc:5697] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.020361 22295 ts_tablet_manager.cc:1403] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.006s
I20260709 13:05:24.030412 22295 raft_consensus.cc:359] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.031131 22295 raft_consensus.cc:385] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.031378 22295 raft_consensus.cc:740] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.032008 22295 consensus_queue.cc:260] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.037027 22295 ts_tablet_manager.cc:1434] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:05:24.038017 22295 tablet_bootstrap.cc:492] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:24.043684 22295 tablet_bootstrap.cc:654] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.052249 22295 tablet_bootstrap.cc:492] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:24.052713 22295 ts_tablet_manager.cc:1403] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.002s
I20260709 13:05:24.052332 22002 catalog_manager.cc:5697] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:24.052984 22296 tablet_bootstrap.cc:492] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:24.053602 22296 ts_tablet_manager.cc:1403] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.109s	user 0.008s	sys 0.020s
I20260709 13:05:24.055431 22295 raft_consensus.cc:359] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.056110 22295 raft_consensus.cc:385] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.056368 22295 raft_consensus.cc:740] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.056994 22295 consensus_queue.cc:260] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.059278 22295 ts_tablet_manager.cc:1434] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:24.060221 22295 tablet_bootstrap.cc:492] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:24.061654 22296 raft_consensus.cc:359] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.067358 22296 raft_consensus.cc:385] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.067652 22296 raft_consensus.cc:740] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.068424 22296 consensus_queue.cc:260] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.070408 22296 ts_tablet_manager.cc:1434] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:05:24.072371 22297 tablet_bootstrap.cc:492] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
W20260709 13:05:24.072438 22052 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:24.072965 22297 ts_tablet_manager.cc:1403] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.167s	user 0.037s	sys 0.037s
I20260709 13:05:24.075506 22297 raft_consensus.cc:359] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.076155 22297 raft_consensus.cc:385] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.076404 22297 raft_consensus.cc:740] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.077018 22297 consensus_queue.cc:260] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.066681 22295 tablet_bootstrap.cc:654] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.080894 22296 tablet_bootstrap.cc:492] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:24.084395 22297 ts_tablet_manager.cc:1434] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:05:24.085443 22297 tablet_bootstrap.cc:492] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:24.091648 22297 tablet_bootstrap.cc:654] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.094002 22295 tablet_bootstrap.cc:492] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:24.094611 22295 ts_tablet_manager.cc:1403] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:05:24.098158 22295 raft_consensus.cc:359] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.098863 22295 raft_consensus.cc:385] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.099148 22295 raft_consensus.cc:740] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.099769 22295 consensus_queue.cc:260] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.101728 22295 ts_tablet_manager.cc:1434] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:24.098134 22296 tablet_bootstrap.cc:654] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.103740 22295 tablet_bootstrap.cc:492] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:24.111934 22295 tablet_bootstrap.cc:654] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.113415 22296 tablet_bootstrap.cc:492] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:24.113919 22296 ts_tablet_manager.cc:1403] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.033s	user 0.003s	sys 0.007s
I20260709 13:05:24.116624 22296 raft_consensus.cc:359] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.117125 22295 tablet_bootstrap.cc:492] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:24.117126 22297 tablet_bootstrap.cc:492] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:24.117280 22296 raft_consensus.cc:385] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.117769 22295 ts_tablet_manager.cc:1403] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 13:05:24.117901 22296 raft_consensus.cc:740] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.118096 22297 ts_tablet_manager.cc:1403] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.019s
I20260709 13:05:24.120472 22295 raft_consensus.cc:359] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.120620 22297 raft_consensus.cc:359] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.121306 22295 raft_consensus.cc:385] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.121423 22297 raft_consensus.cc:385] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.121618 22295 raft_consensus.cc:740] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.121820 22297 raft_consensus.cc:740] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.122509 22295 consensus_queue.cc:260] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.122673 22297 consensus_queue.cc:260] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.122853 22296 consensus_queue.cc:260] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.125160 22295 ts_tablet_manager.cc:1434] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:05:24.126161 22295 tablet_bootstrap.cc:492] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:24.131994 22295 tablet_bootstrap.cc:654] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.135658 22297 ts_tablet_manager.cc:1434] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260709 13:05:24.136234 22369 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.136706 22369 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.137343 22295 tablet_bootstrap.cc:492] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:24.137765 22295 ts_tablet_manager.cc:1403] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:05:24.140075 22297 tablet_bootstrap.cc:492] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:24.140347 22295 raft_consensus.cc:359] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.140703 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:24.141079 22295 raft_consensus.cc:385] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.141316 22253 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:24.142514 22072 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:24.138767 22369 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:24.144112 22372 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.144464 22372 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.144791 22372 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.146390 22296 ts_tablet_manager.cc:1434] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:05:24.141407 22295 raft_consensus.cc:740] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.143254 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:24.147255 22176 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:24.148041 22297 tablet_bootstrap.cc:654] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.148022 22295 consensus_queue.cc:260] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.155781 22296 tablet_bootstrap.cc:492] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:24.156733 22295 ts_tablet_manager.cc:1434] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:05:24.157800 22295 tablet_bootstrap.cc:492] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:24.161029 22297 tablet_bootstrap.cc:492] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:24.161603 22297 ts_tablet_manager.cc:1403] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.001s
I20260709 13:05:24.154771 22372 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.164961 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:24.165588 22176 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.167495 22296 tablet_bootstrap.cc:654] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.172531 22295 tablet_bootstrap.cc:654] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.173291 22297 raft_consensus.cc:359] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.174525 22297 raft_consensus.cc:385] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.174827 22297 raft_consensus.cc:740] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.175535 22297 consensus_queue.cc:260] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.177659 22297 ts_tablet_manager.cc:1434] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:05:24.178674 22297 tablet_bootstrap.cc:492] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:24.179462 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:24.179944 22176 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:24.180099 22251 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.181326 22071 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:24.182065 22369 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:24.182500 22369 raft_consensus.cc:697] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:24.183306 22369 consensus_queue.cc:237] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.184811 22329 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.185298 22329 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.187603 22329 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:24.188683 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:24.190061 22072 leader_election.cc:343] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.187413 22251 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:24.192072 22372 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:24.194128 22297 tablet_bootstrap.cc:654] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.194298 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:05:24.204171 22071 leader_election.cc:343] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.204739 22071 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:24.210144 22329 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:24.217206 22296 tablet_bootstrap.cc:492] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:24.217658 22296 ts_tablet_manager.cc:1403] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.004s
I20260709 13:05:24.217716 22295 tablet_bootstrap.cc:492] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:24.218183 22295 ts_tablet_manager.cc:1403] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.003s
I20260709 13:05:24.219019 22649 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.219767 22297 tablet_bootstrap.cc:492] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:24.219491 22649 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.220238 22297 ts_tablet_manager.cc:1403] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.000s
I20260709 13:05:24.221048 22296 raft_consensus.cc:359] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.221159 22295 raft_consensus.cc:359] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.221704 22649 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:24.221810 22296 raft_consensus.cc:385] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.221906 22295 raft_consensus.cc:385] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.222258 22296 raft_consensus.cc:740] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.222414 22295 raft_consensus.cc:740] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.223001 22297 raft_consensus.cc:359] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.223094 22296 consensus_queue.cc:260] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.223747 22297 raft_consensus.cc:385] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.224040 22297 raft_consensus.cc:740] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.223361 22295 consensus_queue.cc:260] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.224324 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:24.224967 22101 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:24.225301 22296 ts_tablet_manager.cc:1434] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:24.225466 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:24.226349 22296 tablet_bootstrap.cc:492] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:24.226254 22144 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:05:24.228189 22147 leader_election.cc:343] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.229027 22649 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.229722 22649 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.230077 22649 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.230492 22295 ts_tablet_manager.cc:1434] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:05:24.230664 22004 catalog_manager.cc:5697] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.232631 22295 tablet_bootstrap.cc:492] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:24.224993 22297 consensus_queue.cc:260] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.236289 22297 ts_tablet_manager.cc:1434] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:05:24.239580 22297 tablet_bootstrap.cc:492] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:24.248047 22295 tablet_bootstrap.cc:654] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.250865 22297 tablet_bootstrap.cc:654] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.256807 22649 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.259603 22649 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:24.259981 22296 tablet_bootstrap.cc:654] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.262809 22297 tablet_bootstrap.cc:492] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:24.262553 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:24.264756 22101 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.262553 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:24.267433 22295 tablet_bootstrap.cc:492] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
W20260709 13:05:24.267555 22147 leader_election.cc:343] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.268334 22295 ts_tablet_manager.cc:1403] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.001s
I20260709 13:05:24.269990 22297 ts_tablet_manager.cc:1403] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.002s
I20260709 13:05:24.271855 22101 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:24.272218 22295 raft_consensus.cc:359] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.273097 22144 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:24.273348 22295 raft_consensus.cc:385] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.273862 22295 raft_consensus.cc:740] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.274205 22649 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:24.274780 22649 raft_consensus.cc:697] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:24.274521 22295 consensus_queue.cc:260] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.272708 22297 raft_consensus.cc:359] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.275626 22649 consensus_queue.cc:237] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.276284 22297 raft_consensus.cc:385] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.276551 22297 raft_consensus.cc:740] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.276788 22295 ts_tablet_manager.cc:1434] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:24.277149 22297 consensus_queue.cc:260] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.277917 22295 tablet_bootstrap.cc:492] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:24.279209 22297 ts_tablet_manager.cc:1434] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:24.280195 22297 tablet_bootstrap.cc:492] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:24.284170 22295 tablet_bootstrap.cc:654] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.287259 22297 tablet_bootstrap.cc:654] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.295070 22538 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.296185 22295 tablet_bootstrap.cc:492] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:24.295743 22538 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.296674 22295 ts_tablet_manager.cc:1403] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:05:24.297242 22296 tablet_bootstrap.cc:492] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:24.303568 22296 ts_tablet_manager.cc:1403] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.011s
I20260709 13:05:24.309815 22178 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:24.313944 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:24.314400 22538 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:24.299484 22295 raft_consensus.cc:359] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.315637 22295 raft_consensus.cc:385] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.315920 22295 raft_consensus.cc:740] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
W20260709 13:05:24.316847 22218 leader_election.cc:343] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.317286 22295 consensus_queue.cc:260] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.317993 22296 raft_consensus.cc:359] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.318940 22295 ts_tablet_manager.cc:1434] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 13:05:24.319787 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:24.320408 22295 tablet_bootstrap.cc:492] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
W20260709 13:05:24.321626 22220 leader_election.cc:343] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.322168 22220 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:24.323109 22537 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:24.323011 22369 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:24.318796 22296 raft_consensus.cc:385] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.327399 22295 tablet_bootstrap.cc:654] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.328073 22297 tablet_bootstrap.cc:492] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:24.328680 22297 ts_tablet_manager.cc:1403] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.000s
I20260709 13:05:24.336992 22250 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:24.325531 22296 raft_consensus.cc:740] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.339226 22372 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:24.340101 22295 tablet_bootstrap.cc:492] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:24.340596 22295 ts_tablet_manager.cc:1403] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.004s
I20260709 13:05:24.343089 22295 raft_consensus.cc:359] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.343787 22295 raft_consensus.cc:385] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.344043 22295 raft_consensus.cc:740] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.344874 22295 consensus_queue.cc:260] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.347245 22295 ts_tablet_manager.cc:1434] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:24.348291 22295 tablet_bootstrap.cc:492] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:24.350309 22369 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.338879 22297 raft_consensus.cc:359] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.351157 22297 raft_consensus.cc:385] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.350843 22369 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.351468 22297 raft_consensus.cc:740] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.355125 22295 tablet_bootstrap.cc:654] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.353250 22369 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:24.355906 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:24.356626 22255 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:24.357514 22604 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:24.359465 22072 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:24.360424 22372 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.360773 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:24.361462 22372 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.348032 22296 consensus_queue.cc:260] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.362823 22372 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.369851 22537 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.370383 22537 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.372570 22537 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:24.376819 22372 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.378047 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:24.378672 22178 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:24.379590 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:24.380838 22220 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:24.379642 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:24.382841 22295 tablet_bootstrap.cc:492] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:24.383612 22295 ts_tablet_manager.cc:1403] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.009s
I20260709 13:05:24.382887 22601 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.387022 22601 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.387435 22601 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.387166 22295 raft_consensus.cc:359] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.388140 22295 raft_consensus.cc:385] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.388479 22295 raft_consensus.cc:740] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
W20260709 13:05:24.389384 22218 leader_election.cc:343] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.389181 22295 consensus_queue.cc:260] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.381392 22362 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:24.391578 22295 ts_tablet_manager.cc:1434] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:05:24.392608 22295 tablet_bootstrap.cc:492] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:24.393272 22372 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:24.398782 22295 tablet_bootstrap.cc:654] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.399307 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:24.399688 22538 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.399901 22251 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.400265 22538 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.402377 22538 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:24.406189 22254 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.407989 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:24.408777 22295 tablet_bootstrap.cc:492] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:24.408859 22102 raft_consensus.cc:2393] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 1: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:05:24.409269 22295 ts_tablet_manager.cc:1403] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:05:24.412103 22295 raft_consensus.cc:359] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.412962 22295 raft_consensus.cc:385] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.413231 22295 raft_consensus.cc:740] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.413879 22295 consensus_queue.cc:260] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.415416 22604 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:24.416041 22295 ts_tablet_manager.cc:1434] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:05:24.417073 22295 tablet_bootstrap.cc:492] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6: Bootstrap starting.
I20260709 13:05:24.417527 22537 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.417991 22537 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.419214 22362 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:24.424947 22537 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:24.425580 22295 tablet_bootstrap.cc:654] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.430963 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:24.431535 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:24.431622 22176 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:24.430367 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:24.433519 22105 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:24.437523 22218 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:24.438422 22537 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.442523 22537 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.443055 22537 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.449805 22297 consensus_queue.cc:260] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.451165 22179 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:24.462821 22537 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.465911 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:24.467574 22105 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.472419 22601 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.475580 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:05:24.477401 22218 leader_election.cc:343] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.473901 22105 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:24.478610 22297 ts_tablet_manager.cc:1434] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.150s	user 0.008s	sys 0.000s
I20260709 13:05:24.480700 22218 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:24.483873 22604 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.484375 22604 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.486403 22604 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:24.486829 22251 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:24.486258 22362 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:24.487531 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:24.441296 22296 ts_tablet_manager.cc:1434] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.137s	user 0.004s	sys 0.002s
I20260709 13:05:24.488415 22102 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:24.489595 22296 tablet_bootstrap.cc:492] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:24.489945 22144 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:24.490834 22362 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.491261 22362 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.491636 22362 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.493798 22537 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:24.495211 22537 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:24.495783 22537 raft_consensus.cc:697] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:24.496726 22537 consensus_queue.cc:237] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.474642 22601 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:24.501999 22362 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.506716 22001 catalog_manager.cc:5697] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.514146 22297 tablet_bootstrap.cc:492] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:24.517457 22362 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:24.510733 22072 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:24.516606 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:24.532408 22104 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.539644 22362 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:24.540764 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 93375.2us
I20260709 13:05:24.540839 22362 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.541981 22220 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:24.529810 22597 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:24.533438 22253 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.545774 22362 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:24.548628 22538 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:24.565083 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:24.566078 22181 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.568027 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:24.568640 22105 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:24.546681 22649 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:05:24.551400 22597 raft_consensus.cc:697] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:24.561048 22681 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.578006 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:24.581169 22604 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.581158 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:05:24.587330 22281 tablet.cc:2406] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:24.586040 22604 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.580480 22681 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.628489 22604 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:24.639528 22683 log.cc:927] Time spent T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:05:24.644562 22181 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:24.621627 22176 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.614617 22601 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.642334 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:24.653697 22689 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.653947 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:24.663672 22688 log.cc:927] Time spent T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:05:24.627067 22597 consensus_queue.cc:237] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.659560 22601 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.674290 22689 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.700636 22295 tablet_bootstrap.cc:492] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6: No bootstrap required, opened a new log
I20260709 13:05:24.701112 22295 ts_tablet_manager.cc:1403] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6: Time spent bootstrapping tablet: real 0.284s	user 0.064s	sys 0.073s
I20260709 13:05:24.682273 22104 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:24.711699 22604 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.713532 22691 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.740412 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:24.714074 22691 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.741192 22101 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:24.770644 22681 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:24.773840 22689 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:24.778684 22218 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:05:24.786936 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 80170.5us
I20260709 13:05:24.787842 22220 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:24.789734 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:24.790408 22252 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:24.796362 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:24.797003 22181 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:24.797245 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:24.798648 22686 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:24.799089 22251 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.799296 22693 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:24.799785 22693 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.783041 22176 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:24.808290 22690 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:24.808709 22690 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.809031 22690 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.782042 22689 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:05:24.817143 22144 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:24.803040 22604 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:24.821923 22694 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:24.829092 22691 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:24.840044 22295 raft_consensus.cc:359] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.840618 22295 raft_consensus.cc:385] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.840849 22295 raft_consensus.cc:740] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.841378 22295 consensus_queue.cc:260] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.833829 22694 raft_consensus.cc:697] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:05:24.846221 22220 leader_election.cc:343] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.846910 22697 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.830789 22686 raft_consensus.cc:697] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:24.856282 22295 ts_tablet_manager.cc:1434] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6: Time spent starting tablet: real 0.155s	user 0.006s	sys 0.001s
W20260709 13:05:24.875555 22147 leader_election.cc:343] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.875751 22297 tablet_bootstrap.cc:654] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:24.876433 22147 leader_election.cc:343] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:24.879892 22296 tablet_bootstrap.cc:654] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.881477 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:24.888659 22697 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.908907 22693 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:24.921461 22692 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.057s
I20260709 13:05:24.933887 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:24.921355 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:24.951028 22248 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.944422 22686 consensus_queue.cc:237] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.956328 22694 consensus_queue.cc:237] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:24.967401 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:24.968391 22104 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:24.991998 22601 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:05:24.996011 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 71332.9us
I20260709 13:05:25.005188 22369 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:25.012866 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:25.014155 22103 raft_consensus.cc:2393] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 1: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:05:25.022104 22218 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:25.023269 22218 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:25.018515 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:25.026666 22691 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:25.030820 22614 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:25.036208 22101 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.040639 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:25.047448 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:25.064370 22697 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:25.068969 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:25.069605 22106 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 0.
I20260709 13:05:25.077860 22297 tablet_bootstrap.cc:492] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:25.078565 22297 ts_tablet_manager.cc:1403] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.599s	user 0.046s	sys 0.037s
I20260709 13:05:25.079027 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:25.110235 22704 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.110862 22704 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.111338 22704 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.119920 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:25.131162 22681 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.131853 22681 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.133754 22179 raft_consensus.cc:2393] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 1: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:05:25.139992 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:25.140689 22296 tablet_bootstrap.cc:492] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:25.141062 22296 ts_tablet_manager.cc:1403] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.652s	user 0.036s	sys 0.099s
W20260709 13:05:25.143112 22218 leader_election.cc:343] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.143597 22218 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:05:25.144255 22220 leader_election.cc:343] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.148186 22705 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:25.148686 22248 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:25.149372 22686 raft_consensus.cc:2764] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:05:25.155458 22101 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:25.156522 22218 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:25.157778 22705 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:25.159307 22362 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:25.169449 22147 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:25.175864 22649 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.177551 22372 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:25.179522 22649 raft_consensus.cc:697] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:25.180444 22649 consensus_queue.cc:237] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.175025 22690 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.200316 22297 raft_consensus.cc:359] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.201086 22297 raft_consensus.cc:385] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.201365 22297 raft_consensus.cc:740] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.201442 22296 raft_consensus.cc:359] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.202303 22296 raft_consensus.cc:385] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.202800 22296 raft_consensus.cc:740] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.202168 22297 consensus_queue.cc:260] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.217226 22296 consensus_queue.cc:260] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.224804 22297 ts_tablet_manager.cc:1434] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.146s	user 0.009s	sys 0.000s
I20260709 13:05:25.238481 22296 ts_tablet_manager.cc:1434] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.097s	user 0.009s	sys 0.000s
I20260709 13:05:25.245365 22296 tablet_bootstrap.cc:492] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:25.247660 22297 tablet_bootstrap.cc:492] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
W20260709 13:05:25.250151 22707 log.cc:927] Time spent T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.280s	user 0.004s	sys 0.000s
W20260709 13:05:25.267233 22052 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:25.270430 22681 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:25.291546 22000 catalog_manager.cc:5697] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.300784 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:25.307967 22690 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:25.318111 22296 tablet_bootstrap.cc:654] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:25.318974 22718 log.cc:927] Time spent T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:05:25.335276 22704 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.338076 22704 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:25.341374 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:05:25.344748 22220 leader_election.cc:343] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.392737 22177 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.408334 22297 tablet_bootstrap.cc:654] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.420547 22690 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:05:25.431895 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:25.433358 22097 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:25.435539 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 385037us
I20260709 13:05:25.457331 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:25.458209 22296 tablet_bootstrap.cc:492] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:25.458788 22296 ts_tablet_manager.cc:1403] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.214s	user 0.015s	sys 0.002s
I20260709 13:05:25.458139 22104 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.502564 22372 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.504526 22372 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.506378 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:25.507202 22176 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.517554 22372 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:25.529619 22104 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:25.558099 22296 raft_consensus.cc:359] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.558863 22296 raft_consensus.cc:385] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.559177 22296 raft_consensus.cc:740] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.559803 22296 consensus_queue.cc:260] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:25.577011 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 74327.4us
I20260709 13:05:25.577831 22296 ts_tablet_manager.cc:1434] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.000s
I20260709 13:05:25.578963 22296 tablet_bootstrap.cc:492] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2: Bootstrap starting.
I20260709 13:05:25.585537 22176 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:25.586241 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:25.586910 22246 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:25.599017 22297 tablet_bootstrap.cc:492] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:25.599603 22297 ts_tablet_manager.cc:1403] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.362s	user 0.018s	sys 0.011s
I20260709 13:05:25.602036 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:25.602893 22105 raft_consensus.cc:2393] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 1: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:05:25.609514 22097 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:05:25.607926 22297 raft_consensus.cc:359] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.612901 22297 raft_consensus.cc:385] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.613307 22297 raft_consensus.cc:740] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.614108 22297 consensus_queue.cc:260] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.618119 22297 ts_tablet_manager.cc:1434] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:05:25.619246 22297 tablet_bootstrap.cc:492] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Bootstrap starting.
I20260709 13:05:25.610136 22072 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:25.620713 22372 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.621078 22372 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.621387 22372 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.621831 22463 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:25.623793 22102 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.616864 22296 tablet_bootstrap.cc:654] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.627512 22604 consensus_queue.cc:1048] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:25.634438 22297 tablet_bootstrap.cc:654] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.641191 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:25.642694 22704 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.643308 22704 raft_consensus.cc:697] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:25.644238 22704 consensus_queue.cc:237] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.650589 22719 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.652690 22719 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.665939 22372 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.642570 22218 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:25.677520 22372 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:25.677953 22220 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:25.673271 22691 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:25.732420 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 49711.3us
I20260709 13:05:25.676227 22705 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 13:05:25.760546 22711 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.104s
I20260709 13:05:25.761032 22697 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.761588 22296 tablet_bootstrap.cc:492] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2: No bootstrap required, opened a new log
I20260709 13:05:25.761696 22697 raft_consensus.cc:697] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:25.762085 22296 ts_tablet_manager.cc:1403] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent bootstrapping tablet: real 0.183s	user 0.023s	sys 0.007s
W20260709 13:05:25.762810 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 84953.1us
I20260709 13:05:25.765576 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:25.768236 22719 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:25.762603 22697 consensus_queue.cc:237] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.796969 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:25.798473 22179 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 0.
I20260709 13:05:25.799317 22102 raft_consensus.cc:2393] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 1: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:05:25.809521 22296 raft_consensus.cc:359] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.810299 22296 raft_consensus.cc:385] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.810643 22296 raft_consensus.cc:740] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.810873 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:25.811585 22255 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:25.811442 22296 consensus_queue.cc:260] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.815804 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:25.816630 22249 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.822862 22296 ts_tablet_manager.cc:1434] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.001s
I20260709 13:05:25.823671 22297 tablet_bootstrap.cc:492] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: No bootstrap required, opened a new log
I20260709 13:05:25.824168 22297 ts_tablet_manager.cc:1403] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent bootstrapping tablet: real 0.205s	user 0.012s	sys 0.036s
I20260709 13:05:25.843197 22691 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:25.855865 22249 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:25.861596 22597 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.862052 22147 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:25.862155 22597 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.862792 22719 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.863178 22719 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.863533 22719 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.868878 22072 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:25.893831 22297 raft_consensus.cc:359] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.894331 22297 raft_consensus.cc:385] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.894588 22297 raft_consensus.cc:740] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.873258 22734 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.888445 22695 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:05:25.887053 22597 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:25.907845 22297 consensus_queue.cc:260] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.872882 22686 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:05:25.911022 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:25.905887 22734 raft_consensus.cc:697] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:25.920907 22537 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:25.926019 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:25.926664 22181 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:25.917852 22708 consensus_queue.cc:1048] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:25.932950 22297 ts_tablet_manager.cc:1434] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.008s
I20260709 13:05:25.921520 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:25.950142 22071 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:25.918380 22734 consensus_queue.cc:237] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.970593 22372 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:25.975947 22719 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:25.985126 22372 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:25.985837 22372 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.993532 22179 raft_consensus.cc:2393] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 1: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:05:26.014094 22372 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:26.009479 22748 log.cc:927] Time spent T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:05:26.029740 22719 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:26.039455 22714 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:05:26.019134 22604 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.053206 22604 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:26.056134 22604 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:26.100965 22749 log.cc:927] Time spent T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:05:26.129639 22746 log.cc:927] Time spent T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.149s	user 0.002s	sys 0.000s
W20260709 13:05:26.126832 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 73025.6us
I20260709 13:05:26.132541 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:26.133476 22248 raft_consensus.cc:2393] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 1: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:05:26.133399 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:26.140993 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:26.154572 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:26.155376 22101 raft_consensus.cc:2393] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 1: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:05:26.158430 22144 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:26.159169 22604 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:26.162104 22144 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:26.162804 22604 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.169158 22604 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:26.175863 22097 raft_consensus.cc:1240] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:26.179212 22686 consensus_queue.cc:1059] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:26.180291 22686 raft_consensus.cc:3055] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:26.180630 22686 raft_consensus.cc:740] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:26.181429 22686 consensus_queue.cc:260] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:26.182665 22686 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.184772 22003 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40934 (request call id 110) took 1296 ms. Trace:
I20260709 13:05:26.185216 22003 rpcz_store.cc:276] 0709 13:05:24.888823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.888948 (+   125us) service_pool.cc:224] Handling call
0709 13:05:26.184685 (+1295737us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21837,"reported_tablets":4}
I20260709 13:05:26.188575 22000 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40946 (request call id 105) took 1381 ms. Trace:
I20260709 13:05:26.208372 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:26.216455 22372 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:26.189019 22000 rpcz_store.cc:276] 0709 13:05:24.807217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.807373 (+   156us) service_pool.cc:224] Handling call
0709 13:05:26.188507 (+1381134us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:25.339705 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:25.353494 (+ 13789us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:25.389320 (+ 35826us) write_op.cc:435] Acquired schema lock
0709 13:05:25.390409 (+  1089us) tablet.cc:662] Decoding operations
0709 13:05:25.475368 (+ 84959us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:25.475438 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:25.475481 (+    43us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:25.475784 (+   303us) tablet.cc:701] Row locks acquired
0709 13:05:25.475810 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:05:25.475987 (+   177us) write_op.cc:270] Start()
0709 13:05:25.476128 (+   141us) write_op.cc:276] Timestamp: P: 1783602325475937 usec, L: 0
0709 13:05:25.476164 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:05:25.517363 (+ 41199us) log.cc:844] Serialized 540 byte log entry
0709 13:05:25.812731 (+295368us) op_driver.cc:464] REPLICATION: finished
0709 13:05:25.915856 (+103125us) write_op.cc:301] APPLY: starting
0709 13:05:25.915933 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:25.916026 (+    93us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:25.942126 (+ 26100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:25.955232 (+ 13106us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:25.966693 (+ 11461us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:25.969975 (+  3282us) write_op.cc:312] APPLY: finished
0709 13:05:25.980699 (+ 10724us) log.cc:844] Serialized 22 byte log entry
0709 13:05:25.994284 (+ 13585us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:25.996633 (+  2349us) write_op.cc:454] Released schema lock
0709 13:05:25.997229 (+   596us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:26.000420 (+  3191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:26.000451 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":121588,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":102896,"apply.run_cpu_time_us":2266,"apply.run_wall_time_us":84535,"num_ops":1,"prepare.queue_time_us":27057,"prepare.run_cpu_time_us":4002,"prepare.run_wall_time_us":190988,"replication_time_us":336425,"thread_start_us":106292,"threads_started":2}]]}
I20260709 13:05:26.194312 22001 catalog_manager.cc:5697] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.220938 22001 catalog_manager.cc:5697] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:05:26.235363 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:26.251529 22003 catalog_manager.cc:5697] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:26.253144 22248 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:26.255525 22072 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:26.255445 22003 catalog_manager.cc:5697] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:05:26.256620 22463 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:26.257118 22463 raft_consensus.cc:697] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:26.257930 22463 consensus_queue.cc:237] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:26.279572 22700 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.281530 22613 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.282094 22613 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:26.284693 22613 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:26.286674 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:26.286258 22000 catalog_manager.cc:5697] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:26.287410 22099 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:26.289012 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:26.289798 22613 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:26.290169 22613 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.290503 22613 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.291654 22686 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.293043 22000 catalog_manager.cc:5697] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:26.328958 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:26.330569 22253 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 0.
I20260709 13:05:26.349603 22613 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:26.353173 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:26.353856 22097 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.368818 22001 catalog_manager.cc:5697] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.370347 22001 catalog_manager.cc:5697] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 1 to 2, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.371989 22700 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:26.373987 22613 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:26.380733 22097 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:26.382036 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:26.382841 22613 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:26.383524 22613 raft_consensus.cc:697] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:26.389524 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:26.390256 22248 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.392314 22700 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.387089 22613 consensus_queue.cc:237] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:26.410115 22248 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
W20260709 13:05:26.466837 22052 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:26.524784 22003 catalog_manager.cc:5697] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.540832 22711 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.558491 22755 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:26.650326 22176 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.656379 22176 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:26.657939 22711 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:26.668614 22248 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:26.671793 22463 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:26.927718 22604 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.945179 22604 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:27.923285 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:27.965596 22772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:27.965595 22769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:27.965675 22770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:27.968025 21001 server_base.cc:1061] running on GCE node
I20260709 13:05:27.969986 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:27.970314 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:27.970526 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602327970503 us; error 0 us; skew 500 ppm
I20260709 13:05:27.971175 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:27.987869 21001 webserver.cc:533] Webserver started at http://127.20.130.68:37691/ using document root <none> and password file <none>
I20260709 13:05:27.988636 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:27.988914 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:27.989326 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:27.991066 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-3-root/instance:
uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-csvd"
I20260709 13:05:27.997133 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:28.002028 22778 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.003082 21001 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:28.003409 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-3-root
uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-csvd"
I20260709 13:05:28.003721 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:28.021862 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:28.023455 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:28.025180 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:28.028611 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:28.028869 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.029153 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:28.029351 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.138679 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.68:35973
I20260709 13:05:28.138839 22840 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.68:35973 every 8 connection(s)
I20260709 13:05:28.143180 21001 auto_leader_rebalancer-test.cc:384] add a tserver: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:28.161494 22841 heartbeater.cc:344] Connected to a master server at 127.20.130.126:34457
I20260709 13:05:28.162011 22841 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:28.162871 22841 heartbeater.cc:507] Master 127.20.130.126:34457 requested a full tablet report, sending...
I20260709 13:05:28.164902 22001 ts_manager.cc:194] Registered new tserver with Master: a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:28.166548 22001 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40410
I20260709 13:05:28.642633 22102 consensus_queue.cc:237] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:28.652019 22176 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:28.653946 22845 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:28.652019 22253 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:28.663280 22845 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:28.686869 22463 raft_consensus.cc:2955] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:28.688747 22176 raft_consensus.cc:2955] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:28.691836 22253 raft_consensus.cc:2955] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:28.708420 22001 catalog_manager.cc:5697] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:28.713707 22099 consensus_queue.cc:237] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
W20260709 13:05:28.718261 22069 consensus_peers.cc:597] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a37c5a7045b24e5f8f89b17248cb9529. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:28.730789 22069 consensus_peers.cc:597] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f1a2136ffa84255b65c2f9037b0e55d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.733758 22253 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:28.734287 22176 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:28.735380 22463 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:28.736832 22845 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:28.746794 22845 raft_consensus.cc:2955] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:28.756450 22253 raft_consensus.cc:2955] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:28.767410 22176 raft_consensus.cc:2955] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:28.772428 22003 catalog_manager.cc:5697] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:28.784475 22176 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:28.793190 22253 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:28.795420 22775 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:28.796828 22099 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:28.798738 22604 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:28.808534 22144 consensus_peers.cc:597] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ac896e940b543ae8dc989463d3c33a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.809847 22604 raft_consensus.cc:2955] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:28.811885 22253 raft_consensus.cc:2955] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:28.812392 22099 raft_consensus.cc:2955] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:28.832145 22000 catalog_manager.cc:5697] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:28.841375 22253 consensus_queue.cc:237] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:28.852499 22177 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:28.855317 22700 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:28.860339 22099 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:28.862031 22867 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:28.867233 22700 raft_consensus.cc:2955] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:28.871331 22176 raft_consensus.cc:2955] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:28.877426 22099 raft_consensus.cc:2955] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:28.893839 22003 catalog_manager.cc:5697] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:28.895129 22218 consensus_peers.cc:597] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f8d3d512e804f4bbd58ae1baf74c000. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:29.117460 22871 ts_tablet_manager.cc:933] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:29.120700 22871 tablet_copy_client.cc:323] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.65:33421
I20260709 13:05:29.138116 22116 tablet_copy_service.cc:140] P c0694f6572bf406a92d55f1f2ab46ef2: Received BeginTabletCopySession request for tablet 3f1a2136ffa84255b65c2f9037b0e55d from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:43368)
I20260709 13:05:29.138676 22116 tablet_copy_service.cc:161] P c0694f6572bf406a92d55f1f2ab46ef2: Beginning new tablet copy session on tablet 3f1a2136ffa84255b65c2f9037b0e55d from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:43368: session id = a07ca3d1b5b84f4bbcb907f709a69275-3f1a2136ffa84255b65c2f9037b0e55d
I20260709 13:05:29.146993 22116 tablet_copy_source_session.cc:215] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:29.152252 22871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1a2136ffa84255b65c2f9037b0e55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.169466 22841 heartbeater.cc:499] Master 127.20.130.126:34457 was elected leader, sending a full tablet report...
I20260709 13:05:29.171371 22871 tablet_copy_client.cc:806] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:29.172091 22871 tablet_copy_client.cc:670] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:29.177129 22871 tablet_copy_client.cc:538] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:29.186522 22871 tablet_bootstrap.cc:492] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:29.204171 22874 ts_tablet_manager.cc:933] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:29.228147 22871 tablet_bootstrap.cc:492] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:29.229259 22871 tablet_bootstrap.cc:492] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:29.229954 22871 ts_tablet_manager.cc:1403] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.044s	user 0.023s	sys 0.002s
I20260709 13:05:29.236534 22874 tablet_copy_client.cc:323] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.65:33421
I20260709 13:05:29.238473 22116 tablet_copy_service.cc:140] P c0694f6572bf406a92d55f1f2ab46ef2: Received BeginTabletCopySession request for tablet a37c5a7045b24e5f8f89b17248cb9529 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:43368)
I20260709 13:05:29.239044 22116 tablet_copy_service.cc:161] P c0694f6572bf406a92d55f1f2ab46ef2: Beginning new tablet copy session on tablet a37c5a7045b24e5f8f89b17248cb9529 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:43368: session id = a07ca3d1b5b84f4bbcb907f709a69275-a37c5a7045b24e5f8f89b17248cb9529
I20260709 13:05:29.247479 22116 tablet_copy_source_session.cc:215] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:29.237730 22871 raft_consensus.cc:359] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:29.249956 22871 raft_consensus.cc:740] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:29.250939 22871 consensus_queue.cc:260] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:29.257015 22874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a37c5a7045b24e5f8f89b17248cb9529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.261335 22871 ts_tablet_manager.cc:1434] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.031s	user 0.018s	sys 0.002s
I20260709 13:05:29.271739 22116 tablet_copy_service.cc:342] P c0694f6572bf406a92d55f1f2ab46ef2: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-3f1a2136ffa84255b65c2f9037b0e55d received from {username='slave'} at 127.0.0.1:43368
I20260709 13:05:29.272357 22116 tablet_copy_service.cc:434] P c0694f6572bf406a92d55f1f2ab46ef2: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-3f1a2136ffa84255b65c2f9037b0e55d on tablet 3f1a2136ffa84255b65c2f9037b0e55d with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:29.275166 22874 tablet_copy_client.cc:806] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:29.280087 22874 tablet_copy_client.cc:670] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:29.285621 22874 tablet_copy_client.cc:538] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:29.293305 22871 ts_tablet_manager.cc:933] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:29.295926 22874 tablet_bootstrap.cc:492] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:29.304729 22871 tablet_copy_client.cc:323] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.66:42399
I20260709 13:05:29.324741 22874 tablet_bootstrap.cc:492] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:29.325697 22874 tablet_bootstrap.cc:492] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:29.326437 22874 ts_tablet_manager.cc:1403] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.004s
I20260709 13:05:29.329929 22874 raft_consensus.cc:359] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:29.330451 22191 tablet_copy_service.cc:140] P 79683575881f4334bd4dc6d9bdbb45c3: Received BeginTabletCopySession request for tablet 6ac896e940b543ae8dc989463d3c33a8 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:57856)
I20260709 13:05:29.330818 22874 raft_consensus.cc:740] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:29.331067 22191 tablet_copy_service.cc:161] P 79683575881f4334bd4dc6d9bdbb45c3: Beginning new tablet copy session on tablet 6ac896e940b543ae8dc989463d3c33a8 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:57856: session id = a07ca3d1b5b84f4bbcb907f709a69275-6ac896e940b543ae8dc989463d3c33a8
I20260709 13:05:29.331549 22874 consensus_queue.cc:260] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:29.333860 22874 ts_tablet_manager.cc:1434] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:29.342101 22116 tablet_copy_service.cc:342] P c0694f6572bf406a92d55f1f2ab46ef2: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-a37c5a7045b24e5f8f89b17248cb9529 received from {username='slave'} at 127.0.0.1:43368
I20260709 13:05:29.342612 22116 tablet_copy_service.cc:434] P c0694f6572bf406a92d55f1f2ab46ef2: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-a37c5a7045b24e5f8f89b17248cb9529 on tablet a37c5a7045b24e5f8f89b17248cb9529 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:29.340320 22191 tablet_copy_source_session.cc:215] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:29.346830 22871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac896e940b543ae8dc989463d3c33a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.363749 22871 tablet_copy_client.cc:806] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:29.364442 22871 tablet_copy_client.cc:670] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:29.368009 22871 tablet_copy_client.cc:538] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:29.377652 22871 tablet_bootstrap.cc:492] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:29.400725 22871 tablet_bootstrap.cc:492] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:29.401553 22871 tablet_bootstrap.cc:492] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:29.402170 22871 ts_tablet_manager.cc:1403] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.008s
I20260709 13:05:29.405041 22871 raft_consensus.cc:359] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:29.406209 22871 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:29.406864 22871 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:29.409525 22871 ts_tablet_manager.cc:1434] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:29.411231 22191 tablet_copy_service.cc:342] P 79683575881f4334bd4dc6d9bdbb45c3: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-6ac896e940b543ae8dc989463d3c33a8 received from {username='slave'} at 127.0.0.1:57856
I20260709 13:05:29.411674 22191 tablet_copy_service.cc:434] P 79683575881f4334bd4dc6d9bdbb45c3: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-6ac896e940b543ae8dc989463d3c33a8 on tablet 6ac896e940b543ae8dc989463d3c33a8 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:29.458545 22871 ts_tablet_manager.cc:933] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:29.460260 22871 tablet_copy_client.cc:323] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.67:42273
I20260709 13:05:29.477432 22265 tablet_copy_service.cc:140] P 765d912bde9e48959e50d9efec3c26b6: Received BeginTabletCopySession request for tablet 2f8d3d512e804f4bbd58ae1baf74c000 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:45738)
I20260709 13:05:29.478017 22265 tablet_copy_service.cc:161] P 765d912bde9e48959e50d9efec3c26b6: Beginning new tablet copy session on tablet 2f8d3d512e804f4bbd58ae1baf74c000 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:45738: session id = a07ca3d1b5b84f4bbcb907f709a69275-2f8d3d512e804f4bbd58ae1baf74c000
I20260709 13:05:29.485678 22265 tablet_copy_source_session.cc:215] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:29.489491 22871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f8d3d512e804f4bbd58ae1baf74c000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.505414 22871 tablet_copy_client.cc:806] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:29.506036 22871 tablet_copy_client.cc:670] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:29.514662 22871 tablet_copy_client.cc:538] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:29.521905 22871 tablet_bootstrap.cc:492] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:29.528431 22816 raft_consensus.cc:1217] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:29.547452 22871 tablet_bootstrap.cc:492] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:29.548621 22871 tablet_bootstrap.cc:492] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:29.549618 22871 ts_tablet_manager.cc:1403] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.028s	user 0.024s	sys 0.000s
I20260709 13:05:29.552464 22871 raft_consensus.cc:359] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:29.553305 22871 raft_consensus.cc:740] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:29.554061 22871 consensus_queue.cc:260] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:29.556546 22871 ts_tablet_manager.cc:1434] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:05:29.558251 22265 tablet_copy_service.cc:342] P 765d912bde9e48959e50d9efec3c26b6: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-2f8d3d512e804f4bbd58ae1baf74c000 received from {username='slave'} at 127.0.0.1:45738
I20260709 13:05:29.558678 22265 tablet_copy_service.cc:434] P 765d912bde9e48959e50d9efec3c26b6: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-2f8d3d512e804f4bbd58ae1baf74c000 on tablet 2f8d3d512e804f4bbd58ae1baf74c000 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:29.733947 22816 raft_consensus.cc:1217] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:29.848656 22816 raft_consensus.cc:1217] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:29.997007 22372 raft_consensus.cc:1064] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:29.999568 22372 consensus_queue.cc:237] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:30.014206 22816 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:30.016274 22252 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:30.017704 22463 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:30.019160 22372 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:30.021023 22177 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:30.023290 22372 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:30.046391 22372 raft_consensus.cc:2955] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.048728 22177 raft_consensus.cc:2955] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.074023 22003 catalog_manager.cc:5697] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.081053 22816 raft_consensus.cc:2955] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.115607 22816 raft_consensus.cc:1217] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:30.119956 22253 raft_consensus.cc:2955] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.129321 22099 consensus_queue.cc:237] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:30.150837 22816 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:30.152609 22845 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:30.157534 22180 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:30.160248 22845 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:30.162163 22889 raft_consensus.cc:2955] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.163759 22816 raft_consensus.cc:2955] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.175678 22180 raft_consensus.cc:2955] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.181502 22002 catalog_manager.cc:5697] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.181473 21988 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3f1a2136ffa84255b65c2f9037b0e55d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:30.206712 22241 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f1a2136ffa84255b65c2f9037b0e55d with delete_type TABLET_DATA_TOMBSTONED (TS 765d912bde9e48959e50d9efec3c26b6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:05:30.217447 22900 tablet_replica.cc:333] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:05:30.218734 22900 raft_consensus.cc:2243] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.219576 22900 raft_consensus.cc:2272] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.222673 22900 ts_tablet_manager.cc:1916] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:30.235715 22900 ts_tablet_manager.cc:1929] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:30.236129 22900 log.cc:1199] T 3f1a2136ffa84255b65c2f9037b0e55d P 765d912bde9e48959e50d9efec3c26b6: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-2-root/wals/3f1a2136ffa84255b65c2f9037b0e55d
I20260709 13:05:30.237648 21991 catalog_manager.cc:5028] TS 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): tablet 3f1a2136ffa84255b65c2f9037b0e55d (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:30.261431 22886 raft_consensus.cc:1064] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:30.263940 22886 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:30.271759 22816 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:30.273456 22248 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:30.274590 22102 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:30.276135 22775 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:30.277557 22887 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:30.279196 22886 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:30.303297 22887 raft_consensus.cc:2955] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.306996 22102 raft_consensus.cc:2955] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.307480 22248 raft_consensus.cc:2955] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.325168 22000 catalog_manager.cc:5697] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.334824 22816 raft_consensus.cc:2955] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.349265 22180 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:30.371932 22889 raft_consensus.cc:1064] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:30.374909 22253 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:30.374636 22889 consensus_queue.cc:237] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:30.378113 22816 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:30.378847 22887 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:05:30.383337 22887 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:30.392097 22815 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:30.392357 22253 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:30.392638 22886 raft_consensus.cc:2955] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.393812 22463 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:30.396229 22463 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:30.401387 22814 raft_consensus.cc:2955] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.416203 22248 raft_consensus.cc:2955] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.420284 22001 catalog_manager.cc:5697] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.421499 22177 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:30.424477 22845 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:30.427345 21990 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6ac896e940b543ae8dc989463d3c33a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:30.445225 22089 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ac896e940b543ae8dc989463d3c33a8 with delete_type TABLET_DATA_TOMBSTONED (TS c0694f6572bf406a92d55f1f2ab46ef2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50280
I20260709 13:05:30.453413 22909 tablet_replica.cc:333] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:05:30.454502 22909 raft_consensus.cc:2243] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.456187 22372 raft_consensus.cc:2955] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.458575 22909 raft_consensus.cc:2272] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.462899 22909 ts_tablet_manager.cc:1916] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:30.464350 22180 raft_consensus.cc:2955] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.474012 22815 raft_consensus.cc:2955] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.476080 22253 raft_consensus.cc:2955] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.492612 22001 catalog_manager.cc:5697] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.503690 22909 ts_tablet_manager.cc:1929] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:30.504282 22909 log.cc:1199] T 6ac896e940b543ae8dc989463d3c33a8 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/wals/6ac896e940b543ae8dc989463d3c33a8
I20260709 13:05:30.506287 21988 catalog_manager.cc:5028] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): tablet 6ac896e940b543ae8dc989463d3c33a8 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:30.520718 22102 consensus_queue.cc:237] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:30.532780 22815 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:30.533001 22248 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:30.535123 22463 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:30.535974 22910 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:30.543303 22845 raft_consensus.cc:2955] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.545596 22815 raft_consensus.cc:2955] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.553790 22253 raft_consensus.cc:2955] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.564750 21988 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a37c5a7045b24e5f8f89b17248cb9529 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:30.567221 22003 catalog_manager.cc:5697] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.582515 22166 tablet_service.cc:1558] Processing DeleteTablet for tablet a37c5a7045b24e5f8f89b17248cb9529 with delete_type TABLET_DATA_TOMBSTONED (TS 79683575881f4334bd4dc6d9bdbb45c3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51110
I20260709 13:05:30.593134 22911 tablet_replica.cc:333] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:05:30.593905 22911 raft_consensus.cc:2243] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.594769 22911 raft_consensus.cc:2272] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.598875 22911 ts_tablet_manager.cc:1916] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:30.614575 22911 ts_tablet_manager.cc:1929] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:30.615021 22911 log.cc:1199] T a37c5a7045b24e5f8f89b17248cb9529 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/wals/a37c5a7045b24e5f8f89b17248cb9529
I20260709 13:05:30.616875 21990 catalog_manager.cc:5028] TS 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): tablet a37c5a7045b24e5f8f89b17248cb9529 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:30.624243 22893 raft_consensus.cc:1064] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:30.626937 22893 consensus_queue.cc:237] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:30.636904 22815 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:30.639609 22102 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:30.638465 22895 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:30.644665 22180 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:30.646440 22885 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:30.647418 22895 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:30.678869 22700 raft_consensus.cc:2955] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.683508 22099 raft_consensus.cc:2955] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.687479 22815 raft_consensus.cc:2955] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.702968 22001 catalog_manager.cc:5697] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.705435 22180 raft_consensus.cc:2955] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.735765 22248 consensus_queue.cc:237] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:30.744508 22177 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:30.747362 22815 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:30.747393 22700 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:30.748874 22885 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:30.756610 22177 raft_consensus.cc:2955] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.755028 22700 raft_consensus.cc:2955] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.760878 22815 raft_consensus.cc:2955] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.770972 21991 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2f8d3d512e804f4bbd58ae1baf74c000 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:30.776350 22000 catalog_manager.cc:5697] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:30.796360 22089 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8d3d512e804f4bbd58ae1baf74c000 with delete_type TABLET_DATA_TOMBSTONED (TS c0694f6572bf406a92d55f1f2ab46ef2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50280
I20260709 13:05:30.797288 22909 tablet_replica.cc:333] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:05:30.798218 22909 raft_consensus.cc:2243] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.798969 22909 raft_consensus.cc:2272] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.802726 22909 ts_tablet_manager.cc:1916] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:30.817344 22909 ts_tablet_manager.cc:1929] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:30.817761 22909 log.cc:1199] T 2f8d3d512e804f4bbd58ae1baf74c000 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/wals/2f8d3d512e804f4bbd58ae1baf74c000
I20260709 13:05:30.819201 21988 catalog_manager.cc:5028] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): tablet 2f8d3d512e804f4bbd58ae1baf74c000 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:31.883963 22102 consensus_queue.cc:237] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:31.890236 22253 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:31.890312 22177 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:05:31.891249 22069 consensus_peers.cc:597] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 663cabb59b2041f98e811d0b49faf5da. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:31.892372 22916 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:31.893482 22889 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:31.904327 22910 raft_consensus.cc:2955] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:31.906299 22253 raft_consensus.cc:2955] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:31.910275 22177 raft_consensus.cc:2955] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:31.928607 22003 catalog_manager.cc:5697] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index -1 to 3, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 2 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:31.930193 22102 consensus_queue.cc:237] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
W20260709 13:05:31.944880 22069 consensus_peers.cc:597] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db1364cdaa794f9fb4739365dc79d393. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:31.945451 22180 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:31.947114 22910 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.963390 22253 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:31.967279 22889 raft_consensus.cc:2955] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:31.968683 22180 raft_consensus.cc:2955] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:31.980978 22889 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.984376 22102 consensus_queue.cc:237] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:31.998440 22248 raft_consensus.cc:2955] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:32.009310 22253 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:32.010406 22069 consensus_peers.cc:597] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96aa7e0b91bf482db9b8977df7574baf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:32.011943 22889 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:32.068123 22176 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:32.077126 22928 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:32.149520 22889 raft_consensus.cc:2955] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:32.150144 22000 catalog_manager.cc:5697] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.165210 22248 raft_consensus.cc:2955] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:32.180526 22176 consensus_queue.cc:237] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:32.187175 22177 raft_consensus.cc:2955] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:32.205369 22000 catalog_manager.cc:5697] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 2 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:32.225847 22248 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:32.226194 22144 consensus_peers.cc:597] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f27e0e0f167848adb3889027a46ee857. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:32.228772 22102 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:32.230582 22887 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:32.231822 22937 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:32.242511 22887 raft_consensus.cc:2955] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:32.244120 22248 raft_consensus.cc:2955] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:32.245633 22102 raft_consensus.cc:2955] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:32.283546 22001 catalog_manager.cc:5697] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:32.323082 22942 ts_tablet_manager.cc:933] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:32.325140 22942 tablet_copy_client.cc:323] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.65:33421
I20260709 13:05:32.327280 22116 tablet_copy_service.cc:140] P c0694f6572bf406a92d55f1f2ab46ef2: Received BeginTabletCopySession request for tablet 663cabb59b2041f98e811d0b49faf5da from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:43368)
I20260709 13:05:32.327877 22116 tablet_copy_service.cc:161] P c0694f6572bf406a92d55f1f2ab46ef2: Beginning new tablet copy session on tablet 663cabb59b2041f98e811d0b49faf5da from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:43368: session id = a07ca3d1b5b84f4bbcb907f709a69275-663cabb59b2041f98e811d0b49faf5da
I20260709 13:05:32.335112 22116 tablet_copy_source_session.cc:215] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:32.338575 22942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663cabb59b2041f98e811d0b49faf5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.356410 22942 tablet_copy_client.cc:806] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:32.357115 22942 tablet_copy_client.cc:670] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:32.361394 22942 tablet_copy_client.cc:538] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:32.372390 22942 tablet_bootstrap.cc:492] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:32.397675 22942 tablet_bootstrap.cc:492] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:32.398623 22942 tablet_bootstrap.cc:492] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:32.399325 22942 ts_tablet_manager.cc:1403] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.009s
I20260709 13:05:32.402617 22942 raft_consensus.cc:359] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:32.403537 22942 raft_consensus.cc:740] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:32.404246 22942 consensus_queue.cc:260] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:32.411239 22942 ts_tablet_manager.cc:1434] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.001s
I20260709 13:05:32.412940 22116 tablet_copy_service.cc:342] P c0694f6572bf406a92d55f1f2ab46ef2: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-663cabb59b2041f98e811d0b49faf5da received from {username='slave'} at 127.0.0.1:43368
I20260709 13:05:32.413445 22116 tablet_copy_service.cc:434] P c0694f6572bf406a92d55f1f2ab46ef2: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-663cabb59b2041f98e811d0b49faf5da on tablet 663cabb59b2041f98e811d0b49faf5da with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:32.555853 22942 ts_tablet_manager.cc:933] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:32.558341 22942 tablet_copy_client.cc:323] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.65:33421
I20260709 13:05:32.559934 22116 tablet_copy_service.cc:140] P c0694f6572bf406a92d55f1f2ab46ef2: Received BeginTabletCopySession request for tablet db1364cdaa794f9fb4739365dc79d393 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:43368)
I20260709 13:05:32.560523 22116 tablet_copy_service.cc:161] P c0694f6572bf406a92d55f1f2ab46ef2: Beginning new tablet copy session on tablet db1364cdaa794f9fb4739365dc79d393 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:43368: session id = a07ca3d1b5b84f4bbcb907f709a69275-db1364cdaa794f9fb4739365dc79d393
I20260709 13:05:32.568303 22116 tablet_copy_source_session.cc:215] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:32.575543 22942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1364cdaa794f9fb4739365dc79d393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.599529 22942 tablet_copy_client.cc:806] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:32.600129 22942 tablet_copy_client.cc:670] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:32.604622 22942 tablet_copy_client.cc:538] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:32.617429 22942 tablet_bootstrap.cc:492] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:32.617686 22947 ts_tablet_manager.cc:933] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:32.621189 22947 tablet_copy_client.cc:323] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.65:33421
I20260709 13:05:32.623440 22116 tablet_copy_service.cc:140] P c0694f6572bf406a92d55f1f2ab46ef2: Received BeginTabletCopySession request for tablet 96aa7e0b91bf482db9b8977df7574baf from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:43368)
I20260709 13:05:32.624008 22116 tablet_copy_service.cc:161] P c0694f6572bf406a92d55f1f2ab46ef2: Beginning new tablet copy session on tablet 96aa7e0b91bf482db9b8977df7574baf from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:43368: session id = a07ca3d1b5b84f4bbcb907f709a69275-96aa7e0b91bf482db9b8977df7574baf
I20260709 13:05:32.631768 22116 tablet_copy_source_session.cc:215] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:32.635298 22947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96aa7e0b91bf482db9b8977df7574baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.640759 22942 tablet_bootstrap.cc:492] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:32.641799 22942 tablet_bootstrap.cc:492] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:32.642695 22942 ts_tablet_manager.cc:1403] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 13:05:32.646031 22942 raft_consensus.cc:359] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:32.647003 22942 raft_consensus.cc:740] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:32.648164 22942 consensus_queue.cc:260] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:32.650604 22942 ts_tablet_manager.cc:1434] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:32.652472 22116 tablet_copy_service.cc:342] P c0694f6572bf406a92d55f1f2ab46ef2: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-db1364cdaa794f9fb4739365dc79d393 received from {username='slave'} at 127.0.0.1:43368
I20260709 13:05:32.652644 22947 tablet_copy_client.cc:806] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:32.652911 22116 tablet_copy_service.cc:434] P c0694f6572bf406a92d55f1f2ab46ef2: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-db1364cdaa794f9fb4739365dc79d393 on tablet db1364cdaa794f9fb4739365dc79d393 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:32.653237 22947 tablet_copy_client.cc:670] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:32.657701 22947 tablet_copy_client.cc:538] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:32.666069 22947 tablet_bootstrap.cc:492] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:32.689697 22947 tablet_bootstrap.cc:492] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:32.690442 22947 tablet_bootstrap.cc:492] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:32.691051 22947 ts_tablet_manager.cc:1403] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.005s
I20260709 13:05:32.693630 22947 raft_consensus.cc:359] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:32.694451 22947 raft_consensus.cc:740] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:32.695199 22947 consensus_queue.cc:260] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:32.697634 22947 ts_tablet_manager.cc:1434] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:05:32.699947 22116 tablet_copy_service.cc:342] P c0694f6572bf406a92d55f1f2ab46ef2: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-96aa7e0b91bf482db9b8977df7574baf received from {username='slave'} at 127.0.0.1:43368
I20260709 13:05:32.700368 22116 tablet_copy_service.cc:434] P c0694f6572bf406a92d55f1f2ab46ef2: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-96aa7e0b91bf482db9b8977df7574baf on tablet 96aa7e0b91bf482db9b8977df7574baf with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:32.765882 22947 ts_tablet_manager.cc:933] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:32.769994 22947 tablet_copy_client.cc:323] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.66:42399
I20260709 13:05:32.772315 22191 tablet_copy_service.cc:140] P 79683575881f4334bd4dc6d9bdbb45c3: Received BeginTabletCopySession request for tablet f27e0e0f167848adb3889027a46ee857 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:57856)
I20260709 13:05:32.772850 22191 tablet_copy_service.cc:161] P 79683575881f4334bd4dc6d9bdbb45c3: Beginning new tablet copy session on tablet f27e0e0f167848adb3889027a46ee857 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:57856: session id = a07ca3d1b5b84f4bbcb907f709a69275-f27e0e0f167848adb3889027a46ee857
I20260709 13:05:32.780627 22191 tablet_copy_source_session.cc:215] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:32.783902 22947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27e0e0f167848adb3889027a46ee857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.798441 22947 tablet_copy_client.cc:806] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:32.799129 22947 tablet_copy_client.cc:670] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:32.802906 22947 tablet_copy_client.cc:538] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:32.812316 22947 tablet_bootstrap.cc:492] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:32.816182 22815 raft_consensus.cc:1217] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:05:32.842622 22947 tablet_bootstrap.cc:492] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:32.843650 22947 tablet_bootstrap.cc:492] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:32.844384 22947 ts_tablet_manager.cc:1403] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.005s
I20260709 13:05:32.847415 22947 raft_consensus.cc:359] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:32.848434 22947 raft_consensus.cc:740] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:32.849267 22947 consensus_queue.cc:260] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:32.852658 22947 ts_tablet_manager.cc:1434] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:05:32.854664 22191 tablet_copy_service.cc:342] P 79683575881f4334bd4dc6d9bdbb45c3: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-f27e0e0f167848adb3889027a46ee857 received from {username='slave'} at 127.0.0.1:57856
I20260709 13:05:32.855170 22191 tablet_copy_service.cc:434] P 79683575881f4334bd4dc6d9bdbb45c3: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-f27e0e0f167848adb3889027a46ee857 on tablet f27e0e0f167848adb3889027a46ee857 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:33.135176 22815 raft_consensus.cc:1217] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:33.221160 22815 raft_consensus.cc:1217] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:05:33.300159 22815 raft_consensus.cc:1217] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:33.405437 22954 raft_consensus.cc:1064] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:33.408363 22954 consensus_queue.cc:237] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:33.475252 22815 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:33.478370 22177 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:33.478432 22954 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:33.486018 22249 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:33.494445 22957 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:33.501194 22954 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:33.520596 22957 raft_consensus.cc:2955] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.523962 22176 raft_consensus.cc:2955] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.535071 22815 raft_consensus.cc:2955] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.536899 22249 raft_consensus.cc:2955] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.545672 22000 catalog_manager.cc:5697] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index 3 to 4, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.585086 22099 consensus_queue.cc:237] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:33.590296 22815 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:33.591035 22176 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:33.592187 22954 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:33.593300 22921 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:33.600313 22921 raft_consensus.cc:2955] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.602350 22176 raft_consensus.cc:2955] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.605967 22815 raft_consensus.cc:2955] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.610556 21988 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 663cabb59b2041f98e811d0b49faf5da with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:33.627954 22001 catalog_manager.cc:5697] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index 4 to 5, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New cstate: current_term: 2 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.644510 22927 raft_consensus.cc:1064] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:33.648842 22241 tablet_service.cc:1558] Processing DeleteTablet for tablet 663cabb59b2041f98e811d0b49faf5da with delete_type TABLET_DATA_TOMBSTONED (TS 765d912bde9e48959e50d9efec3c26b6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51860
I20260709 13:05:33.647529 22927 consensus_queue.cc:237] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:33.666615 22966 tablet_replica.cc:333] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:05:33.668057 22966 raft_consensus.cc:2243] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:33.669219 22966 raft_consensus.cc:2272] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:33.674218 22966 ts_tablet_manager.cc:1916] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:33.679760 22815 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:33.682018 22177 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:33.683488 22249 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:33.683494 22921 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:33.685822 22927 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:33.687304 22921 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:33.714892 22966 ts_tablet_manager.cc:1929] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:05:33.718045 22966 log.cc:1199] T 663cabb59b2041f98e811d0b49faf5da P 765d912bde9e48959e50d9efec3c26b6: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-2-root/wals/663cabb59b2041f98e811d0b49faf5da
I20260709 13:05:33.720330 21991 catalog_manager.cc:5028] TS 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): tablet 663cabb59b2041f98e811d0b49faf5da (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:33.727717 22815 raft_consensus.cc:2955] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.733875 22252 raft_consensus.cc:2955] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.735548 22921 raft_consensus.cc:1064] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:33.713794 22927 raft_consensus.cc:2955] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.745532 22002 catalog_manager.cc:5697] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.738224 22921 consensus_queue.cc:237] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:33.766005 22177 raft_consensus.cc:2955] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.791618 22815 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:33.792142 22176 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:33.793292 22927 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:33.794579 22910 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:33.795979 22252 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:33.797770 22886 raft_consensus.cc:1064] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:33.800515 22886 consensus_queue.cc:237] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:33.804960 22910 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:33.839494 22102 consensus_queue.cc:237] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:33.867355 22814 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:33.872774 22957 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:33.878279 22816 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:33.879398 22099 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:33.883409 22953 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:33.885568 22953 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:33.886479 22954 raft_consensus.cc:2955] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.891624 22814 raft_consensus.cc:2955] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.919339 22177 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:33.926005 22921 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:33.929788 21988 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 96aa7e0b91bf482db9b8977df7574baf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:33.935492 22910 raft_consensus.cc:2955] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.938009 22180 raft_consensus.cc:2955] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.939471 22002 catalog_manager.cc:5697] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New cstate: current_term: 2 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.942939 22886 raft_consensus.cc:2955] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.948417 22814 raft_consensus.cc:2955] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.959252 22177 raft_consensus.cc:2955] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:05:33.953204 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 82301.4us
I20260709 13:05:33.945673 22103 raft_consensus.cc:2955] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:33.980396 22249 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:33.967118 22252 raft_consensus.cc:2955] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:34.000900 22980 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:34.003224 22241 tablet_service.cc:1558] Processing DeleteTablet for tablet 96aa7e0b91bf482db9b8977df7574baf with delete_type TABLET_DATA_TOMBSTONED (TS 765d912bde9e48959e50d9efec3c26b6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:05:34.004364 22966 tablet_replica.cc:333] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:05:34.016920 22000 catalog_manager.cc:5697] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:34.014703 22814 raft_consensus.cc:2955] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:34.030786 22966 raft_consensus.cc:2243] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.031745 22966 raft_consensus.cc:2272] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.059069 22966 ts_tablet_manager.cc:1916] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:34.097107 22966 ts_tablet_manager.cc:1929] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:05:34.099372 22966 log.cc:1199] T 96aa7e0b91bf482db9b8977df7574baf P 765d912bde9e48959e50d9efec3c26b6: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-2-root/wals/96aa7e0b91bf482db9b8977df7574baf
I20260709 13:05:34.103060 21991 catalog_manager.cc:5028] TS 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): tablet 96aa7e0b91bf482db9b8977df7574baf (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:34.105146 22249 raft_consensus.cc:2955] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:34.107391 22103 consensus_queue.cc:237] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:34.088884 22001 catalog_manager.cc:5697] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.114656 22815 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:34.117309 22954 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:34.117681 22253 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:34.119621 22910 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:34.133409 22957 raft_consensus.cc:2955] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:34.137288 22814 raft_consensus.cc:2955] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:34.137639 22249 raft_consensus.cc:2955] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:34.150029 21988 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet db1364cdaa794f9fb4739365dc79d393 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:34.197572 22003 catalog_manager.cc:5697] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.241657 22166 tablet_service.cc:1558] Processing DeleteTablet for tablet db1364cdaa794f9fb4739365dc79d393 with delete_type TABLET_DATA_TOMBSTONED (TS 79683575881f4334bd4dc6d9bdbb45c3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51110
I20260709 13:05:34.243677 22983 tablet_replica.cc:333] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:05:34.244850 22983 raft_consensus.cc:2243] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.245620 22983 raft_consensus.cc:2272] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.261210 22983 ts_tablet_manager.cc:1916] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:34.275349 22983 ts_tablet_manager.cc:1929] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:34.275785 22983 log.cc:1199] T db1364cdaa794f9fb4739365dc79d393 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/wals/db1364cdaa794f9fb4739365dc79d393
I20260709 13:05:34.277707 21990 catalog_manager.cc:5028] TS 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): tablet db1364cdaa794f9fb4739365dc79d393 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:34.589435 22176 consensus_queue.cc:237] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:34.595042 22249 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:34.595042 22814 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:34.596442 22941 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:34.597548 22886 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:34.609226 22886 raft_consensus.cc:2955] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:34.613981 22248 raft_consensus.cc:2955] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:34.620020 21990 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f27e0e0f167848adb3889027a46ee857 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:34.622452 22814 raft_consensus.cc:2955] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:34.648213 22003 catalog_manager.cc:5697] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:34.661628 22089 tablet_service.cc:1558] Processing DeleteTablet for tablet f27e0e0f167848adb3889027a46ee857 with delete_type TABLET_DATA_TOMBSTONED (TS c0694f6572bf406a92d55f1f2ab46ef2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50280
I20260709 13:05:34.670614 22985 tablet_replica.cc:333] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:05:34.679683 22985 raft_consensus.cc:2243] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.680307 22985 raft_consensus.cc:2272] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.683482 22985 ts_tablet_manager.cc:1916] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:34.699564 22985 ts_tablet_manager.cc:1929] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:34.699930 22985 log.cc:1199] T f27e0e0f167848adb3889027a46ee857 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/wals/f27e0e0f167848adb3889027a46ee857
I20260709 13:05:34.701535 21988 catalog_manager.cc:5028] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): tablet f27e0e0f167848adb3889027a46ee857 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:35.739703 22103 consensus_queue.cc:237] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:35.746094 22248 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:35.746328 22069 consensus_peers.cc:597] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f79004ff583f4b278afa2453c7088bf7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:35.747324 22986 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.747530 22177 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:35.748831 22957 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.757146 22910 raft_consensus.cc:2955] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:35.758544 22248 raft_consensus.cc:2955] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:35.762789 22177 raft_consensus.cc:2955] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:35.774175 22002 catalog_manager.cc:5697] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:35.779286 22176 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
W20260709 13:05:35.793589 22144 consensus_peers.cc:597] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0911b6e64ffb48bd9fc4968f8f52860c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:35.794037 22248 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:35.800958 22103 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:35.801623 22886 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.805408 22981 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.818365 22886 raft_consensus.cc:2955] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:35.824833 22097 raft_consensus.cc:2955] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:35.847649 22248 raft_consensus.cc:2955] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:35.853621 22003 catalog_manager.cc:5697] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:35.875499 22097 consensus_queue.cc:237] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
W20260709 13:05:35.884172 22069 consensus_peers.cc:597] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 383c9bd275674f7d8d5cdf16a1456960. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:35.884411 22248 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:35.885820 22986 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.886154 22176 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:35.887454 22910 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.905648 22990 raft_consensus.cc:2955] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:35.907603 22248 raft_consensus.cc:2955] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:35.907961 22176 raft_consensus.cc:2955] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:35.920764 22176 consensus_queue.cc:237] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:35.926054 22003 catalog_manager.cc:5697] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:35.947570 22249 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:35.948942 22144 consensus_peers.cc:597] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d674bb7c45c407e8aa9767c7438a39e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:35.950080 22103 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:35.951802 22999 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.952682 22886 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.967010 22886 raft_consensus.cc:2955] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:35.968755 22249 raft_consensus.cc:2955] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:35.982249 22001 catalog_manager.cc:5697] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.984297 22103 raft_consensus.cc:2955] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:36.188848 23006 ts_tablet_manager.cc:933] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:36.190742 23006 tablet_copy_client.cc:323] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.65:33421
I20260709 13:05:36.192426 22116 tablet_copy_service.cc:140] P c0694f6572bf406a92d55f1f2ab46ef2: Received BeginTabletCopySession request for tablet f79004ff583f4b278afa2453c7088bf7 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:43368)
I20260709 13:05:36.192884 22116 tablet_copy_service.cc:161] P c0694f6572bf406a92d55f1f2ab46ef2: Beginning new tablet copy session on tablet f79004ff583f4b278afa2453c7088bf7 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:43368: session id = a07ca3d1b5b84f4bbcb907f709a69275-f79004ff583f4b278afa2453c7088bf7
I20260709 13:05:36.197712 22116 tablet_copy_source_session.cc:215] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:36.200644 23006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f79004ff583f4b278afa2453c7088bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:36.220541 23006 tablet_copy_client.cc:806] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:36.221189 23006 tablet_copy_client.cc:670] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:36.225335 23006 tablet_copy_client.cc:538] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:36.234826 23006 tablet_bootstrap.cc:492] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:36.255527 23006 tablet_bootstrap.cc:492] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:36.256475 23006 tablet_bootstrap.cc:492] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:36.257144 23006 ts_tablet_manager.cc:1403] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.004s
I20260709 13:05:36.259956 23006 raft_consensus.cc:359] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:36.260632 23006 raft_consensus.cc:740] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:36.261407 23006 consensus_queue.cc:260] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:36.264377 23006 ts_tablet_manager.cc:1434] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.008s
I20260709 13:05:36.267009 22116 tablet_copy_service.cc:342] P c0694f6572bf406a92d55f1f2ab46ef2: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-f79004ff583f4b278afa2453c7088bf7 received from {username='slave'} at 127.0.0.1:43368
I20260709 13:05:36.267431 22116 tablet_copy_service.cc:434] P c0694f6572bf406a92d55f1f2ab46ef2: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-f79004ff583f4b278afa2453c7088bf7 on tablet f79004ff583f4b278afa2453c7088bf7 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:36.289630 23006 ts_tablet_manager.cc:933] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:36.291304 23006 tablet_copy_client.cc:323] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.66:42399
I20260709 13:05:36.292870 22191 tablet_copy_service.cc:140] P 79683575881f4334bd4dc6d9bdbb45c3: Received BeginTabletCopySession request for tablet 0911b6e64ffb48bd9fc4968f8f52860c from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:57856)
I20260709 13:05:36.293417 22191 tablet_copy_service.cc:161] P 79683575881f4334bd4dc6d9bdbb45c3: Beginning new tablet copy session on tablet 0911b6e64ffb48bd9fc4968f8f52860c from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:57856: session id = a07ca3d1b5b84f4bbcb907f709a69275-0911b6e64ffb48bd9fc4968f8f52860c
I20260709 13:05:36.301069 22191 tablet_copy_source_session.cc:215] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:36.304205 23006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0911b6e64ffb48bd9fc4968f8f52860c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:36.319624 23006 tablet_copy_client.cc:806] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:36.320312 23006 tablet_copy_client.cc:670] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:36.324450 23006 tablet_copy_client.cc:538] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:36.334338 23006 tablet_bootstrap.cc:492] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:36.362950 23006 tablet_bootstrap.cc:492] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:36.363986 23006 tablet_bootstrap.cc:492] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:36.364656 23006 ts_tablet_manager.cc:1403] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.031s	user 0.027s	sys 0.003s
I20260709 13:05:36.367586 23006 raft_consensus.cc:359] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:36.368451 23006 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:36.369118 23006 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:36.371846 23006 ts_tablet_manager.cc:1434] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:36.392495 22191 tablet_copy_service.cc:342] P 79683575881f4334bd4dc6d9bdbb45c3: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-0911b6e64ffb48bd9fc4968f8f52860c received from {username='slave'} at 127.0.0.1:57856
I20260709 13:05:36.392963 22191 tablet_copy_service.cc:434] P 79683575881f4334bd4dc6d9bdbb45c3: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-0911b6e64ffb48bd9fc4968f8f52860c on tablet 0911b6e64ffb48bd9fc4968f8f52860c with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:36.396013 23006 ts_tablet_manager.cc:933] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:36.397939 23006 tablet_copy_client.cc:323] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.66:42399
I20260709 13:05:36.399451 22191 tablet_copy_service.cc:140] P 79683575881f4334bd4dc6d9bdbb45c3: Received BeginTabletCopySession request for tablet 5d674bb7c45c407e8aa9767c7438a39e from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:57856)
I20260709 13:05:36.399909 22191 tablet_copy_service.cc:161] P 79683575881f4334bd4dc6d9bdbb45c3: Beginning new tablet copy session on tablet 5d674bb7c45c407e8aa9767c7438a39e from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:57856: session id = a07ca3d1b5b84f4bbcb907f709a69275-5d674bb7c45c407e8aa9767c7438a39e
I20260709 13:05:36.406569 22191 tablet_copy_source_session.cc:215] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:36.409266 23006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d674bb7c45c407e8aa9767c7438a39e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:36.476989 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 55103us
I20260709 13:05:36.477664 23006 tablet_copy_client.cc:806] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:36.478338 23006 tablet_copy_client.cc:670] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:36.485184 23006 tablet_copy_client.cc:538] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:36.502298 23006 tablet_bootstrap.cc:492] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:36.517743 23014 ts_tablet_manager.cc:933] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:36.527673 23014 tablet_copy_client.cc:323] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.65:33421
I20260709 13:05:36.529414 22116 tablet_copy_service.cc:140] P c0694f6572bf406a92d55f1f2ab46ef2: Received BeginTabletCopySession request for tablet 383c9bd275674f7d8d5cdf16a1456960 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:43368)
I20260709 13:05:36.529963 22116 tablet_copy_service.cc:161] P c0694f6572bf406a92d55f1f2ab46ef2: Beginning new tablet copy session on tablet 383c9bd275674f7d8d5cdf16a1456960 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:43368: session id = a07ca3d1b5b84f4bbcb907f709a69275-383c9bd275674f7d8d5cdf16a1456960
I20260709 13:05:36.537453 22116 tablet_copy_source_session.cc:215] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:36.540789 23006 tablet_bootstrap.cc:492] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:36.541800 23006 tablet_bootstrap.cc:492] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:36.542510 23006 ts_tablet_manager.cc:1403] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.003s
I20260709 13:05:36.543984 23014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383c9bd275674f7d8d5cdf16a1456960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:36.546078 23006 raft_consensus.cc:359] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:36.547030 23006 raft_consensus.cc:740] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:36.547719 23006 consensus_queue.cc:260] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:36.550027 23006 ts_tablet_manager.cc:1434] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:05:36.556512 22191 tablet_copy_service.cc:342] P 79683575881f4334bd4dc6d9bdbb45c3: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-5d674bb7c45c407e8aa9767c7438a39e received from {username='slave'} at 127.0.0.1:57856
I20260709 13:05:36.557021 22191 tablet_copy_service.cc:434] P 79683575881f4334bd4dc6d9bdbb45c3: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-5d674bb7c45c407e8aa9767c7438a39e on tablet 5d674bb7c45c407e8aa9767c7438a39e with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:36.572854 23014 tablet_copy_client.cc:806] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:36.573438 23014 tablet_copy_client.cc:670] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:36.578505 23014 tablet_copy_client.cc:538] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:36.589506 23014 tablet_bootstrap.cc:492] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:36.608996 23014 tablet_bootstrap.cc:492] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:36.610025 23014 tablet_bootstrap.cc:492] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:36.611112 23014 ts_tablet_manager.cc:1403] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.004s
I20260709 13:05:36.614365 23014 raft_consensus.cc:359] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:36.615322 23014 raft_consensus.cc:740] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:36.616030 23014 consensus_queue.cc:260] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:36.619572 23014 ts_tablet_manager.cc:1434] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:36.621657 22116 tablet_copy_service.cc:342] P c0694f6572bf406a92d55f1f2ab46ef2: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-383c9bd275674f7d8d5cdf16a1456960 received from {username='slave'} at 127.0.0.1:43368
I20260709 13:05:36.622066 22116 tablet_copy_service.cc:434] P c0694f6572bf406a92d55f1f2ab46ef2: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-383c9bd275674f7d8d5cdf16a1456960 on tablet 383c9bd275674f7d8d5cdf16a1456960 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:36.774739 22814 raft_consensus.cc:1217] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:36.890548 22814 raft_consensus.cc:1217] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:36.901767 22814 raft_consensus.cc:1217] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:36.920198 22815 raft_consensus.cc:1217] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:37.212781 22990 raft_consensus.cc:1064] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:37.215422 22990 consensus_queue.cc:237] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:37.223073 22814 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:37.223371 22176 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:37.224586 22910 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:37.223073 22249 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:37.227049 23013 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:05:37.230875 22910 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:37.257378 23013 raft_consensus.cc:2955] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.258977 22248 raft_consensus.cc:2955] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.260123 22177 raft_consensus.cc:2955] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.271543 22815 raft_consensus.cc:2955] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.276661 23022 raft_consensus.cc:1064] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:37.285259 22002 catalog_manager.cc:5697] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.286885 23022 consensus_queue.cc:237] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:37.313712 22815 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:37.314076 22248 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:37.315404 22177 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:37.316085 22910 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.317430 23026 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.319154 23013 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.356110 23013 raft_consensus.cc:2955] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.358085 22177 raft_consensus.cc:2955] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.371749 22097 consensus_queue.cc:237] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:37.381632 22815 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:37.375360 22249 raft_consensus.cc:2955] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.386967 22248 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:37.389113 22990 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:37.396008 23026 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:37.399150 22910 raft_consensus.cc:2955] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.408488 22815 raft_consensus.cc:2955] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.415392 22248 raft_consensus.cc:2955] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.417986 22001 catalog_manager.cc:5697] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.443931 21988 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f79004ff583f4b278afa2453c7088bf7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:37.451860 22003 catalog_manager.cc:5697] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.457353 22815 raft_consensus.cc:2955] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.472023 22097 consensus_queue.cc:237] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:37.473003 23018 raft_consensus.cc:1064] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:37.483510 22816 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:37.485960 22253 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:37.487434 22990 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:37.490063 22990 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:37.508975 23026 raft_consensus.cc:2955] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.516917 22815 raft_consensus.cc:2955] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.519157 21988 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 383c9bd275674f7d8d5cdf16a1456960 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:37.516918 23018 consensus_queue.cc:237] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:37.530393 22166 tablet_service.cc:1558] Processing DeleteTablet for tablet f79004ff583f4b278afa2453c7088bf7 with delete_type TABLET_DATA_TOMBSTONED (TS 79683575881f4334bd4dc6d9bdbb45c3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51110
I20260709 13:05:37.546046 22248 raft_consensus.cc:2955] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.557677 22249 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:37.559401 22999 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:37.559322 22000 catalog_manager.cc:5697] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.561328 22815 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:37.564654 22103 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:37.577231 23039 tablet_replica.cc:333] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:05:37.578420 23039 raft_consensus.cc:2243] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.579188 23039 raft_consensus.cc:2272] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.581472 23018 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.583285 23038 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:37.583237 22999 raft_consensus.cc:1064] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:37.586756 22999 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:37.588492 23039 ts_tablet_manager.cc:1916] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:37.597041 22166 tablet_service.cc:1558] Processing DeleteTablet for tablet 383c9bd275674f7d8d5cdf16a1456960 with delete_type TABLET_DATA_TOMBSTONED (TS 79683575881f4334bd4dc6d9bdbb45c3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51110
I20260709 13:05:37.609815 23039 ts_tablet_manager.cc:1929] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:37.610392 23039 log.cc:1199] T f79004ff583f4b278afa2453c7088bf7 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/wals/f79004ff583f4b278afa2453c7088bf7
I20260709 13:05:37.634796 23039 tablet_replica.cc:333] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:05:37.635972 23039 raft_consensus.cc:2243] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.636801 23039 raft_consensus.cc:2272] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.640079 21990 catalog_manager.cc:5028] TS 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): tablet f79004ff583f4b278afa2453c7088bf7 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:37.645165 23039 ts_tablet_manager.cc:1916] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:37.653079 22249 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:37.653600 23038 raft_consensus.cc:2955] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.656955 23037 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.661362 22814 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:37.662860 22999 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.669293 22103 raft_consensus.cc:2955] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.679214 22097 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:37.682036 23039 ts_tablet_manager.cc:1929] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:37.682502 23039 log.cc:1199] T 383c9bd275674f7d8d5cdf16a1456960 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/wals/383c9bd275674f7d8d5cdf16a1456960
I20260709 13:05:37.684299 21990 catalog_manager.cc:5028] TS 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): tablet 383c9bd275674f7d8d5cdf16a1456960 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:37.695544 23037 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:37.700297 23018 raft_consensus.cc:2955] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.706496 22814 raft_consensus.cc:2955] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.709030 22000 catalog_manager.cc:5697] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.714941 22248 raft_consensus.cc:2955] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.722579 22815 raft_consensus.cc:2955] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.737043 22003 catalog_manager.cc:5697] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.739534 22248 raft_consensus.cc:2955] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.751349 22103 raft_consensus.cc:2955] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.753897 22177 consensus_queue.cc:237] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:37.763299 22248 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:37.769151 22176 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:37.770865 22814 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:37.771224 22998 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:37.785579 22999 raft_consensus.cc:2955] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.792750 22814 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:37.796864 22102 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:37.796765 22998 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:37.799813 23036 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:37.801029 23018 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:37.796767 22248 raft_consensus.cc:2955] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.809302 21990 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d674bb7c45c407e8aa9767c7438a39e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:37.812330 22815 raft_consensus.cc:2955] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.814651 23036 raft_consensus.cc:2955] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.816694 22814 raft_consensus.cc:2955] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.828410 22001 catalog_manager.cc:5697] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.829488 22103 raft_consensus.cc:2955] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.835714 22003 catalog_manager.cc:5697] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:37.839255 22089 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d674bb7c45c407e8aa9767c7438a39e with delete_type TABLET_DATA_TOMBSTONED (TS c0694f6572bf406a92d55f1f2ab46ef2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50280
I20260709 13:05:37.843503 21990 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0911b6e64ffb48bd9fc4968f8f52860c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:37.857329 22241 tablet_service.cc:1558] Processing DeleteTablet for tablet 0911b6e64ffb48bd9fc4968f8f52860c with delete_type TABLET_DATA_TOMBSTONED (TS 765d912bde9e48959e50d9efec3c26b6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:05:37.860268 23049 tablet_replica.cc:333] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:05:37.871254 23049 raft_consensus.cc:2243] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.871886 23048 tablet_replica.cc:333] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:05:37.872160 23049 raft_consensus.cc:2272] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.873050 23048 raft_consensus.cc:2243] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.873935 23048 raft_consensus.cc:2272] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.875582 23049 ts_tablet_manager.cc:1916] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:37.877269 23048 ts_tablet_manager.cc:1916] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:37.892778 23048 ts_tablet_manager.cc:1929] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:37.893931 23048 log.cc:1199] T 5d674bb7c45c407e8aa9767c7438a39e P c0694f6572bf406a92d55f1f2ab46ef2: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/wals/5d674bb7c45c407e8aa9767c7438a39e
I20260709 13:05:37.894716 23049 ts_tablet_manager.cc:1929] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:37.895573 21988 catalog_manager.cc:5028] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): tablet 5d674bb7c45c407e8aa9767c7438a39e (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:37.895251 23049 log.cc:1199] T 0911b6e64ffb48bd9fc4968f8f52860c P 765d912bde9e48959e50d9efec3c26b6: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-2-root/wals/0911b6e64ffb48bd9fc4968f8f52860c
I20260709 13:05:37.898288 21991 catalog_manager.cc:5028] TS 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): tablet 0911b6e64ffb48bd9fc4968f8f52860c (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:38.926772 22103 consensus_queue.cc:237] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
W20260709 13:05:38.933099 22069 consensus_peers.cc:597] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 394d042ced1042eb99ada43cc8ab55ba. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.934298 22180 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.935719 22990 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.936098 22249 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.939803 22990 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.948966 23026 raft_consensus.cc:2955] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:38.950840 22249 raft_consensus.cc:2955] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:38.956817 22176 raft_consensus.cc:2955] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:38.967350 22249 consensus_queue.cc:237] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:38.971660 22002 catalog_manager.cc:5697] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.987233 22180 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.989092 22102 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.989805 23019 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:38.993098 22976 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:38.996230 22218 consensus_peers.cc:597] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 62d62f92be1345e38ad2eeb98d958d91. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:39.012305 22976 raft_consensus.cc:2955] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:39.016198 22180 raft_consensus.cc:2955] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:39.080240 22102 raft_consensus.cc:2955] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:39.107700 22103 consensus_queue.cc:237] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:39.108763 22001 catalog_manager.cc:5697] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:39.122692 22069 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c80e8c56632c46d9a35c63a2ca8a532f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:39.125341 22248 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:39.125341 22180 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:39.127408 22990 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:39.128937 23026 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:39.142202 22990 raft_consensus.cc:2955] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:39.149946 22248 raft_consensus.cc:2955] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:39.157905 22180 raft_consensus.cc:2955] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:39.165405 22003 catalog_manager.cc:5697] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:39.169076 22103 consensus_queue.cc:237] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:39.179725 22181 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:39.179935 22248 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:39.181233 22069 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 116931ff9e08478dadc7bdc9e917454a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:39.182994 23050 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:39.188004 23050 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:39.206601 22249 raft_consensus.cc:2955] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:39.204681 22990 raft_consensus.cc:2955] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:39.221383 22003 catalog_manager.cc:5697] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:39.217545 22180 raft_consensus.cc:2955] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:39.415887 23075 ts_tablet_manager.cc:933] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:39.418565 23075 tablet_copy_client.cc:323] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.65:33421
I20260709 13:05:39.420933 22116 tablet_copy_service.cc:140] P c0694f6572bf406a92d55f1f2ab46ef2: Received BeginTabletCopySession request for tablet 394d042ced1042eb99ada43cc8ab55ba from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:43368)
I20260709 13:05:39.421454 22116 tablet_copy_service.cc:161] P c0694f6572bf406a92d55f1f2ab46ef2: Beginning new tablet copy session on tablet 394d042ced1042eb99ada43cc8ab55ba from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:43368: session id = a07ca3d1b5b84f4bbcb907f709a69275-394d042ced1042eb99ada43cc8ab55ba
I20260709 13:05:39.426698 22116 tablet_copy_source_session.cc:215] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:39.429697 23075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394d042ced1042eb99ada43cc8ab55ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.445140 23075 tablet_copy_client.cc:806] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:39.445782 23075 tablet_copy_client.cc:670] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:39.449477 23075 tablet_copy_client.cc:538] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:39.457027 23075 tablet_bootstrap.cc:492] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:39.474844 23075 tablet_bootstrap.cc:492] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:39.476029 23075 tablet_bootstrap.cc:492] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:39.476795 23075 ts_tablet_manager.cc:1403] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.010s
I20260709 13:05:39.479348 23075 raft_consensus.cc:359] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:39.480057 23075 raft_consensus.cc:740] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:39.480656 23075 consensus_queue.cc:260] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:39.484323 23075 ts_tablet_manager.cc:1434] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 13:05:39.486622 22116 tablet_copy_service.cc:342] P c0694f6572bf406a92d55f1f2ab46ef2: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-394d042ced1042eb99ada43cc8ab55ba received from {username='slave'} at 127.0.0.1:43368
I20260709 13:05:39.487157 22116 tablet_copy_service.cc:434] P c0694f6572bf406a92d55f1f2ab46ef2: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-394d042ced1042eb99ada43cc8ab55ba on tablet 394d042ced1042eb99ada43cc8ab55ba with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:39.538018 23075 ts_tablet_manager.cc:933] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:39.541031 23075 tablet_copy_client.cc:323] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.67:42273
I20260709 13:05:39.543248 22265 tablet_copy_service.cc:140] P 765d912bde9e48959e50d9efec3c26b6: Received BeginTabletCopySession request for tablet 62d62f92be1345e38ad2eeb98d958d91 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:45738)
I20260709 13:05:39.543854 22265 tablet_copy_service.cc:161] P 765d912bde9e48959e50d9efec3c26b6: Beginning new tablet copy session on tablet 62d62f92be1345e38ad2eeb98d958d91 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:45738: session id = a07ca3d1b5b84f4bbcb907f709a69275-62d62f92be1345e38ad2eeb98d958d91
I20260709 13:05:39.553535 22265 tablet_copy_source_session.cc:215] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:39.564548 23075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d62f92be1345e38ad2eeb98d958d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.579490 23075 tablet_copy_client.cc:806] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:39.580174 23075 tablet_copy_client.cc:670] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:39.586413 23075 tablet_copy_client.cc:538] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:39.593652 23075 tablet_bootstrap.cc:492] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:39.622478 23075 tablet_bootstrap.cc:492] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:39.623503 23075 tablet_bootstrap.cc:492] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:39.624222 23075 ts_tablet_manager.cc:1403] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.007s
I20260709 13:05:39.627995 23075 raft_consensus.cc:359] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:39.628922 23075 raft_consensus.cc:740] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:39.629647 23075 consensus_queue.cc:260] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:39.632499 23075 ts_tablet_manager.cc:1434] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:39.634681 22265 tablet_copy_service.cc:342] P 765d912bde9e48959e50d9efec3c26b6: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-62d62f92be1345e38ad2eeb98d958d91 received from {username='slave'} at 127.0.0.1:45738
I20260709 13:05:39.635135 22265 tablet_copy_service.cc:434] P 765d912bde9e48959e50d9efec3c26b6: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-62d62f92be1345e38ad2eeb98d958d91 on tablet 62d62f92be1345e38ad2eeb98d958d91 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:39.713920 23075 ts_tablet_manager.cc:933] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:39.715615 23075 tablet_copy_client.cc:323] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.65:33421
I20260709 13:05:39.717237 22116 tablet_copy_service.cc:140] P c0694f6572bf406a92d55f1f2ab46ef2: Received BeginTabletCopySession request for tablet c80e8c56632c46d9a35c63a2ca8a532f from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:43368)
I20260709 13:05:39.717697 22116 tablet_copy_service.cc:161] P c0694f6572bf406a92d55f1f2ab46ef2: Beginning new tablet copy session on tablet c80e8c56632c46d9a35c63a2ca8a532f from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:43368: session id = a07ca3d1b5b84f4bbcb907f709a69275-c80e8c56632c46d9a35c63a2ca8a532f
I20260709 13:05:39.724645 22116 tablet_copy_source_session.cc:215] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:39.727391 23075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c80e8c56632c46d9a35c63a2ca8a532f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.739200 23075 tablet_copy_client.cc:806] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:39.739776 23075 tablet_copy_client.cc:670] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:39.746572 23075 tablet_copy_client.cc:538] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:39.752759 23075 tablet_bootstrap.cc:492] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:39.770665 23075 tablet_bootstrap.cc:492] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:39.771559 23075 tablet_bootstrap.cc:492] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:39.772598 23075 ts_tablet_manager.cc:1403] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 13:05:39.774794 23083 ts_tablet_manager.cc:933] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:39.775208 23075 raft_consensus.cc:359] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:39.778365 23075 raft_consensus.cc:740] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:39.779228 23075 consensus_queue.cc:260] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:39.795984 23075 ts_tablet_manager.cc:1434] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:05:39.805341 23083 tablet_copy_client.cc:323] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.65:33421
I20260709 13:05:39.805871 22116 tablet_copy_service.cc:342] P c0694f6572bf406a92d55f1f2ab46ef2: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-c80e8c56632c46d9a35c63a2ca8a532f received from {username='slave'} at 127.0.0.1:43368
I20260709 13:05:39.806315 22116 tablet_copy_service.cc:434] P c0694f6572bf406a92d55f1f2ab46ef2: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-c80e8c56632c46d9a35c63a2ca8a532f on tablet c80e8c56632c46d9a35c63a2ca8a532f with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:39.809803 22116 tablet_copy_service.cc:140] P c0694f6572bf406a92d55f1f2ab46ef2: Received BeginTabletCopySession request for tablet 116931ff9e08478dadc7bdc9e917454a from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:43368)
I20260709 13:05:39.810330 22116 tablet_copy_service.cc:161] P c0694f6572bf406a92d55f1f2ab46ef2: Beginning new tablet copy session on tablet 116931ff9e08478dadc7bdc9e917454a from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:43368: session id = a07ca3d1b5b84f4bbcb907f709a69275-116931ff9e08478dadc7bdc9e917454a
I20260709 13:05:39.818305 22116 tablet_copy_source_session.cc:215] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:39.821565 22814 raft_consensus.cc:1217] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:39.822279 23083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 116931ff9e08478dadc7bdc9e917454a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.839165 23083 tablet_copy_client.cc:806] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:39.839707 23083 tablet_copy_client.cc:670] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:39.843888 23083 tablet_copy_client.cc:538] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:39.850860 23083 tablet_bootstrap.cc:492] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:39.868458 23083 tablet_bootstrap.cc:492] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:39.869371 23083 tablet_bootstrap.cc:492] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:39.870011 23083 ts_tablet_manager.cc:1403] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.019s	user 0.019s	sys 0.000s
I20260709 13:05:39.872304 23083 raft_consensus.cc:359] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:39.872942 23083 raft_consensus.cc:740] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:39.873489 23083 consensus_queue.cc:260] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:39.875913 23083 ts_tablet_manager.cc:1434] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:05:39.877983 22116 tablet_copy_service.cc:342] P c0694f6572bf406a92d55f1f2ab46ef2: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-116931ff9e08478dadc7bdc9e917454a received from {username='slave'} at 127.0.0.1:43368
I20260709 13:05:39.878422 22116 tablet_copy_service.cc:434] P c0694f6572bf406a92d55f1f2ab46ef2: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-116931ff9e08478dadc7bdc9e917454a on tablet 116931ff9e08478dadc7bdc9e917454a with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:39.971158 22814 raft_consensus.cc:1217] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:40.266136 22814 raft_consensus.cc:1217] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:40.363885 23064 raft_consensus.cc:1064] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:40.365803 23064 consensus_queue.cc:237] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:40.371965 22814 raft_consensus.cc:1217] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:40.374673 22181 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.376748 22102 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.377369 23064 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.378742 23060 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:40.380440 22814 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.386574 23060 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.392421 23050 raft_consensus.cc:1064] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:40.395134 23050 consensus_queue.cc:237] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:40.425612 22816 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.427867 22248 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.427994 23061 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.428001 22177 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.429380 22990 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.433996 23061 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:40.454681 23060 raft_consensus.cc:2955] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.459004 22103 raft_consensus.cc:2955] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.475116 22816 raft_consensus.cc:2955] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.478471 22002 catalog_manager.cc:5697] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:40.490792 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 91076.3us
I20260709 13:05:40.490322 22180 raft_consensus.cc:2955] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.516302 22990 raft_consensus.cc:2955] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.523867 22814 raft_consensus.cc:2955] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.531601 22177 raft_consensus.cc:2955] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.558547 22000 catalog_manager.cc:5697] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.564569 22248 raft_consensus.cc:2955] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.608312 22248 consensus_queue.cc:237] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:40.618602 22177 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.619743 22816 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.622568 23060 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.630477 22103 consensus_queue.cc:237] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:40.637921 22249 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.639956 23097 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:40.647311 22816 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.647384 23092 raft_consensus.cc:2955] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.624560 23060 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:05:40.651968 22249 raft_consensus.cc:2955] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.655005 23100 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:40.661111 22816 raft_consensus.cc:2955] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.662843 23059 raft_consensus.cc:2955] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.667728 21988 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 394d042ced1042eb99ada43cc8ab55ba with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:40.668893 22177 raft_consensus.cc:2955] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.690155 22002 catalog_manager.cc:5697] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.704015 21991 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 62d62f92be1345e38ad2eeb98d958d91 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:40.708055 22000 catalog_manager.cc:5697] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.711694 22814 raft_consensus.cc:2955] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.719025 22166 tablet_service.cc:1558] Processing DeleteTablet for tablet 394d042ced1042eb99ada43cc8ab55ba with delete_type TABLET_DATA_TOMBSTONED (TS 79683575881f4334bd4dc6d9bdbb45c3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51110
I20260709 13:05:40.725576 22089 tablet_service.cc:1558] Processing DeleteTablet for tablet 62d62f92be1345e38ad2eeb98d958d91 with delete_type TABLET_DATA_TOMBSTONED (TS c0694f6572bf406a92d55f1f2ab46ef2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50280
I20260709 13:05:40.740430 23106 tablet_replica.cc:333] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:05:40.741750 23106 raft_consensus.cc:2243] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.742780 23106 raft_consensus.cc:2272] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.743896 23107 tablet_replica.cc:333] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:05:40.745200 23107 raft_consensus.cc:2243] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.745978 23107 raft_consensus.cc:2272] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.748713 23106 ts_tablet_manager.cc:1916] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:40.764386 23107 ts_tablet_manager.cc:1916] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:40.764418 23106 ts_tablet_manager.cc:1929] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:40.765182 23106 log.cc:1199] T 394d042ced1042eb99ada43cc8ab55ba P 79683575881f4334bd4dc6d9bdbb45c3: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/wals/394d042ced1042eb99ada43cc8ab55ba
I20260709 13:05:40.767071 21990 catalog_manager.cc:5028] TS 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): tablet 394d042ced1042eb99ada43cc8ab55ba (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:40.781108 23107 ts_tablet_manager.cc:1929] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:40.781633 23107 log.cc:1199] T 62d62f92be1345e38ad2eeb98d958d91 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/wals/62d62f92be1345e38ad2eeb98d958d91
I20260709 13:05:40.783197 21988 catalog_manager.cc:5028] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): tablet 62d62f92be1345e38ad2eeb98d958d91 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:40.803574 23092 raft_consensus.cc:1064] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:40.806118 23092 consensus_queue.cc:237] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:40.811141 22990 raft_consensus.cc:1064] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:40.813376 22990 consensus_queue.cc:237] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:40.816998 22814 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.818717 22249 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.820103 23097 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.824460 23050 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.831337 22177 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.832849 23100 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:40.844955 22814 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.847028 23092 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:40.847970 22180 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.848284 23097 raft_consensus.cc:2955] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.850705 22249 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.851097 22248 raft_consensus.cc:2955] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.849574 23100 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.866474 23092 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:40.857015 22177 raft_consensus.cc:2955] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.877683 22002 catalog_manager.cc:5697] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.884965 22814 raft_consensus.cc:2955] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.900796 23100 raft_consensus.cc:2955] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.913247 22816 raft_consensus.cc:2955] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.914417 22248 raft_consensus.cc:2955] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.915362 22103 consensus_queue.cc:237] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:40.920127 22177 raft_consensus.cc:2955] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.922320 22815 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.924316 22176 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.924333 23092 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.928054 23100 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.932390 23097 raft_consensus.cc:2955] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.936206 22002 catalog_manager.cc:5697] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.951211 21988 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c80e8c56632c46d9a35c63a2ca8a532f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:40.950448 22814 raft_consensus.cc:2955] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.954881 22177 raft_consensus.cc:2955] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.965759 22103 consensus_queue.cc:237] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:40.974577 22002 catalog_manager.cc:5697] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.980291 22180 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.981791 22816 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.985890 23097 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.987521 22990 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.993465 23100 raft_consensus.cc:2955] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:40.997321 22241 tablet_service.cc:1558] Processing DeleteTablet for tablet c80e8c56632c46d9a35c63a2ca8a532f with delete_type TABLET_DATA_TOMBSTONED (TS 765d912bde9e48959e50d9efec3c26b6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:05:41.000517 22177 raft_consensus.cc:2955] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:41.013281 22816 raft_consensus.cc:2955] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:41.018144 23116 tablet_replica.cc:333] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:05:41.021224 23116 raft_consensus.cc:2243] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:41.023108 23116 raft_consensus.cc:2272] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.027340 23116 ts_tablet_manager.cc:1916] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:41.034734 21988 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 116931ff9e08478dadc7bdc9e917454a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:41.028679 22002 catalog_manager.cc:5697] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:41.047643 22241 tablet_service.cc:1558] Processing DeleteTablet for tablet 116931ff9e08478dadc7bdc9e917454a with delete_type TABLET_DATA_TOMBSTONED (TS 765d912bde9e48959e50d9efec3c26b6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:05:41.051317 23116 ts_tablet_manager.cc:1929] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:41.051894 23116 log.cc:1199] T c80e8c56632c46d9a35c63a2ca8a532f P 765d912bde9e48959e50d9efec3c26b6: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-2-root/wals/c80e8c56632c46d9a35c63a2ca8a532f
I20260709 13:05:41.053922 23116 tablet_replica.cc:333] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:05:41.054126 21991 catalog_manager.cc:5028] TS 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): tablet c80e8c56632c46d9a35c63a2ca8a532f (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:41.055037 23116 raft_consensus.cc:2243] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:41.055851 23116 raft_consensus.cc:2272] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.070819 23116 ts_tablet_manager.cc:1916] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:41.086709 23116 ts_tablet_manager.cc:1929] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:41.087059 23116 log.cc:1199] T 116931ff9e08478dadc7bdc9e917454a P 765d912bde9e48959e50d9efec3c26b6: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-2-root/wals/116931ff9e08478dadc7bdc9e917454a
I20260709 13:05:41.088249 21991 catalog_manager.cc:5028] TS 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): tablet 116931ff9e08478dadc7bdc9e917454a (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:42.244213 22248 consensus_queue.cc:237] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
W20260709 13:05:42.265426 22218 consensus_peers.cc:597] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9be7e328170d4837bbaade0fb02dead2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:42.265451 22177 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:42.266709 22103 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:42.267390 23105 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:42.268512 23122 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:42.277040 23064 raft_consensus.cc:2955] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:42.278539 22177 raft_consensus.cc:2955] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:42.278659 22103 raft_consensus.cc:2955] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:42.296227 22181 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:42.309161 22001 catalog_manager.cc:5697] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
W20260709 13:05:42.315907 22144 consensus_peers.cc:597] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 688b3a79146a41e2b683e0642b986d9a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:42.316514 22248 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:42.318696 22103 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:42.319885 23090 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:42.320997 23117 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:42.356694 23090 raft_consensus.cc:2955] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:42.359972 22253 raft_consensus.cc:2955] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:42.365676 22103 raft_consensus.cc:2955] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:42.388931 22177 consensus_queue.cc:237] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:42.398402 22000 catalog_manager.cc:5697] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:42.413503 22253 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:42.414022 22144 consensus_peers.cc:597] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f9abb5a83ca4007a03cd4613544f2eb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:42.414296 22097 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:42.415262 23090 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.416062 23117 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.435930 23117 raft_consensus.cc:2955] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:42.438664 22249 raft_consensus.cc:2955] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:42.452244 22097 raft_consensus.cc:2955] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:42.461133 22177 consensus_queue.cc:237] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:42.461300 22000 catalog_manager.cc:5697] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.476161 22249 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:42.477854 23090 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.479182 22103 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:42.481266 22144 consensus_peers.cc:597] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5e8334eaf044d0ba6d7817e7e9b2fd9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:42.482420 23090 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.495980 23073 raft_consensus.cc:2955] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:42.498307 22097 raft_consensus.cc:2955] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:42.498179 22248 raft_consensus.cc:2955] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:42.523167 22002 catalog_manager.cc:5697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.663475 23139 ts_tablet_manager.cc:933] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:42.666149 23139 tablet_copy_client.cc:323] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.67:42273
I20260709 13:05:42.668469 22265 tablet_copy_service.cc:140] P 765d912bde9e48959e50d9efec3c26b6: Received BeginTabletCopySession request for tablet 9be7e328170d4837bbaade0fb02dead2 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:45738)
I20260709 13:05:42.669108 22265 tablet_copy_service.cc:161] P 765d912bde9e48959e50d9efec3c26b6: Beginning new tablet copy session on tablet 9be7e328170d4837bbaade0fb02dead2 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:45738: session id = a07ca3d1b5b84f4bbcb907f709a69275-9be7e328170d4837bbaade0fb02dead2
I20260709 13:05:42.677448 22265 tablet_copy_source_session.cc:215] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:42.685346 23139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be7e328170d4837bbaade0fb02dead2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.702064 23139 tablet_copy_client.cc:806] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:42.702775 23139 tablet_copy_client.cc:670] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:42.706900 23139 tablet_copy_client.cc:538] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:42.716122 23139 tablet_bootstrap.cc:492] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:42.738041 23139 tablet_bootstrap.cc:492] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:42.739094 23139 tablet_bootstrap.cc:492] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:42.739768 23139 ts_tablet_manager.cc:1403] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.007s
I20260709 13:05:42.742826 23139 raft_consensus.cc:359] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:42.743703 23139 raft_consensus.cc:740] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:42.744370 23139 consensus_queue.cc:260] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:42.747913 23139 ts_tablet_manager.cc:1434] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:05:42.750854 22265 tablet_copy_service.cc:342] P 765d912bde9e48959e50d9efec3c26b6: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-9be7e328170d4837bbaade0fb02dead2 received from {username='slave'} at 127.0.0.1:45738
I20260709 13:05:42.751349 22265 tablet_copy_service.cc:434] P 765d912bde9e48959e50d9efec3c26b6: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-9be7e328170d4837bbaade0fb02dead2 on tablet 9be7e328170d4837bbaade0fb02dead2 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:42.793614 23139 ts_tablet_manager.cc:933] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:42.796512 23139 tablet_copy_client.cc:323] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.66:42399
I20260709 13:05:42.800335 22191 tablet_copy_service.cc:140] P 79683575881f4334bd4dc6d9bdbb45c3: Received BeginTabletCopySession request for tablet 688b3a79146a41e2b683e0642b986d9a from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:57856)
I20260709 13:05:42.800910 22191 tablet_copy_service.cc:161] P 79683575881f4334bd4dc6d9bdbb45c3: Beginning new tablet copy session on tablet 688b3a79146a41e2b683e0642b986d9a from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:57856: session id = a07ca3d1b5b84f4bbcb907f709a69275-688b3a79146a41e2b683e0642b986d9a
I20260709 13:05:42.808077 22191 tablet_copy_source_session.cc:215] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:42.814316 23139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 688b3a79146a41e2b683e0642b986d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.831094 23139 tablet_copy_client.cc:806] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:42.831749 23139 tablet_copy_client.cc:670] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:42.835875 23139 tablet_copy_client.cc:538] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:42.845458 23139 tablet_bootstrap.cc:492] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:42.869812 23139 tablet_bootstrap.cc:492] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:42.870754 23139 tablet_bootstrap.cc:492] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:42.871460 23139 ts_tablet_manager.cc:1403] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.005s
I20260709 13:05:42.874612 23139 raft_consensus.cc:359] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:42.875542 23139 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:42.876287 23139 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:42.878959 23139 ts_tablet_manager.cc:1434] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:42.880923 22191 tablet_copy_service.cc:342] P 79683575881f4334bd4dc6d9bdbb45c3: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-688b3a79146a41e2b683e0642b986d9a received from {username='slave'} at 127.0.0.1:57856
I20260709 13:05:42.881399 22191 tablet_copy_service.cc:434] P 79683575881f4334bd4dc6d9bdbb45c3: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-688b3a79146a41e2b683e0642b986d9a on tablet 688b3a79146a41e2b683e0642b986d9a with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:42.906227 23139 ts_tablet_manager.cc:933] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:42.907917 23139 tablet_copy_client.cc:323] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.66:42399
I20260709 13:05:42.909586 22191 tablet_copy_service.cc:140] P 79683575881f4334bd4dc6d9bdbb45c3: Received BeginTabletCopySession request for tablet 5f9abb5a83ca4007a03cd4613544f2eb from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:57856)
I20260709 13:05:42.910141 22191 tablet_copy_service.cc:161] P 79683575881f4334bd4dc6d9bdbb45c3: Beginning new tablet copy session on tablet 5f9abb5a83ca4007a03cd4613544f2eb from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:57856: session id = a07ca3d1b5b84f4bbcb907f709a69275-5f9abb5a83ca4007a03cd4613544f2eb
I20260709 13:05:42.917920 22191 tablet_copy_source_session.cc:215] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:42.921116 23139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9abb5a83ca4007a03cd4613544f2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.927203 23146 ts_tablet_manager.cc:933] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:42.931591 23146 tablet_copy_client.cc:323] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.66:42399
I20260709 13:05:42.937857 22191 tablet_copy_service.cc:140] P 79683575881f4334bd4dc6d9bdbb45c3: Received BeginTabletCopySession request for tablet f5e8334eaf044d0ba6d7817e7e9b2fd9 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:57856)
I20260709 13:05:42.938427 22191 tablet_copy_service.cc:161] P 79683575881f4334bd4dc6d9bdbb45c3: Beginning new tablet copy session on tablet f5e8334eaf044d0ba6d7817e7e9b2fd9 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:57856: session id = a07ca3d1b5b84f4bbcb907f709a69275-f5e8334eaf044d0ba6d7817e7e9b2fd9
I20260709 13:05:42.940578 23139 tablet_copy_client.cc:806] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:42.941216 23139 tablet_copy_client.cc:670] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:42.944759 23139 tablet_copy_client.cc:538] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:42.946892 22191 tablet_copy_source_session.cc:215] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:42.950336 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5e8334eaf044d0ba6d7817e7e9b2fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.951969 23139 tablet_bootstrap.cc:492] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:42.965046 23146 tablet_copy_client.cc:806] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:42.965669 23146 tablet_copy_client.cc:670] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:42.969929 23146 tablet_copy_client.cc:538] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:42.977527 23139 tablet_bootstrap.cc:492] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:42.978711 23139 tablet_bootstrap.cc:492] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:42.979629 23139 ts_tablet_manager.cc:1403] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.011s
I20260709 13:05:42.981245 23146 tablet_bootstrap.cc:492] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:42.982364 23139 raft_consensus.cc:359] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:42.983232 23139 raft_consensus.cc:740] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:42.983844 23139 consensus_queue.cc:260] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:42.990655 23139 ts_tablet_manager.cc:1434] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:05:42.997591 22191 tablet_copy_service.cc:342] P 79683575881f4334bd4dc6d9bdbb45c3: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-5f9abb5a83ca4007a03cd4613544f2eb received from {username='slave'} at 127.0.0.1:57856
I20260709 13:05:42.998040 22191 tablet_copy_service.cc:434] P 79683575881f4334bd4dc6d9bdbb45c3: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-5f9abb5a83ca4007a03cd4613544f2eb on tablet 5f9abb5a83ca4007a03cd4613544f2eb with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:43.014288 23146 tablet_bootstrap.cc:492] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:43.015280 23146 tablet_bootstrap.cc:492] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:43.015980 23146 ts_tablet_manager.cc:1403] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.001s
I20260709 13:05:43.020416 23146 raft_consensus.cc:359] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:43.021474 23146 raft_consensus.cc:740] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:43.022109 23146 consensus_queue.cc:260] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:43.057196 23146 ts_tablet_manager.cc:1434] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.002s
I20260709 13:05:43.059021 22191 tablet_copy_service.cc:342] P 79683575881f4334bd4dc6d9bdbb45c3: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-f5e8334eaf044d0ba6d7817e7e9b2fd9 received from {username='slave'} at 127.0.0.1:57856
I20260709 13:05:43.059434 22191 tablet_copy_service.cc:434] P 79683575881f4334bd4dc6d9bdbb45c3: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-f5e8334eaf044d0ba6d7817e7e9b2fd9 on tablet f5e8334eaf044d0ba6d7817e7e9b2fd9 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:43.156201 22814 raft_consensus.cc:1217] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:43.379611 22816 raft_consensus.cc:1217] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:43.443928 22816 raft_consensus.cc:1217] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:43.507082 22816 raft_consensus.cc:1217] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:43.687026 23122 raft_consensus.cc:1064] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:43.689169 23122 consensus_queue.cc:237] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:43.698014 22816 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.703794 23150 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.717031 22097 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.723801 22180 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.727301 23153 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:43.732072 23154 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.783067 23155 raft_consensus.cc:2955] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:43.785630 22097 raft_consensus.cc:2955] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:43.785907 22177 raft_consensus.cc:2955] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:43.796646 22816 raft_consensus.cc:2955] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:43.805656 22001 catalog_manager.cc:5697] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:43.833443 22248 consensus_queue.cc:237] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:43.839773 22816 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:43.840675 22097 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:43.840924 23150 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:43.842162 23155 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:43.851334 23155 raft_consensus.cc:2955] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:43.856086 22103 raft_consensus.cc:2955] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:43.858614 22816 raft_consensus.cc:2955] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:43.865206 23073 raft_consensus.cc:1064] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:43.871862 23073 consensus_queue.cc:237] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:43.886376 22000 catalog_manager.cc:5697] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:43.890360 21991 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9be7e328170d4837bbaade0fb02dead2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:43.903383 22816 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.905019 23090 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.907752 22249 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.911087 22166 tablet_service.cc:1558] Processing DeleteTablet for tablet 9be7e328170d4837bbaade0fb02dead2 with delete_type TABLET_DATA_TOMBSTONED (TS 79683575881f4334bd4dc6d9bdbb45c3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51110
I20260709 13:05:43.912410 23073 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.913089 22103 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.916931 23073 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.938958 23090 raft_consensus.cc:2955] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:43.938570 23165 tablet_replica.cc:333] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:05:43.940817 22097 raft_consensus.cc:2955] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:43.941818 23165 raft_consensus.cc:2243] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.944661 23165 raft_consensus.cc:2272] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.956859 23165 ts_tablet_manager.cc:1916] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:43.965855 22249 raft_consensus.cc:2955] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:43.974256 22001 catalog_manager.cc:5697] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:43.980063 22816 raft_consensus.cc:2955] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:43.994856 23165 ts_tablet_manager.cc:1929] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:43.995532 23165 log.cc:1199] T 9be7e328170d4837bbaade0fb02dead2 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/wals/9be7e328170d4837bbaade0fb02dead2
I20260709 13:05:43.997300 21990 catalog_manager.cc:5028] TS 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): tablet 9be7e328170d4837bbaade0fb02dead2 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:44.000196 23073 raft_consensus.cc:1064] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:44.002614 23073 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:44.016389 22248 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:44.016446 22816 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:44.018324 23090 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:44.021399 22097 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:44.024080 23170 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:44.025184 23169 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:44.031477 22180 consensus_queue.cc:237] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:44.057727 23073 raft_consensus.cc:2955] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.060037 22248 raft_consensus.cc:2955] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.061666 22097 raft_consensus.cc:2955] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.076920 22000 catalog_manager.cc:5697] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.079030 22816 raft_consensus.cc:2955] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.094220 22816 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:44.096387 23117 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:44.098053 22103 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:44.102355 22177 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:44.114478 22253 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:44.116094 23169 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:44.115513 22814 raft_consensus.cc:2955] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.116578 23090 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:44.119758 22815 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:44.127913 23090 raft_consensus.cc:2955] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.128197 22253 raft_consensus.cc:2955] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.132938 23170 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:44.134459 23117 raft_consensus.cc:1064] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:44.135767 22102 raft_consensus.cc:2955] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.112178 23073 raft_consensus.cc:2955] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.136957 23117 consensus_queue.cc:237] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:44.146246 22816 raft_consensus.cc:2955] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.150458 21990 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 688b3a79146a41e2b683e0642b986d9a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:44.163333 21990 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5f9abb5a83ca4007a03cd4613544f2eb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:44.162794 22000 catalog_manager.cc:5697] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.172052 22001 catalog_manager.cc:5697] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:44.182188 22814 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:44.185286 22253 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:44.190137 22241 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f9abb5a83ca4007a03cd4613544f2eb with delete_type TABLET_DATA_TOMBSTONED (TS 765d912bde9e48959e50d9efec3c26b6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:05:44.189172 23170 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:44.193351 23169 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:44.202463 22089 tablet_service.cc:1558] Processing DeleteTablet for tablet 688b3a79146a41e2b683e0642b986d9a with delete_type TABLET_DATA_TOMBSTONED (TS c0694f6572bf406a92d55f1f2ab46ef2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50280
I20260709 13:05:44.222985 23178 tablet_replica.cc:333] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:05:44.224325 23178 raft_consensus.cc:2243] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:44.225126 23178 raft_consensus.cc:2272] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:44.227293 22097 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:44.229197 23178 ts_tablet_manager.cc:1916] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:44.229808 23117 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:44.231628 23181 tablet_replica.cc:333] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:05:44.234651 23181 raft_consensus.cc:2243] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:44.235510 23181 raft_consensus.cc:2272] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:44.239493 23181 ts_tablet_manager.cc:1916] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:44.283010 23117 raft_consensus.cc:2955] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.294654 23178 ts_tablet_manager.cc:1929] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:44.294201 22097 raft_consensus.cc:2955] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.295166 23178 log.cc:1199] T 5f9abb5a83ca4007a03cd4613544f2eb P 765d912bde9e48959e50d9efec3c26b6: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-2-root/wals/5f9abb5a83ca4007a03cd4613544f2eb
I20260709 13:05:44.297459 21991 catalog_manager.cc:5028] TS 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): tablet 5f9abb5a83ca4007a03cd4613544f2eb (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:44.305886 23181 ts_tablet_manager.cc:1929] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:44.306547 23181 log.cc:1199] T 688b3a79146a41e2b683e0642b986d9a P c0694f6572bf406a92d55f1f2ab46ef2: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/wals/688b3a79146a41e2b683e0642b986d9a
I20260709 13:05:44.308389 21988 catalog_manager.cc:5028] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): tablet 688b3a79146a41e2b683e0642b986d9a (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:44.311332 22253 raft_consensus.cc:2955] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.315316 22003 catalog_manager.cc:5697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.332105 22814 raft_consensus.cc:2955] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.352419 22177 consensus_queue.cc:237] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:44.364187 22814 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:44.364506 22253 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:44.365842 23090 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:44.367841 23117 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:44.375975 23090 raft_consensus.cc:2955] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.381024 22253 raft_consensus.cc:2955] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.382351 22814 raft_consensus.cc:2955] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.393247 21990 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f5e8334eaf044d0ba6d7817e7e9b2fd9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:44.400703 22000 catalog_manager.cc:5697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:44.411916 22089 tablet_service.cc:1558] Processing DeleteTablet for tablet f5e8334eaf044d0ba6d7817e7e9b2fd9 with delete_type TABLET_DATA_TOMBSTONED (TS c0694f6572bf406a92d55f1f2ab46ef2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50280
I20260709 13:05:44.412922 23181 tablet_replica.cc:333] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:05:44.413849 23181 raft_consensus.cc:2243] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:44.414458 23181 raft_consensus.cc:2272] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:44.417102 23181 ts_tablet_manager.cc:1916] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:44.430755 23181 ts_tablet_manager.cc:1929] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:44.432263 23181 log.cc:1199] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/wals/f5e8334eaf044d0ba6d7817e7e9b2fd9
I20260709 13:05:44.433866 21988 catalog_manager.cc:5028] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): tablet f5e8334eaf044d0ba6d7817e7e9b2fd9 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:45.475116 22253 consensus_queue.cc:237] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:45.482012 22177 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:45.483331 22103 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:45.485464 22218 consensus_peers.cc:597] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ed3b0d7588c4652991dbe99eb204ae2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.486073 23185 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.487532 23150 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.496497 23186 raft_consensus.cc:2955] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.498425 22177 raft_consensus.cc:2955] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.505842 22103 raft_consensus.cc:2955] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.515820 22003 catalog_manager.cc:5697] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.537334 22177 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
W20260709 13:05:45.544098 22144 consensus_peers.cc:597] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57adaf54eaf24c778165ac40cc629c38. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.544029 22253 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:45.548244 23117 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.548781 22103 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:45.550441 23090 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:45.558243 23090 raft_consensus.cc:2955] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.562966 22103 raft_consensus.cc:2955] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.566511 22253 raft_consensus.cc:2955] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.593905 22103 consensus_queue.cc:237] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:45.602335 22002 catalog_manager.cc:5697] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.618567 22253 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:45.620206 22069 consensus_peers.cc:597] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef905e474cc543dc9b0f2de05a3807c6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.620810 23175 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.622514 22176 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:45.624200 23198 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.637131 23175 raft_consensus.cc:2955] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.640913 22249 raft_consensus.cc:2955] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.650336 22177 raft_consensus.cc:2955] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.653437 22176 consensus_queue.cc:237] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:45.657769 22002 catalog_manager.cc:5697] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.668874 22103 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:45.670580 23090 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.671721 22249 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:45.672387 22144 consensus_peers.cc:597] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d6633743ea44146a5164f64185db9a6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.673800 23193 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.684170 23117 raft_consensus.cc:2955] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.690016 22249 raft_consensus.cc:2955] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.697726 22103 raft_consensus.cc:2955] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.710767 22003 catalog_manager.cc:5697] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:45.894124 23206 ts_tablet_manager.cc:933] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:45.896330 23206 tablet_copy_client.cc:323] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.67:42273
I20260709 13:05:45.898710 22265 tablet_copy_service.cc:140] P 765d912bde9e48959e50d9efec3c26b6: Received BeginTabletCopySession request for tablet 5ed3b0d7588c4652991dbe99eb204ae2 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:45738)
I20260709 13:05:45.899358 22265 tablet_copy_service.cc:161] P 765d912bde9e48959e50d9efec3c26b6: Beginning new tablet copy session on tablet 5ed3b0d7588c4652991dbe99eb204ae2 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:45738: session id = a07ca3d1b5b84f4bbcb907f709a69275-5ed3b0d7588c4652991dbe99eb204ae2
I20260709 13:05:45.906796 22265 tablet_copy_source_session.cc:215] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:45.909871 23206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed3b0d7588c4652991dbe99eb204ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.924573 23206 tablet_copy_client.cc:806] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:45.925181 23206 tablet_copy_client.cc:670] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:45.929066 23206 tablet_copy_client.cc:538] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:45.938349 23206 tablet_bootstrap.cc:492] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:45.959424 23206 tablet_bootstrap.cc:492] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:45.960414 23206 tablet_bootstrap.cc:492] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:45.961115 23206 ts_tablet_manager.cc:1403] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.023s	user 0.025s	sys 0.000s
I20260709 13:05:45.964087 23206 raft_consensus.cc:359] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:45.964955 23206 raft_consensus.cc:740] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:45.965615 23206 consensus_queue.cc:260] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:45.968899 23206 ts_tablet_manager.cc:1434] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:45.972206 22265 tablet_copy_service.cc:342] P 765d912bde9e48959e50d9efec3c26b6: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-5ed3b0d7588c4652991dbe99eb204ae2 received from {username='slave'} at 127.0.0.1:45738
I20260709 13:05:45.972628 22265 tablet_copy_service.cc:434] P 765d912bde9e48959e50d9efec3c26b6: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-5ed3b0d7588c4652991dbe99eb204ae2 on tablet 5ed3b0d7588c4652991dbe99eb204ae2 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:46.078545 23206 ts_tablet_manager.cc:933] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:46.080488 23206 tablet_copy_client.cc:323] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.65:33421
I20260709 13:05:46.082320 22116 tablet_copy_service.cc:140] P c0694f6572bf406a92d55f1f2ab46ef2: Received BeginTabletCopySession request for tablet ef905e474cc543dc9b0f2de05a3807c6 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:43368)
I20260709 13:05:46.082839 22116 tablet_copy_service.cc:161] P c0694f6572bf406a92d55f1f2ab46ef2: Beginning new tablet copy session on tablet ef905e474cc543dc9b0f2de05a3807c6 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:43368: session id = a07ca3d1b5b84f4bbcb907f709a69275-ef905e474cc543dc9b0f2de05a3807c6
I20260709 13:05:46.088348 22116 tablet_copy_source_session.cc:215] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:46.091506 23206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef905e474cc543dc9b0f2de05a3807c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.106215 23206 tablet_copy_client.cc:806] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:46.106879 23206 tablet_copy_client.cc:670] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:46.110891 23206 tablet_copy_client.cc:538] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:46.117515 23206 tablet_bootstrap.cc:492] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:46.143975 23206 tablet_bootstrap.cc:492] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:46.144865 23212 ts_tablet_manager.cc:933] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:46.144968 23206 tablet_bootstrap.cc:492] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:46.145872 23206 ts_tablet_manager.cc:1403] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.012s
I20260709 13:05:46.149032 23206 raft_consensus.cc:359] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:46.152767 23206 raft_consensus.cc:740] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:46.152791 23212 tablet_copy_client.cc:323] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.66:42399
I20260709 13:05:46.153592 23206 consensus_queue.cc:260] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:46.154667 22191 tablet_copy_service.cc:140] P 79683575881f4334bd4dc6d9bdbb45c3: Received BeginTabletCopySession request for tablet 57adaf54eaf24c778165ac40cc629c38 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:57856)
I20260709 13:05:46.155241 22191 tablet_copy_service.cc:161] P 79683575881f4334bd4dc6d9bdbb45c3: Beginning new tablet copy session on tablet 57adaf54eaf24c778165ac40cc629c38 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:57856: session id = a07ca3d1b5b84f4bbcb907f709a69275-57adaf54eaf24c778165ac40cc629c38
I20260709 13:05:46.155668 23206 ts_tablet_manager.cc:1434] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:05:46.158196 22116 tablet_copy_service.cc:342] P c0694f6572bf406a92d55f1f2ab46ef2: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-ef905e474cc543dc9b0f2de05a3807c6 received from {username='slave'} at 127.0.0.1:43368
I20260709 13:05:46.158636 22116 tablet_copy_service.cc:434] P c0694f6572bf406a92d55f1f2ab46ef2: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-ef905e474cc543dc9b0f2de05a3807c6 on tablet ef905e474cc543dc9b0f2de05a3807c6 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:46.170598 22191 tablet_copy_source_session.cc:215] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:46.173840 23212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57adaf54eaf24c778165ac40cc629c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.189843 23212 tablet_copy_client.cc:806] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:46.190403 23212 tablet_copy_client.cc:670] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:46.194149 23212 tablet_copy_client.cc:538] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:46.203835 23212 tablet_bootstrap.cc:492] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:46.225721 23212 tablet_bootstrap.cc:492] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:46.226783 23212 tablet_bootstrap.cc:492] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:46.227084 23206 ts_tablet_manager.cc:933] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:46.227543 23212 ts_tablet_manager.cc:1403] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.005s
I20260709 13:05:46.230641 23212 raft_consensus.cc:359] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:46.231748 23212 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:46.232461 23212 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:46.233628 23206 tablet_copy_client.cc:323] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.66:42399
I20260709 13:05:46.235177 23212 ts_tablet_manager.cc:1434] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:46.235670 22191 tablet_copy_service.cc:140] P 79683575881f4334bd4dc6d9bdbb45c3: Received BeginTabletCopySession request for tablet 5d6633743ea44146a5164f64185db9a6 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:57856)
I20260709 13:05:46.236265 22191 tablet_copy_service.cc:161] P 79683575881f4334bd4dc6d9bdbb45c3: Beginning new tablet copy session on tablet 5d6633743ea44146a5164f64185db9a6 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:57856: session id = a07ca3d1b5b84f4bbcb907f709a69275-5d6633743ea44146a5164f64185db9a6
I20260709 13:05:46.240329 22190 tablet_copy_service.cc:342] P 79683575881f4334bd4dc6d9bdbb45c3: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-57adaf54eaf24c778165ac40cc629c38 received from {username='slave'} at 127.0.0.1:57856
I20260709 13:05:46.240752 22190 tablet_copy_service.cc:434] P 79683575881f4334bd4dc6d9bdbb45c3: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-57adaf54eaf24c778165ac40cc629c38 on tablet 57adaf54eaf24c778165ac40cc629c38 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:46.246954 22191 tablet_copy_source_session.cc:215] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:46.250618 23206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d6633743ea44146a5164f64185db9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.264107 23206 tablet_copy_client.cc:806] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:46.264675 23206 tablet_copy_client.cc:670] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:46.268596 23206 tablet_copy_client.cc:538] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:46.277221 23206 tablet_bootstrap.cc:492] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:46.283383 22814 raft_consensus.cc:1217] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:46.347468 23206 tablet_bootstrap.cc:492] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:46.348497 23206 tablet_bootstrap.cc:492] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:46.349077 23206 ts_tablet_manager.cc:1403] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.072s	user 0.032s	sys 0.009s
I20260709 13:05:46.351603 23206 raft_consensus.cc:359] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:46.352182 23206 raft_consensus.cc:740] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:46.352738 23206 consensus_queue.cc:260] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:46.354674 23206 ts_tablet_manager.cc:1434] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:05:46.357275 22191 tablet_copy_service.cc:342] P 79683575881f4334bd4dc6d9bdbb45c3: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-5d6633743ea44146a5164f64185db9a6 received from {username='slave'} at 127.0.0.1:57856
I20260709 13:05:46.357692 22191 tablet_copy_service.cc:434] P 79683575881f4334bd4dc6d9bdbb45c3: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-5d6633743ea44146a5164f64185db9a6 on tablet 5d6633743ea44146a5164f64185db9a6 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:46.592995 22813 raft_consensus.cc:1217] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:46.612884 22813 raft_consensus.cc:1217] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:46.691352 22813 raft_consensus.cc:1217] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:46.753940 23190 raft_consensus.cc:1064] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:46.757676 23190 consensus_queue.cc:237] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:46.766958 22813 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:46.768105 22177 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:46.768590 22097 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:46.768946 23220 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.770416 23190 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:46.773528 23220 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.794818 23186 raft_consensus.cc:2955] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:46.798815 22177 raft_consensus.cc:2955] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:46.798821 22813 raft_consensus.cc:2955] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:46.816355 22002 catalog_manager.cc:5697] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:46.824817 22097 raft_consensus.cc:2955] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:46.884125 22253 consensus_queue.cc:237] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:46.893154 22816 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:46.894445 22103 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:46.896423 23223 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:46.897977 23225 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:46.920992 23186 raft_consensus.cc:2955] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:46.927109 22814 raft_consensus.cc:2955] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:46.929769 22103 raft_consensus.cc:2955] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:46.944051 21991 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5ed3b0d7588c4652991dbe99eb204ae2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:46.953358 22003 catalog_manager.cc:5697] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:46.971395 22166 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ed3b0d7588c4652991dbe99eb204ae2 with delete_type TABLET_DATA_TOMBSTONED (TS 79683575881f4334bd4dc6d9bdbb45c3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51110
I20260709 13:05:46.982857 23230 tablet_replica.cc:333] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:05:46.984086 23230 raft_consensus.cc:2243] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:46.984871 23230 raft_consensus.cc:2272] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:46.989032 23230 ts_tablet_manager.cc:1916] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:47.005518 23230 ts_tablet_manager.cc:1929] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:47.006114 23230 log.cc:1199] T 5ed3b0d7588c4652991dbe99eb204ae2 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/wals/5ed3b0d7588c4652991dbe99eb204ae2
I20260709 13:05:47.008615 21990 catalog_manager.cc:5028] TS 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): tablet 5ed3b0d7588c4652991dbe99eb204ae2 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:47.013332 23183 raft_consensus.cc:1064] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:47.015885 23183 consensus_queue.cc:237] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:47.025058 22177 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.025323 22813 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.027040 23200 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:47.027730 22253 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.027829 23217 raft_consensus.cc:1064] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:47.028992 23200 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:05:47.072702 23217 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:47.084255 23175 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.092633 22249 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.092818 22814 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.095644 23218 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.098546 23193 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:47.130677 22253 raft_consensus.cc:2955] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.133216 23175 raft_consensus.cc:2955] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.133169 22813 raft_consensus.cc:2955] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.152062 22001 catalog_manager.cc:5697] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:05:47.155952 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 61968.8us
I20260709 13:05:47.160972 22103 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.172508 22103 consensus_queue.cc:237] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:47.188383 22253 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:47.190038 23200 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:47.197494 22177 raft_consensus.cc:2955] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.208160 22816 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:47.209237 23183 raft_consensus.cc:2955] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.223543 23233 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:05:47.231369 22253 raft_consensus.cc:2955] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.231194 22813 raft_consensus.cc:2955] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.238739 21988 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ef905e474cc543dc9b0f2de05a3807c6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:47.246802 22003 catalog_manager.cc:5697] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.252830 23217 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:47.253947 23239 raft_consensus.cc:2955] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.266970 22166 tablet_service.cc:1558] Processing DeleteTablet for tablet ef905e474cc543dc9b0f2de05a3807c6 with delete_type TABLET_DATA_TOMBSTONED (TS 79683575881f4334bd4dc6d9bdbb45c3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51110
I20260709 13:05:47.267951 23230 tablet_replica.cc:333] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:05:47.268950 23230 raft_consensus.cc:2243] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:47.292958 23230 raft_consensus.cc:2272] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:47.297705 23230 ts_tablet_manager.cc:1916] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:47.310873 22813 raft_consensus.cc:2955] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.317184 22097 raft_consensus.cc:2955] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.323295 22249 raft_consensus.cc:2955] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.333675 23217 raft_consensus.cc:1064] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:47.337033 23217 consensus_queue.cc:237] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:47.344753 22003 catalog_manager.cc:5697] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.353857 22248 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.354945 22097 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.355773 22813 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.356544 23243 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.357774 23217 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:47.360973 23239 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:47.372722 23230 ts_tablet_manager.cc:1929] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:47.373375 23230 log.cc:1199] T ef905e474cc543dc9b0f2de05a3807c6 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/wals/ef905e474cc543dc9b0f2de05a3807c6
I20260709 13:05:47.381450 21990 catalog_manager.cc:5028] TS 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): tablet ef905e474cc543dc9b0f2de05a3807c6 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:47.381372 23243 raft_consensus.cc:2955] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.392977 22103 raft_consensus.cc:2955] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.397106 22813 raft_consensus.cc:2955] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.433585 22177 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:47.437458 22001 catalog_manager.cc:5697] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.449545 22249 raft_consensus.cc:2955] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.452819 22816 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:47.454664 23217 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:47.462518 22248 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:47.463433 23218 raft_consensus.cc:2955] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.465119 23239 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:47.463933 22177 consensus_queue.cc:237] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:47.472057 22097 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:47.474226 22816 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:47.474231 23239 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:47.476593 23237 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:47.479034 22249 raft_consensus.cc:2955] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.483213 21990 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57adaf54eaf24c778165ac40cc629c38 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:47.485872 22814 raft_consensus.cc:2955] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.485828 23237 raft_consensus.cc:2955] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.498512 22103 raft_consensus.cc:2955] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.502542 22003 catalog_manager.cc:5697] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.508198 21990 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d6633743ea44146a5164f64185db9a6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:47.514168 22089 tablet_service.cc:1558] Processing DeleteTablet for tablet 57adaf54eaf24c778165ac40cc629c38 with delete_type TABLET_DATA_TOMBSTONED (TS c0694f6572bf406a92d55f1f2ab46ef2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50280
I20260709 13:05:47.542944 23249 tablet_replica.cc:333] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:05:47.543283 22003 catalog_manager.cc:5697] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.544131 23249 raft_consensus.cc:2243] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:47.531721 22813 raft_consensus.cc:2955] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:47.554733 23249 raft_consensus.cc:2272] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:47.558439 23249 ts_tablet_manager.cc:1916] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:47.564494 22241 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d6633743ea44146a5164f64185db9a6 with delete_type TABLET_DATA_TOMBSTONED (TS 765d912bde9e48959e50d9efec3c26b6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:05:47.568845 23250 tablet_replica.cc:333] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:05:47.569929 23250 raft_consensus.cc:2243] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:47.570812 23250 raft_consensus.cc:2272] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:47.574369 23250 ts_tablet_manager.cc:1916] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:47.578644 23249 ts_tablet_manager.cc:1929] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:47.579370 23249 log.cc:1199] T 57adaf54eaf24c778165ac40cc629c38 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/wals/57adaf54eaf24c778165ac40cc629c38
I20260709 13:05:47.581019 21988 catalog_manager.cc:5028] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): tablet 57adaf54eaf24c778165ac40cc629c38 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:47.588112 23250 ts_tablet_manager.cc:1929] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:47.588469 23250 log.cc:1199] T 5d6633743ea44146a5164f64185db9a6 P 765d912bde9e48959e50d9efec3c26b6: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-2-root/wals/5d6633743ea44146a5164f64185db9a6
I20260709 13:05:47.590112 21991 catalog_manager.cc:5028] TS 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): tablet 5d6633743ea44146a5164f64185db9a6 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:48.144563 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:48.195823 22248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:48610
I20260709 13:05:48.196483 22248 raft_consensus.cc:606] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Received request to transfer leadership to TS a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:48.216516 22176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:05:48.217125 22176 raft_consensus.cc:606] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Received request to transfer leadership to TS a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:48.219686 22176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:05:48.220285 22176 raft_consensus.cc:606] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:48.232383 22099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:05:48.232858 22099 raft_consensus.cc:606] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:48.235296 22176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efc23a012ae0497797e82803613f3835"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:05:48.235862 22176 raft_consensus.cc:606] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:48.238325 22177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:05:48.238767 22177 raft_consensus.cc:606] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Received request to transfer leadership to TS a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:48.239775 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:48.240872 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:48.342389 23239 raft_consensus.cc:993] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: : Instructing follower a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:48.343039 23193 raft_consensus.cc:1081] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Signalling peer a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:48.344502 22814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:35214
I20260709 13:05:48.345017 22814 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.345361 22814 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.351958 22814 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:48.355149 22814 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:48.354979 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:48.355357 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:48.355835 22177 raft_consensus.cc:3055] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:48.356060 22249 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.356191 22177 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:48.356969 22177 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:48.357877 22177 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.361058 22249 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:48.362365 22782 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:48.364042 23255 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.365489 23255 raft_consensus.cc:697] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:05:48.366513 23255 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:48.366452 22177 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:48.377091 22002 catalog_manager.cc:5697] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 2, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 2 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.513195 23193 raft_consensus.cc:993] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: : Instructing follower 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:05:48.513870 23239 raft_consensus.cc:1081] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Signalling peer 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:05:48.516722 22248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:51880
I20260709 13:05:48.517314 22248 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.517724 22248 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.520241 23193 raft_consensus.cc:993] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3: : Instructing follower 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:05:48.521401 23239 raft_consensus.cc:1081] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Signalling peer 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:05:48.523052 22249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efc23a012ae0497797e82803613f3835"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:51880
I20260709 13:05:48.523578 22249 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.524085 22249 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.525985 22248 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:48.528234 22248 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:48.529078 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:48.529661 22103 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.530522 22249 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:48.532437 22249 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:48.533761 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:48.534384 22177 raft_consensus.cc:3055] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:48.534721 22177 raft_consensus.cc:740] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:48.535105 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:48.535645 22176 raft_consensus.cc:3055] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:48.535975 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:48.536441 22176 raft_consensus.cc:740] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:48.536576 22097 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.537185 22176 consensus_queue.cc:260] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:48.538364 22176 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.540762 22103 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:05:48.544123 22097 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:05:48.545697 22176 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:05:48.535627 22177 consensus_queue.cc:260] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:48.547153 22177 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.547410 22220 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:48.548972 23186 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.548138 23242 raft_consensus.cc:993] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:05:48.555644 23242 raft_consensus.cc:1081] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Signalling peer 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:05:48.558892 22218 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:48.560925 23223 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.561601 23223 raft_consensus.cc:697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:48.561534 22177 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:05:48.562590 22176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:05:48.562889 23186 raft_consensus.cc:697] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:48.563700 22176 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.564419 22176 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.564507 23186 consensus_queue.cc:237] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:48.571869 23223 consensus_queue.cc:237] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:48.576301 22176 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:48.580057 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:48.580648 22253 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.585168 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:48.585804 22103 raft_consensus.cc:3055] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:48.586079 22103 raft_consensus.cc:740] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:48.586783 22103 consensus_queue.cc:260] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:48.587754 22103 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.593360 22253 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:05:48.598572 22147 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:48.594087 22176 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:48.604163 22002 catalog_manager.cc:5697] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 2, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 2 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.612828 23239 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.613543 23239 raft_consensus.cc:697] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:48.615789 23239 consensus_queue.cc:237] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:48.616302 22103 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:05:48.639091 23261 raft_consensus.cc:993] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: : Instructing follower a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:48.639616 23261 raft_consensus.cc:1081] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Signalling peer a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:48.645817 22002 catalog_manager.cc:5697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 2, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 2 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.646593 22814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:35230
I20260709 13:05:48.648591 22814 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.648976 22814 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.649955 22003 catalog_manager.cc:5697] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 1 to 2, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.665280 23193 raft_consensus.cc:993] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: : Instructing follower a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:48.665761 23193 raft_consensus.cc:1081] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Signalling peer a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:48.676183 22814 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:48.677243 22816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:35214
I20260709 13:05:48.677848 22816 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.678207 22816 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.678637 22814 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:48.680339 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:48.680898 22253 raft_consensus.cc:3055] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:48.681183 22253 raft_consensus.cc:740] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:48.681874 22253 consensus_queue.cc:260] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:48.682845 22253 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.683878 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:48.684446 22103 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.687767 22816 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:48.689805 22816 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:48.690426 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:48.691002 22177 raft_consensus.cc:3055] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:48.691289 22177 raft_consensus.cc:740] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:48.691187 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:48.692176 22177 consensus_queue.cc:260] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:48.692641 22249 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.693378 22177 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.696635 22103 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:48.697861 22779 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:48.698664 23255 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.699155 23255 raft_consensus.cc:697] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:05:48.699888 22249 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:48.699983 23255 consensus_queue.cc:237] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:48.704406 22782 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:48.705437 23256 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.710862 22177 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:48.714061 22099 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:48.713825 22003 catalog_manager.cc:5697] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 2, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 2 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.691767 22253 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:48.723481 23256 raft_consensus.cc:697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:05:48.724512 23256 consensus_queue.cc:237] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:05:48.730193 22069 consensus_peers.cc:597] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a4e641637cf41118865c96aec55b340. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:48.731362 22253 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:48.731649 22177 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:48.733256 23200 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.734578 23200 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.734660 22003 catalog_manager.cc:5697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 2, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 2 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.753726 23242 raft_consensus.cc:2955] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:48.756256 22253 raft_consensus.cc:2955] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:48.756256 22177 raft_consensus.cc:2955] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:48.767014 22249 consensus_queue.cc:237] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:48.774294 22003 catalog_manager.cc:5697] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:48.777393 22218 consensus_peers.cc:597] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f8407607d7441c7bdac45e1dadc700d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:48.779731 22099 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:48.781226 23186 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.783931 22177 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:48.786415 23186 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.802423 23261 raft_consensus.cc:2955] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:48.804473 22099 raft_consensus.cc:2955] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:48.806106 22181 raft_consensus.cc:2955] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:48.816561 22249 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:48.820506 22001 catalog_manager.cc:5697] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:48.835278 22176 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:48.837000 22099 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:48.837673 22218 consensus_peers.cc:597] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbe9d18a693340a29f852081a41a74f1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:48.838280 23186 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:48.839478 23263 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.848837 23261 raft_consensus.cc:2955] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:48.851675 22099 raft_consensus.cc:2955] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:48.858670 22177 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:48.860803 23256 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:48.890676 22001 catalog_manager.cc:5697] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:48.897011 22176 consensus_queue.cc:237] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
W20260709 13:05:48.904651 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 70037.2us
I20260709 13:05:48.910959 22181 raft_consensus.cc:2955] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:48.933523 22249 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:48.935384 23256 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:05:48.958160 22144 consensus_peers.cc:597] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03ed5952f28c46d8b66e87a9d1b03981. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:48.960439 22099 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:48.960923 22249 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:48.962414 23268 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:48.968358 23269 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:48.987516 23268 raft_consensus.cc:2955] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:48.988562 22249 raft_consensus.cc:2955] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:48.988714 22099 raft_consensus.cc:2955] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:49.007730 22103 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.018975 23269 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.030647 22001 catalog_manager.cc:5697] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.042542 22103 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.045286 23261 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.051923 22253 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.053815 23239 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.069164 22103 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.090569 22176 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.092845 23262 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:49.102092 22253 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:49.101895 23261 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.103808 23271 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:49.133281 22176 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.134802 23261 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.203589 22103 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:49.208253 23271 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:49.241752 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:49.276414 23302 ts_tablet_manager.cc:933] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:49.288095 23304 ts_tablet_manager.cc:933] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:49.291780 23302 tablet_copy_client.cc:323] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.67:42273
I20260709 13:05:49.293529 22265 tablet_copy_service.cc:140] P 765d912bde9e48959e50d9efec3c26b6: Received BeginTabletCopySession request for tablet cbe9d18a693340a29f852081a41a74f1 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:45738)
I20260709 13:05:49.294046 22265 tablet_copy_service.cc:161] P 765d912bde9e48959e50d9efec3c26b6: Beginning new tablet copy session on tablet cbe9d18a693340a29f852081a41a74f1 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:45738: session id = a07ca3d1b5b84f4bbcb907f709a69275-cbe9d18a693340a29f852081a41a74f1
I20260709 13:05:49.296460 23304 tablet_copy_client.cc:323] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.67:42273
I20260709 13:05:49.299347 22264 tablet_copy_service.cc:140] P 765d912bde9e48959e50d9efec3c26b6: Received BeginTabletCopySession request for tablet 6f8407607d7441c7bdac45e1dadc700d from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:45738)
I20260709 13:05:49.299888 22264 tablet_copy_service.cc:161] P 765d912bde9e48959e50d9efec3c26b6: Beginning new tablet copy session on tablet 6f8407607d7441c7bdac45e1dadc700d from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:45738: session id = a07ca3d1b5b84f4bbcb907f709a69275-6f8407607d7441c7bdac45e1dadc700d
I20260709 13:05:49.336371 22177 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:49.345182 22252 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:49.347973 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:49.349911 23271 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:49.354598 23271 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:49.393055 22265 tablet_copy_source_session.cc:215] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:49.396543 23302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe9d18a693340a29f852081a41a74f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.409988 22264 tablet_copy_source_session.cc:215] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:49.414378 22097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:05:49.415280 22097 raft_consensus.cc:606] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Received request to transfer leadership to TS a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:49.418500 22176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:05:49.419169 23304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8407607d7441c7bdac45e1dadc700d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.419265 22176 raft_consensus.cc:606] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:49.422456 22097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a4e641637cf41118865c96aec55b340"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:05:49.423026 22097 raft_consensus.cc:606] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:49.423789 23308 ts_tablet_manager.cc:933] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:49.435832 22253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:48610
I20260709 13:05:49.436446 22253 raft_consensus.cc:606] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Received request to transfer leadership to TS a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:49.439450 22253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efc23a012ae0497797e82803613f3835"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:48610
I20260709 13:05:49.439955 22253 raft_consensus.cc:606] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:49.441260 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:49.442729 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:49.466194 23302 tablet_copy_client.cc:806] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:49.467226 23302 tablet_copy_client.cc:670] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:49.469539 23310 ts_tablet_manager.cc:933] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:49.475512 23302 tablet_copy_client.cc:538] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:49.479434 23310 tablet_copy_client.cc:323] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.66:42399
I20260709 13:05:49.490506 22191 tablet_copy_service.cc:140] P 79683575881f4334bd4dc6d9bdbb45c3: Received BeginTabletCopySession request for tablet 03ed5952f28c46d8b66e87a9d1b03981 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:57856)
I20260709 13:05:49.491091 22191 tablet_copy_service.cc:161] P 79683575881f4334bd4dc6d9bdbb45c3: Beginning new tablet copy session on tablet 03ed5952f28c46d8b66e87a9d1b03981 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:57856: session id = a07ca3d1b5b84f4bbcb907f709a69275-03ed5952f28c46d8b66e87a9d1b03981
I20260709 13:05:49.498279 22191 tablet_copy_source_session.cc:215] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:49.499097 23304 tablet_copy_client.cc:806] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:49.499711 23304 tablet_copy_client.cc:670] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:49.502794 23310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ed5952f28c46d8b66e87a9d1b03981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.505366 23308 tablet_copy_client.cc:323] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.65:33421
I20260709 13:05:49.507287 22116 tablet_copy_service.cc:140] P c0694f6572bf406a92d55f1f2ab46ef2: Received BeginTabletCopySession request for tablet 9a4e641637cf41118865c96aec55b340 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:43368)
I20260709 13:05:49.507818 22116 tablet_copy_service.cc:161] P c0694f6572bf406a92d55f1f2ab46ef2: Beginning new tablet copy session on tablet 9a4e641637cf41118865c96aec55b340 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:43368: session id = a07ca3d1b5b84f4bbcb907f709a69275-9a4e641637cf41118865c96aec55b340
I20260709 13:05:49.513195 23304 tablet_copy_client.cc:538] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:49.515393 22116 tablet_copy_source_session.cc:215] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:49.517640 23302 tablet_bootstrap.cc:492] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:49.518553 23200 raft_consensus.cc:993] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:49.518913 23308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4e641637cf41118865c96aec55b340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.519093 23200 raft_consensus.cc:1081] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Signalling peer a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:49.520974 22814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:35198
I20260709 13:05:49.521459 22814 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.521764 22814 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.529393 22814 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:49.531227 23304 tablet_bootstrap.cc:492] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:49.533075 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:49.533668 22252 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.533891 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:49.534456 22097 raft_consensus.cc:3055] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.538626 22097 raft_consensus.cc:740] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:49.539337 22097 consensus_queue.cc:260] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:49.540601 22097 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.543833 22252 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:49.545020 22782 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:49.546233 23255 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:49.546696 23255 raft_consensus.cc:697] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:05:49.548403 23255 consensus_queue.cc:237] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:49.551226 22814 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:49.552044 22097 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:49.555218 23186 raft_consensus.cc:993] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6: : Instructing follower 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:05:49.555730 23186 raft_consensus.cc:1081] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Signalling peer 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:05:49.557426 22177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efc23a012ae0497797e82803613f3835"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:51114
I20260709 13:05:49.557934 22177 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.558264 22177 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.568152 22177 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:49.570139 22177 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:49.571379 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:49.572921 22252 raft_consensus.cc:3055] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:49.573427 22252 raft_consensus.cc:740] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:49.574290 22252 consensus_queue.cc:260] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:49.575601 22252 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.576187 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:49.581144 22097 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.576383 23310 tablet_copy_client.cc:806] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:49.588163 23310 tablet_copy_client.cc:670] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:49.593063 23308 tablet_copy_client.cc:806] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:49.593676 23308 tablet_copy_client.cc:670] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:49.608560 23310 tablet_copy_client.cc:538] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:49.610522 23304 tablet_bootstrap.cc:492] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:49.611541 23304 tablet_bootstrap.cc:492] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:49.612372 23304 ts_tablet_manager.cc:1403] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.081s	user 0.019s	sys 0.007s
I20260709 13:05:49.589486 22001 catalog_manager.cc:5697] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 2, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 2 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:49.613087 23308 tablet_copy_client.cc:538] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:49.615624 23304 raft_consensus.cc:359] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:49.622171 23200 raft_consensus.cc:993] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:05:49.631104 23304 raft_consensus.cc:740] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:49.631426 23200 raft_consensus.cc:1081] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Signalling peer 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:05:49.631901 23304 consensus_queue.cc:260] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:49.633273 23308 tablet_bootstrap.cc:492] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:49.633221 22253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a4e641637cf41118865c96aec55b340"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:51872
I20260709 13:05:49.633903 22253 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.634305 22253 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.634415 23304 ts_tablet_manager.cc:1434] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:05:49.636320 22265 tablet_copy_service.cc:342] P 765d912bde9e48959e50d9efec3c26b6: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-6f8407607d7441c7bdac45e1dadc700d received from {username='slave'} at 127.0.0.1:45738
I20260709 13:05:49.636801 22265 tablet_copy_service.cc:434] P 765d912bde9e48959e50d9efec3c26b6: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-6f8407607d7441c7bdac45e1dadc700d on tablet 6f8407607d7441c7bdac45e1dadc700d with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:49.624964 22097 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:05:49.644289 23310 tablet_bootstrap.cc:492] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:49.643911 22253 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:49.648764 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:49.649396 22097 raft_consensus.cc:3055] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.649718 22097 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:49.650157 23302 tablet_bootstrap.cc:492] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:49.650668 22097 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:49.651367 22144 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:49.652192 23269 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:49.652676 23269 raft_consensus.cc:697] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:49.652369 22097 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.653484 23269 consensus_queue.cc:237] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:49.651516 23302 tablet_bootstrap.cc:492] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:49.656471 23302 ts_tablet_manager.cc:1403] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.139s	user 0.029s	sys 0.011s
I20260709 13:05:49.658141 22253 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:49.659476 23302 raft_consensus.cc:359] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:49.660329 23302 raft_consensus.cc:740] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:49.661041 23302 consensus_queue.cc:260] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:49.661681 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:49.662250 22177 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.663344 22097 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:05:49.665777 22218 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:49.666679 23261 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:49.667196 23261 raft_consensus.cc:697] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:49.663884 23302 ts_tablet_manager.cc:1434] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:49.668273 23261 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:49.670076 22265 tablet_copy_service.cc:342] P 765d912bde9e48959e50d9efec3c26b6: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-cbe9d18a693340a29f852081a41a74f1 received from {username='slave'} at 127.0.0.1:45738
I20260709 13:05:49.670493 22265 tablet_copy_service.cc:434] P 765d912bde9e48959e50d9efec3c26b6: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-cbe9d18a693340a29f852081a41a74f1 on tablet cbe9d18a693340a29f852081a41a74f1 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:49.676919 23308 tablet_bootstrap.cc:492] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:49.677950 23308 tablet_bootstrap.cc:492] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:49.678622 23308 ts_tablet_manager.cc:1403] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.000s
I20260709 13:05:49.681718 23308 raft_consensus.cc:359] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:49.682556 23308 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:49.683408 23308 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:49.686786 23308 ts_tablet_manager.cc:1434] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:49.688575 22116 tablet_copy_service.cc:342] P c0694f6572bf406a92d55f1f2ab46ef2: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-9a4e641637cf41118865c96aec55b340 received from {username='slave'} at 127.0.0.1:43368
I20260709 13:05:49.689051 22116 tablet_copy_service.cc:434] P c0694f6572bf406a92d55f1f2ab46ef2: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-9a4e641637cf41118865c96aec55b340 on tablet 9a4e641637cf41118865c96aec55b340 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:49.701666 22177 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:05:49.701005 22000 catalog_manager.cc:5697] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 2, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 2 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.706117 22003 catalog_manager.cc:5697] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 2 to 3, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 3 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.650104 22252 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:05:49.777562 23310 tablet_bootstrap.cc:492] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:49.778337 23310 tablet_bootstrap.cc:492] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:49.779017 23310 ts_tablet_manager.cc:1403] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.135s	user 0.025s	sys 0.052s
I20260709 13:05:49.782248 23310 raft_consensus.cc:359] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:49.783211 23310 raft_consensus.cc:740] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:49.783861 23310 consensus_queue.cc:260] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:49.785498 23268 raft_consensus.cc:993] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3: : Instructing follower 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:05:49.786001 23268 raft_consensus.cc:1081] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Signalling peer 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:05:49.786695 23310 ts_tablet_manager.cc:1434] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:49.788487 22191 tablet_copy_service.cc:342] P 79683575881f4334bd4dc6d9bdbb45c3: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-03ed5952f28c46d8b66e87a9d1b03981 received from {username='slave'} at 127.0.0.1:57856
I20260709 13:05:49.788895 22191 tablet_copy_service.cc:434] P 79683575881f4334bd4dc6d9bdbb45c3: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-03ed5952f28c46d8b66e87a9d1b03981 on tablet 03ed5952f28c46d8b66e87a9d1b03981 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:49.791764 22252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:51880
I20260709 13:05:49.792392 22252 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.792726 22252 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.795275 22253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a4e641637cf41118865c96aec55b340"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51860
I20260709 13:05:49.795835 22253 raft_consensus.cc:606] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:05:49.799872 22252 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:49.800227 22253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a4e641637cf41118865c96aec55b340"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51860
I20260709 13:05:49.800881 22253 raft_consensus.cc:606] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:05:49.802335 22252 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:05:49.802471 21991 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 9a4e641637cf41118865c96aec55b340 already in progress [suppressed 3 similar messages]
I20260709 13:05:49.802860 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:49.803468 22177 raft_consensus.cc:3055] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.803774 22177 raft_consensus.cc:740] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:49.803993 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:49.804551 22097 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.804472 22177 consensus_queue.cc:260] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:49.805912 22177 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.810860 22252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a4e641637cf41118865c96aec55b340"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51860
I20260709 13:05:49.811465 22252 raft_consensus.cc:606] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:05:49.812268 22177 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:05:49.812883 22097 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:05:49.813357 22220 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:49.814179 23261 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:49.814666 23261 raft_consensus.cc:697] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:49.815512 23261 consensus_queue.cc:237] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:49.819794 22052 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:05:49.820266 22052 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 9a4e641637cf41118865c96aec55b340 already in progress
W20260709 13:05:49.820559 22052 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 9a4e641637cf41118865c96aec55b340 already in progress
I20260709 13:05:49.830168 22001 catalog_manager.cc:5697] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 2, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 2 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:49.848117 22812 raft_consensus.cc:1217] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:49.873626 23327 raft_consensus.cc:993] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6: : Instructing follower a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:49.874137 23186 raft_consensus.cc:1081] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Signalling peer a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:49.875607 22812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:35230
I20260709 13:05:49.876246 22812 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.876595 22812 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.880597 22813 raft_consensus.cc:1217] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:49.893680 22812 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:49.896818 22812 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:49.897118 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:49.897724 22097 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.897809 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:49.898442 22253 raft_consensus.cc:3055] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.898737 22253 raft_consensus.cc:740] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:49.899581 22253 consensus_queue.cc:260] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:49.900789 22253 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.908460 22253 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:49.908460 22097 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:49.909919 22782 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:49.910775 23256 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:49.911278 23256 raft_consensus.cc:697] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:05:49.912148 23256 consensus_queue.cc:237] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:49.929461 22001 catalog_manager.cc:5697] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 2, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 2 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:49.987434 22813 raft_consensus.cc:1217] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:49.999555 22097 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:50.006821 23256 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:50.033967 22248 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:50.037410 23255 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:50.063814 22099 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:50.065824 23329 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:50.096524 22181 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:50.098608 23327 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:50.115437 22097 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:50.117851 23186 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.129310 23261 raft_consensus.cc:993] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6: : Instructing follower c0694f6572bf406a92d55f1f2ab46ef2 to start an election
I20260709 13:05:50.129786 23261 raft_consensus.cc:1081] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Signalling peer c0694f6572bf406a92d55f1f2ab46ef2 to start an election
I20260709 13:05:50.133445 22813 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Advancing to term 2
I20260709 13:05:50.133558 22103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a4e641637cf41118865c96aec55b340"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:50282
I20260709 13:05:50.134197 22103 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:50.134553 22103 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:50.142009 22103 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:50.144084 22103 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:50.145063 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:50.155400 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:50.156124 22253 raft_consensus.cc:3055] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:50.156464 22253 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:50.159192 22252 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:50.159410 22253 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:50.161808 23239 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.162411 22253 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:50.191808 22813 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEARNER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:50.214389 22253 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:05:50.215641 22072 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:50.217779 23318 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:50.218253 23318 raft_consensus.cc:697] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:50.219158 23318 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:50.225883 22181 raft_consensus.cc:1275] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.232018 23262 consensus_queue.cc:1048] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.242825 22003 catalog_manager.cc:5697] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 3, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 3 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.250330 22099 raft_consensus.cc:1275] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.252290 23186 consensus_queue.cc:1048] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.306701 23261 raft_consensus.cc:1064] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:50.308900 23261 consensus_queue.cc:237] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:50.315702 22176 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.316722 22099 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.317348 23327 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.315702 22813 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.318169 23261 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.328811 23327 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.336845 22099 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:50.338141 23271 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:50.339982 23327 raft_consensus.cc:2955] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.347913 22099 raft_consensus.cc:2955] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.352890 22252 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:50.354528 23271 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:50.363550 22176 raft_consensus.cc:2955] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.377171 22003 catalog_manager.cc:5697] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.393090 22813 raft_consensus.cc:2955] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.407554 23186 raft_consensus.cc:1064] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:50.409895 23186 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:50.414603 23239 raft_consensus.cc:1064] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:50.439379 22252 consensus_queue.cc:237] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:50.418083 23239 consensus_queue.cc:237] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:50.446055 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:50.446602 22181 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.448078 23261 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:50.453084 22812 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.456763 22812 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.457300 23262 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:50.458115 23329 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.462297 22813 raft_consensus.cc:2955] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.459318 23262 raft_consensus.cc:2955] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.469801 22176 raft_consensus.cc:2955] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.472626 22099 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.475098 22252 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.475112 23329 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:50.477154 21991 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6f8407607d7441c7bdac45e1dadc700d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:50.478358 23268 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.504621 22001 catalog_manager.cc:5697] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.519927 23329 raft_consensus.cc:2955] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.522207 22089 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f8407607d7441c7bdac45e1dadc700d with delete_type TABLET_DATA_TOMBSTONED (TS c0694f6572bf406a92d55f1f2ab46ef2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50280
I20260709 13:05:50.526813 22813 raft_consensus.cc:2955] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.530223 22099 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.532354 22181 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.532552 22816 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.536669 23262 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.541079 23327 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.551874 23327 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.549126 22097 raft_consensus.cc:2955] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.555691 22248 raft_consensus.cc:2955] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.564957 22000 catalog_manager.cc:5697] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.589105 23352 tablet_replica.cc:333] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:05:50.591424 23352 raft_consensus.cc:2243] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.594655 23352 raft_consensus.cc:2272] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.592021 23186 raft_consensus.cc:2955] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.595929 22812 raft_consensus.cc:2955] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.599535 23352 ts_tablet_manager.cc:1916] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:50.592408 22181 raft_consensus.cc:2955] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.608865 22103 raft_consensus.cc:2955] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.633984 23352 ts_tablet_manager.cc:1929] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:50.634521 23352 log.cc:1199] T 6f8407607d7441c7bdac45e1dadc700d P c0694f6572bf406a92d55f1f2ab46ef2: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/wals/6f8407607d7441c7bdac45e1dadc700d
I20260709 13:05:50.638818 22176 consensus_queue.cc:237] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:50.639480 21988 catalog_manager.cc:5028] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): tablet 6f8407607d7441c7bdac45e1dadc700d (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:50.642501 22813 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEARNER]: Advancing to term 3
I20260709 13:05:50.648502 22097 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.649520 22002 catalog_manager.cc:5697] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.652743 22813 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:50.654464 23239 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:50.657258 23318 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.664060 22812 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.666334 23269 raft_consensus.cc:2955] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.669988 23329 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:50.671662 22181 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:50.677843 22103 raft_consensus.cc:2955] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.686903 22181 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:50.691852 22248 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:50.702814 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:50.706797 23242 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:50.710125 22814 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.712628 22097 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.712513 23262 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:50.713191 22812 raft_consensus.cc:2955] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.714044 23327 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:50.714874 23318 raft_consensus.cc:1064] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
W20260709 13:05:50.715312 23318 raft_consensus.cc:1068] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: Unable to promote non-voter a07ca3d1b5b84f4bbcb907f709a69275: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:05:50.716202 21990 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 03ed5952f28c46d8b66e87a9d1b03981 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:50.725924 23186 raft_consensus.cc:2955] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.727602 22816 raft_consensus.cc:2955] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.742549 21991 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cbe9d18a693340a29f852081a41a74f1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:50.743331 22097 raft_consensus.cc:2955] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.752486 22001 catalog_manager.cc:5697] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.759766 22003 catalog_manager.cc:5697] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index 3 to 4, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.768451 22166 tablet_service.cc:1558] Processing DeleteTablet for tablet cbe9d18a693340a29f852081a41a74f1 with delete_type TABLET_DATA_TOMBSTONED (TS 79683575881f4334bd4dc6d9bdbb45c3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51110
I20260709 13:05:50.776010 22241 tablet_service.cc:1558] Processing DeleteTablet for tablet 03ed5952f28c46d8b66e87a9d1b03981 with delete_type TABLET_DATA_TOMBSTONED (TS 765d912bde9e48959e50d9efec3c26b6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51860
I20260709 13:05:50.782521 22248 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:50.787755 23357 tablet_replica.cc:333] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:05:50.789989 23357 raft_consensus.cc:2243] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.790843 23357 raft_consensus.cc:2272] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.799193 23358 tablet_replica.cc:333] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:05:50.799578 23357 ts_tablet_manager.cc:1916] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:50.802614 23358 raft_consensus.cc:2243] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.804766 23358 raft_consensus.cc:2272] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.818763 22248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:48610
I20260709 13:05:50.819393 22248 raft_consensus.cc:606] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:50.822737 22176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:05:50.825204 23357 ts_tablet_manager.cc:1929] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:50.825824 23357 log.cc:1199] T cbe9d18a693340a29f852081a41a74f1 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/wals/cbe9d18a693340a29f852081a41a74f1
I20260709 13:05:50.826727 23358 ts_tablet_manager.cc:1916] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:50.828063 21990 catalog_manager.cc:5028] TS 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): tablet cbe9d18a693340a29f852081a41a74f1 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:50.831354 23321 raft_consensus.cc:1064] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:50.832697 23359 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:50.823599 22176 raft_consensus.cc:606] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:50.841365 23321 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:50.844672 22102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:05:50.845245 22102 raft_consensus.cc:606] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Received request to transfer leadership to TS a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:50.851889 22816 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:50.852676 22102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:05:50.853250 22102 raft_consensus.cc:606] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Received request to transfer leadership to TS a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:50.854401 22181 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:50.857344 23318 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:50.857823 22102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:05:50.858508 22102 raft_consensus.cc:606] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Received request to transfer leadership to TS a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:50.859963 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:50.863543 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:50.868333 23360 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:50.888758 23358 ts_tablet_manager.cc:1929] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:50.889576 23358 log.cc:1199] T 03ed5952f28c46d8b66e87a9d1b03981 P 765d912bde9e48959e50d9efec3c26b6: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-2-root/wals/03ed5952f28c46d8b66e87a9d1b03981
I20260709 13:05:50.892217 21991 catalog_manager.cc:5028] TS 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): tablet 03ed5952f28c46d8b66e87a9d1b03981 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:50.904633 22253 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:50.908443 23359 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:50.912717 22253 raft_consensus.cc:2955] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.914515 23242 raft_consensus.cc:2955] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.914567 22176 raft_consensus.cc:2955] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.934978 22816 raft_consensus.cc:2955] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.937116 22002 catalog_manager.cc:5697] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index 2 to 5, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.958220 22102 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:50.963725 22181 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:50.965570 23360 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:50.964540 22816 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:50.967772 23360 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:50.972242 23321 raft_consensus.cc:2955] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.973619 22181 raft_consensus.cc:2955] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.977135 22816 raft_consensus.cc:2955] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.982681 23360 raft_consensus.cc:993] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:50.983242 23360 raft_consensus.cc:1081] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Signalling peer a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:50.985390 22812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:35198
I20260709 13:05:50.986016 22812 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:50.986716 22812 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.993626 22003 catalog_manager.cc:5697] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 5 to 6, VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) evicted. New cstate: current_term: 3 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:50.994277 22812 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:50.997329 21988 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a4e641637cf41118865c96aec55b340 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:50.997388 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:50.998073 22102 raft_consensus.cc:3055] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.998363 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:50.998370 22102 raft_consensus.cc:740] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:50.999048 22253 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.999467 22102 consensus_queue.cc:260] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:51.000718 22102 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.007558 22253 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:51.008764 22782 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:51.008337 22812 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:51.011674 23271 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:51.012336 23271 raft_consensus.cc:697] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:05:51.011409 22102 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:51.013197 23271 consensus_queue.cc:237] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:51.016336 22241 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a4e641637cf41118865c96aec55b340 with delete_type TABLET_DATA_TOMBSTONED (TS 765d912bde9e48959e50d9efec3c26b6 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:51860
I20260709 13:05:51.017395 23358 tablet_replica.cc:333] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:05:51.018273 23358 raft_consensus.cc:2243] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:51.019007 23358 raft_consensus.cc:2272] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.024852 23358 ts_tablet_manager.cc:1916] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:51.028847 22004 catalog_manager.cc:5697] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 2, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 2 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.043315 23361 raft_consensus.cc:993] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: : Instructing follower 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:05:51.043805 23361 raft_consensus.cc:1081] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Signalling peer 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:05:51.045897 22181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:51114
I20260709 13:05:51.046418 22181 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.046797 22181 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.054157 23358 ts_tablet_manager.cc:1929] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:05:51.054065 22181 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:51.054629 23358 log.cc:1199] T 9a4e641637cf41118865c96aec55b340 P 765d912bde9e48959e50d9efec3c26b6: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-2-root/wals/9a4e641637cf41118865c96aec55b340
I20260709 13:05:51.056360 21991 catalog_manager.cc:5028] TS 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): tablet 9a4e641637cf41118865c96aec55b340 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:51.056842 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:51.057453 22102 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.057408 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:51.058338 22253 raft_consensus.cc:3055] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.058632 22253 raft_consensus.cc:740] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:51.059376 22253 consensus_queue.cc:260] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:51.060122 22253 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.056365 22181 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:51.064580 22102 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:05:51.065706 22144 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:51.066483 23329 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:51.066519 22253 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:05:51.067061 23329 raft_consensus.cc:697] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:51.067869 23329 consensus_queue.cc:237] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:51.076647 22004 catalog_manager.cc:5697] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 1 to 2, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.140794 23318 raft_consensus.cc:993] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:51.141237 23359 raft_consensus.cc:1081] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Signalling peer a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:51.142843 22812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:35198
I20260709 13:05:51.143404 22812 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.143700 22812 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.150709 22812 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:51.153115 22812 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:51.153930 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:51.154632 22097 raft_consensus.cc:3055] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.155006 22097 raft_consensus.cc:740] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:51.155790 22097 consensus_queue.cc:260] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:51.157176 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:51.157848 22176 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.157173 22097 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.164805 22176 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:51.165958 22781 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:51.166967 23271 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:51.168305 23271 raft_consensus.cc:697] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:05:51.169088 23271 consensus_queue.cc:237] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:51.169687 22097 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:51.177314 22004 catalog_manager.cc:5697] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 2, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 2 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.224298 23269 raft_consensus.cc:993] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3: : Instructing follower 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:05:51.224728 23329 raft_consensus.cc:1081] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Signalling peer 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:05:51.225966 22253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:51880
I20260709 13:05:51.226405 22253 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.226668 22253 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.232230 22253 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:51.234285 22253 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:51.234894 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:51.235682 22102 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.239254 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:51.239862 22181 raft_consensus.cc:3055] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.240195 22181 raft_consensus.cc:740] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:51.240630 22102 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:05:51.241089 22181 consensus_queue.cc:260] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:51.241942 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:51.242496 22181 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.243326 23362 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:51.243814 23362 raft_consensus.cc:697] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:51.244699 23362 consensus_queue.cc:237] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:51.241526 22097 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:51.251987 22181 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:05:51.258011 22004 catalog_manager.cc:5697] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 2, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 2 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.297737 23318 raft_consensus.cc:993] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:51.298264 23359 raft_consensus.cc:1081] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Signalling peer a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:51.299743 22812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:35198
I20260709 13:05:51.300202 22812 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.300470 22812 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.306867 22812 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:51.308893 22812 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:51.309479 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:51.309845 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:51.310103 22097 raft_consensus.cc:3055] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.310458 22248 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.310467 22097 raft_consensus.cc:740] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:51.311497 22097 consensus_queue.cc:260] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:51.312637 22097 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.317076 22248 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:51.318348 22782 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:51.318994 22097 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:51.319200 23271 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:51.319809 23271 raft_consensus.cc:697] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:05:51.320727 23271 consensus_queue.cc:237] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:51.329507 22004 catalog_manager.cc:5697] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 2, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 2 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.450363 22248 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:51.451795 23271 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:51.465078 22097 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:51.468073 23271 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:05:51.480176 22102 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:51.481678 23329 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.506029 22248 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:51.507848 23329 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.581722 22102 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:51.583264 23255 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:51.592507 22181 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:51.594547 23370 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:51.847548 22176 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:51.848695 23362 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.861045 22097 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:51.862838 23381 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.864512 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:51.866199 22248 consensus_queue.cc:237] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:51.887151 22102 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:05:51.889976 22218 consensus_peers.cc:597] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6d938b9c784244a59de8b48c3136eb3f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:51.891256 22176 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.891285 23370 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:51.892809 23381 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.896605 22097 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.898352 23327 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.909668 22248 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:51.908958 23327 raft_consensus.cc:2955] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:51.911475 23372 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:51.924263 22176 raft_consensus.cc:2955] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:51.937178 22253 consensus_queue.cc:237] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:51.944725 22004 catalog_manager.cc:5697] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:51.952894 22102 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:51.961508 22218 consensus_peers.cc:597] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77137a3a1cee4b55ae36e0a368f7e363. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:51.962649 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:51.969985 22181 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.971668 23362 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.972527 23381 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.990439 22103 raft_consensus.cc:2955] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:52.010739 23327 raft_consensus.cc:2955] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:52.012341 22102 raft_consensus.cc:2955] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:52.037569 22176 consensus_queue.cc:237] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:52.039841 22180 raft_consensus.cc:2955] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
W20260709 13:05:52.064248 22144 consensus_peers.cc:597] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12ac70b72e5d452ca6dd020f9ccb0541. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:52.063917 22000 catalog_manager.cc:5697] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:52.067028 22248 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:52.068707 23269 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.085908 22181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:05:52.086522 22181 raft_consensus.cc:606] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Received request to transfer leadership to TS a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:52.091253 22102 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:52.092671 23329 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.094455 22102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:05:52.095096 22102 raft_consensus.cc:606] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Received request to transfer leadership to TS a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:52.103127 22103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:05:52.103776 22103 raft_consensus.cc:606] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:52.103359 23329 raft_consensus.cc:2955] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:52.106904 22103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:05:52.107492 22103 raft_consensus.cc:606] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:52.107672 22252 raft_consensus.cc:2955] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:52.117847 22253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:48610
I20260709 13:05:52.118507 22253 raft_consensus.cc:606] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:52.120991 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:52.122951 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:52.131829 22253 consensus_queue.cc:237] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:52.132584 22003 catalog_manager.cc:5697] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.134584 22103 raft_consensus.cc:2955] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
W20260709 13:05:52.141045 22218 consensus_peers.cc:597] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 252049d2bcdd4f329ca5015bf10c1b19. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:52.150846 22181 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:52.152910 23394 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:52.153311 22103 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:52.155884 23394 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:52.159715 23327 raft_consensus.cc:2955] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:52.161391 22180 raft_consensus.cc:2955] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:52.166957 22103 raft_consensus.cc:2955] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:05:52.182247 22004 catalog_manager.cc:5697] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index -1 to 3, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 2 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.262385 23318 raft_consensus.cc:993] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:05:52.263187 23318 raft_consensus.cc:1081] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Signalling peer 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:05:52.273854 22252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:51872
I20260709 13:05:52.274971 22252 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.275638 22252 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.289567 22252 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:52.301851 22252 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:52.306502 23362 raft_consensus.cc:993] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: : Instructing follower 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:05:52.307791 23262 raft_consensus.cc:1081] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Signalling peer 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:05:52.322588 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:52.323732 22102 raft_consensus.cc:3055] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.324150 22102 raft_consensus.cc:740] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:52.325326 22102 consensus_queue.cc:260] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:52.296175 23269 raft_consensus.cc:993] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: : Instructing follower a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:52.339916 23360 raft_consensus.cc:993] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:52.373744 23400 raft_consensus.cc:1081] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Signalling peer a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:52.374432 23269 raft_consensus.cc:1081] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Signalling peer a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:05:52.352451 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:52.353729 22180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:51114
I20260709 13:05:52.375279 22176 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.375496 22180 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.375905 22180 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.384902 22816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:35198
I20260709 13:05:52.385579 22816 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.385954 22816 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.406445 22816 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:52.407346 22102 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.410137 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:52.410887 22177 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.412016 23403 ts_tablet_manager.cc:933] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:52.413548 22180 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:52.418105 22816 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:52.418993 22180 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:52.419166 22102 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:05:52.415737 22176 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:05:52.420612 22177 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:05:52.422209 22781 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:52.424039 23372 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:52.424526 23372 raft_consensus.cc:697] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:05:52.425631 23372 consensus_queue.cc:237] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:52.427253 22812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:35214
I20260709 13:05:52.427871 22812 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.428233 22812 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.458277 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:52.459422 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:52.477725 22097 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.483350 22102 raft_consensus.cc:3055] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:52.483719 22102 raft_consensus.cc:740] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:52.484270 22097 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:05:52.485806 22144 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:52.486733 23239 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:05:52.472134 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 69270.5us
I20260709 13:05:52.487283 23239 raft_consensus.cc:697] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:52.488415 22220 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:52.490200 23239 consensus_queue.cc:237] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:52.491432 23327 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.493345 23327 raft_consensus.cc:697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:52.494349 23327 consensus_queue.cc:237] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:52.503118 23408 ts_tablet_manager.cc:933] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:05:52.505373 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 72103.9us
I20260709 13:05:52.513347 22003 catalog_manager.cc:5697] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 2 to 3, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 3 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.520226 23409 ts_tablet_manager.cc:933] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:52.515518 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:52.521117 22253 raft_consensus.cc:3055] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.521426 22253 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:52.523001 22253 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:52.523430 22812 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:52.524495 22253 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.525149 23403 tablet_copy_client.cc:323] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.67:42273
I20260709 13:05:52.528201 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:52.528513 23409 tablet_copy_client.cc:323] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.67:42273
I20260709 13:05:52.528891 22097 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.498677 22102 consensus_queue.cc:260] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:52.531177 22265 tablet_copy_service.cc:140] P 765d912bde9e48959e50d9efec3c26b6: Received BeginTabletCopySession request for tablet 77137a3a1cee4b55ae36e0a368f7e363 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:45738)
I20260709 13:05:52.531729 22265 tablet_copy_service.cc:161] P 765d912bde9e48959e50d9efec3c26b6: Beginning new tablet copy session on tablet 77137a3a1cee4b55ae36e0a368f7e363 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:45738: session id = a07ca3d1b5b84f4bbcb907f709a69275-77137a3a1cee4b55ae36e0a368f7e363
I20260709 13:05:52.537729 22264 tablet_copy_service.cc:140] P 765d912bde9e48959e50d9efec3c26b6: Received BeginTabletCopySession request for tablet 6d938b9c784244a59de8b48c3136eb3f from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:45738)
I20260709 13:05:52.538394 22264 tablet_copy_service.cc:161] P 765d912bde9e48959e50d9efec3c26b6: Beginning new tablet copy session on tablet 6d938b9c784244a59de8b48c3136eb3f from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:45738: session id = a07ca3d1b5b84f4bbcb907f709a69275-6d938b9c784244a59de8b48c3136eb3f
I20260709 13:05:52.543780 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:52.544488 22177 raft_consensus.cc:3055] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.544852 22177 raft_consensus.cc:740] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:52.545842 22177 consensus_queue.cc:260] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:52.547550 22177 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.550156 23408 tablet_copy_client.cc:323] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.66:42399
I20260709 13:05:52.552155 22812 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:52.552387 22191 tablet_copy_service.cc:140] P 79683575881f4334bd4dc6d9bdbb45c3: Received BeginTabletCopySession request for tablet 12ac70b72e5d452ca6dd020f9ccb0541 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:57856)
I20260709 13:05:52.552966 22191 tablet_copy_service.cc:161] P 79683575881f4334bd4dc6d9bdbb45c3: Beginning new tablet copy session on tablet 12ac70b72e5d452ca6dd020f9ccb0541 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:57856: session id = a07ca3d1b5b84f4bbcb907f709a69275-12ac70b72e5d452ca6dd020f9ccb0541
I20260709 13:05:52.554574 22177 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:52.556128 22097 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:52.558133 22781 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:52.559283 23406 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.559755 23406 raft_consensus.cc:697] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:05:52.560614 23406 consensus_queue.cc:237] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:52.570326 23318 raft_consensus.cc:993] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:05:52.570742 22102 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.570937 23318 raft_consensus.cc:1081] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Signalling peer 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:05:52.573971 22191 tablet_copy_source_session.cc:215] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:52.574573 22177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:05:52.576552 22177 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.577050 22177 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.576465 22003 catalog_manager.cc:5697] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 1 to 2, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.578465 23408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ac70b72e5d452ca6dd020f9ccb0541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.580449 22102 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:05:52.588467 22265 tablet_copy_source_session.cc:215] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:52.589118 22253 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:05:52.588467 22264 tablet_copy_source_session.cc:215] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:52.593379 22177 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:52.595292 22177 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:52.596417 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:52.597070 22103 raft_consensus.cc:3055] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.597417 22103 raft_consensus.cc:740] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:52.598475 22103 consensus_queue.cc:260] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:52.599833 22103 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.611266 22103 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:05:52.612165 23403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77137a3a1cee4b55ae36e0a368f7e363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.617152 22144 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:52.618155 23239 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.618677 23239 raft_consensus.cc:697] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:52.619554 23239 consensus_queue.cc:237] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:52.624367 23409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d938b9c784244a59de8b48c3136eb3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.631919 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:52.632572 22252 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.637166 22004 catalog_manager.cc:5697] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 2, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 2 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.639132 22252 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:05:52.667138 23408 tablet_copy_client.cc:806] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:52.667805 23408 tablet_copy_client.cc:670] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:52.672298 23408 tablet_copy_client.cc:538] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:52.675343 22004 catalog_manager.cc:5697] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 1 to 2, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.682221 23408 tablet_bootstrap.cc:492] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:52.699512 23403 tablet_copy_client.cc:806] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:52.682782 22003 catalog_manager.cc:5697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 2, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 2 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.700549 23403 tablet_copy_client.cc:670] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:52.710635 23403 tablet_copy_client.cc:538] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:52.720412 23409 tablet_copy_client.cc:806] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:52.721038 23409 tablet_copy_client.cc:670] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:52.724987 23409 tablet_copy_client.cc:538] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:52.735245 23403 tablet_bootstrap.cc:492] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:52.743721 23409 tablet_bootstrap.cc:492] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:52.770687 23417 ts_tablet_manager.cc:933] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:52.772629 23408 tablet_bootstrap.cc:492] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:52.776357 23408 tablet_bootstrap.cc:492] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:52.778105 23408 ts_tablet_manager.cc:1403] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.096s	user 0.033s	sys 0.023s
I20260709 13:05:52.782680 23408 raft_consensus.cc:359] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:52.783977 23417 tablet_copy_client.cc:323] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.67:42273
I20260709 13:05:52.786042 22264 tablet_copy_service.cc:140] P 765d912bde9e48959e50d9efec3c26b6: Received BeginTabletCopySession request for tablet 252049d2bcdd4f329ca5015bf10c1b19 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:45738)
I20260709 13:05:52.786643 22264 tablet_copy_service.cc:161] P 765d912bde9e48959e50d9efec3c26b6: Beginning new tablet copy session on tablet 252049d2bcdd4f329ca5015bf10c1b19 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:45738: session id = a07ca3d1b5b84f4bbcb907f709a69275-252049d2bcdd4f329ca5015bf10c1b19
I20260709 13:05:52.789321 23403 tablet_bootstrap.cc:492] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:52.790246 23403 tablet_bootstrap.cc:492] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:52.792104 23403 ts_tablet_manager.cc:1403] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.056s	user 0.006s	sys 0.020s
I20260709 13:05:52.795083 22264 tablet_copy_source_session.cc:215] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:52.795128 23403 raft_consensus.cc:359] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:52.796145 23403 raft_consensus.cc:740] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:52.795646 23408 raft_consensus.cc:740] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:52.796826 23403 consensus_queue.cc:260] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:52.798676 23409 tablet_bootstrap.cc:492] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:52.799605 23409 tablet_bootstrap.cc:492] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:52.800279 23409 ts_tablet_manager.cc:1403] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.016s
I20260709 13:05:52.800473 23417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252049d2bcdd4f329ca5015bf10c1b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.803764 23403 ts_tablet_manager.cc:1434] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:05:52.803516 23409 raft_consensus.cc:359] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:52.805577 23409 raft_consensus.cc:740] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:52.806906 22265 tablet_copy_service.cc:342] P 765d912bde9e48959e50d9efec3c26b6: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-77137a3a1cee4b55ae36e0a368f7e363 received from {username='slave'} at 127.0.0.1:45738
I20260709 13:05:52.807439 22265 tablet_copy_service.cc:434] P 765d912bde9e48959e50d9efec3c26b6: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-77137a3a1cee4b55ae36e0a368f7e363 on tablet 77137a3a1cee4b55ae36e0a368f7e363 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:52.807245 23409 consensus_queue.cc:260] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:52.814177 23409 ts_tablet_manager.cc:1434] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:05:52.796895 23408 consensus_queue.cc:260] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:52.816285 22264 tablet_copy_service.cc:342] P 765d912bde9e48959e50d9efec3c26b6: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-6d938b9c784244a59de8b48c3136eb3f received from {username='slave'} at 127.0.0.1:45738
I20260709 13:05:52.816733 22264 tablet_copy_service.cc:434] P 765d912bde9e48959e50d9efec3c26b6: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-6d938b9c784244a59de8b48c3136eb3f on tablet 6d938b9c784244a59de8b48c3136eb3f with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:52.816757 23408 ts_tablet_manager.cc:1434] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.004s
I20260709 13:05:52.821733 22191 tablet_copy_service.cc:342] P 79683575881f4334bd4dc6d9bdbb45c3: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-12ac70b72e5d452ca6dd020f9ccb0541 received from {username='slave'} at 127.0.0.1:57856
I20260709 13:05:52.822201 22191 tablet_copy_service.cc:434] P 79683575881f4334bd4dc6d9bdbb45c3: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-12ac70b72e5d452ca6dd020f9ccb0541 on tablet 12ac70b72e5d452ca6dd020f9ccb0541 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:52.836192 23417 tablet_copy_client.cc:806] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:52.840644 22103 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:52.842206 23255 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:52.843971 23417 tablet_copy_client.cc:670] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:52.849972 23417 tablet_copy_client.cc:538] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:52.863643 23417 tablet_bootstrap.cc:492] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:05:52.890607 22177 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:52.897187 22812 raft_consensus.cc:1217] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:52.902185 23255 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:52.928982 23417 tablet_bootstrap.cc:492] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:52.929935 23417 tablet_bootstrap.cc:492] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:05:52.930660 23417 ts_tablet_manager.cc:1403] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.004s
I20260709 13:05:52.934754 22103 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.950084 23239 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.933740 23417 raft_consensus.cc:359] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:52.957770 23417 raft_consensus.cc:740] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:05:52.958525 23417 consensus_queue.cc:260] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:05:52.972396 23417 ts_tablet_manager.cc:1434] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:05:52.982367 22264 tablet_copy_service.cc:342] P 765d912bde9e48959e50d9efec3c26b6: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-252049d2bcdd4f329ca5015bf10c1b19 received from {username='slave'} at 127.0.0.1:45738
I20260709 13:05:52.982853 22264 tablet_copy_service.cc:434] P 765d912bde9e48959e50d9efec3c26b6: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-252049d2bcdd4f329ca5015bf10c1b19 on tablet 252049d2bcdd4f329ca5015bf10c1b19 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:52.984406 22812 raft_consensus.cc:1217] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:53.001386 22812 raft_consensus.cc:1217] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:53.031070 22253 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.033515 23239 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.036105 22103 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:53.037587 23255 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:53.052418 22177 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.054499 23362 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:53.075138 22253 raft_consensus.cc:1275] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.081516 23239 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:53.095474 22176 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:53.097194 23406 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:53.106487 22103 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.109314 23362 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.124094 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:53.160485 22102 raft_consensus.cc:1275] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.162230 23402 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:53.194574 22812 raft_consensus.cc:1217] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:05:53.253274 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:53.281376 23327 raft_consensus.cc:1064] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:53.285734 23327 consensus_queue.cc:237] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:53.312230 22248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:48610
I20260709 13:05:53.314548 22248 raft_consensus.cc:606] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:53.318756 22176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:05:53.319484 22176 raft_consensus.cc:606] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:53.323314 22176 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.323652 22102 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.325026 23327 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:53.336954 22103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:05:53.337661 22103 raft_consensus.cc:606] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:53.337266 23262 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:53.344465 22816 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.345818 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:05:53.346598 23327 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:53.348766 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:53.363250 23362 raft_consensus.cc:2955] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.367893 23381 raft_consensus.cc:1064] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:53.369344 22814 raft_consensus.cc:2955] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.370711 23381 consensus_queue.cc:237] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:53.393414 22176 raft_consensus.cc:2955] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.396914 22102 raft_consensus.cc:2955] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.401983 22002 catalog_manager.cc:5697] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.417905 22103 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.419176 22180 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.419936 23327 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:53.421936 23443 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:53.423277 22814 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.448516 23381 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:53.472496 23381 raft_consensus.cc:2955] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.481012 22177 raft_consensus.cc:2955] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.493048 22814 raft_consensus.cc:2955] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.497845 22102 raft_consensus.cc:2955] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.505789 23269 raft_consensus.cc:1064] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:53.508773 23269 consensus_queue.cc:237] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:53.538547 22248 consensus_queue.cc:237] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:53.542034 22812 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 LEARNER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.543787 23239 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:53.546532 22812 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:53.550544 22176 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:53.550114 22004 catalog_manager.cc:5697] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.553690 23442 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:53.561640 22102 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.563844 22248 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.566793 23269 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:53.567948 23239 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:53.567930 23442 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:53.570513 23362 raft_consensus.cc:2955] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.567962 22248 consensus_queue.cc:237] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:53.582207 22813 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:53.582062 22176 raft_consensus.cc:2955] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.584946 23269 raft_consensus.cc:2955] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.588852 22101 raft_consensus.cc:2955] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.612938 22003 catalog_manager.cc:5697] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.612540 22813 raft_consensus.cc:2955] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.629122 23426 raft_consensus.cc:993] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: : Instructing follower 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:05:53.629815 23426 raft_consensus.cc:1081] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Signalling peer 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:05:53.634016 22000 catalog_manager.cc:5697] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.635846 23442 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:53.639225 21991 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 77137a3a1cee4b55ae36e0a368f7e363 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:53.640588 22103 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:53.647616 22089 tablet_service.cc:1558] Processing DeleteTablet for tablet 77137a3a1cee4b55ae36e0a368f7e363 with delete_type TABLET_DATA_TOMBSTONED (TS c0694f6572bf406a92d55f1f2ab46ef2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50280
I20260709 13:05:53.655681 22248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:51880
I20260709 13:05:53.656330 22248 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:53.656708 22248 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.668054 22248 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:53.709534 22248 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:53.712574 23454 tablet_replica.cc:333] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:05:53.712296 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:53.715248 22180 raft_consensus.cc:3055] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:53.715657 22180 raft_consensus.cc:740] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:53.716384 22180 consensus_queue.cc:260] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:53.717427 22180 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.724220 22180 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
W20260709 13:05:53.715019 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 46410.8us
I20260709 13:05:53.744621 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:53.745285 22102 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.751102 22813 raft_consensus.cc:2955] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.755409 22220 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:53.740336 22248 raft_consensus.cc:2955] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.757790 23454 raft_consensus.cc:2243] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.758647 23454 raft_consensus.cc:2272] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.759260 23442 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:53.759806 23442 raft_consensus.cc:697] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:53.760885 23442 consensus_queue.cc:237] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:53.775255 23381 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:53.772913 23362 raft_consensus.cc:2955] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.791040 22102 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:05:53.815021 22812 raft_consensus.cc:2955] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.817093 21991 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6d938b9c784244a59de8b48c3136eb3f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:53.819792 23381 raft_consensus.cc:1064] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:05:53.822781 23381 consensus_queue.cc:237] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:53.822044 22101 raft_consensus.cc:2955] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.830181 22000 catalog_manager.cc:5697] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 2 to 3, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 3 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.830765 22180 consensus_queue.cc:237] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:53.831869 22000 catalog_manager.cc:5697] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 3 to 4, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New cstate: current_term: 1 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.837303 22813 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:53.840227 23454 ts_tablet_manager.cc:1916] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:53.840449 23442 raft_consensus.cc:993] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6: : Instructing follower c0694f6572bf406a92d55f1f2ab46ef2 to start an election
I20260709 13:05:53.847646 23442 raft_consensus.cc:1081] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Signalling peer c0694f6572bf406a92d55f1f2ab46ef2 to start an election
I20260709 13:05:53.840755 23455 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:53.843626 22253 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:53.848320 22813 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEARNER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:53.848925 22166 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d938b9c784244a59de8b48c3136eb3f with delete_type TABLET_DATA_TOMBSTONED (TS 79683575881f4334bd4dc6d9bdbb45c3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51110
I20260709 13:05:53.851819 22102 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:53.852983 23359 raft_consensus.cc:993] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:05:53.853484 23360 raft_consensus.cc:1081] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Signalling peer 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:05:53.855661 22176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:05:53.856215 22176 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:53.856554 22176 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.859467 22102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:50282
I20260709 13:05:53.860009 22102 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:53.860339 22102 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.868218 22176 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:53.872412 23402 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:53.872660 23426 raft_consensus.cc:2955] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.875018 22812 raft_consensus.cc:2955] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.879465 22177 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:53.885037 22176 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:53.886037 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:53.886333 22102 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:53.886674 22103 raft_consensus.cc:3055] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:53.887647 22103 raft_consensus.cc:740] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:53.888470 22103 consensus_queue.cc:260] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:53.889564 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:53.889796 22103 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.890206 22177 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.880834 23442 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:05:53.892480 23327 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:53.894446 23443 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:53.901363 22253 raft_consensus.cc:2955] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.905759 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:53.906369 22248 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.922353 22103 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:05:53.923633 22144 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:53.924625 23239 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:53.925177 23239 raft_consensus.cc:697] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:53.926455 22177 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:53.932945 22102 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:53.934383 22000 catalog_manager.cc:5697] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 3 to 4, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New cstate: current_term: 1 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:53.947577 22248 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:05:53.947923 23239 consensus_queue.cc:237] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:53.952669 23454 ts_tablet_manager.cc:1929] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:53.953328 23454 log.cc:1199] T 77137a3a1cee4b55ae36e0a368f7e363 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/wals/77137a3a1cee4b55ae36e0a368f7e363
I20260709 13:05:53.955108 23458 tablet_replica.cc:333] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:05:53.956384 23458 raft_consensus.cc:2243] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.957057 23458 raft_consensus.cc:2272] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.968042 23458 ts_tablet_manager.cc:1916] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:53.978636 21990 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 12ac70b72e5d452ca6dd020f9ccb0541 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:53.997435 23362 raft_consensus.cc:2955] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:54.001601 22089 tablet_service.cc:1558] Processing DeleteTablet for tablet 12ac70b72e5d452ca6dd020f9ccb0541 with delete_type TABLET_DATA_TOMBSTONED (TS c0694f6572bf406a92d55f1f2ab46ef2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50280
I20260709 13:05:54.002367 22071 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:54.002696 23454 tablet_replica.cc:333] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:05:54.004017 23454 raft_consensus.cc:2243] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:54.002704 21988 catalog_manager.cc:5028] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): tablet 77137a3a1cee4b55ae36e0a368f7e363 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:05:54.010751 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:54.011432 22246 raft_consensus.cc:3055] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:54.011760 22246 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:54.012594 22246 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:53.998970 22180 raft_consensus.cc:2955] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:54.022339 23318 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:54.076933 23318 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:54.023211 23454 raft_consensus.cc:2272] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:54.026551 22003 catalog_manager.cc:5697] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 3 to 4, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.080365 22102 raft_consensus.cc:2955] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:05:54.092150 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 60753.7us
W20260709 13:05:54.094031 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 47883.1us
I20260709 13:05:54.093674 23318 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:54.143796 22813 raft_consensus.cc:2955] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:05:54.143260 22246 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:54.156490 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 50801.7us
I20260709 13:05:54.168920 22102 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:54.173342 23327 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:05:54.212085 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 55813.1us
I20260709 13:05:54.254887 23454 ts_tablet_manager.cc:1916] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:05:54.269500 23465 log.cc:927] Time spent T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:05:54.281863 22246 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:54.320246 23458 ts_tablet_manager.cc:1929] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:54.320804 23458 log.cc:1199] T 6d938b9c784244a59de8b48c3136eb3f P 79683575881f4334bd4dc6d9bdbb45c3: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/wals/6d938b9c784244a59de8b48c3136eb3f
I20260709 13:05:54.329587 22180 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:54.333938 22000 catalog_manager.cc:5697] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 1 to 2, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.322865 21990 catalog_manager.cc:5028] TS 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): tablet 6d938b9c784244a59de8b48c3136eb3f (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
W20260709 13:05:54.317294 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 60843.8us
I20260709 13:05:54.349898 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:54.354038 23381 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:54.369335 22102 raft_consensus.cc:1275] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:54.373239 23402 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:54.405918 23454 ts_tablet_manager.cc:1929] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:54.406562 23454 log.cc:1199] T 12ac70b72e5d452ca6dd020f9ccb0541 P c0694f6572bf406a92d55f1f2ab46ef2: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/wals/12ac70b72e5d452ca6dd020f9ccb0541
I20260709 13:05:54.421748 22004 catalog_manager.cc:5697] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 1 to 2, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.440945 21988 catalog_manager.cc:5028] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): tablet 12ac70b72e5d452ca6dd020f9ccb0541 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
W20260709 13:05:54.478840 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 50945us
I20260709 13:05:54.505043 22249 raft_consensus.cc:1275] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:54.512853 22246 consensus_queue.cc:237] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:54.519366 23455 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:05:54.565092 22813 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:55.598711 23493 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:55.599316 23493 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:55.603982 23493 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:55.628978 23493 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:55.629947 23493 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:55.632725 23493 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:55.949115 23493 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:55.949941 23493 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:55.952843 23493 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:56.046216 23493 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:56.052249 23495 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:56.053085 23495 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:56.056285 23495 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:56.047047 23493 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:56.215588 23493 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:05:56.626837 22177 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.070s	user 0.072s	sys 0.154s
W20260709 13:05:56.629350 22177 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.072s	user 0.074s	sys 0.154s
I20260709 13:05:56.860973 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:57.063336 23496 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.064179 23496 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.067041 23496 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:05:57.067670 22145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.002s	sys 0.005s
W20260709 13:05:57.403283 22145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.002s	sys 0.005s
W20260709 13:05:57.266302 22069 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.68:35973 timed out after 1.631s (SENT)
W20260709 13:05:57.356176 22177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.004s	sys 0.004s
I20260709 13:05:57.402355 23499 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:05:57.430542 22177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.004s	sys 0.004s
I20260709 13:05:57.430830 23499 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.431669 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1202) took 2898 ms. Trace:
I20260709 13:05:57.433877 23499 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.432303 22177 rpcz_store.cc:276] 0709 13:05:54.532819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.535518 (+  2699us) service_pool.cc:224] Handling call
0709 13:05:54.535751 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:54.535915 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:56.638038 (+2102123us) log.cc:844] Serialized 14 byte log entry
0709 13:05:57.431101 (+793063us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:57.431189 (+    88us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:57.431252 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.431344 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.431548 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28554,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":716644,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"thread_start_us":2873306,"threads_started":3,"wal-append.queue_time_us":958}
I20260709 13:05:57.438324 23499 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.441587 23496 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.441692 23499 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.442147 23496 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.444970 23501 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.446334 23499 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.447208 23498 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:05:57.464645 22780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.596s	user 0.066s	sys 0.114s
W20260709 13:05:57.465291 22780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.599s	user 0.067s	sys 0.115s
W20260709 13:05:57.469515 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 203251us
I20260709 13:05:57.468413 23498 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.474748 23496 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.476980 23496 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.462756 23501 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.497360 23500 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.523090 23500 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.524199 23508 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.525556 23500 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.501024 23501 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.521368 23405 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.485457 23498 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.483688 23496 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.527614 23405 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.529111 23496 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.530215 23405 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.524801 23508 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.533664 23508 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.534390 23508 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.535027 23508 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.535616 23514 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.536172 23405 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.536194 23514 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.536877 23405 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.537313 23508 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.537921 23508 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.538426 23508 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.538704 23514 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.538808 23405 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.540632 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:57.541319 22812 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:57.540580 23508 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:57.542259 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:05:57.555351 22781 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.582s	user 0.023s	sys 0.024s
W20260709 13:05:57.555909 22781 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.582s	user 0.023s	sys 0.024s
I20260709 13:05:57.558554 23405 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.559326 23513 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.559765 23514 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.560137 23513 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.560597 23514 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.563077 23405 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.564707 23405 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.565471 23513 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.567691 23514 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:57.568334 23514 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.568909 23514 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.572594 23514 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:57.578122 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:57.596284 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:57.596999 22815 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:57.604426 22069 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:57.605388 23512 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:57.605813 23512 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.606114 23512 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.613356 23512 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.616220 23512 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.619742 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:05:57.622438 22810 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.629808 22810 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:57.631125 22069 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:57.631954 23512 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:57.632735 23512 raft_consensus.cc:697] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:57.633688 23512 consensus_queue.cc:237] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:05:57.635210 22782 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.566s	user 0.004s	sys 0.072s
W20260709 13:05:57.635905 22782 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.567s	user 0.004s	sys 0.072s
I20260709 13:05:57.640473 23513 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.640532 23405 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.641433 23514 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.641162 23513 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.641162 23405 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.641956 23514 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.643476 23513 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:57.643628 23405 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.644824 23514 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:57.648240 22837 debug-util.cc:398] Leaking SignalData structure 0x7b08001dc6c0 after lost signal to thread 21004
I20260709 13:05:57.662506 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:57.677270 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:57.678081 22809 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:57.679250 22069 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:57.679920 23512 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:57.680408 23512 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.680713 23512 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.685341 23470 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.685957 23470 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.687229 23512 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.687672 23514 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.688217 23514 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.688747 23508 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.688901 23470 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.690367 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:05:57.689728 23508 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.691521 23512 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.690779 23513 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.691053 22809 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.690301 23514 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.692358 23513 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.693403 23508 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.690901 23470 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.694641 23513 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:57.694514 23470 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.696709 23470 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:57.704660 23517 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.705276 23517 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.707665 23517 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.708244 23517 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:57.708781 23517 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.699987 23504 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.710285 23504 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.710898 23517 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.711481 23517 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:57.711935 23517 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.712463 23504 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.712954 23504 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.713366 23504 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.713935 23517 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.700462 23499 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.719695 23499 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.722246 23499 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.700819 23505 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.701682 23501 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:57.703087 23507 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.703173 22809 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:57.722909 23505 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.730607 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:57.731182 23505 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.730604 23504 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.731670 23507 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.733194 23517 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.734091 23517 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.735294 23507 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.735960 23505 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.736999 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:57.723062 23501 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.737176 23505 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.738988 23501 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.736127 23517 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.740723 23518 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.740842 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:57.741240 23505 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.741734 23507 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.743142 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:57.752679 22106 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
I20260709 13:05:57.752609 23507 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.753187 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:57.753695 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:57.754348 22106 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
I20260709 13:05:57.754532 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:57.755009 23507 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.755131 22105 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
I20260709 13:05:57.742478 23517 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.743448 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:57.743526 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:57.757050 22104 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:57.757808 23502 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.758213 23502 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.756906 23517 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.743778 23504 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.759649 23504 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.760286 23502 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.760548 23517 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.760859 23502 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.752126 23518 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.761312 23502 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.761816 23504 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.741618 22069 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:57.744849 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:57.762979 23518 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.763273 23506 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.763789 23506 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.764413 22779 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:57.765266 23518 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:57.765796 23518 raft_consensus.cc:697] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:05:57.766084 23506 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.766582 22779 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:57.766716 23269 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.767277 23269 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.767692 23475 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:57.768160 23475 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.768522 23475 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.769079 23269 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.769550 23269 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.769946 23269 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.766588 23506 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.747278 23501 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.772179 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:57.772464 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:57.772444 23501 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.773187 22809 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:57.774523 23501 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.771854 23506 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.775813 23502 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.776400 23269 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:57.748862 22837 debug-util.cc:398] Leaking SignalData structure 0x7b08000bd880 after lost signal to thread 22038
I20260709 13:05:57.777693 22779 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:57.777949 23469 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:57.778329 23469 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.778674 23469 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.741935 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:57.780289 23515 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:57.780692 23515 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.781055 23515 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.766723 23518 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.782959 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:57.783594 23506 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.784201 23475 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.793529 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:57.780710 22069 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:57.806500 23518 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:57.807009 23518 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.807498 23518 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.816402 23518 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.818313 23517 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.818980 23517 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.819322 23518 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.819964 23518 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.820459 23518 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.821157 23517 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.821790 23517 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.822393 23517 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.822508 23518 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.823827 23504 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.824524 23517 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.824364 23504 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.824556 23515 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.826349 23504 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.827517 23515 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:57.872820 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 3.3019e+06us
I20260709 13:05:57.874981 22101 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:57.878657 23475 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:05:57.895823 22837 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea080 after lost signal to thread 22130
W20260709 13:05:57.896270 22837 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3180 after lost signal to thread 22131
I20260709 13:05:57.896675 22810 raft_consensus.cc:2393] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 2: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
W20260709 13:05:57.897322 22837 debug-util.cc:398] Leaking SignalData structure 0x7b0800282ee0 after lost signal to thread 22205
I20260709 13:05:57.899828 23509 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.900504 23509 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.902719 23509 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.913287 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:05:57.916476 23502 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.917146 23502 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.919453 23502 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.921947 22004 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40924 (request call id 270) took 3360 ms. Trace:
I20260709 13:05:57.922315 22004 rpcz_store.cc:276] 0709 13:05:54.561737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.561917 (+   180us) service_pool.cc:224] Handling call
0709 13:05:57.921860 (+3359943us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87555,"reported_tablets":3}
I20260709 13:05:57.927647 23506 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:57.928399 23269 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.928316 23506 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.928962 23269 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.930501 23506 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.930743 23269 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:57.933003 22837 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3ea0 after lost signal to thread 22249
I20260709 13:05:57.933498 23522 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:05:57.933719 22837 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4de0 after lost signal to thread 22279
I20260709 13:05:57.934037 23522 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.934743 23521 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.935370 23521 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.936506 23500 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.937147 23511 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.937028 23500 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.937561 23521 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.938136 23521 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.938390 23381 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:57.938942 23381 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.939075 23496 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:57.940364 23496 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.941186 23381 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:57.941288 23510 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:57.942293 23496 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.939337 23500 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.939046 23520 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:05:57.945564 22837 debug-util.cc:398] Leaking SignalData structure 0x7b080003a240 after lost signal to thread 22840
I20260709 13:05:57.945497 23520 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.946398 23327 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:57.946874 23327 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.944641 23526 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.938707 23521 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:57.947417 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 3.37942e+06us
I20260709 13:05:57.955960 23327 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.957711 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:57.958437 22106 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.964602 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:57.965920 23362 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.970880 23327 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.971824 23327 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.975699 23520 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.976091 23362 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:57.977947 23362 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.979351 22004 catalog_manager.cc:5697] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 1 to 2, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.983886 22004 catalog_manager.cc:5697] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 1 to 2, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.972795 23443 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:57.989837 23522 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:57.991272 23327 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:57.990130 23443 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.990480 23522 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:57.998487 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1299) took 3466 ms. Trace:
I20260709 13:05:58.037938 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.040077 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.042673 23269 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:58.049075 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.002664 22249 rpcz_store.cc:276] 0709 13:05:54.532174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.533127 (+   953us) service_pool.cc:224] Handling call
0709 13:05:54.533424 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:54.533747 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:54.533771 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:54.534183 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 13:05:54.561351 (+ 27168us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:54.591965 (+ 30614us) log.cc:844] Serialized 14 byte log entry
0709 13:05:57.997974 (+3406009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.998221 (+   247us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:57.998261 (+    40us) raft_consensus.cc:1685] finished
0709 13:05:57.998272 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.998402 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3343014,"prepare.queue_time_us":29900,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":3352504,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":176,"thread_start_us":89125,"threads_started":2,"wal-append.queue_time_us":577517,"wal-append.run_cpu_time_us":3522,"wal-append.run_wall_time_us":1385306}
I20260709 13:05:58.052134 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.053720 23269 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:57.937615 23511 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:58.058830 23362 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.060859 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.060859 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.038551 23506 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:58.062493 23269 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:58.039712 23496 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:58.066821 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.067386 22097 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:58.067426 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.068940 22176 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:58.066076 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.076668 23362 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.077185 23327 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.069897 23524 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:58.070602 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.074074 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:58.075534 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:58.046499 23500 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:58.046258 23502 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:58.079624 23527 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:58.080101 22246 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:58.049805 23509 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:58.050114 23520 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:58.082192 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.098688 22253 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:58.085227 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:58.099480 22816 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:58.052804 23442 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:58.036852 23522 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:58.101555 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.102428 22103 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:05:58.086364 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.086704 23327 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.088204 23362 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:57.972580 23526 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:58.092317 22815 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:58.096587 23530 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.104434 22097 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:05:58.107283 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.086259 23506 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.098009 23500 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.106968 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:58.113215 22180 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:58.116560 23500 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.116911 23506 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.117295 23521 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:58.126645 22808 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:58.102643 23524 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:58.131325 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.122428 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.101471 23381 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:58.132256 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:58.119570 23327 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.081807 23496 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:05:58.134804 22808 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:58.135761 22106 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:58.135900 23496 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:58.104251 23509 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.107304 23442 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.138074 23509 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.139372 22252 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:58.141196 22815 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:58.141487 22779 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:58.097891 23502 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:58.148437 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.147249 23362 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.154354 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:58.155589 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.152702 23362 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:58.107249 23520 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.139899 23442 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.149345 23513 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.147449 23531 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.144017 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.153542 23522 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:58.169407 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:58.170313 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.171461 23362 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:58.127300 23504 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:05:58.174232 23327 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:58.167513 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:58.175985 23327 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.176885 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.178284 23362 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:58.178305 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.178884 23362 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.179162 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.171473 23442 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.107049 23527 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.159217 23381 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.180164 22097 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:05:58.170903 23510 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.181335 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:58.174089 23511 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:58.129825 23530 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.184036 23529 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.184137 23442 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:58.174348 23513 raft_consensus.cc:697] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:05:58.173272 23528 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.189507 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.175942 23525 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:58.175900 22175 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:58.192498 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.180164 23443 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:58.195791 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.179891 23531 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:58.181137 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.197279 23327 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.263957 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.250054 23528 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:58.444980 22178 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:58.445313 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.445758 23527 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.446166 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.446322 23527 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.447312 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.447697 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.448060 22255 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:58.448310 22254 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:58.449182 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.449280 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.450344 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.450702 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.451009 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.451654 22251 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:58.451854 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.452566 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.453223 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.195833 23526 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:58.453660 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.453914 22175 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:58.447103 23502 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:58.426044 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.450412 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.190254 23510 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.246238 23362 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.456439 23531 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:58.425371 23327 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.426059 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.454762 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.371459 22103 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:58.184160 23484 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:58.456697 22251 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
I20260709 13:05:58.458726 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.458853 23484 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.459553 22249 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
I20260709 13:05:58.348821 23530 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.458386 23527 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:58.249234 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.446379 23528 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:58.460408 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.460767 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.457268 23327 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:58.249599 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 54551.8us
I20260709 13:05:58.191699 23511 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:58.468801 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:05:58.405954 23469 consensus_meta.cc:287] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.004s
I20260709 13:05:58.285079 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.322238 22810 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:58.408936 23442 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:58.401830 23381 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.208839 23533 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:58.491858 22097 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:58.501561 22255 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:58.499601 22254 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:58.492571 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.502871 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.504733 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.476595 23484 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.271718 23535 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:58.201571 23529 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.492370 23530 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.400055 23524 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:58.514212 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.503863 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.502628 23520 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.515364 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.515519 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:58.517270 23327 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:58.522130 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.527118 22175 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:58.527275 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.527940 22101 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:58.528344 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.528825 22246 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:58.529568 23527 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:58.529719 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.529982 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.530591 22178 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:58.531222 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.508983 23534 consensus_queue.cc:1059] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:05:58.510250 23510 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.510648 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.532605 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.532868 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.533216 22249 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
I20260709 13:05:58.534021 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.534097 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.535948 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.536935 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.537282 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.538731 22180 raft_consensus.cc:3055] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.539139 22180 raft_consensus.cc:740] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:58.539170 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.539376 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:58.539925 22180 consensus_queue.cc:260] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.540400 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.540879 22180 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.541512 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.542567 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.515451 23530 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:58.543593 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.544653 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:58.509549 23511 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:05:58.538002 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.538656 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.548996 22177 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
I20260709 13:05:58.537869 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.534155 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.556165 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.559629 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.550648 22101 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:58.402261 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.509979 23533 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.579075 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.507977 22106 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:58.581115 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.296245 23513 consensus_queue.cc:237] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.584898 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.585711 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.590286 22101 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:58.616312 22180 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:58.620175 23327 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:58.622944 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.623734 22254 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:05:58.625655 23327 consensus_queue.cc:1059] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:58.626374 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.627008 23327 consensus_queue.cc:1243] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer c0694f6572bf406a92d55f1f2ab46ef2 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:05:58.627228 22250 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
W20260709 13:05:58.628795 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 106964us
I20260709 13:05:58.629534 22144 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:58.503446 23469 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:05:58.665231 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 143546us
W20260709 13:05:58.663467 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:58.668200 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.664112 22218 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:58.670369 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.671525 22249 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:05:58.673588 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.531350 23529 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.622506 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.612221 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:05:58.684454 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 103814us
I20260709 13:05:58.249020 23525 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:58.687994 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.688611 22252 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
W20260709 13:05:58.685555 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 56101.8us
W20260709 13:05:58.689168 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 147864us
I20260709 13:05:58.689600 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:05:58.690424 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 108828us
I20260709 13:05:58.691747 23499 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:58.693406 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:58.618639 22247 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
I20260709 13:05:58.703768 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.703874 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.704452 22814 raft_consensus.cc:2393] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 2: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:05:58.706159 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.708885 22071 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:58.511935 23535 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.711560 22782 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:05:58.712512 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 150561us
I20260709 13:05:58.703322 22175 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:58.687477 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.682590 23511 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:05:58.716356 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.696202 23502 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.714072 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:58.717664 22144 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:58.714275 22782 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:58.724783 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.695052 23529 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:58.728389 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.718568 23507 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:58.731410 22781 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:58.707366 22246 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:58.733222 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.737814 22248 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:58.737991 23535 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.738687 23533 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:58.738771 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.739988 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.741406 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.742117 23524 raft_consensus.cc:3055] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.742535 23524 raft_consensus.cc:740] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:58.748558 23469 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:58.748406 23524 consensus_queue.cc:260] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:58.735184 23509 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.750217 23509 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:58.750674 23509 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.750773 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.732373 22782 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:58.742611 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.723281 23515 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:58.754801 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.755240 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.724498 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.721854 23530 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:58.759217 22253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:48610
I20260709 13:05:58.724783 23521 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:58.751729 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.757387 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.749815 23524 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.747268 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.759912 22253 raft_consensus.cc:606] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Received request to transfer leadership to TS a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:58.758605 22172 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:05:58.756421 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.731303 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:58.774801 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.762388 23475 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:58.761070 22781 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:58.756601 23541 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.725492 23502 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:58.745436 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.767913 23515 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.769979 22809 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:58.786477 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.770680 22782 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:58.771783 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.737231 23507 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:58.782382 22072 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:58.765165 23506 consensus_queue.cc:1059] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:05:58.787747 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.879844 22102 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:58.861490 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.840386 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.881188 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.815542 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.881631 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.817781 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:58.856716 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:05:58.882865 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 112264us
W20260709 13:05:58.883572 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 101269us
I20260709 13:05:58.883944 22782 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:05:58.882483 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 121469us
I20260709 13:05:58.885620 22781 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:05:58.883638 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 164369us
I20260709 13:05:58.816870 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.882216 22180 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:05:58.889562 22072 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:58.892452 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.897533 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.897847 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.895696 22782 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:58.904017 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.907104 23475 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.907338 22147 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:58.907612 23475 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.828722 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.908105 23475 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.898640 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:05:58.816989 22276 debug-util.cc:398] Leaking SignalData structure 0x7b0800138680 after lost signal to thread 21004
I20260709 13:05:58.909184 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.909410 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.910668 22147 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:58.914294 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:58.901086 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.917867 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.783806 23502 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.913146 22071 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:05:58.925072 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.784178 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.783881 23515 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.840003 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.926630 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:58.776413 22250 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:05:58.858772 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:05:58.907523 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.885406 23507 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.776274 23541 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.930351 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.857188 23520 raft_consensus.cc:3055] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.931527 22147 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:58.931885 23519 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:58.933269 23500 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:58.940155 22144 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:58.942214 22218 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:58.970129 23519 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.970367 23547 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.970688 23519 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.970863 23547 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:58.895222 23518 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:58.879747 23525 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:58.842139 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.896232 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:58.949059 22071 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:58.950688 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:58.951180 22174 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:05:58.943964 23515 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.951874 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:58.918895 23521 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:58.793978 23544 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:58.919212 23470 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.911890 23522 raft_consensus.cc:3055] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.919073 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:58.965791 22147 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:58.967087 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.954488 23540 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.985689 22218 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:58.985904 22071 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:58.977804 23525 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:58.991677 22106 raft_consensus.cc:2393] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 2: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:05:58.993258 22276 debug-util.cc:398] Leaking SignalData structure 0x7b0800137e20 after lost signal to thread 22038
I20260709 13:05:58.986671 22220 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:58.962859 23520 raft_consensus.cc:740] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:58.985265 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.970175 23500 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:59.059701 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 174178us
W20260709 13:05:59.031185 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 65491.2us
W20260709 13:05:59.032694 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 46855.9us
I20260709 13:05:58.986905 23327 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:59.032902 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 47322.9us
W20260709 13:05:59.061262 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 74648.8us
I20260709 13:05:58.971386 23547 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.994721 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:58.964699 23541 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.994117 23470 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:58.995814 23504 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.063071 22781 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:59.041271 23484 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.038154 23496 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:59.126876 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 64598.1us
W20260709 13:05:59.132393 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 70296us
I20260709 13:05:59.044133 23522 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:05:59.063941 23500 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:59.131134 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 68135.2us
I20260709 13:05:59.204455 22781 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.045181 23540 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:59.046149 23548 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:59.049811 22276 debug-util.cc:398] Leaking SignalData structure 0x7b0800137f60 after lost signal to thread 22052
I20260709 13:05:59.130182 23542 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.062021 23553 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.126098 23504 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:59.068313 23533 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.039340 22809 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:05:59.033605 23509 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:59.101584 23470 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:59.170795 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:59.197441 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 136178us
I20260709 13:05:59.169356 22004 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40924 (request call id 271) took 1218 ms. Trace:
I20260709 13:05:59.206197 22781 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.043038 23525 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:59.159718 23545 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:59.213680 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 49787.4us
I20260709 13:05:59.212296 23548 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:59.222715 22254 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:59.207538 23508 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:59.203923 23546 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:59.225947 22004 rpcz_store.cc:276] 0709 13:05:57.951016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.952066 (+  1050us) service_pool.cc:224] Handling call
0709 13:05:59.169232 (+1217166us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:58.101205 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:58.112580 (+ 11375us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:58.112613 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:05:58.112631 (+    18us) tablet.cc:662] Decoding operations
0709 13:05:58.115821 (+  3190us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:58.115903 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:58.115931 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:05:58.116242 (+   311us) tablet.cc:701] Row locks acquired
0709 13:05:58.116260 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:05:58.116395 (+   135us) write_op.cc:270] Start()
0709 13:05:58.116516 (+   121us) write_op.cc:276] Timestamp: P: 1783602358116358 usec, L: 0
0709 13:05:58.116540 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:05:58.117175 (+   635us) log.cc:844] Serialized 919 byte log entry
0709 13:05:58.755979 (+638804us) op_driver.cc:464] REPLICATION: finished
0709 13:05:58.929222 (+173243us) write_op.cc:301] APPLY: starting
0709 13:05:58.942857 (+ 13635us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:58.942990 (+   133us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:58.943108 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:58.950828 (+  7720us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:58.951000 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:05:58.951043 (+    43us) write_op.cc:312] APPLY: finished
0709 13:05:58.951237 (+   194us) log.cc:844] Serialized 29 byte log entry
0709 13:05:58.951399 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:58.951479 (+    80us) write_op.cc:454] Released schema lock
0709 13:05:58.951530 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:58.952019 (+   489us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:58.952046 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":1569024,"child_traces":[["op",{"apply.queue_time_us":138772,"apply.run_cpu_time_us":2225,"apply.run_wall_time_us":31644,"num_ops":2,"prepare.queue_time_us":100978,"prepare.run_cpu_time_us":46550,"prepare.run_wall_time_us":220421,"raft.queue_time_us":291280,"raft.run_cpu_time_us":21188,"raft.run_wall_time_us":164596,"replication_time_us":639248,"thread_start_us":603925,"threads_started":4,"wal-append.queue_time_us":344962}]]}
I20260709 13:05:59.240708 23546 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:59.209786 23540 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.227542 22781 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:59.228039 22147 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:05:59.097986 23529 consensus_queue.cc:1059] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:05:59.220705 23504 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.222892 23533 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.243880 22071 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:59.235248 23525 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.251312 22069 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:59.210902 23475 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:59.139515 23520 consensus_queue.cc:260] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:59.248646 22781 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:05:59.257026 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 322583us
I20260709 13:05:59.257613 23558 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:05:59.242089 22106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:05:59.221200 23542 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:59.260577 22071 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:59.242604 23548 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.237325 23469 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:59.254024 22276 debug-util.cc:398] Leaking SignalData structure 0x7b08001cdc80 after lost signal to thread 22130
I20260709 13:05:59.270485 22144 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:59.273061 22781 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:59.286576 22781 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.225404 23554 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.253261 23508 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.261089 23517 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.258942 23533 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.249724 23545 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:05:59.304402 23534 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.304832 23534 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:59.305217 23534 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:59.307202 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 356818us
I20260709 13:05:59.321938 23559 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:59.322796 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 62307.9us
I20260709 13:05:59.275125 23553 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:05:59.324862 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 73634.7us
I20260709 13:05:59.279434 22175 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:59.330700 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.331732 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.323771 22071 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:05:59.296178 22276 debug-util.cc:398] Leaking SignalData structure 0x7b0800319b20 after lost signal to thread 22131
I20260709 13:05:59.333907 23546 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:05:59.334741 22276 debug-util.cc:398] Leaking SignalData structure 0x7b08003498e0 after lost signal to thread 22205
W20260709 13:05:59.335269 22276 debug-util.cc:398] Leaking SignalData structure 0x7b0800248180 after lost signal to thread 22206
I20260709 13:05:59.284811 22106 raft_consensus.cc:606] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:05:59.335718 22276 debug-util.cc:398] Leaking SignalData structure 0x7b0800351700 after lost signal to thread 22220
W20260709 13:05:59.336632 22276 debug-util.cc:398] Leaking SignalData structure 0x7b0800241560 after lost signal to thread 22249
I20260709 13:05:59.281913 23542 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.327176 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.251704 23522 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:59.300617 23520 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.301162 23513 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.302084 23517 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:59.306464 23545 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:59.353844 22276 debug-util.cc:398] Leaking SignalData structure 0x7b080033d280 after lost signal to thread 22279
I20260709 13:05:59.360277 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:05:59.369362 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.361253 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.324705 23469 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.367574 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.326289 23559 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:59.375289 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:59.310089 23515 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:59.384481 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.399952 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.400805 23554 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:59.401494 23554 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.402055 22002 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40934 (request call id 282) took 1238 ms. Trace:
I20260709 13:05:59.385725 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.381825 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.362025 23513 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:59.413877 23513 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.362232 23517 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.394071 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.359237 23499 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.367578 23555 raft_consensus.cc:3055] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:59.380985 23559 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.378062 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.412604 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.402451 22002 rpcz_store.cc:276] 0709 13:05:58.163844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.163981 (+   137us) service_pool.cc:224] Handling call
0709 13:05:58.619697 (+455716us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540001de54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb8090 00007f66a7f56f3a 00007f66add0d1cc 00007f66ade0b37e 00007f66ac2cc2a4 00007f66ac2cc232 00007f66ac2cc161 00007f66ac2cc0dc 00007f66ac2cb392 00007f66a628948c 00007f66a62888c6
0709 13:05:59.401989 (+782292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80770,"reported_tablets":1,"spinlock_wait_cycles":307603840}
W20260709 13:05:59.416777 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.417164 23551 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.402573 23522 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.400857 23558 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.412606 23515 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:59.428153 23529 consensus_queue.cc:1059] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:59.404917 22004 catalog_manager.cc:5697] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 2, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 2 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.423801 23555 raft_consensus.cc:740] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:05:59.492892 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 169172us
W20260709 13:05:59.495645 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 225247us
I20260709 13:05:59.440074 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:59.439422 23558 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:59.505574 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.486693 23542 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:05:59.491973 22276 debug-util.cc:398] Leaking SignalData structure 0x7b08002169e0 after lost signal to thread 22840
I20260709 13:05:59.504837 22071 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:05:59.476366 23475 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:59.523685 22144 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.525235 23562 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.526496 22144 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:59.430123 23551 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:59.417783 23557 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.233s
I20260709 13:05:59.516780 23558 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.554463 23560 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:59.555197 23560 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:59.555723 23560 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.528636 22144 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.543496 23542 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:59.561415 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:59.503813 23509 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:05:59.522650 22276 debug-util.cc:398] Leaking SignalData structure 0x7b0800261e20 after lost signal to thread 23318
I20260709 13:05:59.563689 23568 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:59.531852 23515 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.534068 23551 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.568715 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:05:59.572074 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 44195us
I20260709 13:05:59.572831 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.584887 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.577272 23568 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:59.586297 23568 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.600960 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.584255 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.576133 23515 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:59.608886 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:05:59.614006 23507 consensus_meta.cc:287] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.641s	user 0.004s	sys 0.008s
I20260709 13:05:59.614614 23507 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:59.616201 22097 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:05:59.618244 23534 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:59.602335 23504 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:59.620296 23534 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:59.620932 22181 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:59.596246 23506 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.623524 22102 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:05:59.597038 23521 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:59.633133 22811 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:59.636521 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:59.641646 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:59.642534 23540 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:59.647890 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:05:59.648556 22249 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:59.641340 23515 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:59.633675 23530 raft_consensus.cc:3055] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:59.649693 23529 consensus_queue.cc:1059] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 13:05:59.653307 23541 consensus_meta.cc:287] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.018s
I20260709 13:05:59.661008 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:59.659894 22782 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:05:59.665098 23538 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:59.655764 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.655412 23530 raft_consensus.cc:740] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:05:59.657949 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:59.665866 23538 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:59.669771 23508 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.570784 23555 consensus_queue.cc:260] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:59.680074 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:59.684741 22816 raft_consensus.cc:2393] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 2: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
W20260709 13:05:59.687830 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 366351us
I20260709 13:05:59.670259 23541 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:59.692880 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:59.694559 22072 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:05:59.681877 23508 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:59.704424 23519 consensus_meta.cc:287] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.733s	user 0.009s	sys 0.001s
I20260709 13:05:59.704835 23519 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:59.722150 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:59.712529 23547 consensus_meta.cc:287] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.004s
I20260709 13:05:59.694061 23507 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:59.740159 23557 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.744848 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:59.708122 23508 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.751240 23537 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:59.751967 23537 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:59.750464 23547 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:05:59.753556 23500 consensus_meta.cc:287] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.542s	user 0.002s	sys 0.009s
I20260709 13:05:59.755125 22178 raft_consensus.cc:1240] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:59.702689 23533 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:59.736289 23519 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:59.761233 22218 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.772892 22218 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.773051 23537 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:59.773264 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:59.773629 23537 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.774252 23537 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.774463 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:59.735975 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:59.775622 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:59.775923 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:05:59.739120 23541 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:59.745239 23554 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:05:59.767060 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 69007.8us
W20260709 13:05:59.758905 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.784242 22072 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:05:59.750336 23557 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:05:59.770560 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 197793us
I20260709 13:05:59.753943 23500 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:59.786437 23547 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:59.787585 23500 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:59.788234 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:05:59.789143 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.778246 22218 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:05:59.766826 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 220824us
I20260709 13:05:59.749308 23540 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:59.792272 22218 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.793351 22218 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.796967 22218 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.798261 22218 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.800073 22814 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:05:59.789258 23557 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.813083 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:59.796083 23537 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:59.818958 23576 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.796370 23529 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:59.819656 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:59.800546 23511 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.802354 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:05:59.812623 22173 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:05:59.817459 23502 consensus_meta.cc:287] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.869s	user 0.008s	sys 0.004s
I20260709 13:05:59.826023 22144 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:59.771571 23530 consensus_queue.cc:260] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:59.848482 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:59.811944 23538 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:05:59.826548 23576 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:05:59.867802 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.877529 22144 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:59.879290 22144 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.868777 23502 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:05:59.883594 23563 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.884140 23563 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:59.884261 22180 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:59.884541 23563 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.887622 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.888743 22144 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:05:59.870388 23564 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.854113 23537 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.891768 23506 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.892207 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:59.892283 23502 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:05:59.870712 23529 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.902704 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:59.903553 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:59.903785 23504 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:05:59.905228 22144 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:05:59.904282 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 231691us
I20260709 13:05:59.908823 22180 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.874742 23576 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.880532 23547 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.889678 23530 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.902124 23564 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:05:59.916229 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.904242 23500 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:59.913727 23572 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.927549 23571 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:59.936535 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 138303us
I20260709 13:05:59.937398 22181 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:05:59.937721 22218 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.938663 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:59.938993 22218 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:05:59.926682 23525 consensus_meta.cc:287] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.006s
I20260709 13:05:59.940492 22218 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.955621 23576 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:59.956983 22144 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.960438 23502 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.961649 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:05:59.962527 22218 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.964322 22180 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:05:59.965715 22144 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.931705 23564 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.986445 22144 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.995724 22144 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.003422 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:05:59.936080 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:05:59.940012 23571 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:05:59.938081 23511 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:05:59.938503 23533 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:05:59.967674 23522 consensus_meta.cc:287] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.001s
I20260709 13:05:59.939859 23529 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:00.047027 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.918241 23568 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.019204 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:00.033826 23470 consensus_meta.cc:287] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.798s	user 0.014s	sys 0.000s
I20260709 13:05:59.939975 23537 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.035593 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:00.040032 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:00.042181 22816 raft_consensus.cc:1240] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.065821 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:00.041590 23511 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.074054 23511 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:00.076304 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:00.077453 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:00.077690 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:00.078136 22255 raft_consensus.cc:2393] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:00.078619 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:00.042596 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:05:59.926151 23551 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:05:59.940194 23572 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:00.091497 22106 raft_consensus.cc:1240] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:00.018741 23571 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.966368 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:00.035737 23530 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:00.019726 23562 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:00.020068 23500 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:00.029518 23517 consensus_meta.cc:287] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.003s
I20260709 13:06:00.019892 23547 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.019270 23527 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:00.042685 23559 consensus_meta.cc:287] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.611s	user 0.003s	sys 0.008s
I20260709 13:06:00.020217 23514 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:00.045152 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:00.239723 23572 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.962150 23525 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:00.106799 23548 consensus_meta.cc:287] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.811s	user 0.008s	sys 0.006s
I20260709 13:06:00.059692 23533 consensus_queue.cc:1059] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:06:00.195147 23554 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:00.106827 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 322596us
I20260709 13:06:00.263034 22072 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:00.078884 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:00.140952 22781 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:00.060083 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:00.173081 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:00.269232 22180 raft_consensus.cc:2393] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:00.211933 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:05:59.975045 23560 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.138162 22808 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.068427 23470 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:00.139086 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 319255us
W20260709 13:06:00.179029 23558 consensus_meta.cc:287] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.004s
W20260709 13:06:00.235189 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 415229us
I20260709 13:06:00.277263 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:00.095178 23510 raft_consensus.cc:3055] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:00.088229 22253 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
W20260709 13:06:00.267891 23545 consensus_meta.cc:287] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.891s	user 0.012s	sys 0.000s
I20260709 13:06:00.248906 23517 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.044731 22811 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.082772 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:00.222687 23576 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:00.154754 23537 consensus_queue.cc:1059] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:06:00.070160 22173 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:06:00.074079 23508 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.264407 23548 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.252173 22178 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:00.240756 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:00.057884 22810 raft_consensus.cc:1240] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.180126 23563 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.243037 23568 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:00.271365 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 130496us
I20260709 13:06:00.278465 22176 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:00.279570 22072 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:00.096980 22816 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.282173 23510 raft_consensus.cc:740] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:00.236656 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 194145us
I20260709 13:06:00.250998 23559 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:00.307294 22813 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.254289 23514 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.284106 22174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:06:00.323493 22097 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.239334 23502 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:00.361491 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 312678us
I20260709 13:06:00.282186 23558 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.288120 23499 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:00.335870 22781 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:00.339425 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 59970.2us
I20260709 13:06:00.309759 23541 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.311506 22172 raft_consensus.cc:1240] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:00.282320 23564 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.346434 22812 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:00.354709 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:00.371896 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:00.363803 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:00.345232 23576 consensus_queue.cc:1059] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:06:00.369402 22072 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:00.370074 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:00.370194 22102 raft_consensus.cc:1240] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.381171 22072 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:00.381644 23558 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:00.385375 23513 consensus_meta.cc:287] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.971s	user 0.010s	sys 0.011s
I20260709 13:06:00.385299 23570 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:00.386061 23507 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:00.386593 23507 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.388280 23559 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:06:00.353531 23566 consensus_queue.cc:1059] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:06:00.390822 23566 raft_consensus.cc:3055] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.391240 23566 raft_consensus.cc:740] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:00.372211 23574 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:00.327384 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.356765 23542 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.374462 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.287922 23545 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.376467 22144 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:00.369239 22781 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:00.392151 23566 consensus_queue.cc:260] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.364679 23510 consensus_queue.cc:260] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.366235 23499 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:00.372867 23554 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:00.417045 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 47857.4us
I20260709 13:06:00.417371 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.405467 22179 raft_consensus.cc:1240] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.366024 22104 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.378998 23508 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:00.421240 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.407900 22218 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:00.402521 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1241) took 1263 ms. Trace:
I20260709 13:06:00.411660 23510 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.411990 23564 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:00.421834 22176 rpcz_store.cc:276] 0709 13:05:59.138781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.138954 (+   173us) service_pool.cc:224] Handling call
0709 13:05:59.144900 (+  5946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.335644 (+1190744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.402191 (+ 66547us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540013e054. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:00.402423 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2607484032}
I20260709 13:06:00.442546 22218 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:00.499766 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 57313.5us
I20260709 13:06:00.500485 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:00.501080 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 80406.2us
W20260709 13:06:00.501180 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 120082us
I20260709 13:06:00.414279 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:00.417688 22781 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:00.503557 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 85910.8us
I20260709 13:06:00.503832 22218 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:00.403025 22099 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:00.504173 22144 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.422654 22103 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:00.422758 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:00.503707 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 67811us
I20260709 13:06:00.505453 22180 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
W20260709 13:06:00.377497 23582 log.cc:927] Time spent T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:06:00.507256 22813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 350) took 1577 ms. Trace:
I20260709 13:06:00.507351 23560 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:00.507690 22813 rpcz_store.cc:276] 0709 13:05:58.930104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.930851 (+   747us) service_pool.cc:224] Handling call
0709 13:05:58.943860 (+ 13009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.360079 (+1416219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.507017 (+146938us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400736c54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:00.507171 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3135115008}
I20260709 13:06:00.427376 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:00.508883 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:00.509330 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:00.508945 22255 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.511142 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:00.429071 22220 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:00.513082 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 84096us
I20260709 13:06:00.385915 23513 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.414906 23566 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.374850 23568 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:00.536202 23568 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.537801 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:00.493199 23381 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.436873 23521 consensus_queue.cc:1059] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 13:06:00.544348 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:00.504279 22781 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:00.404778 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:00.549271 22180 raft_consensus.cc:2393] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 2: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:06:00.516430 23580 log.cc:927] Time spent T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:06:00.406018 23555 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.394141 23551 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:00.385926 23570 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:00.415946 23499 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.517418 22071 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:00.517812 23522 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.518093 23518 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:00.557816 23518 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.560127 23518 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:00.554716 23554 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.512177 23542 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.517452 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:00.567427 22247 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.554541 23577 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:00.569327 23577 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:00.569705 23577 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.513650 23537 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:00.520121 23513 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:00.520460 23545 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:00.520921 22072 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:00.521193 23517 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:00.521559 22815 raft_consensus.cc:1240] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.521991 23558 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:00.588253 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 67426.1us
I20260709 13:06:00.589540 22072 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:00.522637 23557 consensus_meta.cc:287] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.697s	user 0.006s	sys 0.005s
I20260709 13:06:00.518813 23519 consensus_queue.cc:1059] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:06:00.592022 23551 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:00.592500 23551 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:00.593055 23551 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.524329 23470 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:00.511651 22144 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.525651 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.570559 23504 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:00.534605 23563 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:00.420169 23553 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.423074 23574 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.600348 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:00.524405 23533 raft_consensus.cc:3055] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.545127 23521 raft_consensus.cc:3055] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.408350 23547 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:00.413015 23525 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:00.593770 23517 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:00.604048 23574 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:00.602389 23533 raft_consensus.cc:740] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:00.527420 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:00.404201 23514 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:00.516109 23484 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:00.491530 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:00.552253 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 48043.7us
I20260709 13:06:00.431102 23538 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.420073 23562 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:00.553449 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:00.436018 23548 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:00.538651 23568 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:00.554515 23570 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.518684 23508 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.564270 22147 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:00.627970 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 63783.3us
I20260709 13:06:00.566053 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:00.428063 23520 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.576833 22255 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:00.590632 22072 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:00.632437 23509 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.563283 23442 consensus_queue.cc:1059] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:00.594873 23537 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:00.514488 23585 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.584237 23511 consensus_queue.cc:1059] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
W20260709 13:06:00.594343 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 82768.4us
I20260709 13:06:00.555586 23381 consensus_queue.cc:1059] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:06:00.601432 23558 raft_consensus.cc:3055] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:00.597103 23557 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.606689 23533 consensus_queue.cc:260] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.609786 22174 raft_consensus.cc:606] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:00.611105 23556 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:00.636202 22172 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.611238 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:00.601142 22173 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:00.592399 23571 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.619583 23530 raft_consensus.cc:3055] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:00.623484 22176 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.625141 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1143) took 1299 ms. Trace:
I20260709 13:06:00.687212 23557 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:00.631850 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:00.594343 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 68803.2us
I20260709 13:06:00.688424 22218 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:00.649501 23572 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.686612 23507 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:00.636898 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:00.605860 23521 raft_consensus.cc:740] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:00.639285 22144 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.639401 22147 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:00.642949 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:00.638756 23568 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:00.643296 23558 raft_consensus.cc:740] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:00.649610 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:00.620859 22247 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:00.698771 23584 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.670441 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:00.676895 22254 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:00.598111 23504 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:00.638427 23508 raft_consensus.cc:697] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:00.688186 23585 raft_consensus.cc:3055] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:00.686395 22174 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.689733 22218 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.708815 23537 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.708886 22218 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:00.709177 22175 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.709297 23571 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:00.710139 22218 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:00.634647 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 44089.4us
I20260709 13:06:00.711316 22072 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:00.712610 22218 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.713279 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:00.713699 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.638278 23509 raft_consensus.cc:697] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:00.691262 23533 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.717770 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.651769 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:00.697611 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 58413.8us
I20260709 13:06:00.726694 22144 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:00.698087 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 58761.8us
I20260709 13:06:00.699739 22815 raft_consensus.cc:2393] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 2: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:00.682221 23442 raft_consensus.cc:3055] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.700955 22178 raft_consensus.cc:2393] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 2: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:00.701184 22782 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:00.684267 23381 raft_consensus.cc:3055] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:00.684708 23530 raft_consensus.cc:740] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:00.704236 23504 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.701818 23521 consensus_queue.cc:260] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.707046 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:00.687050 22104 rpcz_store.cc:276] 0709 13:05:59.325803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.327331 (+  1528us) service_pool.cc:224] Handling call
0709 13:05:59.350042 (+ 22711us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.443026 (+1092984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.624857 (+181831us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54002b8754. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:00.625048 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292961664}
I20260709 13:06:00.742664 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:00.744779 22071 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:00.714744 22072 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:00.708003 23538 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:06:00.696846 23568 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:00.716779 23524 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.694782 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:00.707476 23508 consensus_queue.cc:237] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.716951 22173 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.711326 23555 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.721740 23511 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.706179 23585 raft_consensus.cc:740] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:00.722851 22218 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:00.723151 23548 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:00.717092 23537 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:00.700806 23502 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.730507 22781 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:00.730798 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:00.726699 23572 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:00.733340 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:00.734078 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:00.734949 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:00.735735 22099 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:00.736119 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:00.736931 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:00.746853 22072 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:00.728905 23563 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.727013 23484 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:00.726842 23558 consensus_queue.cc:260] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.794672 23555 raft_consensus.cc:3055] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.794963 23558 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.795341 23555 raft_consensus.cc:740] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:00.727087 23557 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:00.755029 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.702497 23551 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.797521 23562 consensus_queue.cc:1059] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:00.800926 23557 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:00.801865 23562 raft_consensus.cc:3055] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:00.802399 23562 raft_consensus.cc:740] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:00.802632 23551 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:00.737571 23525 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:00.755484 23556 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:00.732260 23442 raft_consensus.cc:740] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:00.732038 23381 raft_consensus.cc:740] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:00.747323 22174 raft_consensus.cc:1240] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:00.841084 23470 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:00.841800 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:00.744796 23514 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:00.844115 23514 raft_consensus.cc:697] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:00.845050 23514 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.749426 23574 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:00.762758 22097 raft_consensus.cc:2393] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 2: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:00.801394 23557 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.749272 23568 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.852106 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:00.768827 22105 raft_consensus.cc:2393] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:00.771862 22147 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.772630 23563 raft_consensus.cc:697] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:00.855723 23563 consensus_queue.cc:237] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:00.857055 23574 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:00.857529 23574 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.772541 23560 consensus_queue.cc:1059] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:00.753016 23517 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:00.863577 22180 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.753794 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:00.731521 23509 consensus_queue.cc:237] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.737777 23506 consensus_queue.cc:1059] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:06:00.767297 23541 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:00.773444 23559 consensus_queue.cc:1059] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:00.781994 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:00.785169 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:00.883615 22099 raft_consensus.cc:2393] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 2: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:00.824553 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:00.757167 23518 consensus_queue.cc:1059] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:06:00.774335 23549 raft_consensus.cc:993] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:06:00.757545 23548 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:00.775357 23530 consensus_queue.cc:260] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.776837 22072 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:00.806596 23585 consensus_queue.cc:260] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.758140 23529 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:00.849051 22101 raft_consensus.cc:1240] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.752882 23520 consensus_queue.cc:1059] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:06:00.799623 23519 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:00.846962 22174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:06:00.829583 23521 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.868371 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:00.803545 23562 consensus_queue.cc:260] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.871950 23442 consensus_queue.cc:260] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.880358 22069 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:00.884678 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 112891us
I20260709 13:06:00.931730 22147 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:00.906517 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.834132 23570 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.833391 23577 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:00.929370 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 152648us
I20260709 13:06:00.926085 23519 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:00.933238 22174 raft_consensus.cc:606] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:00.897030 23548 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:00.946597 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 223812us
I20260709 13:06:00.901333 22172 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:00.891992 23510 consensus_queue.cc:1059] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:06:00.933393 23549 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:00.936421 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 56156.6us
I20260709 13:06:00.940088 23442 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.944175 22147 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.923482 23545 raft_consensus.cc:1081] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Signalling peer 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:06:00.919857 23502 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.948908 22218 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.924679 23530 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.970028 23601 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.952740 22177 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:00.935719 22098 raft_consensus.cc:2393] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 2: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:00.893019 23504 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:00.977689 23504 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:00.959506 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 70231.7us
I20260709 13:06:00.942516 23551 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:00.983682 22097 raft_consensus.cc:1240] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:00.946973 23519 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.985112 22218 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.945833 23581 raft_consensus.cc:3055] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:00.988718 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:00.947775 23564 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:00.991699 22105 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:00.996601 22147 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.997305 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:00.999742 22105 raft_consensus.cc:2393] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 2: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:01.007849 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:01.008211 22218 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.988395 22100 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:01.011397 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:01.012491 22103 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:01.011852 23581 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:01.021788 23556 raft_consensus.cc:3055] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.900992 23381 consensus_queue.cc:260] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:00.953353 23537 consensus_queue.cc:1059] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:06:01.022500 23556 raft_consensus.cc:740] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:01.021917 23581 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.027772 23381 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:01.032220 22106 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:00.989621 23511 consensus_queue.cc:1059] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:06:00.997885 23530 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.010174 23510 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.085013 22779 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:00.995826 23499 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:01.144606 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 59698.2us
I20260709 13:06:01.013934 23554 consensus_queue.cc:1059] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:06:01.155288 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:01.043502 23595 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:01.167807 23517 raft_consensus.cc:3055] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:01.168280 23517 raft_consensus.cc:740] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:01.169170 23517 consensus_queue.cc:260] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:01.160804 23601 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.017438 23514 consensus_queue.cc:1059] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
I20260709 13:06:01.143033 23581 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:01.020190 23555 consensus_queue.cc:260] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.145151 23508 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.199520 23529 raft_consensus.cc:3055] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:01.175420 23542 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:01.203785 23566 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.095280 23533 consensus_queue.cc:1059] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:06:01.129570 23520 consensus_queue.cc:1059] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:06:01.241128 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:01.176960 23530 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:01.163658 23557 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.217204 23541 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:01.230126 23553 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:01.231317 23529 raft_consensus.cc:740] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:01.274596 23553 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:01.279084 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:01.280093 23553 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:01.265125 23555 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.280526 23514 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:06:01.284989 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 251234us
I20260709 13:06:01.251873 23566 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:01.248150 23542 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.264184 23508 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:06:01.291517 23499 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:01.297377 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.298470 22253 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:06:01.348182 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.295945 22176 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:06:01.292359 23584 consensus_meta.cc:287] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.590s	user 0.013s	sys 0.000s
I20260709 13:06:01.282028 23520 raft_consensus.cc:3055] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:01.293458 22172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:06:01.277522 23577 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:01.381242 23520 raft_consensus.cc:740] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:01.384341 23571 raft_consensus.cc:3055] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:01.384886 23571 raft_consensus.cc:740] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:01.386453 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.344761 22103 raft_consensus.cc:1240] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:01.387598 23470 raft_consensus.cc:3055] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:01.388134 23470 raft_consensus.cc:740] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:01.388893 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:01.389186 23470 consensus_queue.cc:260] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:01.344715 22248 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:01.373045 23594 log.cc:927] Time spent T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:06:01.271944 23541 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:01.272107 23548 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.403409 23525 raft_consensus.cc:3055] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:01.403831 23525 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:01.404573 23548 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:01.352548 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.404654 23525 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.405285 23562 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:01.405927 22099 raft_consensus.cc:1240] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:01.288935 22104 raft_consensus.cc:1240] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:01.380421 23593 log.cc:927] Time spent T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:06:01.293975 23570 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:01.385885 23571 consensus_queue.cc:260] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:01.414757 23541 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:01.263566 23530 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.391310 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.172015 23556 consensus_queue.cc:260] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:01.380440 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.294672 23514 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:01.380843 23529 consensus_queue.cc:260] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.380308 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:01.399564 23547 raft_consensus.cc:3055] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:01.353613 23584 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.405925 23525 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:01.390887 23470 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:01.406852 22172 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:01.421348 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.412506 23577 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:01.443434 23529 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.444869 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.447079 22249 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:01.447122 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 114) took 1309 ms. Trace:
I20260709 13:06:01.450387 22177 rpcz_store.cc:276] 0709 13:06:00.137898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.681398 (+543500us) service_pool.cc:224] Handling call
0709 13:06:00.952576 (+271178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.975158 (+ 22582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.446897 (+471739us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b540006a250. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:01.447047 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593498368}
I20260709 13:06:01.438884 22255 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
W20260709 13:06:01.445749 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 449190us
I20260709 13:06:01.453536 23559 raft_consensus.cc:3055] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:01.453962 23559 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:01.455359 22101 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:01.427793 23547 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:01.471536 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.439083 22172 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.465754 23559 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:01.475211 23558 consensus_meta.cc:287] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.680s	user 0.006s	sys 0.005s
I20260709 13:06:01.484292 22101 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:06:01.484362 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.486938 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.488253 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.489461 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:01.489982 23530 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:01.495106 23540 raft_consensus.cc:3055] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:01.495647 23540 raft_consensus.cc:740] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:01.495440 23547 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:01.496654 23540 consensus_queue.cc:260] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:01.499023 22144 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:01.449718 23577 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.501693 22097 raft_consensus.cc:2410] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:01.502990 22251 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
W20260709 13:06:01.504295 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.497344 23547 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.479156 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:01.515866 23519 consensus_meta.cc:287] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.517s	user 0.004s	sys 0.005s
I20260709 13:06:01.516291 23519 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.517728 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1262) took 1094 ms. Trace:
I20260709 13:06:01.518491 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:01.519007 22102 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:01.495151 23602 log.cc:927] Time spent T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:06:01.483328 23557 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:01.488582 23559 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:01.531795 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.522233 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.529865 22248 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:01.499037 23585 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:01.548231 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:01.518357 23519 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:01.508515 22250 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
W20260709 13:06:01.551481 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 206660us
I20260709 13:06:01.554966 22176 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:01.554414 23608 consensus_queue.cc:1059] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:01.560498 23600 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.561326 22103 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:01.566282 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:01.566802 23574 consensus_meta.cc:287] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.709s	user 0.011s	sys 0.003s
I20260709 13:06:01.518118 22100 rpcz_store.cc:276] 0709 13:06:00.423641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.437194 (+ 13553us) service_pool.cc:224] Handling call
0709 13:06:00.517500 (+ 80306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:01.010847 (+493347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.517495 (+506648us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b5400124154. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:01.517671 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002295680}
I20260709 13:06:01.570060 23574 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:01.572283 22103 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:01.573202 23574 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:01.531517 23606 consensus_queue.cc:1059] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:06:01.561868 23542 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:01.562155 23566 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:01.578104 23553 consensus_queue.cc:1059] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:06:01.580485 23611 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:01.531508 23609 consensus_queue.cc:1059] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:06:01.587644 23530 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:01.594161 23530 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.598795 23599 consensus_queue.cc:1059] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:06:01.599902 23599 raft_consensus.cc:3055] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:01.600284 23530 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:01.600461 23607 raft_consensus.cc:3055] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:01.600875 23607 raft_consensus.cc:740] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:01.590677 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:01.596758 22807 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:01.038374 23524 consensus_queue.cc:1175] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "79683575881f4334bd4dc6d9bdbb45c3" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:06:01.605084 23568 consensus_meta.cc:287] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.749s	user 0.009s	sys 0.000s
I20260709 13:06:01.605647 23568 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.569761 23508 consensus_queue.cc:1059] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:06:01.588331 23538 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:01.616637 22072 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:01.590322 23577 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:01.592443 23514 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:01.623020 22072 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:01.625130 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:01.626041 23581 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:01.626345 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:01.600301 23599 raft_consensus.cc:740] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:01.608815 23592 consensus_queue.cc:1175] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:01.619495 22218 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:01.628197 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:01.629237 22072 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:01.622174 23604 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:06:01.611788 23611 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.650738 22101 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:06:01.651296 22101 pending_rounds.cc:85] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 4
I20260709 13:06:01.630098 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:01.636564 23575 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:01.653309 22071 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:01.624714 23538 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.637892 22104 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:01.631345 23520 consensus_queue.cc:260] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.656350 22072 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:01.627120 23557 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:01.624504 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.660059 22101 pending_rounds.cc:107] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:06:01.662511 22101 raft_consensus.cc:2889] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:01.665968 22218 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:01.666957 22072 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:01.635521 23558 consensus_queue.cc:1059] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:01.668256 22781 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:01.669838 22072 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:01.661273 23570 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:01.662866 23533 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.673713 23508 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:01.674073 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.674348 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:01.675066 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.664722 23566 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:01.710502 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.701188 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:01.675771 22004 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40410 (request call id 192) took 2337 ms. Trace:
I20260709 13:06:01.676452 22781 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:01.679157 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:01.688558 23575 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.688310 22172 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:01.693567 23538 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:01.693887 23537 raft_consensus.cc:3055] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:01.695641 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:01.670298 23519 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:01.697679 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:01.722157 23603 raft_consensus.cc:3055] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:01.725807 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.703351 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:01.705976 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:01.729925 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:01.730711 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:01.731274 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:01.732177 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:01.732928 22174 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:01.733686 22172 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:01.735176 22220 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:01.736277 22247 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:01.736478 22220 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:01.737337 23533 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.737854 23538 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.722523 23566 raft_consensus.cc:697] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:01.739441 23614 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:01.647534 23599 consensus_queue.cc:260] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.715683 22004 rpcz_store.cc:276] 0709 13:05:59.338139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.338431 (+   292us) service_pool.cc:224] Handling call
0709 13:06:01.675709 (+2337278us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:59.749132 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:59.774789 (+ 25657us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:59.774829 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:05:59.774848 (+    19us) tablet.cc:662] Decoding operations
0709 13:05:59.802961 (+ 28113us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:59.804639 (+  1678us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:59.812202 (+  7563us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:59.829977 (+ 17775us) tablet.cc:701] Row locks acquired
0709 13:05:59.833232 (+  3255us) write_op.cc:260] PREPARE: finished
0709 13:05:59.870309 (+ 37077us) write_op.cc:270] Start()
0709 13:05:59.874994 (+  4685us) write_op.cc:276] Timestamp: P: 1783602359870226 usec, L: 0
0709 13:05:59.880935 (+  5941us) op_driver.cc:348] REPLICATION: starting
0709 13:05:59.965597 (+ 84662us) log.cc:844] Serialized 532 byte log entry
0709 13:06:00.907252 (+941655us) op_driver.cc:464] REPLICATION: finished
0709 13:06:00.970360 (+ 63108us) write_op.cc:301] APPLY: starting
0709 13:06:00.971036 (+   676us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:00.971184 (+   148us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:00.971366 (+   182us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:00.971690 (+   324us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:00.971906 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:00.971992 (+    86us) write_op.cc:312] APPLY: finished
0709 13:06:00.972281 (+   289us) log.cc:844] Serialized 23 byte log entry
0709 13:06:00.972498 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:00.972603 (+   105us) write_op.cc:454] Released schema lock
0709 13:06:00.987961 (+ 15358us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:01.039616 (+ 51655us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:01.061830 (+ 22214us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27601,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":62858,"apply.run_cpu_time_us":2295,"apply.run_wall_time_us":48426,"num_ops":1,"prepare.queue_time_us":207200,"prepare.run_cpu_time_us":13993,"prepare.run_wall_time_us":510723,"raft.queue_time_us":257218,"raft.run_cpu_time_us":7952,"raft.run_wall_time_us":110935,"replication_time_us":1018067,"thread_start_us":479015,"threads_started":4,"wal-append.queue_time_us":292627}]]}
I20260709 13:06:01.668954 23577 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.721167 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:01.724156 23537 raft_consensus.cc:740] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:01.775938 23537 consensus_queue.cc:260] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.777263 23537 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:01.722828 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 46471.5us
I20260709 13:06:01.723613 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:01.779369 22251 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
I20260709 13:06:01.779515 22781 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:01.780252 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.745586 23519 raft_consensus.cc:697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:01.781354 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.781538 23553 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.781891 22251 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:01.782351 23553 consensus_queue.cc:1059] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:01.781369 23519 consensus_queue.cc:237] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.783787 22807 raft_consensus.cc:1240] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:01.783941 23553 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:01.726804 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.739845 23566 consensus_queue.cc:237] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:01.741231 23549 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.792163 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:01.742317 22246 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:01.743201 23604 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.706171 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:01.744158 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:01.747452 23611 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:01.747902 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:01.697719 23568 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:01.751049 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1361) took 1018 ms. Trace:
I20260709 13:06:01.751085 23606 raft_consensus.cc:3055] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:01.755400 23525 consensus_queue.cc:1059] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:01.756083 23509 consensus_queue.cc:1059] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:01.757473 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:01.806403 22099 raft_consensus.cc:2393] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:01.760419 23614 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:01.771692 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:01.773241 23595 raft_consensus.cc:3055] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:01.695796 22250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1353) took 1271 ms (client timeout 1642 ms). Trace:
I20260709 13:06:01.785965 22782 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:01.811563 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 84828.8us
W20260709 13:06:01.787504 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 117737us
I20260709 13:06:01.788146 22178 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:01.794577 22179 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:01.796054 22249 rpcz_store.cc:276] 0709 13:06:00.732697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.732796 (+    99us) service_pool.cc:224] Handling call
0709 13:06:00.751714 (+ 18918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:01.449899 (+698185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.750677 (+300778us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54002cb0d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:01.750962 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1598732544}
I20260709 13:06:01.797142 22251 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:01.800026 22102 raft_consensus.cc:1240] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:01.801185 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.802323 22252 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 2: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:01.804922 22255 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:01.725457 23603 raft_consensus.cc:740] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:01.811673 22101 raft_consensus.cc:1240] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:01.871927 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 85423.3us
W20260709 13:06:01.872037 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 86158.9us
I20260709 13:06:01.873425 22782 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:01.876097 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:01.877864 22255 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:01.879096 22255 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:01.880348 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 67326.7us
I20260709 13:06:01.869678 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:01.797188 23558 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.889231 22071 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:01.892557 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:01.897838 22106 raft_consensus.cc:3055] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:01.870263 23595 raft_consensus.cc:740] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:01.897472 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:01.806434 23606 raft_consensus.cc:740] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:01.910245 22220 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:01.910477 22102 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:01.910694 22071 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:01.907466 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:01.841473 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.880705 23604 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:01.888810 23508 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:01.876825 22250 rpcz_store.cc:269] 0709 13:06:00.423886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.436847 (+ 12961us) service_pool.cc:224] Handling call
0709 13:06:01.695549 (+1258702us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54003bbd54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:01.695692 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966446976}
I20260709 13:06:01.810370 23585 consensus_queue.cc:1059] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:06:01.924674 22102 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:01.924867 22072 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:01.932221 22072 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:01.903457 23559 raft_consensus.cc:3055] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:01.933677 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:01.920486 23592 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:01.908356 22106 raft_consensus.cc:740] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:01.802584 23549 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:01.920951 23558 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:01.921340 23604 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:01.979599 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 82169.9us
I20260709 13:06:01.979773 23545 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.956542 22253 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:01.918174 23470 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:06:01.918036 23562 consensus_queue.cc:1059] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 13:06:02.048204 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 67783.2us
I20260709 13:06:01.940658 23581 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:01.939929 23567 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:02.044919 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 60127.5us
I20260709 13:06:02.049692 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:01.982172 23615 raft_consensus.cc:3055] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:01.953078 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:01.953589 23559 raft_consensus.cc:740] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:01.935734 23600 consensus_queue.cc:1059] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 13:06:01.952483 23538 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:01.945161 23592 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:02.058018 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:02.059382 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:02.062682 23470 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.962523 23508 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.984757 23603 consensus_queue.cc:260] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:01.982903 23604 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.958839 22098 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
W20260709 13:06:01.982630 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 50008.9us
I20260709 13:06:02.112140 22072 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:02.113411 22072 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:02.064512 23514 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:02.069481 22812 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.052800 22816 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.959695 23558 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.117460 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:02.088404 22247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1358) took 1358 ms (client timeout 1781 ms). Trace:
W20260709 13:06:02.081476 23547 consensus_meta.cc:287] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.000s
I20260709 13:06:02.099252 23615 raft_consensus.cc:740] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:02.105397 22102 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:02.108457 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 177618us
I20260709 13:06:01.945875 22106 consensus_queue.cc:260] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.094023 23581 raft_consensus.cc:697] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:02.121044 22072 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:02.096910 23567 raft_consensus.cc:697] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:02.103257 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.124511 22069 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:02.102136 23592 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:02.119743 23558 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:02.140057 22816 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:02.143309 22812 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:02.144325 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:02.123749 23603 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:02.120260 23545 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:02.119364 23549 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:02.121529 23570 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:02.102605 23538 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.127038 23501 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:02.157143 22172 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 2: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:06:02.172043 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.111435 23470 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.170389 23519 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:02.137822 23577 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:02.172986 23506 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:02.170604 23622 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:06:02.173599 23559 consensus_queue.cc:260] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.141106 23568 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:02.157275 23600 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.116426 23508 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.155575 23533 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:02.122531 22247 rpcz_store.cc:269] 0709 13:06:00.730167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.732558 (+  2391us) service_pool.cc:224] Handling call
0709 13:06:02.088228 (+1355670us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b54001cc5d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:02.088338 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1871111424}
I20260709 13:06:02.183805 22072 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:02.179328 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.218434 22072 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:02.142379 23547 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 13:06:02.184890 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 60462.1us
W20260709 13:06:02.196986 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:02.202255 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.177672 23571 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.167768 23581 consensus_queue.cc:237] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.226269 22147 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:02.182806 23506 raft_consensus.cc:697] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:02.230150 22072 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:02.230314 23506 consensus_queue.cc:237] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.231824 22072 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:02.233609 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:02.234726 22174 raft_consensus.cc:2393] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 2: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:02.236126 23572 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:02.236783 23572 raft_consensus.cc:697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:02.240773 23470 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:02.242421 22809 raft_consensus.cc:2393] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 2: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:02.243778 23508 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:02.257321 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:02.258255 22178 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:02.263585 22252 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:02.262521 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:02.237943 23572 consensus_queue.cc:237] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.267661 22101 raft_consensus.cc:1240] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:02.217473 23554 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.214524 23562 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:02.182461 23609 consensus_queue.cc:1059] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:06:02.276566 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:02.266023 23576 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:02.280151 23538 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:02.282373 23623 log.cc:927] Time spent T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:06:02.283489 22247 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:02.283735 23504 raft_consensus.cc:3055] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:02.221199 23533 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.283859 23510 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:02.223114 23600 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.227339 23575 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:02.264736 22255 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:06:02.181378 23577 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.296563 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:02.349779 22174 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:02.300707 22218 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:02.292027 23518 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:02.292577 23596 log.cc:927] Time spent T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:06:02.293285 23628 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:02.317538 23537 consensus_meta.cc:287] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
W20260709 13:06:02.386718 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 89711.5us
I20260709 13:06:02.355302 23504 raft_consensus.cc:740] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:02.310305 23631 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:06:02.383620 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 83037us
I20260709 13:06:02.222961 23615 consensus_queue.cc:260] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.395349 23545 consensus_queue.cc:1059] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.396209 23381 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:02.347590 23572 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:02.292259 23554 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.294974 23562 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.299435 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:02.264042 23567 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.417399 22102 raft_consensus.cc:2393] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:02.372552 23617 consensus_queue.cc:1059] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:06:02.412626 23381 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:02.425210 23381 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.381295 23510 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.408061 23537 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:02.444722 23537 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.407789 23631 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.413020 23576 raft_consensus.cc:697] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:02.429183 23575 raft_consensus.cc:697] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:02.427564 23504 consensus_queue.cc:260] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.439949 23518 raft_consensus.cc:697] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:02.441720 23625 log.cc:927] Time spent T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:06:02.442229 23577 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:02.444190 23562 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:02.457018 23556 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.449396 23533 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:02.466832 23538 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:02.470479 23564 raft_consensus.cc:3055] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:02.470888 23564 raft_consensus.cc:740] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:02.470800 23576 consensus_queue.cc:237] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.471505 23470 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:02.472050 23470 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.471935 23564 consensus_queue.cc:260] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.447275 23381 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.481283 23510 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:02.446766 23537 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:02.448127 23517 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.450268 23540 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:02.455708 23600 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:02.470391 23538 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.450278 23617 raft_consensus.cc:3055] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:02.421223 23572 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.448231 23554 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:02.491732 23631 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:02.477178 23529 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.448902 23607 consensus_queue.cc:260] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.498620 23559 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.506440 23607 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:02.489321 23617 raft_consensus.cc:740] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:02.508510 23614 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:02.508816 23572 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:02.476194 23575 consensus_queue.cc:237] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.512764 23595 consensus_queue.cc:260] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.517969 23617 consensus_queue.cc:260] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.504868 23564 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.540753 23604 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.544759 23604 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:02.500476 23606 consensus_queue.cc:260] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.546237 23606 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:02.553653 23617 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:02.553227 23595 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.446846 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1524) took 1056 ms. Trace:
I20260709 13:06:02.607739 22253 rpcz_store.cc:276] 0709 13:06:01.390193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.391064 (+   871us) service_pool.cc:224] Handling call
0709 13:06:01.946955 (+555891us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400035fa0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7ec5dc0 00007f66a7f51e18 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6
0709 13:06:02.446691 (+499736us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b540019c154. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:02.446792 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490336384}
I20260709 13:06:02.485285 23470 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:02.613840 23504 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.616202 23518 consensus_queue.cc:237] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.556357 23592 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.620328 22814 raft_consensus.cc:1240] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:02.645655 23529 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.664615 22072 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:02.655774 23381 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:02.671470 23570 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:02.672232 23570 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.672694 23570 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:02.674638 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:02.675871 22172 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:02.683765 23529 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:02.686609 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:02.689301 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.770195 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:02.780248 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.780248 23636 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:02.781951 23558 consensus_meta.cc:287] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.004s
I20260709 13:06:02.784212 22102 raft_consensus.cc:1240] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:02.785123 23615 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:02.785908 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.781446 23636 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.782665 23558 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.815227 23545 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.816434 23545 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.817042 23592 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:02.821404 23520 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.821578 22815 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
W20260709 13:06:02.827322 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:02.828122 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:02.828529 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:02.828927 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.831585 22072 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:02.833351 23566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.011s	sys 0.033s
W20260709 13:06:02.833870 23566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.011s	sys 0.033s
I20260709 13:06:02.847795 22099 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:02.854065 22247 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:02.854274 23644 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:02.855122 23644 raft_consensus.cc:697] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:02.861500 23636 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:02.862268 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 449780us
I20260709 13:06:02.863518 22100 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:02.865926 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:02.866567 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:02.867655 22807 raft_consensus.cc:2393] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 2: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:02.868073 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:02.868849 22812 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:02.869124 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:02.870029 23558 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:02.871999 23545 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:02.872944 23540 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.873628 23540 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.875808 23520 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.876559 23520 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.876979 23514 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.877141 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:02.877532 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:02.877861 22816 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:02.877655 23514 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.878594 22810 raft_consensus.cc:2393] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 2: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:02.879873 22781 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:02.878911 23520 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:02.881439 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:02.882114 23518 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:02.891824 22101 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:02.892557 23540 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:02.870479 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 159) took 1288 ms. Trace:
I20260709 13:06:02.883335 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:02.885035 23599 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:02.895776 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:02.896184 22249 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:02.896718 22809 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:02.899291 23647 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:02.899842 22252 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:02.900115 23647 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.901953 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:02.902732 22246 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:02.887486 22105 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:02.891330 23518 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.882308 22102 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:02.882375 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:02.885391 23570 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.856743 23644 consensus_queue.cc:237] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.902833 23647 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:02.905035 23637 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.122s	user 0.005s	sys 0.000s
W20260709 13:06:02.926260 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 59689us
I20260709 13:06:02.927086 22106 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.927721 23570 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:02.928222 23549 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.928547 23518 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:02.929540 23638 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.929817 23506 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.931224 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:02.942895 23549 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:02.943439 22250 raft_consensus.cc:2376] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2. Re-sending same reply.
I20260709 13:06:02.943357 23506 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.932363 22177 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:02.935431 22255 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:02.904003 22100 rpcz_store.cc:276] 0709 13:06:01.582485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.583405 (+   920us) service_pool.cc:224] Handling call
0709 13:06:02.643430 (+1060025us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b5800003398. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:02.668781 (+ 25351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.864189 (+195408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.865685 (+  1496us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54000ba254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:02.870379 (+  4694us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452730880}
I20260709 13:06:02.943197 23638 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:02.931334 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:02.931226 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:02.946635 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 67045us
I20260709 13:06:02.953408 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:02.954780 22176 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:02.947991 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:02.972678 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:02.974807 22253 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:02.978972 22255 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:02.979836 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:02.976147 23520 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:02.984193 23638 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:02.984197 23520 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:02.985500 23636 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:06:02.986300 23645 log.cc:927] Time spent T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.214s	user 0.001s	sys 0.002s
I20260709 13:06:02.966150 22807 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:02.987823 23520 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:02.988139 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:02.989009 22172 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:02.971597 23506 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:02.991881 22147 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:02.992057 23538 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:02.994112 22103 raft_consensus.cc:2393] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:02.965520 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:02.969862 23540 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:02.996138 22145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.004s	sys 0.036s
W20260709 13:06:03.002892 22145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.066s	user 0.005s	sys 0.036s
I20260709 13:06:03.003651 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:03.001068 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:03.002696 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1277) took 1471 ms. Trace:
I20260709 13:06:03.007329 22072 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:03.009091 22255 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.011790 22249 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 3: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:03.010040 23504 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:03.006529 22105 rpcz_store.cc:276] 0709 13:06:01.531404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.531994 (+   590us) service_pool.cc:224] Handling call
0709 13:06:01.532390 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.919911 (+1387521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.000919 (+ 81008us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003ff2d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:03.002602 (+  1683us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3115128704}
I20260709 13:06:02.999969 22247 raft_consensus.cc:1813] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Handling vote request from an unknown peer 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:03.021060 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.020808 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.023350 22247 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:06:02.986311 23636 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.024533 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:03.024231 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:03.028098 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:03.015479 23567 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:03.010205 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:03.031164 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:03.028169 23638 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:03.029472 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:03.032331 22100 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:03.008563 23570 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:06:03.031013 23567 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.037953 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:03.041427 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:03.026506 23514 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.048277 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:03.053550 22177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 1577) took 1353 ms (client timeout 1516 ms). Trace:
W20260709 13:06:03.054111 22177 rpcz_store.cc:269] 0709 13:06:01.700199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.700689 (+   490us) service_pool.cc:224] Handling call
0709 13:06:03.050356 (+1349667us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b540031a6d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:03.053462 (+  3106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866067328}
I20260709 13:06:03.055060 23636 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:03.042227 23638 raft_consensus.cc:697] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:03.049079 22102 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:03.056702 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:03.043642 23567 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.050086 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:03.059949 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:03.066836 22249 raft_consensus.cc:2393] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 2: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:03.067365 22101 raft_consensus.cc:2393] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 2: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:03.069618 22103 raft_consensus.cc:2393] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:03.070420 22781 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:03.070760 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.071578 22173 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:03.072468 22781 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:03.073553 23618 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:03.073601 22781 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:03.074134 23618 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.074172 23549 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:03.074703 23618 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.075356 23617 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:03.075796 23617 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.074759 23604 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:03.080428 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:03.091358 23650 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 13:06:03.094416 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 102648us
I20260709 13:06:03.080370 23604 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.102559 23559 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.102782 23604 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.103232 23559 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.105445 23559 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.105997 23559 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:03.106772 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.107544 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.108852 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:03.108965 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 163) took 1186 ms. Trace:
I20260709 13:06:03.109551 22099 rpcz_store.cc:276] 0709 13:06:01.922445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.922687 (+   242us) service_pool.cc:224] Handling call
0709 13:06:01.923125 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:02.848426 (+925301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.108587 (+260161us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54002ab7d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:03.108906 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2120242048}
I20260709 13:06:03.101881 23520 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.111905 23520 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.112964 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:03.114002 22101 raft_consensus.cc:2393] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:03.110144 22106 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:03.115324 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:03.116211 22104 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 2: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:03.116959 23538 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.117532 23538 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:03.118409 22106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1281) took 1319 ms (client timeout 1679 ms). Trace:
I20260709 13:06:03.076221 23617 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:03.125294 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.121521 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:03.106520 23559 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.114665 23520 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:03.132483 22099 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:03.137287 23603 consensus_queue.cc:1059] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:03.137395 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:03.138505 23559 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.138602 22246 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
I20260709 13:06:03.064813 23638 consensus_queue.cc:237] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.123832 23538 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:03.119060 22106 rpcz_store.cc:269] 0709 13:06:01.799233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.806048 (+  6815us) service_pool.cc:224] Handling call
0709 13:06:02.826402 (+1020354us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b58000a49d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7eaa0aa 00007f66a7f2c447 00007f66a7f44fe7 00007f66a7f467de 00007f66a7f5227c 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c
0709 13:06:03.115234 (+288832us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586855296}
I20260709 13:06:03.131880 22172 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 2: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:06:03.176308 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 89433.1us
I20260709 13:06:03.144436 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:03.187980 22147 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:03.188231 22144 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:03.187273 23506 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.198716 23538 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.204082 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.229025 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.225925 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:03.231537 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 43667.4us
I20260709 13:06:03.226965 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:03.232807 22177 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
W20260709 13:06:03.235628 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 136553us
I20260709 13:06:03.205528 23506 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.251534 23538 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:03.252502 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 55037.6us
I20260709 13:06:03.253364 22069 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:03.253873 23538 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:03.255211 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:03.255964 23564 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:03.256033 23581 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:03.256501 23564 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:03.256734 23581 raft_consensus.cc:697] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:03.256971 23564 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.257856 23581 consensus_queue.cc:237] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.259054 22071 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:06:03.255508 23651 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:06:03.244412 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:03.234995 22173 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:03.264931 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.265858 22181 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:03.216921 23559 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:06:03.269505 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:03.270256 22248 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:03.271282 22782 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:03.271478 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:03.276295 22220 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:03.277863 22220 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:03.243443 23647 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:03.278622 23647 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.278991 23647 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.279745 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:03.281136 23606 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:03.281667 23606 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.282101 23606 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.254745 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:03.284168 23484 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:03.284566 23484 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:03.285017 23484 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:03.287657 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 87798.7us
I20260709 13:06:03.292307 23644 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:03.293661 23636 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:03.294106 23636 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:03.294577 23636 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.286657 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:03.295367 22176 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:03.300832 23659 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.242684 23567 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.304870 23567 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.305943 23559 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.306459 23559 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.308465 23559 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:03.308871 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:03.309656 22098 raft_consensus.cc:2368] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:03.310328 23514 raft_consensus.cc:3055] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:03.310720 23514 raft_consensus.cc:740] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:03.262128 23575 consensus_queue.cc:1059] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.164s
I20260709 13:06:03.312031 23575 raft_consensus.cc:3055] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:03.311704 23514 consensus_queue.cc:260] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.312390 23575 raft_consensus.cc:740] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:03.313531 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 65003.1us
I20260709 13:06:03.313313 23575 consensus_queue.cc:260] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.314798 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:03.316031 23557 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:03.316797 23592 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:03.316599 23557 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.317189 23592 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:03.317587 23592 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:03.320072 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.337110 22255 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:03.329530 22220 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:03.313241 23514 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:03.319283 23653 log.cc:927] Time spent T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
W20260709 13:06:03.344949 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 84357.8us
I20260709 13:06:03.314852 23575 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.322661 23559 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.319890 23557 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.328292 23538 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:03.328234 23656 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:03.346287 23644 raft_consensus.cc:697] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:03.368868 22147 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:03.356459 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:03.381978 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 160548us
I20260709 13:06:03.381531 22814 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
W20260709 13:06:03.397492 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 123683us
I20260709 13:06:03.373093 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:03.402606 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.404408 22176 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:03.364830 23538 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:03.413511 22782 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:03.396530 23660 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.364146 23559 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.423986 22782 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:03.412756 23538 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.433488 23603 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.470788 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.471808 22176 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:03.457139 23638 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:03.473199 23638 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.475282 23667 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.475770 23638 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:03.475863 23667 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.435962 23618 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:03.498137 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 168665us
I20260709 13:06:03.500342 23595 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:03.500921 23595 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:03.501362 23595 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.501755 23663 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:03.502219 23663 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.502599 23663 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.503108 23669 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:03.503799 23669 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:03.511536 23658 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:06:03.512029 23559 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.512954 23661 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.515043 23666 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:03.515476 23666 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.515803 23666 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.519438 23668 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:03.519722 23655 log.cc:927] Time spent T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:06:03.520054 23668 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.521039 23604 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.522434 23668 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:03.525033 23564 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.467311 23603 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.527848 23667 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.528973 23520 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:03.433856 23660 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.594337 23672 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.510751 23647 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.506812 23669 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.530634 23606 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:03.641680 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 214818us
I20260709 13:06:03.618487 23668 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:03.693634 23538 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.499598 22220 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:03.531117 23644 consensus_queue.cc:237] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.668079 22815 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:03.697798 23599 consensus_meta.cc:287] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.795s	user 0.008s	sys 0.006s
I20260709 13:06:03.656543 23540 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:03.702787 23540 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.706346 22180 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:03.667376 23518 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.677306 23506 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.718197 23518 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.720407 23518 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.669253 23558 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.721242 23558 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.723445 23558 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:03.679910 23647 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:03.724383 23647 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:03.680321 23672 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.682541 23570 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.725476 23570 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.727406 23672 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:03.727840 23570 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.728075 23669 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:03.728618 23669 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.731036 23669 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:03.731827 23676 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:03.732470 23676 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.733402 23518 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:03.735298 23662 log.cc:927] Time spent T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.315s	user 0.000s	sys 0.007s
I20260709 13:06:03.734134 23518 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:03.725229 22180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 1572) took 2441 ms (client timeout 2065 ms). Trace:
W20260709 13:06:03.743726 22180 rpcz_store.cc:269] 0709 13:06:01.283795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.283927 (+   132us) service_pool.cc:224] Handling call
0709 13:06:01.674194 (+390267us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b5800165698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:03.724945 (+2050751us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b5400069d54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:03.725096 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4578219264}
I20260709 13:06:03.745169 23603 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.748745 23660 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.685691 23606 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:03.689922 23663 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.690861 23564 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:03.669164 23636 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.752982 23636 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:03.662271 23617 consensus_meta.cc:287] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.005s
I20260709 13:06:03.754483 23617 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.756181 22812 raft_consensus.cc:2368] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:03.759173 22181 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:03.762966 23540 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.766290 22177 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.768214 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:03.768922 22177 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.772826 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:03.775799 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.740207 23518 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.776984 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:03.709849 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 210385us
I20260709 13:06:03.712253 22003 catalog_manager.cc:5697] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 3, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 3 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.708971 23671 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:03.778831 22100 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:03.778488 22003 catalog_manager.cc:5697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 3, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 3 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.779677 23663 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.778512 22220 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:03.694248 23668 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.781065 22220 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:03.782260 22220 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:03.783031 23668 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:03.783375 22220 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:03.783717 23668 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:03.784278 23668 raft_consensus.cc:697] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:03.784778 22220 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:03.718402 23506 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:03.667104 23559 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:03.684016 22218 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:03.777227 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:03.706420 23484 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.766290 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.791313 22180 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:03.788780 23636 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:03.788457 23506 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.789115 23647 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:03.797210 23647 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:03.797839 23647 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.798485 23506 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.785275 23668 consensus_queue.cc:237] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.789451 23672 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:03.789268 23559 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:03.789877 22071 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 2.065s (SENT) [suppressed 3 similar messages]
I20260709 13:06:03.671481 23659 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.792349 22779 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:03.796244 23484 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:03.796672 22173 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.813897 23559 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.815073 22172 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:03.815809 23484 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:03.818099 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 420731us
I20260709 13:06:03.819931 22144 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:03.821050 22144 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:03.805022 22177 raft_consensus.cc:2410] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:03.802197 23636 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:03.802448 23518 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.805894 23672 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.739681 23618 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:03.831606 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 366647us
I20260709 13:06:03.668509 23592 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.816215 23484 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.778657 23671 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:03.810286 23514 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:03.851321 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.840744 23636 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.831249 23559 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:03.819625 23676 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:03.852841 22782 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:03.856437 23514 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.858433 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:03.853996 23484 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.859717 23677 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:03.860894 22172 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:03.841851 23599 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:03.846014 23672 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:03.884850 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 95000.4us
W20260709 13:06:03.867573 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 82886.7us
I20260709 13:06:03.889803 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.890492 22180 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:03.845531 23518 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.887002 22177 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.886068 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.895845 22176 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:03.867399 23514 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.849160 23567 consensus_queue.cc:1059] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:06:03.897176 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 44432.3us
W20260709 13:06:03.897348 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 46468.4us
I20260709 13:06:03.898638 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.865489 23559 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.911278 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:03.902891 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 218925us
I20260709 13:06:03.889446 23599 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:03.912647 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.906884 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:03.886642 23538 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:03.924413 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.882982 23676 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:03.884743 22173 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:03.932677 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.888087 23570 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:03.893312 23617 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:03.928218 22251 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:06:03.939813 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:03.944073 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:03.944824 22176 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:06:03.947595 22180 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:03.913362 23559 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.892117 23595 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.933354 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:03.933619 23599 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.959796 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:03.963896 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:03.940244 23677 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:03.966789 22814 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:03.965286 22099 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.975222 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:03.947000 23603 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.975932 22218 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:03.983412 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:03.968181 22220 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:03.974818 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:03.950335 23660 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.977087 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:03.982630 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:03.964452 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:03.944746 23570 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.964928 23688 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.949533 23668 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.997512 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.000455 22101 raft_consensus.cc:2393] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:03.953039 23666 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.975052 23592 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:03.949976 23676 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.988055 23603 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:03.987823 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:03.998484 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:03.979188 22250 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:03.969259 23681 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.015323 22248 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:04.066843 22099 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:04.067795 22781 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:04.025480 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:04.069315 22099 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:04.069978 22814 raft_consensus.cc:2393] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 2: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:04.006289 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.005157 22179 raft_consensus.cc:1275] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:04.025993 22816 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.984368 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:03.991047 23679 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.012679 22807 raft_consensus.cc:2393] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:04.085340 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.086172 22176 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.000629 23689 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.008495 23604 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:04.014154 23676 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:04.011379 23666 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:04.007791 23518 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:04.026597 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.095211 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.098340 22099 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:04.099038 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.099655 22179 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:04.105865 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 137767us
I20260709 13:06:04.106612 22220 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:04.018836 23688 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.098052 23676 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.109817 23640 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:04.110232 23693 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.110599 23680 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.111994 23570 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:04.113750 22811 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:04.115053 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.139945 23564 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.140448 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.103610 22106 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:04.141163 22178 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:04.142197 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.098249 23506 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.133710 23682 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:04.143322 23506 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.143968 23682 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.145251 23647 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.145848 23506 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:04.116423 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.146217 23682 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:04.140494 23564 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.116865 23559 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.105877 23663 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:04.149696 23559 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:04.118352 23484 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.123833 23671 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:04.066336 23668 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.151757 23484 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:04.152470 22254 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:04.142794 22178 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:04.127704 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:04.000756 23660 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.105042 23538 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:04.143311 23680 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.155545 23538 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.155951 23538 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.157672 23680 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:04.159344 22809 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:04.136179 23693 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.163435 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.098438 23679 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.165181 22172 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:04.167213 23679 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:04.169615 23668 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:04.171612 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:04.094933 23689 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.176820 23689 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:04.171671 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.178424 22103 raft_consensus.cc:2393] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:04.179559 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:04.180058 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.180342 22811 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:04.154364 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.181565 22181 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.174736 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.185016 22071 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:04.185173 23630 consensus_queue.cc:1059] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:04.185774 23644 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.186304 23581 raft_consensus.cc:3055] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:04.186758 23581 raft_consensus.cc:740] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:04.187803 23581 consensus_queue.cc:260] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.189054 23581 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.189102 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.189805 22253 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:04.174742 22180 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.192027 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.192554 22180 raft_consensus.cc:2376] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3. Re-sending same reply.
I20260709 13:06:04.192998 22782 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:04.193374 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.111020 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.138962 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:04.139142 23695 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:04.137238 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:04.147280 23603 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:04.147374 23656 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:04.149439 23663 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.149605 23564 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:04.193917 22180 raft_consensus.cc:2376] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3. Re-sending same reply.
I20260709 13:06:04.202814 22813 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:04.195485 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.204254 22173 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:04.204869 23656 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.205392 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.206060 22173 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:04.202278 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:04.206588 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:04.203437 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.207276 23656 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:04.208280 22180 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:04.189821 23660 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:04.211102 23695 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:04.211522 23695 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:04.213683 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.140856 23595 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:04.217623 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.218406 22106 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:04.219161 23567 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:04.219909 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.187798 23576 raft_consensus.cc:3055] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:04.220914 23576 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:04.221686 23576 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.224713 22071 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:04.130509 22147 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:04.146651 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.251367 22255 raft_consensus.cc:2393] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:04.252238 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.253295 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.254223 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:04.131650 23640 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.186213 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:04.255121 23640 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:04.263397 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 126213us
I20260709 13:06:04.263273 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.264247 22220 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:04.264635 22178 raft_consensus.cc:2393] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:04.264993 23595 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:04.265403 23595 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:04.265792 23595 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.265861 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:04.266778 23606 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:04.265588 23564 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:04.228238 22069 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:04.268453 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 138049us
I20260709 13:06:04.268826 23564 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:04.269356 23564 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.269841 23564 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.270643 23630 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:04.271078 23630 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.271413 23630 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.272419 22781 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:04.274406 23661 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.230111 22809 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:04.197072 23688 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:04.153610 22099 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.276765 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.277619 22178 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.278052 22781 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:04.279090 23603 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:04.279450 23603 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.279771 23603 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.281857 23506 raft_consensus.cc:2764] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:04.231796 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.283270 22254 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:04.281059 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.232206 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.232136 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.286700 22247 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:04.017474 23677 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.193969 23684 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:04.287678 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 63047.1us
I20260709 13:06:04.287828 23684 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.288374 23684 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.288450 22071 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:04.288901 23677 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:04.235863 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.234861 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:04.236871 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.291993 22174 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:04.129583 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 153737us
I20260709 13:06:04.297052 22172 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:04.239835 22779 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:04.302363 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 62650.4us
I20260709 13:06:04.240521 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:04.303893 23683 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:04.304342 23683 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.304657 23683 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.305548 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:04.306216 22255 raft_consensus.cc:1813] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Handling vote request from an unknown peer 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:04.242013 22179 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:04.306721 22255 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:04.243834 22816 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:04.317272 22181 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:04.318971 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.222707 23576 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.198342 23514 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.355440 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:04.245210 23636 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.246290 23672 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.361078 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.362746 23672 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:04.355163 23695 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.364127 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:04.364919 22250 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.365116 23656 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:04.366480 23695 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:04.267946 22220 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:04.204349 23663 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:04.286906 22253 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:04.236140 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.368835 22180 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:04.368937 23564 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.369941 23677 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:04.239842 23518 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.165220 23693 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:04.307847 22176 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:04.311014 22173 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:04.311303 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:04.262432 23640 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.320873 23545 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.320983 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.321597 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.305526 23567 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:04.322352 23644 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:04.326277 23647 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:04.327489 22781 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:04.386971 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 59564.9us
I20260709 13:06:04.328814 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.329926 23630 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.243553 23599 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.330374 23683 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.400552 23683 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:04.331305 22099 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:04.401369 23697 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:04.331825 23575 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:04.401930 23697 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.333536 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:04.333410 23684 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.402956 22103 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.404363 23697 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:04.404827 23684 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:04.334297 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.335342 22175 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:04.406383 23599 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:04.407222 22177 raft_consensus.cc:2368] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:04.407753 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:04.408375 23630 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:04.409900 23604 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:04.342808 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.415544 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:04.416128 23604 raft_consensus.cc:697] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:04.353482 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:04.370220 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.370551 22249 raft_consensus.cc:2393] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:04.297798 22218 leader_election.cc:400] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:04.417438 22218 leader_election.cc:403] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:06:04.418246 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 120767us
I20260709 13:06:04.414870 22811 raft_consensus.cc:2393] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:04.420130 22103 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:04.422041 23564 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:04.372686 23636 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:04.331796 23603 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.424113 23647 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:04.374322 22815 raft_consensus.cc:2393] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:04.426600 23603 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:04.375099 22252 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.369413 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.380416 22178 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:04.366552 22144 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:04.397797 23672 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:04.429530 23672 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.431668 23672 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:04.431716 23514 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:04.398612 23693 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:04.432426 23693 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.433825 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:04.434499 23693 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:04.332141 22071 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:04.434813 22099 raft_consensus.cc:2393] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 2: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:04.435111 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:04.435266 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 103215us
I20260709 13:06:04.435505 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:04.435698 22249 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.435770 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:04.436235 22106 raft_consensus.cc:2393] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:04.436625 22098 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:04.395783 23545 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.436923 23567 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:04.380371 23518 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.437402 23567 raft_consensus.cc:697] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:04.438568 23545 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:04.438762 23518 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:04.371356 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 103466us
I20260709 13:06:04.439136 23545 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.439687 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:04.439857 22147 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:04.440214 22816 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.414045 23640 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:04.423182 22814 raft_consensus.cc:1240] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:04.441757 22147 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:04.442588 22147 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:04.433998 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:04.443732 22102 raft_consensus.cc:2393] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:04.443969 23581 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.411653 22172 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:04.444154 22147 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:04.436471 22071 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:04.444453 23581 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.445366 22071 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:04.390569 23677 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.446504 23581 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:04.443562 23656 raft_consensus.cc:2764] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:04.447156 23663 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:04.447595 23663 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.447734 23606 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.447911 23677 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:04.372022 23695 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:04.447583 23581 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:04.448509 23695 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:04.448987 23695 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.449178 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.449635 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.449775 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.450845 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.451287 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.448896 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.339965 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.448042 23663 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.452126 22179 raft_consensus.cc:2368] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:04.451848 23644 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:04.452843 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 86365.1us
I20260709 13:06:04.453109 23644 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.416219 22253 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.455211 23644 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:04.452126 22104 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:04.447365 23656 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:04.456596 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:04.456844 23656 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.457123 23606 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:04.435149 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.458451 22144 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:04.459942 22144 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:04.460546 22249 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:04.442606 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.461897 22103 raft_consensus.cc:2393] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:04.462818 22144 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:04.462996 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:04.463557 22815 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:04.463387 22782 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:04.452206 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.464378 22144 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:04.464915 22178 raft_consensus.cc:2393] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:04.438407 23567 consensus_queue.cc:237] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.458642 22105 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:04.469655 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.467057 22069 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:04.466049 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:04.474588 22104 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.469534 23682 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:04.465804 23506 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:04.488174 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:04.488188 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.476389 23545 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:04.448720 23581 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.489178 23545 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.470404 23640 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:04.489776 23545 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.356177 23538 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.476011 22220 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:04.478015 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:04.492264 23677 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.492326 23538 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:04.492931 23677 raft_consensus.cc:697] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:04.493868 23677 consensus_queue.cc:237] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.494589 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:04.495558 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:04.496497 22781 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:04.485805 23656 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:04.498126 22781 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:04.498478 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:04.499101 22251 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.499009 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.470731 23630 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.500238 22179 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 3: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:04.501030 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:04.501912 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.502193 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:04.502905 22099 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 2: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:04.503540 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:04.417115 23604 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.485394 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.515501 22176 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.485687 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:04.516842 22814 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:04.488839 22255 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.517823 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.489291 23581 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.484220 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.502939 22813 raft_consensus.cc:2368] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:04.507860 22251 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:04.508733 22816 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:04.465421 22144 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:04.526229 22180 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:04.528314 22218 leader_election.cc:400] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
W20260709 13:06:04.529063 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 63689.5us
I20260709 13:06:04.515419 22253 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:04.531283 22782 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:04.506615 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:04.532859 22102 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.491827 22220 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:04.540122 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 48361.1us
I20260709 13:06:04.541009 22220 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:04.542526 22220 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:04.520056 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.544204 22181 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.487365 23564 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.520826 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.505976 22248 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:04.545811 22144 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:04.535764 22069 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:04.546794 22249 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:04.536804 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:04.532117 22218 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:04.548486 22251 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:04.549027 22815 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:04.550278 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:04.550486 22144 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:04.503944 23518 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:04.552268 22255 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:04.555832 22218 leader_election.cc:400] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:04.556131 22248 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:04.557140 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:04.557337 22144 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:04.559234 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:04.560038 22255 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.560760 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:04.561707 22144 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:04.514883 23684 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:04.565088 22220 leader_election.cc:400] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:04.565538 22220 leader_election.cc:403] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:04.565874 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:04.566665 22815 raft_consensus.cc:2368] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:04.569670 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.516939 23640 raft_consensus.cc:697] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:04.529466 23661 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:04.570734 22103 raft_consensus.cc:2393] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:04.575932 22176 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:04.579252 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.577611 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.579830 22220 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:04.523590 23693 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:04.531332 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.522771 23575 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:04.579843 22106 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:04.534518 23682 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.565151 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:04.582420 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:04.582684 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:04.579113 23592 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.584543 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.573133 23559 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:04.534790 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.587927 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:04.593873 22104 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:04.595301 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:04.555955 23672 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:04.627745 23672 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.628285 23672 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:04.551472 23678 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:04.631829 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.597090 23668 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:04.555766 23647 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:04.563916 23697 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:04.578819 23689 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
W20260709 13:06:04.572927 23692 log.cc:927] Time spent T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.218s	user 0.011s	sys 0.000s
I20260709 13:06:04.599807 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.564420 23506 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:04.672963 22255 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:04.600644 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:04.556348 23518 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.636101 23592 raft_consensus.cc:697] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:04.695044 23506 raft_consensus.cc:697] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:04.601384 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:04.564450 23688 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:04.578598 23696 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:04.563937 23606 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:04.573459 23669 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:04.610078 22781 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:04.616922 22252 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
W20260709 13:06:04.708838 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 98873.6us
I20260709 13:06:04.618067 22181 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:04.539175 23630 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:06:04.623662 22099 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.635402 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.639456 22173 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.660365 22811 raft_consensus.cc:2368] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
W20260709 13:06:04.601056 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 85799.5us
I20260709 13:06:04.633793 23564 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.638731 23668 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.598990 23693 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.649679 23647 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.603724 23575 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.601992 23695 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.653312 22098 raft_consensus.cc:2368] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:04.601456 22220 leader_election.cc:400] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:04.756961 22220 leader_election.cc:403] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:04.654286 23678 raft_consensus.cc:697] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:04.770987 22099 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:04.714520 22071 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:04.772069 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 57627.5us
W20260709 13:06:04.772660 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 171342us
I20260709 13:06:04.714267 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.696439 23518 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:04.778957 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 217266us
I20260709 13:06:04.665735 23697 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.707913 23606 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.709697 23684 raft_consensus.cc:697] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:04.706477 22174 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
W20260709 13:06:04.760102 23700 log.cc:927] Time spent T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:06:04.760653 22253 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:04.760766 23506 consensus_queue.cc:237] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.727453 23696 raft_consensus.cc:697] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:04.752274 23702 log.cc:927] Time spent T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:06:04.765666 22250 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:04.727710 23668 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.737496 23592 consensus_queue.cc:237] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.766526 23672 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.769155 22102 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:04.712451 22781 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:04.779412 22178 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:04.707710 23661 raft_consensus.cc:697] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:04.780023 22220 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:04.823174 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.824100 22246 raft_consensus.cc:2393] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:04.824947 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.826170 22147 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:04.827160 22147 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:04.828258 22147 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:04.830353 23682 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:04.830206 23663 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.720995 23514 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:04.728009 23669 raft_consensus.cc:697] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:04.776826 23558 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:04.777277 23677 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:04.781629 23576 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:04.831008 23682 raft_consensus.cc:697] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:04.831482 23680 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:04.831738 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.832948 23581 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.833143 23661 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.818639 22254 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:04.714603 23640 consensus_queue.cc:237] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.801445 23599 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:04.888401 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:04.889294 22177 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.857019 23538 raft_consensus.cc:2764] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:06:04.801201 23688 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:04.835747 23684 consensus_queue.cc:237] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.848382 22105 raft_consensus.cc:1240] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:04.780344 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:04.848763 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.783756 23606 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:04.849423 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 137055us
I20260709 13:06:04.734256 23647 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.852536 22255 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:04.904492 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:04.905298 22255 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.849359 22220 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:04.863632 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:04.864079 22779 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:04.826864 23595 consensus_meta.cc:287] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.560s	user 0.002s	sys 0.007s
I20260709 13:06:04.848479 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:04.857235 23564 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:06:04.872422 23680 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.856477 23689 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:06:04.902493 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 122260us
I20260709 13:06:04.893153 23570 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:04.861495 23679 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:04.867399 23514 raft_consensus.cc:697] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:04.843571 23575 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:04.857399 23666 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:04.903683 23706 log.cc:927] Time spent T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:06:04.933997 23680 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.900624 23670 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.885888 23558 raft_consensus.cc:697] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:04.917570 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 68267.4us
I20260709 13:06:04.941689 22255 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:05.006996 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:04.948387 23603 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:05.007761 22255 raft_consensus.cc:2393] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 3: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:04.891615 22246 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:04.834836 23678 consensus_queue.cc:237] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:04.927772 22172 raft_consensus.cc:2368] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:04.923986 23677 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:04.920574 23576 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:04.855530 23545 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:04.995735 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 62492.4us
I20260709 13:06:05.000801 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:05.002606 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 138663us
I20260709 13:06:04.916460 23688 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:04.933635 22247 raft_consensus.cc:2393] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:05.011075 22072 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:05.013706 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:05.013968 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:05.015570 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:04.923602 23595 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.013327 22175 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:06:05.017328 23711 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 13:06:05.019691 23721 log.cc:927] Time spent T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:06:05.020942 23581 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:05.006541 23714 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:06:05.022989 23682 consensus_queue.cc:237] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.009274 23669 consensus_queue.cc:237] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:05.027673 23514 consensus_queue.cc:237] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:05.084623 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:05.039346 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:05.002158 23559 consensus_queue.cc:1059] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:06:05.030463 23518 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:05.086613 23693 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:05.005962 23725 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.088284 22099 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:05.089609 22103 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.026783 22177 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
W20260709 13:06:05.096177 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 85176.7us
I20260709 13:06:04.988143 23689 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.100394 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:05.100900 23575 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.101290 23677 raft_consensus.cc:697] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:05.009857 23670 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:05.087321 22101 raft_consensus.cc:2368] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:05.040738 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:05.080051 23603 raft_consensus.cc:697] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:04.994668 23679 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:05.135246 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:05.136368 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:05.143472 22177 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:05.105875 23697 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:05.151305 22072 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:04.987861 23696 consensus_queue.cc:237] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:05.031729 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:05.160830 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:05.140007 23695 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:05.165840 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:05.161880 22106 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:05.153890 23710 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:05.159650 23672 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:05.148993 23719 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:05.100472 23576 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.181282 22218 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:05.181218 23719 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.182507 22218 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:05.183557 23719 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:05.184114 22218 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:05.186892 22218 leader_election.cc:400] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:05.187434 22218 leader_election.cc:403] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:05.186853 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:05.188459 22218 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:05.172205 23697 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:05.174299 23663 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:05.200223 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:05.204041 22252 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:05.164347 23575 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:06:05.184346 23484 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:05.145877 23558 consensus_queue.cc:237] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:05.180284 23545 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:05.184146 23695 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:05.207422 22103 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:05.207195 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:05.208448 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:05.180567 23666 raft_consensus.cc:697] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:05.186740 23693 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.214815 22218 leader_election.cc:400] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:05.215202 23730 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.217938 22173 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:05.218168 23575 raft_consensus.cc:3055] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:05.218660 23724 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:05.195046 23672 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:05.225188 22176 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:05.240957 22218 leader_election.cc:400] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:05.209195 23484 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.209767 23697 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.206317 23603 consensus_queue.cc:237] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:05.365371 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 124665us
I20260709 13:06:05.224182 23688 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:05.366102 23666 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:05.367846 23518 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:05.380165 22249 raft_consensus.cc:2376] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4. Re-sending same reply.
I20260709 13:06:05.384939 22072 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:05.261335 23575 raft_consensus.cc:740] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:05.244575 23677 consensus_queue.cc:237] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.395920 22072 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:05.376055 23484 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.366127 23670 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:05.368655 23606 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:05.406013 23668 consensus_meta.cc:287] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.004s
W20260709 13:06:05.419467 23722 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:06:05.419872 23712 raft_consensus.cc:2764] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:06:05.420368 23738 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:05.407488 23545 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:05.438812 23545 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.439482 23545 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.443492 23679 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:05.443281 23738 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.433697 23683 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.447655 23683 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:05.448244 23679 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:05.449048 23679 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:05.458740 23575 consensus_queue.cc:260] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.460544 23575 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.463393 23683 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:05.426594 23689 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:05.408414 23724 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:05.472873 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:05.473839 22246 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.477185 23725 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:05.481863 22144 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:05.490200 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:05.517947 22174 raft_consensus.cc:2393] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:05.525857 23484 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.528527 23484 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:05.484616 23738 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:05.514989 23725 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:05.431313 23668 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.524645 23679 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:05.544986 22248 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:05.546437 23739 log.cc:927] Time spent T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.002s
I20260709 13:06:05.547492 23668 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:05.550319 23606 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:05.552934 22103 pending_rounds.cc:85] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 4
I20260709 13:06:05.553294 22103 pending_rounds.cc:107] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:06:05.553601 22103 raft_consensus.cc:2889] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:05.553728 23545 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:05.556704 23647 consensus_meta.cc:287] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.000s
W20260709 13:06:05.564422 23680 consensus_meta.cc:287] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.004s
I20260709 13:06:05.564855 23680 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.566100 22181 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:05.572209 23680 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:05.562829 23647 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.576282 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 235) took 1080 ms. Trace:
I20260709 13:06:05.577140 23647 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:05.578601 22251 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:05.577231 23545 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:05.585520 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1307) took 1137 ms. Trace:
I20260709 13:06:05.589708 23564 raft_consensus.cc:3055] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:05.590384 23564 raft_consensus.cc:740] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:05.597472 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:05.598517 22099 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.586218 22172 rpcz_store.cc:276] 0709 13:06:04.447692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.451029 (+  3337us) service_pool.cc:224] Handling call
0709 13:06:05.585218 (+1134189us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b540028c654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:05.585433 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1001990912}
I20260709 13:06:05.606739 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:05.609234 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:05.614454 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1216) took 1048 ms. Trace:
I20260709 13:06:05.576954 22808 rpcz_store.cc:276] 0709 13:06:04.495863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.503120 (+  7257us) service_pool.cc:224] Handling call
0709 13:06:05.575924 (+1072804us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002008d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:05.576161 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2364810624}
I20260709 13:06:05.602481 23647 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:05.619341 22101 rpcz_store.cc:276] 0709 13:06:04.565645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.582393 (+ 16748us) service_pool.cc:224] Handling call
0709 13:06:05.614219 (+1031826us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b540009e2d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:05.614358 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094552448}
I20260709 13:06:05.637861 22099 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:05.642642 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:05.643491 22176 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 3: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:05.644354 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:05.645149 22144 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:05.647217 22176 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.649675 22177 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:05.642359 23679 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:05.655256 23679 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:05.657596 23679 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:06:05.603116 22246 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:05.654152 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:05.650635 23606 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:05.665637 23606 raft_consensus.cc:697] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:05.666690 23606 consensus_queue.cc:237] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.640722 23647 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:05.674115 22072 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:05.689802 22176 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:05.698139 23647 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:05.684690 23575 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:05.663699 23564 consensus_queue.cc:260] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:05.707154 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1404) took 1245 ms. Trace:
I20260709 13:06:05.707255 23575 raft_consensus.cc:697] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:05.707794 22247 rpcz_store.cc:276] 0709 13:06:04.461511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.466393 (+  4882us) service_pool.cc:224] Handling call
0709 13:06:05.706869 (+1240476us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b540019c154. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:05.707050 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617928448}
I20260709 13:06:05.708695 23575 consensus_queue.cc:237] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.712229 22814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 240) took 1197 ms. Trace:
I20260709 13:06:05.712622 22814 rpcz_store.cc:276] 0709 13:06:04.514868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.554900 (+ 40032us) service_pool.cc:224] Handling call
0709 13:06:05.711977 (+1157077us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b54004f5954. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:05.712170 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1868705152}
I20260709 13:06:05.715246 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:05.716190 22246 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:06:05.717408 22253 raft_consensus.cc:1240] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:05.717504 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:05.719426 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:05.721033 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:05.721614 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1567) took 1162 ms. Trace:
I20260709 13:06:05.721999 22246 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:05.723479 22097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1213) took 1175 ms. Trace:
I20260709 13:06:05.723600 23564 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.723938 22097 rpcz_store.cc:276] 0709 13:06:04.547829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.627997 (+ 80168us) service_pool.cc:224] Handling call
0709 13:06:04.628318 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:04.782391 (+154073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:04.782435 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:04.782484 (+    49us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:04.782517 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.723187 (+940670us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54002aadd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:05.723248 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.723408 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353809152}
I20260709 13:06:05.729409 22003 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40924 (request call id 273) took 2052 ms. Trace:
I20260709 13:06:05.709204 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:05.735265 22072 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:05.741202 23558 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:05.741729 23558 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.742193 23558 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.744905 23724 consensus_queue.cc:1059] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:05.746021 23724 raft_consensus.cc:3055] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:05.746439 23724 raft_consensus.cc:740] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:05.747435 23724 consensus_queue.cc:260] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.748934 23724 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:05.750478 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1316) took 1185 ms. Trace:
I20260709 13:06:05.760414 23599 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:05.761169 23599 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:05.764305 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:05.765642 22246 raft_consensus.cc:2393] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:05.766816 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:05.767591 22247 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
I20260709 13:06:05.768481 23595 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:05.774243 23715 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.882s	user 0.005s	sys 0.009s
I20260709 13:06:05.776404 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:05.777791 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45738 (request call id 193) took 1594 ms. Trace:
I20260709 13:06:05.778208 22250 rpcz_store.cc:276] 0709 13:06:04.183302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.201956 (+ 18654us) service_pool.cc:224] Handling call
0709 13:06:05.777635 (+1575679us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b540005d7d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:05.777735 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363165952}
I20260709 13:06:05.780692 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1570) took 1214 ms. Trace:
I20260709 13:06:05.781188 22248 rpcz_store.cc:276] 0709 13:06:04.566125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.660018 (+ 93893us) service_pool.cc:224] Handling call
0709 13:06:04.695388 (+ 35370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.545446 (+850058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.780451 (+235005us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b540014afd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:05.780627 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1953436544}
W20260709 13:06:05.784020 23708 log.cc:927] Time spent T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 1.018s	user 0.007s	sys 0.004s
I20260709 13:06:05.790871 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1581) took 1038 ms. Trace:
I20260709 13:06:05.791448 22249 rpcz_store.cc:276] 0709 13:06:04.752922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.206909 (+453987us) service_pool.cc:224] Handling call
0709 13:06:05.790661 (+583752us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54002cabd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:05.790795 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382665472}
W20260709 13:06:05.795738 23726 log.cc:927] Time spent T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.615s	user 0.005s	sys 0.004s
I20260709 13:06:05.750851 22105 rpcz_store.cc:276] 0709 13:06:04.564960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.640213 (+ 75253us) service_pool.cc:224] Handling call
0709 13:06:04.822000 (+181787us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:04.900087 (+ 78087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.750288 (+850201us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b540009e7d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:05.750423 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361186688}
I20260709 13:06:05.806816 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 564) took 1394 ms. Trace:
I20260709 13:06:05.794489 23636 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:05.807058 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:05.813452 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1621) took 1035 ms. Trace:
W20260709 13:06:05.834045 22254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1406) took 1372 ms (client timeout 1601 ms). Trace:
I20260709 13:06:05.718545 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:05.849645 22147 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:05.830679 22220 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:05.878816 22147 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:05.880929 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 50317.2us
I20260709 13:06:05.849068 23725 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:05.834496 22254 rpcz_store.cc:269] 0709 13:06:04.462057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.468413 (+  6356us) service_pool.cc:224] Handling call
0709 13:06:05.833879 (+1365466us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b540023a854. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:05.833985 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795157888}
I20260709 13:06:05.831454 22246 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.882297 23669 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:05.888803 22147 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:05.722133 22251 rpcz_store.cc:276] 0709 13:06:04.559055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.560066 (+  1011us) service_pool.cc:224] Handling call
0709 13:06:04.590262 (+ 30196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.579241 (+988979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.721275 (+142034us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b540014aad4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:05.721511 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272394496}
I20260709 13:06:05.814023 22180 rpcz_store.cc:276] 0709 13:06:04.777632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.778128 (+   496us) service_pool.cc:224] Handling call
0709 13:06:04.779109 (+   981us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:04.783349 (+  4240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:04.783379 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:04.803540 (+ 20161us) log.cc:844] Serialized 26 byte log entry
0709 13:06:04.952624 (+149084us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:04.952661 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.952727 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:05.794821 (+842094us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:05.798340 (+  3519us) raft_consensus.cc:1685] finished
0709 13:06:05.798368 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.813351 (+ 14983us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":21213,"spinlock_wait_cycles":9953920,"thread_start_us":105172,"threads_started":1,"wal-append.queue_time_us":323688}
I20260709 13:06:05.894399 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:05.895977 23678 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:05.896364 22174 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:05.896531 22097 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:05.896741 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:05.897527 22105 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:05.906857 22248 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.901907 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:05.904850 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:05.886317 23599 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:05.816004 23636 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:05.882756 23716 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:05.907904 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.888494 23595 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:05.915438 22071 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:05.729976 22003 rpcz_store.cc:276] 0709 13:06:03.676945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.679304 (+  2359us) service_pool.cc:224] Handling call
0709 13:06:05.729283 (+2049979us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:04.094103 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:04.150115 (+ 56012us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:04.150167 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:06:04.150201 (+    34us) tablet.cc:662] Decoding operations
0709 13:06:04.150714 (+   513us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:04.150798 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:04.150828 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:04.151340 (+   512us) tablet.cc:701] Row locks acquired
0709 13:06:04.151389 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:06:04.151568 (+   179us) write_op.cc:270] Start()
0709 13:06:04.151724 (+   156us) write_op.cc:276] Timestamp: P: 1783602364151503 usec, L: 0
0709 13:06:04.151758 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:06:04.240800 (+ 89042us) log.cc:844] Serialized 924 byte log entry
0709 13:06:05.378377 (+1137577us) op_driver.cc:464] REPLICATION: finished
0709 13:06:05.543223 (+164846us) write_op.cc:301] APPLY: starting
0709 13:06:05.543338 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:05.543482 (+   144us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:05.543628 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:05.549618 (+  5990us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:05.549869 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:06:05.549931 (+    62us) write_op.cc:312] APPLY: finished
0709 13:06:05.550275 (+   344us) log.cc:844] Serialized 29 byte log entry
0709 13:06:05.551153 (+   878us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.551247 (+    94us) write_op.cc:454] Released schema lock
0709 13:06:05.551300 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:05.551694 (+   394us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.551720 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":152453,"apply.run_cpu_time_us":2469,"apply.run_wall_time_us":8486,"num_ops":2,"prepare.queue_time_us":142140,"prepare.run_cpu_time_us":31615,"prepare.run_wall_time_us":488490,"raft.queue_time_us":218308,"raft.run_cpu_time_us":17341,"raft.run_wall_time_us":296400,"replication_time_us":1093876,"thread_start_us":607230,"threads_started":4,"wal-append.queue_time_us":412308}]]}
I20260709 13:06:05.918664 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:05.918592 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.920773 22220 leader_election.cc:400] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:05.920809 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:05.886842 23647 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:06:05.910346 22781 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:05.944669 22220 leader_election.cc:403] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:06:05.944819 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 56170.9us
I20260709 13:06:05.944108 22815 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:05.892750 23728 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:05.883783 23606 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:06:05.903136 23743 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:05.958567 22176 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:05.917572 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:05.918502 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1623) took 1100 ms. Trace:
I20260709 13:06:05.920677 23683 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:05.961189 22248 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:05.969733 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:05.969995 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1583) took 1156 ms. Trace:
I20260709 13:06:05.947149 23682 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:05.955585 23663 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:05.965391 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 50050.9us
I20260709 13:06:05.894999 23725 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:05.984735 23725 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:05.986037 23745 log.cc:927] Time spent T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.426s	user 0.003s	sys 0.000s
I20260709 13:06:05.986433 22250 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:05.920980 23570 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:06:05.956794 23595 raft_consensus.cc:697] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:05.947170 23668 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:05.970553 22248 rpcz_store.cc:276] 0709 13:06:04.813864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.782496 (+968632us) service_pool.cc:224] Handling call
0709 13:06:05.906532 (+124036us) spinlock_profiling.cc:243] Waited 42 ms on lock 0x7b5800111698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:05.906719 (+   187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.969716 (+ 62997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.969942 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96638848}
I20260709 13:06:05.911324 23678 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:05.964110 22254 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:06.019336 22248 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:05.971815 23545 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:05.962193 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:05.962360 23681 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:05.951853 23712 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:06:05.943466 23716 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:05.923166 23604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.039s	sys 0.039s
I20260709 13:06:05.959923 23728 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:06.030237 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 77944.4us
I20260709 13:06:06.021807 22172 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:06.042624 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:06.043985 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:06.035708 23728 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:06.031610 22248 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:05.807328 22810 rpcz_store.cc:276] 0709 13:06:04.412707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.412857 (+   150us) service_pool.cc:224] Handling call
0709 13:06:04.419799 (+  6942us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:04.420235 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:04.420274 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:04.420805 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:06:04.627428 (+206623us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:04.627473 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.636052 (+  8579us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:05.783230 (+1147178us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:05.785097 (+  1867us) raft_consensus.cc:1685] finished
0709 13:06:05.785145 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.806591 (+ 21446us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b54005e01d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:05.806732 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7150,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":937,"spinlock_wait_cycles":38952960,"thread_start_us":199298,"threads_started":1,"wal-append.queue_time_us":298966}
I20260709 13:06:05.966204 22175 rpcz_store.cc:276] 0709 13:06:04.805488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.817504 (+ 12016us) service_pool.cc:224] Handling call
0709 13:06:04.856229 (+ 38725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.084334 (+228105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.887068 (+802734us) spinlock_profiling.cc:243] Waited 97.1 ms on lock 0x7b54003287d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:05.900196 (+ 13128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223228288}
I20260709 13:06:05.978261 23683 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:06.033748 23678 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:06.035691 22246 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:06.016825 23672 consensus_queue.cc:1059] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:06.015404 23682 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:06.019157 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:06.039644 23681 raft_consensus.cc:697] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:06:06.026741 23604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.259s	user 0.039s	sys 0.039s
I20260709 13:06:06.050860 22218 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:06.052500 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1315) took 1487 ms. Trace:
W20260709 13:06:06.080358 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 48176.8us
W20260709 13:06:06.053216 23758 log.cc:927] Time spent T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:06:06.077431 22104 rpcz_store.cc:276] 0709 13:06:04.564669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.640410 (+ 75741us) service_pool.cc:224] Handling call
0709 13:06:04.640857 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:04.812526 (+171669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:04.812561 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.770169 (+957608us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b2c00000658. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6857372 00007f66a7f89a01 00007f66a7f4e43a 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2
0709 13:06:05.770685 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.919066 (+148381us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:05.919099 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.919158 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:06.052169 (+133011us) raft_consensus.cc:1685] finished
0709 13:06:06.052206 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.052435 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9808,"raft.queue_time_us":76475,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":11620,"spinlock_wait_cycles":10650880,"thread_start_us":252145,"threads_started":2,"wal-append.queue_time_us":240965}
I20260709 13:06:06.085438 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:06.087672 22810 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:06.091245 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:06.093415 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:06.096441 23746 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.536s	user 0.002s	sys 0.000s
I20260709 13:06:06.094327 22814 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
W20260709 13:06:06.099061 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 152562us
I20260709 13:06:06.063205 23683 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:06.055331 23716 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:06.051024 23679 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.053885 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:06.050284 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:06.061235 23636 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:06.083426 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:06.077013 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 205) took 1306 ms. Trace:
W20260709 13:06:06.107086 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 181740us
W20260709 13:06:06.108618 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 57837.9us
I20260709 13:06:06.116873 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:06.117245 22218 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:06.055776 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:06.054049 23630 consensus_queue.cc:1059] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:06:06.054170 23670 consensus_queue.cc:1059] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:06:06.121680 23670 raft_consensus.cc:3055] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:06.122074 23670 raft_consensus.cc:740] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:06.123126 23670 consensus_queue.cc:260] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:06.119024 23680 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:06.119547 22218 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:06.135216 22218 leader_election.cc:400] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:06.136283 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:06.120126 23636 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.123761 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:06.124943 23681 consensus_queue.cc:237] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:06.059917 23545 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:06:06.130062 22181 raft_consensus.cc:2393] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:06.145807 23647 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.146494 22814 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:06.147303 23647 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:06.147780 23647 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:06.148170 23647 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.148563 22174 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:06.117756 23599 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:06:06.116248 23595 consensus_queue.cc:237] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:06.155176 23570 raft_consensus.cc:3055] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:06.155642 23570 raft_consensus.cc:740] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:06.156381 22181 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:06.156442 23570 consensus_queue.cc:260] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:06.157976 22181 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:06.113996 23725 consensus_queue.cc:1059] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:06:06.157877 23570 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:06.159907 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.113332 23592 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:06.116590 22247 rpcz_store.cc:276] 0709 13:06:04.769199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.768307 (+999108us) service_pool.cc:224] Handling call
0709 13:06:06.063390 (+295083us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b5800111698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:06.063638 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.063817 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.063845 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:06.063892 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:06.063925 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.063993 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.075513 (+ 11520us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94880128}
I20260709 13:06:06.166146 22181 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:06.150727 22174 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:06.160009 22172 raft_consensus.cc:2393] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:06.179713 22782 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:06.168407 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1577) took 1417 ms. Trace:
I20260709 13:06:06.186429 22252 rpcz_store.cc:276] 0709 13:06:04.751536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.785710 (+1034174us) service_pool.cc:224] Handling call
0709 13:06:06.167710 (+382000us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b5800111698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:06.167901 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.168093 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.168124 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:06.168165 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:06.168193 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.168244 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.168353 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39387904}
I20260709 13:06:06.159504 22173 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.177037 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:06.112673 23679 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:06.196338 22176 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:06:06.197808 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 144275us
I20260709 13:06:06.198237 22177 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:06.199630 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:06.192150 22220 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:06.165019 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:06.169535 23716 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.169747 23592 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:06.201843 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 220054us
I20260709 13:06:06.243669 22071 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:06.203994 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:06.222642 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:06.188768 22811 raft_consensus.cc:2393] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 2: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:06.282166 23666 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:06.264415 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:06.260345 22097 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:06.270058 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:06.212424 23670 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:06.285778 23672 consensus_queue.cc:1059] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:06.278802 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:06.286767 23682 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:06.281644 23679 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:06.284330 23728 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:06.248121 22181 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:06.276875 23681 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:06:06.201248 23725 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:06.212893 23668 raft_consensus.cc:2764] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:06:06.300400 23678 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:06.268589 23767 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:06.297804 22105 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:06.246737 23744 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:06:06.248847 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:06.302734 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 189725us
I20260709 13:06:06.247210 22250 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:06.193087 23558 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:06.377028 23558 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:06.299142 23669 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:06.330353 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.302704 23603 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:06:06.248288 23592 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:06.365445 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 120499us
I20260709 13:06:06.367761 23672 raft_consensus.cc:3055] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:06.364750 23769 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:06.397471 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:06.398568 22106 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:06.399634 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:06.400408 22104 raft_consensus.cc:2410] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:06:06.323908 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 111510us
W20260709 13:06:06.384752 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 248550us
I20260709 13:06:06.327877 23730 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.248585 23716 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:06.401997 22218 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:06.395931 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 131163us
W20260709 13:06:06.427616 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 138405us
W20260709 13:06:06.395874 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 179729us
I20260709 13:06:06.432637 22781 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:06.434180 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:06.453464 22097 raft_consensus.cc:2368] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
W20260709 13:06:06.490268 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 69188.5us
I20260709 13:06:06.488758 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:06.491333 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 89419.2us
I20260709 13:06:06.493008 22218 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:06.430531 23730 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:06.497913 22181 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:06:06.498293 23730 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:06.498734 22004 catalog_manager.cc:5697] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 2, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:06.500126 23716 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:06.500267 22004 catalog_manager.cc:5697] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 2 to 3, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 3 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:06.500864 23770 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:06.502496 23669 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.427366 22173 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:06.503029 23669 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:06.505069 23669 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:06.507716 22175 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:06.508646 23636 consensus_queue.cc:1059] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:06.509450 23636 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:06.510016 23647 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:06.396349 23672 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:06.511688 23672 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:06.512365 22218 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:06.512946 23672 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:06.514989 23679 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:06.515517 23668 consensus_queue.cc:1059] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:06.516253 23668 consensus_queue.cc:1243] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer a07ca3d1b5b84f4bbcb907f709a69275 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:06.517109 22105 raft_consensus.cc:2368] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:06.498330 22181 pending_rounds.cc:85] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 4
I20260709 13:06:06.519347 22181 pending_rounds.cc:107] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:06:06.519639 22181 raft_consensus.cc:2889] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:06.501921 22004 catalog_manager.cc:5697] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 2, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } }
I20260709 13:06:06.502676 23640 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:06.525931 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:06.527163 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:06.527348 22147 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:06.527697 22251 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:06.528582 22251 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:06.531733 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:06.532673 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:06.533371 22181 raft_consensus.cc:2393] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:06.599965 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:06.612406 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:06.618461 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 85602.7us
W20260709 13:06:06.619268 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 190375us
I20260709 13:06:06.627811 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:06.622793 22779 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:06.516194 23679 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:06:06.678952 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:06.674551 22251 raft_consensus.cc:1275] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:06.601362 23669 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:06.596838 23640 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.682540 22251 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:06:06.692864 22251 pending_rounds.cc:85] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 4
I20260709 13:06:06.735405 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:06.736259 22104 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:06.737639 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1411) took 1731 ms. Trace:
I20260709 13:06:06.741905 22255 rpcz_store.cc:276] 0709 13:06:05.006188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.191413 (+1185225us) service_pool.cc:224] Handling call
0709 13:06:06.191798 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.192055 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:06.403047 (+210992us) log.cc:844] Serialized 14 byte log entry
0709 13:06:06.737181 (+334134us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:06.737254 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:06.737312 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.737403 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.737558 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45977,"thread_start_us":462426,"threads_started":3}
I20260709 13:06:06.665930 23781 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.688361 23669 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.618409 23777 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.128s
I20260709 13:06:06.695927 23773 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.808198 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:06.779484 23680 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.812954 23696 raft_consensus.cc:3055] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:06.813395 23696 raft_consensus.cc:740] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:06.745311 23595 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:06.697434 23640 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:06.792412 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:06.839664 22807 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:06.801916 23767 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.847219 23767 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:06.850032 23767 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:06.802716 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.715071 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:06.851318 22072 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:06.853899 23567 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:06.854552 23567 raft_consensus.cc:697] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:06.827430 23773 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:06.855767 23567 consensus_queue.cc:237] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:06.857128 23773 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:06.693921 22251 pending_rounds.cc:107] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.5
W20260709 13:06:06.830565 23756 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.948s	user 0.007s	sys 0.003s
I20260709 13:06:06.777091 23669 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:06.845184 23570 consensus_meta.cc:287] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.678s	user 0.009s	sys 0.005s
I20260709 13:06:06.866272 22104 raft_consensus.cc:2410] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:06.873355 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1631) took 1244 ms. Trace:
I20260709 13:06:06.808204 23744 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:06.752858 23540 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:06:06.891415 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:06.876374 22251 raft_consensus.cc:2917] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Aborting config change with OpId 2.5: Aborted: Op aborted by new leader
I20260709 13:06:06.893486 22104 raft_consensus.cc:2410] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:06.893556 22251 raft_consensus.cc:2889] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:06.890048 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 393430us
I20260709 13:06:06.873922 22179 rpcz_store.cc:276] 0709 13:06:05.628744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.640943 (+ 12199us) service_pool.cc:224] Handling call
0709 13:06:05.653543 (+ 12600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.653856 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.653885 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.663307 (+  9422us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.841419 (+178112us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:05.841481 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.841582 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:06.829938 (+988356us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:06.872975 (+ 43037us) raft_consensus.cc:1685] finished
0709 13:06:06.873005 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.873277 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":255,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":4604288,"thread_start_us":171948,"threads_started":1,"wal-append.queue_time_us":201365}
I20260709 13:06:06.814308 23696 consensus_queue.cc:260] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:06.899797 23682 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:06.901151 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1588) took 1949 ms. Trace:
I20260709 13:06:06.812988 23680 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:06.906828 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:06.901662 22249 rpcz_store.cc:276] 0709 13:06:04.951380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.792257 (+840877us) service_pool.cc:224] Handling call
0709 13:06:06.121192 (+328935us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b5800111698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:06.121393 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.121608 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:06.300447 (+178839us) log.cc:844] Serialized 14 byte log entry
0709 13:06:06.900795 (+600348us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:06.900845 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:06.900888 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.900960 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.901093 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14963,"prepare.queue_time_us":611225,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":121398,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"spinlock_wait_cycles":61849984,"thread_start_us":763243,"threads_started":3,"wal-append.queue_time_us":491061}
I20260709 13:06:06.915977 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:06.776703 23781 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:06.927328 22249 raft_consensus.cc:1275] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:06.926625 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51860 (request call id 80) took 12429 ms. Trace:
I20260709 13:06:06.927783 22251 rpcz_store.cc:276] 0709 13:05:54.488159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.490048 (+  1889us) service_pool.cc:224] Handling call
0709 13:05:54.547433 (+ 57385us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b2c000ad588. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6856a0a 00007f66a6856693 00007f66a6856631 00007f66a7f893f1 00007f66a7ec29fe 00007f66a7f49749 00007f66a7f4a76a 00007f66a7f4991b 00007f66a7f5503c 00007f66a7f546b3
0709 13:05:54.554340 (+  6907us) log.cc:844] Serialized 501 byte log entry
0709 13:05:56.098063 (+1543723us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b18000cfb80. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4ddbc0a 00007f66ae51b219 00007f66abe2258f 00007f66a4e61571 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd
0709 13:06:06.912548 (+10814485us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":220,"mutex_wait_us":1514772,"raft.queue_time_us":10758,"raft.run_cpu_time_us":1374,"raft.run_wall_time_us":21933,"spinlock_wait_cycles":12088832}
I20260709 13:06:06.936793 22104 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:06.912150 23647 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:06.902685 23682 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:06.973400 23660 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.999020 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:07.000761 22097 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:07.001164 22097 pending_rounds.cc:85] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 1
I20260709 13:06:07.001416 22097 pending_rounds.cc:107] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:07.001724 22097 raft_consensus.cc:2889] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:07.000743 23660 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:07.011605 23660 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:07.000468 23592 consensus_meta.cc:287] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.572s	user 0.000s	sys 0.015s
I20260709 13:06:06.997980 23678 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.073832 22173 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:07.055418 23765 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:07.183696 23672 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.995087 23640 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:07.006903 23666 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:07.004668 23540 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:07.373443 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:07.348672 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:07.332531 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.451169 22103 raft_consensus.cc:2368] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:07.339148 22097 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:07.289342 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:07.449347 22106 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:07.055864 23678 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.372879 22099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0232d828f8664f348df823432990379b"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:06:07.490448 22099 raft_consensus.cc:606] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:07.333288 23780 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:07.322607 23670 consensus_meta.cc:287] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.020s	user 0.014s	sys 0.000s
I20260709 13:06:07.330761 23669 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:07.495177 22105 raft_consensus.cc:2410] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:07.495316 23669 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:07.184363 23672 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:07.429500 22807 consensus_meta.cc:287] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.585s	user 0.003s	sys 0.010s
I20260709 13:06:07.497440 22807 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:07.498186 23672 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:07.498535 22811 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:07.070597 23660 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:07.186033 23647 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.184571 23789 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:07.499729 22781 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:07.484427 23540 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:07.332970 23781 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:07.323995 23682 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:07.324553 23661 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:07.332913 23743 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:07.333276 23680 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:07.031885 23592 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:07.511549 22070 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.089s	user 0.025s	sys 0.077s
W20260709 13:06:07.513283 22070 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.025s	sys 0.077s
W20260709 13:06:07.523345 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:07.500159 22807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35198 (request call id 574) took 1579 ms (client timeout 2087 ms). Trace:
I20260709 13:06:07.507860 23789 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:07.482967 23666 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:07.512619 23661 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:07.701478 23661 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:07.522266 23743 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:07.709470 23743 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:07.505944 23647 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:07.712858 23647 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:07.505752 23660 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:07.075197 23765 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:07.680691 23797 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:07.506292 23780 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:07.694360 23640 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:07.697897 23670 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:07.704241 23592 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:07.643478 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 133766us
W20260709 13:06:07.738807 22220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.068s	user 0.059s	sys 0.145s
W20260709 13:06:07.752780 22220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.059s	sys 0.146s
W20260709 13:06:07.753276 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 1.13327e+06us
I20260709 13:06:07.674082 23680 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.577536 23793 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:07.729563 22246 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.063s	sys 0.123s
W20260709 13:06:07.729800 22174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.212s	user 0.063s	sys 0.134s
I20260709 13:06:07.754468 22220 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:07.750813 23743 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:07.757777 22246 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.064s	sys 0.123s
W20260709 13:06:07.761549 22174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.242s	user 0.063s	sys 0.134s
I20260709 13:06:07.723584 23540 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:07.675451 23603 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
W20260709 13:06:07.765962 22179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.008s	sys 0.000s
W20260709 13:06:07.778650 22179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.008s	sys 0.000s
W20260709 13:06:07.723388 22250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.027s	sys 0.035s
W20260709 13:06:07.675163 22807 rpcz_store.cc:269] 0709 13:06:05.918619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.921956 (+  3337us) service_pool.cc:224] Handling call
0709 13:06:06.792250 (+870294us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29eee 0000000000375939 00007f66ace9d1e0 00007f66acf660c4 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:07.497955 (+705705us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9269504}
I20260709 13:06:07.739674 23797 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:07.763465 23781 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.760337 23640 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 13:06:07.785488 22180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.006s	sys 0.010s
W20260709 13:06:07.783932 22004 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.960s	user 0.018s	sys 0.042s
W20260709 13:06:07.811429 22004 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.020s	sys 0.043s
I20260709 13:06:07.760151 23680 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:07.792016 22180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.007s	sys 0.010s
I20260709 13:06:07.809502 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:07.759243 23670 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:07.783166 22250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.030s	sys 0.037s
I20260709 13:06:07.815749 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:07.821859 22251 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:07.823143 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:07.823874 22251 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:07.764272 23793 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:07.816128 22249 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:07.832203 23789 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:07.831904 23793 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:07.791339 23799 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.833040 23680 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:07.808698 23592 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:07.832973 23799 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:07.833871 23592 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:07.834834 23798 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:07.835376 23799 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:07.836071 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1422) took 1311 ms. Trace:
I20260709 13:06:07.836138 23592 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:07.785236 23725 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:06:07.836500 22248 rpcz_store.cc:276] 0709 13:06:06.524845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.524947 (+   102us) service_pool.cc:224] Handling call
0709 13:06:06.525240 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:06.525543 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.525567 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:06.612086 (+ 86519us) log.cc:844] Serialized 26 byte log entry
0709 13:06:06.950304 (+338218us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:06.950366 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.950465 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.835856 (+885391us) raft_consensus.cc:1685] finished
0709 13:06:07.835876 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.836014 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44594,"raft.queue_time_us":70272,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":10178,"thread_start_us":265187,"threads_started":1,"wal-append.queue_time_us":1090703}
I20260709 13:06:07.834834 23793 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:07.766314 23743 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:07.839257 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 166) took 1383 ms. Trace:
I20260709 13:06:07.843734 22147 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:07.840607 23743 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:07.791270 23669 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 13:06:07.849167 22071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.421s	user 0.003s	sys 0.018s
I20260709 13:06:07.849509 23592 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:07.849933 22071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.422s	user 0.003s	sys 0.018s
I20260709 13:06:07.849826 23725 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:07.850188 23592 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:07.850534 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 1.42257e+06us
I20260709 13:06:07.851469 22071 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:07.852278 23592 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:07.852339 23799 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:07.854143 22218 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.007s	sys 0.004s
I20260709 13:06:07.856712 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:07.857884 22249 raft_consensus.cc:2410] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:07.864521 22251 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:07.829452 23802 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:07.847815 23789 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:07.853665 23765 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:07.844852 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1421) took 1738 ms. Trace:
W20260709 13:06:07.854585 22218 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.007s	sys 0.004s
W20260709 13:06:07.935377 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 84015.6us
I20260709 13:06:07.883809 22147 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:07.839696 22174 rpcz_store.cc:276] 0709 13:06:06.456323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.489590 (+ 33267us) service_pool.cc:224] Handling call
0709 13:06:06.516393 (+ 26803us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:06.516760 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.516792 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:06.517317 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:06:07.783415 (+1266098us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:07.791613 (+  8198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.810834 (+ 19221us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.839039 (+ 28205us) raft_consensus.cc:1685] finished
0709 13:06:07.839058 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.839195 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2683,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":79422,"thread_start_us":1251739,"threads_started":1,"wal-append.queue_time_us":1311802}
W20260709 13:06:07.942651 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 58925.1us
W20260709 13:06:07.939131 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 1.04999e+06us
W20260709 13:06:07.994324 21991 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 252049d2bcdd4f329ca5015bf10c1b19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 13:06:07.936894 23660 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:07.996934 23765 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:07.997535 23765 raft_consensus.cc:697] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:07.998448 23765 consensus_queue.cc:237] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.000029 22816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 571) took 2082 ms. Trace:
I20260709 13:06:08.000654 22816 rpcz_store.cc:276] 0709 13:06:05.917701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.917885 (+   184us) service_pool.cc:224] Handling call
0709 13:06:05.918334 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.062096 (+143762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.062128 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:06.062167 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:06.062197 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.999707 (+1937510us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400740254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:07.999774 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.999951 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330148096}
I20260709 13:06:08.002352 22175 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.003146 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1337) took 1474 ms. Trace:
I20260709 13:06:08.003511 22175 rpcz_store.cc:276] 0709 13:06:06.528902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.595716 (+ 66814us) service_pool.cc:224] Handling call
0709 13:06:08.001713 (+1405997us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b5800165698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:08.001954 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.002827 (+   873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.003087 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10580864}
I20260709 13:06:07.928031 23592 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.005209 23592 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.006395 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1605) took 1487 ms. Trace:
I20260709 13:06:07.869961 23789 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:08.014261 22253 rpcz_store.cc:276] 0709 13:06:06.518914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.519041 (+   127us) service_pool.cc:224] Handling call
0709 13:06:08.005394 (+1486353us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b5800111698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:08.005714 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.005937 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.005973 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:08.006047 (+    74us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:08.006095 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.006174 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.006323 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7570176}
I20260709 13:06:07.876998 23666 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:07.878173 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1602) took 1363 ms. Trace:
I20260709 13:06:08.012765 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:08.022732 23669 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:07.877508 23802 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.023798 23743 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:08.071309 23743 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.025712 23725 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.025806 23797 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:08.026847 23680 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:08.075589 23725 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.075958 23680 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:08.034009 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.079005 22780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.324s	user 0.008s	sys 0.014s
W20260709 13:06:08.079532 22780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.548s	user 0.008s	sys 0.014s
I20260709 13:06:08.081735 22218 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:08.082057 23795 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:08.034402 22252 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:08.082856 23795 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.083873 23672 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:08.084408 23672 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.048945 23780 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:08.087212 23803 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:08.087853 23803 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:08.054280 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 114253us
I20260709 13:06:08.089727 23647 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:08.059129 22247 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:08.059963 23564 raft_consensus.cc:3055] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:07.940618 22246 rpcz_store.cc:276] 0709 13:06:06.106248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.106765 (+   517us) service_pool.cc:224] Handling call
0709 13:06:06.126198 (+ 19433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:06.126602 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.126634 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:06.127168 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:06:06.388757 (+261589us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:06.656972 (+268215us) log.cc:844] Serialized 14 byte log entry
0709 13:06:07.770190 (+1113218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.807773 (+ 37583us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.820760 (+ 12987us) raft_consensus.cc:1685] finished
0709 13:06:07.827313 (+  6553us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.843032 (+ 15719us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7488,"prepare.queue_time_us":412733,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":119511,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":314,"thread_start_us":1505465,"threads_started":3,"wal-append.queue_time_us":669440,"wal-append.run_cpu_time_us":2012,"wal-append.run_wall_time_us":1012074}
I20260709 13:06:08.074486 23743 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:08.067308 23599 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:08.083287 22146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.092s	user 0.003s	sys 0.019s
W20260709 13:06:08.120801 22146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.358s	user 0.004s	sys 0.019s
I20260709 13:06:08.093508 22218 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:08.097745 22071 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:08.033273 23712 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:08.100265 22816 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:08.104103 22255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.302s	user 0.025s	sys 0.083s
I20260709 13:06:08.093271 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:08.078827 23680 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:08.127300 22255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.325s	user 0.025s	sys 0.083s
I20260709 13:06:08.112275 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 572) took 2194 ms. Trace:
I20260709 13:06:08.094278 23669 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.113801 23781 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.016733 23789 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:08.115278 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 168) took 1129 ms. Trace:
W20260709 13:06:08.118120 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 365264us
W20260709 13:06:08.138839 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 45455us
I20260709 13:06:08.139869 22218 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:08.127489 22254 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.127162 22071 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:08.131199 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.138672 22180 rpcz_store.cc:276] 0709 13:06:06.985762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.985897 (+   135us) service_pool.cc:224] Handling call
0709 13:06:06.986252 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:06.986612 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.986640 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:06.987122 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:06:07.815046 (+827924us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:07.815089 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.815149 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.114710 (+299561us) raft_consensus.cc:1685] finished
0709 13:06:08.114735 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.114884 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":5738,"spinlock_wait_cycles":1311104,"thread_start_us":826766,"threads_started":1,"wal-append.queue_time_us":1125001}
W20260709 13:06:08.121801 22072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.015s	sys 0.009s
I20260709 13:06:08.141096 22218 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:08.141378 22072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.016s	sys 0.010s
I20260709 13:06:08.107079 23564 raft_consensus.cc:740] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:08.123013 22172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.194s	user 0.052s	sys 0.110s
W20260709 13:06:08.194424 22779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.565s	user 0.002s	sys 0.033s
W20260709 13:06:08.194883 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 54515.3us
W20260709 13:06:08.195398 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 68474.4us
W20260709 13:06:08.196026 22070 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.016s	sys 0.012s
W20260709 13:06:08.201355 22070 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.016s	sys 0.012s
I20260709 13:06:08.201900 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:08.194799 22779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.566s	user 0.002s	sys 0.033s
I20260709 13:06:08.202158 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:08.126297 23725 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:08.203860 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 1.58101e+06us
W20260709 13:06:08.127203 23567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.216s	user 0.007s	sys 0.018s
I20260709 13:06:08.136263 23799 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:08.139052 23668 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:06:08.135708 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:08.136849 23743 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.130225 23647 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:08.217419 23567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.306s	user 0.007s	sys 0.018s
I20260709 13:06:08.218223 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:08.219550 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:08.146816 23801 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:08.211788 23724 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:08.192478 22172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.267s	user 0.052s	sys 0.111s
I20260709 13:06:08.124423 23599 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.232476 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:08.246534 22176 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:08.247077 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1339) took 1717 ms. Trace:
I20260709 13:06:08.239915 23680 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:08.233317 23799 raft_consensus.cc:697] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:08.237481 23743 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.242300 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:08.192785 23670 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:08.215899 23672 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:08.137403 23712 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.210875 23797 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:06:08.217751 23807 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:08.226547 23575 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.225564 23781 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:08.218493 23725 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.280287 23670 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:08.284327 23801 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.299314 23725 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.299675 23670 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.283133 23680 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.301730 23725 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:08.237270 23678 consensus_meta.cc:287] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.003s
I20260709 13:06:08.130415 22808 rpcz_store.cc:276] 0709 13:06:05.918005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.921898 (+  3893us) service_pool.cc:224] Handling call
0709 13:06:07.914126 (+1992228us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29eee 0000000000375939 00007f66ace9d1e0 00007f66acf660c4 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:07.945850 (+ 31724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.016586 (+ 70736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.019980 (+  3394us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:08.022007 (+  2027us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:08.032283 (+ 10276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.064448 (+ 32165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.108135 (+ 43687us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9389440}
I20260709 13:06:08.303184 23678 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.303678 23807 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.306094 23678 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:08.254480 23564 consensus_queue.cc:260] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.243721 23647 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.307560 23564 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:08.309290 23647 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:08.283910 23672 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:08.310729 23672 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.312077 23575 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.313501 23672 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:08.283695 23724 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.247371 23803 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:08.302698 23680 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:08.314481 23575 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:08.302578 23670 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:08.316883 23670 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.317565 23670 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.325066 23670 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:08.326387 23696 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.300248 23804 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:08.286510 23802 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:08.267763 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:08.316056 23575 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.314548 23724 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.293612 23599 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:08.292784 23712 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:08.319555 23595 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:08.306290 23807 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:08.321863 23789 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:08.333962 23815 log.cc:927] Time spent T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:08.334704 22811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 250) took 1345 ms. Trace:
I20260709 13:06:08.335974 23743 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:08.337319 23669 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:08.029930 22250 rpcz_store.cc:276] 0709 13:06:06.517852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.522901 (+  5049us) service_pool.cc:224] Handling call
0709 13:06:06.657824 (+134923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.842165 (+1184341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:07.842866 (+   701us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:07.844657 (+  1791us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:07.848625 (+  3968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.858817 (+ 10192us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.875084 (+ 16267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90982,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":66,"thread_start_us":1090111,"threads_started":1}
I20260709 13:06:08.339305 22816 raft_consensus.cc:2368] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
W20260709 13:06:08.293941 22219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.484s	user 0.009s	sys 0.029s
W20260709 13:06:08.373492 22219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.754s	user 0.009s	sys 0.030s
I20260709 13:06:08.287982 23656 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:08.247401 22176 rpcz_store.cc:276] 0709 13:06:06.529508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.530164 (+   656us) service_pool.cc:224] Handling call
0709 13:06:08.232305 (+1702141us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b5800165698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:08.247025 (+ 14720us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6382464}
I20260709 13:06:08.294456 23668 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.315331 23799 consensus_queue.cc:237] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.360370 23724 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:08.367655 22254 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
W20260709 13:06:08.391930 22254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1606) took 1872 ms (client timeout 1850 ms). Trace:
I20260709 13:06:08.366139 23595 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:08.392611 22254 rpcz_store.cc:269] 0709 13:06:06.519306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.519411 (+   105us) service_pool.cc:224] Handling call
0709 13:06:08.093048 (+1573637us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b5800111698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:08.391843 (+298795us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20236672}
I20260709 13:06:08.352310 23804 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.362190 23575 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.406522 22254 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:08.370467 22811 rpcz_store.cc:276] 0709 13:06:06.989006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.992358 (+  3352us) service_pool.cc:224] Handling call
0709 13:06:07.498250 (+505892us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:07.499032 (+   782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.334379 (+835347us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b540054db50. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:08.334621 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128508672}
I20260709 13:06:08.377476 23712 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:08.416940 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:08.407704 23682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.024s	sys 0.021s
I20260709 13:06:08.395144 23679 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.391608 23802 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:08.403257 23669 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:08.426304 22099 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:08.426460 22252 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:08.440629 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:08.394181 23592 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:08.431509 22106 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:08.431953 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 167) took 1456 ms. Trace:
I20260709 13:06:08.410151 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:08.438844 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:08.468145 22180 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
I20260709 13:06:08.441952 22179 rpcz_store.cc:276] 0709 13:06:06.975802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.976019 (+   217us) service_pool.cc:224] Handling call
0709 13:06:06.991316 (+ 15297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:06.991767 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.991809 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:07.003022 (+ 11213us) log.cc:844] Serialized 26 byte log entry
0709 13:06:07.779335 (+776313us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:07.779395 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.779501 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.431758 (+652257us) raft_consensus.cc:1685] finished
0709 13:06:08.431779 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.431895 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2077,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4186,"thread_start_us":766763,"threads_started":1,"wal-append.queue_time_us":1183701}
W20260709 13:06:08.417557 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 276515us
I20260709 13:06:08.470108 22218 leader_election.cc:400] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:08.470480 22218 leader_election.cc:403] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:08.396082 23668 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.467862 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:08.464596 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:08.526358 22176 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:08.392948 23656 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.414471 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:08.544216 22102 raft_consensus.cc:1275] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:08.526441 22810 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:08.545727 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:08.545933 23575 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:08.547168 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:08.547436 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:08.432952 23682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.024s	sys 0.021s
I20260709 13:06:08.550462 23682 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:08.426581 23564 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.429507 23817 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.413784 23743 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.535205 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:08.525801 23592 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:08.537190 23668 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:08.597780 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 380905us
I20260709 13:06:08.538237 23804 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:08.539316 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:08.539644 23789 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:08.540702 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:08.541965 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:08.441399 22097 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:08.551129 23660 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:08.551806 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:08.552086 22246 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:08.464571 23725 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.583406 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:08.628551 22102 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:08.583429 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:08.584715 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:08.585117 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:08.437300 23680 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.465332 23606 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:08.435113 23818 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 13:06:08.588785 22176 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:08.606830 23816 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:08.554312 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:08.595772 22069 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:08.597631 23743 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.596493 23817 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.443779 23802 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.465389 23669 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.560640 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:08.538178 23813 log.cc:927] Time spent T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:06:08.435266 23712 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:08.597241 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.692174 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.605926 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:08.586618 23796 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:08.591209 23564 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.594869 23803 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:08.601018 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:08.703231 22250 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:06:08.637207 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:08.693480 22175 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:08.704319 23802 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:08.600769 23599 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:08.606238 23824 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:08.589617 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 119654us
I20260709 13:06:08.646359 23680 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.669909 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:08.651026 23606 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.668970 23816 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.593472 23682 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:08.649075 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 47260.8us
I20260709 13:06:08.536824 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:08.625202 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:08.439136 23679 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:08.668390 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:08.624913 23789 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:08.677004 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:08.686869 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 91211.3us
I20260709 13:06:08.664163 23830 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.655716 23804 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.693006 22099 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:08.693837 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:08.695009 22252 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:08.670537 23765 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:08.697849 23820 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:06:08.698113 23811 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:06:08.698837 23564 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:08.700913 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:08.647720 22147 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:08.638020 23725 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:08.888309 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 287299us
I20260709 13:06:09.009541 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:08.794106 22254 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:06:09.013262 22254 pending_rounds.cc:85] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 4
I20260709 13:06:09.013564 22254 pending_rounds.cc:107] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:06:09.011751 22814 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:09.013850 22254 raft_consensus.cc:2889] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:08.945513 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:08.790789 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:08.674393 22809 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:06:08.949497 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:09.014887 22248 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:06:09.037971 22102 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:08.690935 23575 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:08.708670 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:09.039862 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:09.019006 23765 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:09.041085 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:09.045830 22218 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:08.942782 22072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.850s (SENT) [suppressed 6 similar messages]
I20260709 13:06:09.041167 23789 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:09.041769 23682 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:08.709048 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:09.019006 23672 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.020644 23743 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:09.037779 23828 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:06:09.039873 22808 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:06:08.710776 23803 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:09.073099 23679 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:09.074589 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:09.048346 23804 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:09.075932 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.705178 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.077478 23765 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:09.078088 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.044720 22253 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
I20260709 13:06:09.033686 23824 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:08.705348 23599 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:09.041404 23725 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:09.045511 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:08.960326 22144 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:09.074630 23803 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:09.082906 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 122650us
I20260709 13:06:09.083878 22144 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:09.084726 23682 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:09.084874 23825 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:09.085320 23682 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.085901 23682 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.086562 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:09.087620 23825 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:09.088119 23825 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:09.088586 23825 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.088693 23789 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:09.031284 23782 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:06:09.051767 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:09.080793 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 165) took 2632 ms. Trace:
I20260709 13:06:09.093662 22172 rpcz_store.cc:276] 0709 13:06:06.432641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.433946 (+  1305us) service_pool.cc:224] Handling call
0709 13:06:06.623381 (+189435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:06.715623 (+ 92242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.740078 (+ 24455us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:06.869921 (+129843us) log.cc:844] Serialized 26 byte log entry
0709 13:06:08.271501 (+1401580us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:08.280443 (+  8942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.289632 (+  9189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.043828 (+754196us) raft_consensus.cc:1685] finished
0709 13:06:09.045831 (+  2003us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.062318 (+ 16487us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14,"raft.queue_time_us":11304,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":29896,"thread_start_us":1334075,"threads_started":1,"wal-append.queue_time_us":1515676}
I20260709 13:06:09.096525 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.096707 22144 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:09.056329 22218 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:09.004434 23696 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:08.695958 23819 consensus_queue.cc:1048] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.351s
I20260709 13:06:09.097942 23696 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:09.044137 23839 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:06:09.100363 23696 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:09.066381 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.101320 22181 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:09.061766 23836 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.102561 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.104082 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.105260 22181 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:08.792127 23595 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:09.107601 23595 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:09.046403 23564 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:09.072230 23795 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:09.078270 23804 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:09.043246 23816 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:08.707132 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:09.109609 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.110244 22181 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:06:09.111073 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.006860 23817 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:09.048175 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:09.080592 23672 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:09.113032 23795 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.081091 22782 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:09.114078 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 57894.5us
W20260709 13:06:09.114172 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 44376.6us
I20260709 13:06:09.083971 23599 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:09.070500 22174 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:09.108356 23564 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:09.113065 22250 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:09.081961 22175 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:09.114387 22782 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:09.114888 22218 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:08.788074 23808 log.cc:927] Time spent T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.374s	user 0.000s	sys 0.001s
I20260709 13:06:08.781384 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:09.112526 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.116493 22144 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:08.708374 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:09.118160 22248 raft_consensus.cc:2393] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:09.097381 22172 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
W20260709 13:06:09.116938 23799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.002s	sys 0.019s
I20260709 13:06:09.135792 22220 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:09.123538 23564 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.081349 23712 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:09.039060 23830 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:09.122062 23789 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:09.139438 23683 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:09.123970 23782 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:08.708669 23796 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:09.232810 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 585143us
W20260709 13:06:09.237079 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 88566.3us
I20260709 13:06:09.249607 22218 leader_election.cc:400] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:09.250027 22218 leader_election.cc:403] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:09.232910 22100 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:09.251624 23575 raft_consensus.cc:697] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:09.251737 23802 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
W20260709 13:06:09.253808 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 311183us
I20260709 13:06:09.234155 23725 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:09.230268 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 113836us
I20260709 13:06:09.258623 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:09.157552 23799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.003s	sys 0.019s
I20260709 13:06:09.231607 22247 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 3: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:09.243250 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:09.149983 23836 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.254030 22218 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:09.237493 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 101818us
I20260709 13:06:09.257289 22099 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:09.132237 23807 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:06:09.230299 22246 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:09.262838 22218 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:09.263712 22147 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:09.264485 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:09.235540 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:09.261313 22220 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:09.238552 23789 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.269435 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:09.245791 23795 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:09.231508 23595 consensus_queue.cc:1059] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:06:09.241858 23683 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:09.241348 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:09.250167 23782 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:06:09.281019 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 165953us
I20260709 13:06:09.261849 23725 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.301080 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1607) took 2476 ms. Trace:
I20260709 13:06:09.311641 22255 rpcz_store.cc:276] 0709 13:06:06.800840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.800970 (+   130us) service_pool.cc:224] Handling call
0709 13:06:06.801284 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:06.801628 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.801661 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:06.802187 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:06:08.127772 (+1325585us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:08.127820 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.127907 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.277200 (+1149293us) raft_consensus.cc:1685] finished
0709 13:06:09.277226 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.277415 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2788,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":31717,"thread_start_us":1325224,"threads_started":1,"wal-append.queue_time_us":1560650}
I20260709 13:06:09.303224 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:09.304854 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:09.305451 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:09.240334 23696 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:09.275089 23828 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:09.268208 23803 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.266700 23679 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:09.272303 23765 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.300655 23782 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.274719 23789 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.328137 22097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:06:09.280645 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:09.328397 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:09.252957 23575 consensus_queue.cc:237] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:09.355940 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:09.356592 22098 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:09.335819 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 71400.2us
W20260709 13:06:09.336047 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 74793.4us
I20260709 13:06:09.361719 22218 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:09.361915 22220 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:09.337262 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 73660.6us
I20260709 13:06:09.274235 23795 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.340108 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.281518 23683 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.270569 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.352319 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:09.353498 22104 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:09.271402 23802 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:06:09.311206 23680 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:09.352387 22097 raft_consensus.cc:606] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:09.319962 23725 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.362912 22779 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:09.380141 22218 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:09.375844 22147 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:09.375909 22176 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:06:09.321956 23828 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:09.280546 23743 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:06:09.339397 23679 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:06:09.378059 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 109219us
I20260709 13:06:09.349439 23836 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.423084 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:09.428440 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:09.350173 23857 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.362509 23606 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:09.376699 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:09.379211 23795 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.382105 23839 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.423360 23716 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:09.450294 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.456351 22176 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:09.388545 23828 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.352128 23765 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:09.458165 23595 raft_consensus.cc:3055] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:09.458571 23595 raft_consensus.cc:740] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:09.378961 23660 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 13:06:09.459108 23851 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:06:09.459185 23765 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:09.426913 23679 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.459447 23595 consensus_queue.cc:260] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:09.461026 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 98207.8us
I20260709 13:06:09.443257 23712 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:09.432489 23860 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:09.469437 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:09.469847 23846 log.cc:927] Time spent T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:06:09.471788 23863 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.472462 23865 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.475387 23849 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:09.476869 22779 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:09.482362 23855 log.cc:927] Time spent T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:06:09.485654 23796 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:09.488220 23564 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:09.489502 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:09.598300 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 236423us
I20260709 13:06:09.677812 22220 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:09.678706 22220 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:09.491204 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.491799 23802 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:09.493086 23669 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:09.443840 23857 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:09.497329 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:09.497710 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.501695 23656 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:09.504668 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:09.505447 23816 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.502161 23789 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:09.508514 22071 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:09.722105 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 213834us
I20260709 13:06:09.723181 22071 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:09.463881 23595 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:09.536944 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 60160us
I20260709 13:06:09.723783 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 219) took 1337 ms. Trace:
I20260709 13:06:09.724450 22254 rpcz_store.cc:276] 0709 13:06:08.386774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.407710 (+ 20936us) service_pool.cc:224] Handling call
0709 13:06:08.426755 (+ 19045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.014469 (+587714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.723506 (+709037us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54003bdb54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:09.723705 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":844001536}
W20260709 13:06:09.537259 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 157143us
I20260709 13:06:09.535635 23849 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:09.680241 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:09.506824 23672 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:09.476776 23712 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:09.479426 23860 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:09.693295 23796 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:09.532518 23661 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:09.699908 23845 log.cc:927] Time spent T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.323s	user 0.000s	sys 0.004s
W20260709 13:06:09.689781 23848 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.222s	user 0.000s	sys 0.005s
W20260709 13:06:09.699782 23854 log.cc:927] Time spent T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.184s	user 0.001s	sys 0.003s
I20260709 13:06:09.518332 22098 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:09.727653 22218 leader_election.cc:400] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
W20260709 13:06:09.592659 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 210810us
I20260709 13:06:09.759266 22181 raft_consensus.cc:2393] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:09.759826 22147 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:09.729122 22071 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:09.730203 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 301826us
I20260709 13:06:09.764827 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:09.718372 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 224) took 1298 ms. Trace:
I20260709 13:06:09.722568 23862 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.479192 23824 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:09.698487 23790 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.700462 23802 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:09.705626 23865 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:09.765690 22249 rpcz_store.cc:276] 0709 13:06:08.420338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.093080 (+672742us) service_pool.cc:224] Handling call
0709 13:06:09.093479 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.093903 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.093931 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.094499 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.253158 (+158659us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:09.253197 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.253754 (+   557us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.718064 (+464310us) raft_consensus.cc:1685] finished
0709 13:06:09.718093 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.718292 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":158117,"threads_started":1,"wal-append.queue_time_us":204140}
I20260709 13:06:09.680177 23770 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:09.737108 23816 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:09.741282 23712 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.741084 23835 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:09.736626 23826 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:09.728814 22173 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:09.739691 23849 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.779573 22144 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:06:09.778561 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 49532.9us
W20260709 13:06:09.803154 23682 consensus_meta.cc:287] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.711s	user 0.011s	sys 0.000s
I20260709 13:06:09.749244 23860 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:09.799408 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 47386.3us
I20260709 13:06:09.747903 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1345) took 1079 ms. Trace:
I20260709 13:06:09.773872 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 176) took 1236 ms. Trace:
I20260709 13:06:09.837100 22180 rpcz_store.cc:276] 0709 13:06:08.537849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.545731 (+  7882us) service_pool.cc:224] Handling call
0709 13:06:08.796498 (+250767us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5800165698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:08.796675 (+   177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.797037 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.797078 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:08.963801 (+166723us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.245912 (+282111us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:09.245955 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.246017 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.765069 (+519052us) raft_consensus.cc:1685] finished
0709 13:06:09.765088 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.773806 (+  8718us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":451,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":83310,"spinlock_wait_cycles":35579776,"thread_start_us":186334,"threads_started":1,"wal-append.queue_time_us":389271}
I20260709 13:06:09.839833 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.771981 23672 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:09.773872 22250 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:09.810563 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:09.736064 23828 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:09.811928 22218 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:09.764839 23861 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:09.781008 23545 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.755532 23796 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:09.817601 23835 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.820475 23872 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.797577 23802 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.760456 23661 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:09.754395 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 52641.9us
W20260709 13:06:09.830662 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 51183.3us
I20260709 13:06:09.869149 22144 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:09.801667 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:09.836078 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 181) took 1236 ms. Trace:
I20260709 13:06:09.812366 23863 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:09.815619 23669 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:09.881325 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.882339 22180 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:09.883694 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:09.850364 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:09.781370 23862 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:09.817260 23826 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.858577 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 220) took 1471 ms. Trace:
I20260709 13:06:09.858095 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:09.903275 22249 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:09.902828 22252 rpcz_store.cc:276] 0709 13:06:08.387116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.075750 (+688634us) service_pool.cc:224] Handling call
0709 13:06:09.076126 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.076331 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.076356 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.076812 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.253478 (+176666us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:09.253521 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.253601 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.858346 (+604745us) raft_consensus.cc:1685] finished
0709 13:06:09.858371 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.858520 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":176316,"threads_started":1,"wal-append.queue_time_us":365994}
W20260709 13:06:09.855707 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 53898.7us
I20260709 13:06:09.813582 23716 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:06:09.851159 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:09.818439 23859 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:09.833925 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57856 (request call id 178) took 1290 ms. Trace:
I20260709 13:06:09.853814 23672 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.870287 22177 rpcz_store.cc:276] 0709 13:06:08.599829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.600061 (+   232us) service_pool.cc:224] Handling call
0709 13:06:08.600384 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.711173 (+110789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.711201 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:08.711647 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.138340 (+426693us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:09.138395 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.684374 (+545979us) spinlock_profiling.cc:243] Waited 98.9 ms on lock 0x7b540031abd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:09.684447 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.818651 (+134204us) raft_consensus.cc:1685] finished
0709 13:06:09.818671 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.836011 (+ 17340us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11449,"raft.queue_time_us":11844,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":148,"spinlock_wait_cycles":227518720,"thread_start_us":357411,"threads_started":1,"wal-append.queue_time_us":492064}
I20260709 13:06:09.855463 23656 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:09.899281 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:09.864362 23835 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.858364 23861 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:09.830616 23682 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:09.842074 23679 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:09.811597 23865 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:09.816578 23770 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:09.904824 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:10.045840 23796 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:10.045972 22249 raft_consensus.cc:2376] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3. Re-sending same reply.
I20260709 13:06:10.047123 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:10.048092 23725 consensus_meta.cc:287] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.000s
I20260709 13:06:10.048345 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:10.048529 23725 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:09.951828 23866 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:09.979056 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 197232us
I20260709 13:06:09.936141 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:10.055354 23857 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:10.056108 23871 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
W20260709 13:06:10.056869 23864 log.cc:927] Time spent T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:06:10.062144 23828 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:10.059018 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.082176 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.085580 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.914328 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:09.836887 22172 rpcz_store.cc:276] 0709 13:06:08.668392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.490840 (+822448us) service_pool.cc:224] Handling call
0709 13:06:09.740392 (+249552us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:09.942755 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:10.104817 22180 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:06:10.105758 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1352) took 1374 ms. Trace:
I20260709 13:06:10.106375 22180 rpcz_store.cc:276] 0709 13:06:08.731188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.942436 (+1211248us) service_pool.cc:224] Handling call
0709 13:06:10.105681 (+163245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:09.931959 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:09.959689 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 233889us
W20260709 13:06:10.126392 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 430862us
I20260709 13:06:10.146615 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:10.147718 22177 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:06:10.150957 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:10.152629 22815 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.893268 23680 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:09.915627 23826 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:10.171111 22249 raft_consensus.cc:2410] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:09.952343 23873 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.879678 23863 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:10.175034 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.915220 23564 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:10.091295 23672 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.199729 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:10.180845 22147 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:10.202407 23564 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:10.203403 23564 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.204253 23564 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.144704 23856 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:10.182063 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:10.206444 23856 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:10.206965 22811 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
W20260709 13:06:10.207742 22811 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35214 (request call id 384) took 1680 ms (client timeout 1877 ms). Trace:
I20260709 13:06:10.148919 23807 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:06:10.208236 22811 rpcz_store.cc:269] 0709 13:06:08.526985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.536745 (+  9760us) service_pool.cc:224] Handling call
0709 13:06:10.181864 (+1645119us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:10.207637 (+ 25773us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40345472}
I20260709 13:06:10.209134 23807 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:10.209929 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:10.169945 23832 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:10.214764 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.215046 23832 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:10.216322 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:10.217669 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.218549 22809 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:10.200114 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:10.148630 23545 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:10.056041 23866 raft_consensus.cc:697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:10.210819 22811 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:10.180472 22180 raft_consensus.cc:2393] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:10.091918 23656 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:10.219291 23545 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.219866 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.231062 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.148747 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:10.218858 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:10.253835 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 73110.4us
I20260709 13:06:10.099654 23861 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:10.255853 22106 raft_consensus.cc:2393] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:10.256332 22147 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:10.149434 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.221881 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:10.258153 22177 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:10.224598 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 1661) took 1185 ms. Trace:
I20260709 13:06:10.227167 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.259402 22781 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:10.259433 22180 rpcz_store.cc:276] 0709 13:06:09.038814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.152429 (+1113615us) service_pool.cc:224] Handling call
0709 13:06:10.224540 (+ 72111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.151985 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:10.263900 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.167995 23680 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:10.171054 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:10.267445 23728 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:10.267474 23885 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:10.268599 23733 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:10.203975 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:10.272575 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:10.273125 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:10.272416 22781 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:10.184026 23863 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:10.275076 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.274395 22218 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:10.274529 22253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.000s	sys 0.018s
W20260709 13:06:10.281082 22253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.000s	sys 0.018s
I20260709 13:06:10.227384 23656 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:10.286247 23780 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.004s	sys 0.013s
I20260709 13:06:10.221881 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:10.220139 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:10.272205 23872 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:10.318503 22815 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:10.087070 22173 rpcz_store.cc:276] 0709 13:06:08.538495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.546316 (+  7821us) service_pool.cc:224] Handling call
0709 13:06:09.497522 (+951206us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b5800165698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:09.828752 (+331230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82820480}
W20260709 13:06:10.204003 22247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45738 (request call id 215) took 1818 ms (client timeout 1704 ms). Trace:
I20260709 13:06:10.299111 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:09.905545 23669 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.300868 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.254885 23796 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:10.315240 23884 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:10.274855 23680 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:10.272343 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:10.324678 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 50372.2us
I20260709 13:06:10.327869 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.286859 23728 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.277606 23733 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:10.282315 23696 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:10.333865 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.289157 23885 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.145943 23859 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.312614 23712 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:10.194841 23873 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:10.220837 23866 consensus_queue.cc:237] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:10.313171 23780 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.005s	sys 0.014s
I20260709 13:06:10.287746 23661 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:10.338855 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 132775us
I20260709 13:06:10.407888 22218 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:10.410054 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:10.410187 22106 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:10.411245 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:10.325510 23872 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:10.329833 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:10.412859 22219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.011s	sys 0.028s
I20260709 13:06:10.413203 23878 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:10.414958 23828 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:10.415838 23795 consensus_meta.cc:287] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.955s	user 0.014s	sys 0.008s
I20260709 13:06:10.417320 23828 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.417888 23828 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:10.419020 23717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.002s	sys 0.016s
W20260709 13:06:10.419345 23717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.002s	sys 0.016s
W20260709 13:06:10.419394 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.419950 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.333871 23816 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:10.424160 22219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.011s	sys 0.028s
I20260709 13:06:10.414131 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:10.373216 23770 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:10.432392 22218 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:10.363169 23884 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.425876 23865 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:10.399221 23725 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:10.372515 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:10.337872 23896 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.416013 23872 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:10.436295 23849 consensus_meta.cc:287] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.001s
I20260709 13:06:10.438313 23878 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.374529 23807 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:10.408761 23669 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:10.381763 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:10.410707 23733 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:10.398386 23856 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:10.417364 23825 consensus_meta.cc:287] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 1.328s	user 0.020s	sys 0.005s
I20260709 13:06:10.457947 22812 raft_consensus.cc:1217] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Deduplicated request from leader. Original: 1.4->[2.5-2.5]   Dedup: 2.5->[]
I20260709 13:06:10.462396 22812 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:10.462683 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.439435 23865 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:10.380249 23832 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:10.413446 23862 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:10.338163 23796 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:10.440551 23682 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:10.328497 22247 rpcz_store.cc:269] 0709 13:06:08.385158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.391885 (+  6727us) service_pool.cc:224] Handling call
0709 13:06:10.203758 (+1811873us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54001cb6d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:10.203919 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481719040}
I20260709 13:06:10.446487 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:10.472529 23595 consensus_meta.cc:287] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.736s	user 0.010s	sys 0.002s
W20260709 13:06:10.470753 23782 consensus_meta.cc:287] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 1.093s	user 0.015s	sys 0.005s
I20260709 13:06:10.469228 22172 raft_consensus.cc:2410] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:10.417883 23795 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:10.470556 23860 consensus_meta.cc:287] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.002s
I20260709 13:06:10.474644 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:10.472257 23683 consensus_meta.cc:287] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 1.045s	user 0.011s	sys 0.003s
I20260709 13:06:10.470259 23669 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:10.481985 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 49657.3us
I20260709 13:06:10.460714 23849 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.485690 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1350) took 1809 ms. Trace:
I20260709 13:06:10.473603 23679 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:10.474298 23865 raft_consensus.cc:697] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:10.493897 22103 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:06:10.477312 23545 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:10.497973 22172 rpcz_store.cc:276] 0709 13:06:08.676503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.177190 (+1500687us) service_pool.cc:224] Handling call
0709 13:06:10.485602 (+308412us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.503702 22097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33706 (request call id 12) took 1200 ms. Trace:
I20260709 13:06:10.503811 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:10.504244 22097 rpcz_store.cc:276] 0709 13:06:09.303331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.322123 (+ 18792us) service_pool.cc:224] Handling call
0709 13:06:10.503505 (+1181382us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b4c001196c0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a621aa20 00007f66a622ba29 00007f66a61f1644 00007f66a6218f2d 00007f66a6218b93 00007f66a7f48c92 00007f66a7f4884a 00007f66acf1660a 00007f66a649c7d4 00007f66a649c762 00007f66a649c691
0709 13:06:10.503612 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137622016}
I20260709 13:06:10.504593 22172 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:10.505489 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:10.506096 22172 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:10.507583 23828 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.508430 22249 raft_consensus.cc:1240] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:10.486228 23782 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.511057 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:10.511796 22173 raft_consensus.cc:2368] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 4. Current term is 5.
I20260709 13:06:10.496253 23860 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.512022 22808 raft_consensus.cc:2393] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:10.495193 23669 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:10.510751 23564 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:10.513216 22255 raft_consensus.cc:1240] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:10.467453 23825 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.514557 23669 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.517741 22246 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:10.518172 23884 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:10.518362 23865 consensus_queue.cc:237] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.519174 23860 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:10.527341 23802 consensus_meta.cc:287] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.009s
I20260709 13:06:10.527948 23802 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:10.529379 22250 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 2: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:10.523293 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:10.532635 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.530519 23802 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:10.516584 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:10.497282 23683 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.538738 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.531988 23885 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:10.541335 23712 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:10.536355 23782 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:10.543565 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:10.557775 22179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57856 (request call id 175) took 2083 ms (client timeout 1503 ms). Trace:
W20260709 13:06:10.558462 22179 rpcz_store.cc:269] 0709 13:06:08.474282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.474464 (+   182us) service_pool.cc:224] Handling call
0709 13:06:10.543438 (+2068974us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5800165698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:10.557717 (+ 14279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48358272}
I20260709 13:06:10.558777 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:10.559607 22103 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.540570 22173 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:10.543269 23728 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:10.561056 23733 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.562008 23859 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:10.561097 23863 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:10.543898 23828 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:10.544983 23873 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:10.549549 23683 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:10.566111 22179 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:10.566429 23825 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:10.566768 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1342) took 1899 ms. Trace:
I20260709 13:06:10.567129 22179 rpcz_store.cc:276] 0709 13:06:08.667650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.559125 (+1891475us) service_pool.cc:224] Handling call
0709 13:06:10.565949 (+  6824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.566529 (+   580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.566715 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.569679 23861 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:10.540215 23796 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:10.570744 22249 raft_consensus.cc:1240] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:10.570518 22103 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:10.571826 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.572108 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.572476 22103 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:10.575918 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:10.577376 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 234) took 1565 ms. Trace:
I20260709 13:06:10.577060 23835 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:10.577705 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:10.578215 22104 raft_consensus.cc:2368] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
I20260709 13:06:10.578509 22811 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.535291 23826 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:10.578758 23656 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.546751 23672 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:10.590044 22181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 1650) took 1555 ms (client timeout 1813 ms). Trace:
W20260709 13:06:10.590441 22181 rpcz_store.cc:269] 0709 13:06:09.034685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.112282 (+ 77597us) service_pool.cc:224] Handling call
0709 13:06:10.589859 (+1477577us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54003287d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:10.589993 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425307520}
I20260709 13:06:10.548233 23564 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:10.591799 22181 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:10.592077 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.592391 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1344) took 1924 ms. Trace:
I20260709 13:06:10.592888 22101 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:06:10.592728 22181 rpcz_store.cc:276] 0709 13:06:08.668166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.591277 (+1923111us) service_pool.cc:224] Handling call
0709 13:06:10.591592 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.592167 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.592345 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.594245 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1346) took 1925 ms. Trace:
I20260709 13:06:10.594470 22181 rpcz_store.cc:276] 0709 13:06:08.668636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.593515 (+1924879us) service_pool.cc:224] Handling call
0709 13:06:10.593764 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.593917 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.593940 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.593980 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:10.594007 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.594090 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.594198 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.577737 22253 rpcz_store.cc:276] 0709 13:06:09.012185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.144264 (+132079us) service_pool.cc:224] Handling call
0709 13:06:09.268399 (+124135us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.382614 (+114215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.382684 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.400875 (+ 18191us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.281476 (+880601us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:10.281526 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.281610 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.310728 (+ 29118us) raft_consensus.cc:1685] finished
0709 13:06:10.310761 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.577134 (+266373us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b540005d7d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:10.577322 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":181165,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5512,"spinlock_wait_cycles":77504896,"thread_start_us":943097,"threads_started":2,"wal-append.queue_time_us":876129}
I20260709 13:06:10.562624 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.581981 22179 raft_consensus.cc:1217] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[2.5-2.5]   Dedup: 2.5->[]
I20260709 13:06:10.584923 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:10.587759 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:10.571875 23849 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:10.596583 22179 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:10.596879 22103 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.606139 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 223) took 1250 ms. Trace:
I20260709 13:06:10.606573 22101 rpcz_store.cc:276] 0709 13:06:09.356182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.591842 (+1235660us) service_pool.cc:224] Handling call
0709 13:06:10.606055 (+ 14213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.607275 23672 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:10.608264 23863 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:10.550004 23795 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:10.609247 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:10.609637 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1343) took 1941 ms. Trace:
I20260709 13:06:10.609992 22179 rpcz_store.cc:276] 0709 13:06:08.667923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.567953 (+1900030us) service_pool.cc:224] Handling call
0709 13:06:10.568287 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.609401 (+ 41114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.609584 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.611629 23672 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:10.611881 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1353) took 1812 ms. Trace:
I20260709 13:06:10.612438 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.612226 22181 rpcz_store.cc:276] 0709 13:06:08.799779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.611150 (+1811371us) service_pool.cc:224] Handling call
0709 13:06:10.611398 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.611588 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.611613 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.611652 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:10.611684 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.611738 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.611832 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.615082 22181 raft_consensus.cc:1240] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:10.615669 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1644) took 1585 ms. Trace:
I20260709 13:06:10.615952 22181 rpcz_store.cc:276] 0709 13:06:09.030084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.614402 (+1584318us) service_pool.cc:224] Handling call
0709 13:06:10.614711 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.615445 (+   734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.615621 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.616518 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:10.618045 22814 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:10.618760 22179 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:10.619098 22177 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:10.619354 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1356) took 1680 ms. Trace:
I20260709 13:06:10.619693 22179 rpcz_store.cc:276] 0709 13:06:08.939080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.618284 (+1679204us) service_pool.cc:224] Handling call
0709 13:06:10.618551 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.619131 (+   580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.619306 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.620695 22179 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:10.621182 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1646) took 1589 ms. Trace:
I20260709 13:06:10.621446 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.621632 22179 rpcz_store.cc:276] 0709 13:06:09.031808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.620323 (+1588515us) service_pool.cc:224] Handling call
0709 13:06:10.620546 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.620987 (+   441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.621125 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.622524 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.548763 23680 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.621244 22218 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:10.625064 23680 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:10.625576 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1358) took 1573 ms. Trace:
I20260709 13:06:10.626081 23861 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:10.625933 22177 rpcz_store.cc:276] 0709 13:06:09.051943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.261891 (+1209948us) service_pool.cc:224] Handling call
0709 13:06:10.609040 (+347149us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b5800165698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:10.625493 (+ 16453us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4392704}
I20260709 13:06:10.626554 22103 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:10.627416 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.627895 22253 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:10.628153 22103 raft_consensus.cc:2410] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:10.623287 22101 raft_consensus.cc:2410] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:10.618045 22181 raft_consensus.cc:1240] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:10.629658 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1645) took 1598 ms. Trace:
I20260709 13:06:10.629988 22181 rpcz_store.cc:276] 0709 13:06:09.031032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.617267 (+1586235us) service_pool.cc:224] Handling call
0709 13:06:10.617893 (+   626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.629432 (+ 11539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.629607 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.628755 22254 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:10.630910 22180 raft_consensus.cc:2393] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 2: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:10.628989 22253 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:10.617173 22808 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:10.628916 22103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:06:10.623255 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1647) took 1590 ms. Trace:
I20260709 13:06:10.632946 22179 rpcz_store.cc:276] 0709 13:06:09.032493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.622323 (+1589830us) service_pool.cc:224] Handling call
0709 13:06:10.622562 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.622744 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.622767 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.623027 (+   260us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:10.623064 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.623113 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.623212 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.606696 23826 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:10.634508 22179 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:10.632812 22103 raft_consensus.cc:606] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:10.635088 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1651) took 1600 ms. Trace:
I20260709 13:06:10.635676 22179 rpcz_store.cc:276] 0709 13:06:09.035072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.633931 (+1598859us) service_pool.cc:224] Handling call
0709 13:06:10.634198 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.634822 (+   624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.634989 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.643797 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1653) took 1608 ms. Trace:
I20260709 13:06:10.644630 22179 rpcz_store.cc:276] 0709 13:06:09.035758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.636442 (+1600684us) service_pool.cc:224] Handling call
0709 13:06:10.636700 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.643459 (+  6759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.643485 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.643526 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:10.643556 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.643618 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.643743 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.551956 23872 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.631667 23672 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:10.635277 23866 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:10.670547 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:10.671803 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:10.672358 22813 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.674322 23656 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:10.677780 23669 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.679509 23733 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:10.664690 23672 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:10.691394 23830 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:10.715107 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:10.660902 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:10.647346 22179 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:10.717243 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:10.717512 22813 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:10.719043 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:10.722256 22779 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:10.724696 23863 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.727556 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:10.728730 22816 raft_consensus.cc:1240] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:10.726233 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1657) took 1689 ms. Trace:
I20260709 13:06:10.728523 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:10.729640 22814 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:10.730706 22253 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:10.727384 22254 raft_consensus.cc:2410] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:10.731436 22179 rpcz_store.cc:276] 0709 13:06:09.037065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.646513 (+1609448us) service_pool.cc:224] Handling call
0709 13:06:10.646897 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.724123 (+ 77226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.726180 (+  2057us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:10.726548 23887 log.cc:927] Time spent T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.399s	user 0.009s	sys 0.000s
I20260709 13:06:10.732461 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:10.738812 22174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1349) took 2069 ms (client timeout 1600 ms). Trace:
I20260709 13:06:10.737289 22814 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:10.751681 22813 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:10.730152 23717 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.739931 22179 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:10.753516 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:10.757026 22253 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:10.758276 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:10.730037 23734 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:10.759492 23770 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:06:10.739053 23856 consensus_queue.cc:1059] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 13:06:10.739416 22174 rpcz_store.cc:269] 0709 13:06:08.669376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.696284 (+ 26908us) service_pool.cc:224] Handling call
0709 13:06:10.738588 (+2042304us) spinlock_profiling.cc:243] Waited 8.87 ms on lock 0x7b540003c354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:10.738737 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20395776}
I20260709 13:06:10.763958 23856 raft_consensus.cc:3055] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:10.740031 23835 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:10.732973 23863 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:10.767454 22253 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:10.775193 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 236) took 1097 ms. Trace:
I20260709 13:06:10.735512 23826 consensus_queue.cc:1059] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:06:10.756409 22072 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:10.799757 22104 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:06:10.800972 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.802404 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1649) took 1768 ms. Trace:
I20260709 13:06:10.796653 22248 rpcz_store.cc:276] 0709 13:06:09.677433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.677594 (+   161us) service_pool.cc:224] Handling call
0709 13:06:09.677914 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.776637 (+ 98723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.776684 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.791227 (+ 14543us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.291992 (+500765us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:10.292050 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.664454 (+372404us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:10.762727 (+ 98273us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b54002283d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:10.762775 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.774913 (+ 12138us) raft_consensus.cc:1685] finished
0709 13:06:10.774947 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.775117 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5416,"raft.queue_time_us":175973,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":2022,"spinlock_wait_cycles":46091264,"thread_start_us":549430,"threads_started":2,"wal-append.queue_time_us":513580}
I20260709 13:06:10.800719 22072 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:10.804122 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:10.804760 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.805546 22248 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:10.805855 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:10.803160 22181 rpcz_store.cc:276] 0709 13:06:09.033870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.630753 (+1596883us) service_pool.cc:224] Handling call
0709 13:06:10.631016 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.631191 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:10.632175 (+   984us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.802021 (+169846us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.802092 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:10.802148 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.802227 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.802339 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1168,"prepare.run_cpu_time_us":2348,"prepare.run_wall_time_us":5874,"raft.queue_time_us":73,"thread_start_us":169531,"threads_started":1}
I20260709 13:06:10.807937 22253 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:06:10.811599 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:10.814759 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:10.760030 22172 raft_consensus.cc:2393] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 3: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:10.809123 22072 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:10.815366 22253 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:10.816238 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:10.816767 22253 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:10.817514 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:10.818666 22181 raft_consensus.cc:1240] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:10.819437 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1662) took 1778 ms. Trace:
I20260709 13:06:10.823926 22181 rpcz_store.cc:276] 0709 13:06:09.041024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.812237 (+1771213us) service_pool.cc:224] Handling call
0709 13:06:10.818450 (+  6213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.819168 (+   718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.819375 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.767694 23856 raft_consensus.cc:740] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:10.813030 23832 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.831110 23669 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:10.764230 22811 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:10.832221 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1628) took 1039 ms. Trace:
I20260709 13:06:10.835909 22251 rpcz_store.cc:276] 0709 13:06:09.792408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.615587 (+823179us) service_pool.cc:224] Handling call
0709 13:06:10.615962 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.616345 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.616386 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.616988 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.722838 (+105850us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:10.722866 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.722913 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.831970 (+109057us) raft_consensus.cc:1685] finished
0709 13:06:10.831997 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.832149 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":689,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":105478,"threads_started":1,"wal-append.queue_time_us":197491}
I20260709 13:06:10.838022 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:10.786088 23872 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:10.840829 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:10.828011 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:10.813712 23836 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:06:10.828845 23835 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:10.838689 22251 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.832753 23830 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.880512 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 226) took 1523 ms. Trace:
I20260709 13:06:10.866709 22248 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:10.868556 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 177) took 2330 ms. Trace:
I20260709 13:06:10.890728 22178 rpcz_store.cc:276] 0709 13:06:08.538203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.546045 (+  7842us) service_pool.cc:224] Handling call
0709 13:06:08.793762 (+247717us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b5800165698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:08.793941 (+   179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.043689 (+249748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.043726 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.044145 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.137683 (+ 93538us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:09.137745 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.868250 (+1730505us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540013db54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:10.868322 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.868361 (+    39us) raft_consensus.cc:1685] finished
0709 13:06:10.868372 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.868504 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3196,"raft.queue_time_us":20685,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":15477,"spinlock_wait_cycles":600989184,"thread_start_us":93208,"threads_started":1,"wal-append.queue_time_us":193937,"wal-append.run_cpu_time_us":2495,"wal-append.run_wall_time_us":1218976}
I20260709 13:06:10.953217 22178 raft_consensus.cc:1240] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:10.954162 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1663) took 1420 ms. Trace:
I20260709 13:06:10.954602 22178 rpcz_store.cc:276] 0709 13:06:09.533477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.952537 (+1419060us) service_pool.cc:224] Handling call
0709 13:06:10.952957 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.953802 (+   845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.954084 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.961870 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1664) took 1280 ms. Trace:
I20260709 13:06:10.962531 22178 rpcz_store.cc:276] 0709 13:06:09.680972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.960715 (+1279743us) service_pool.cc:224] Handling call
0709 13:06:10.961155 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.961410 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.961445 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.961511 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:10.961560 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.961639 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.961794 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.965698 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1665) took 1129 ms. Trace:
I20260709 13:06:10.966317 22178 rpcz_store.cc:276] 0709 13:06:09.836824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.964531 (+1127707us) service_pool.cc:224] Handling call
0709 13:06:10.964976 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.965220 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.965262 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.965323 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:10.965371 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.965448 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.965601 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.969146 22251 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:10.875346 23672 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:10.972095 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 105178us
I20260709 13:06:10.944716 23795 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.887957 23835 raft_consensus.cc:697] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:10.889125 23861 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.981029 22178 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:10.983290 23907 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:06:10.988572 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1612) took 1201 ms. Trace:
I20260709 13:06:10.989985 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1617) took 1201 ms. Trace:
I20260709 13:06:10.995697 22249 rpcz_store.cc:276] 0709 13:06:09.788450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.510130 (+721680us) service_pool.cc:224] Handling call
0709 13:06:10.513528 (+  3398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.571303 (+ 57775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.989680 (+418377us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b54003bc754. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:10.989907 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131217664}
I20260709 13:06:10.994630 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1666) took 1148 ms. Trace:
I20260709 13:06:10.992964 23795 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.997642 22246 rpcz_store.cc:276] 0709 13:06:09.786825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.425520 (+638695us) service_pool.cc:224] Handling call
0709 13:06:10.425862 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.532656 (+106794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.988169 (+455513us) spinlock_profiling.cc:243] Waited 89 ms on lock 0x7b54001b03d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:10.988474 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204727552}
I20260709 13:06:11.002199 23835 consensus_queue.cc:237] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:10.973836 23856 consensus_queue.cc:260] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:11.003942 23545 raft_consensus.cc:3055] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:11.004245 23856 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:11.004606 23545 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:11.005784 23545 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:11.007377 23863 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:11.008419 23795 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:11.012682 23847 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 1.684s	user 0.004s	sys 0.006s
I20260709 13:06:11.014120 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1325) took 2589 ms. Trace:
I20260709 13:06:11.014520 22105 rpcz_store.cc:276] 0709 13:06:08.424426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.424560 (+   134us) service_pool.cc:224] Handling call
0709 13:06:08.424899 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.468189 (+ 43290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.468235 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:08.468781 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:06:08.795171 (+326390us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b18003f0ee0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee0d1 00007f66a7f09a0f
0709 13:06:09.015159 (+219988us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:09.015213 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.015300 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.011914 (+1996614us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:11.013823 (+  1909us) raft_consensus.cc:1685] finished
0709 13:06:11.013850 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.014023 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7901,"raft.queue_time_us":34857,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":84274,"spinlock_wait_cycles":9302144,"thread_start_us":219794,"threads_started":1,"wal-append.queue_time_us":776570}
I20260709 13:06:11.016660 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.017194 22105 raft_consensus.cc:2376] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4. Re-sending same reply.
I20260709 13:06:11.049217 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:10.999516 22178 rpcz_store.cc:276] 0709 13:06:09.846729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.979658 (+1132929us) service_pool.cc:224] Handling call
0709 13:06:10.980757 (+  1099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.994345 (+ 13588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.994569 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:11.056234 22178 raft_consensus.cc:1240] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:11.057171 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1667) took 1202 ms. Trace:
I20260709 13:06:11.060309 22779 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:11.065109 22178 rpcz_store.cc:276] 0709 13:06:09.855006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.055558 (+1200552us) service_pool.cc:224] Handling call
0709 13:06:11.055979 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.056819 (+   840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.057098 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:11.079885 22178 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:11.083438 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1668) took 1225 ms. Trace:
I20260709 13:06:11.085129 22178 rpcz_store.cc:276] 0709 13:06:09.857822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.070309 (+1212487us) service_pool.cc:224] Handling call
0709 13:06:11.070735 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.081561 (+ 10826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.083352 (+  1791us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:11.093164 22178 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:11.105659 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:11.090785 23545 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:11.107712 23911 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:06:11.109506 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1261) took 1315 ms. Trace:
W20260709 13:06:11.119287 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 59052.4us
I20260709 13:06:11.119844 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1363) took 1241 ms. Trace:
I20260709 13:06:10.998031 23861 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:11.120416 22102 rpcz_store.cc:276] 0709 13:06:09.878095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.118712 (+1240617us) service_pool.cc:224] Handling call
0709 13:06:11.119158 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.119410 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.119447 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.119505 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:11.119550 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.119623 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.119771 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:11.121778 23914 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:06:11.158174 22248 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:06:11.158317 22813 raft_consensus.cc:1240] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:11.158784 22248 pending_rounds.cc:85] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 5
I20260709 13:06:11.159052 22248 pending_rounds.cc:107] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:06:11.159276 22248 raft_consensus.cc:2889] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:11.125788 23681 raft_consensus.cc:2764] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:06:11.109902 22098 rpcz_store.cc:276] 0709 13:06:09.794328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.662719 (+868391us) service_pool.cc:224] Handling call
0709 13:06:10.716498 (+ 53779us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.732872 (+ 16374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.735237 (+  2365us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.739163 (+  3926us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.868296 (+129133us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:10.870901 (+  2605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.873323 (+  2422us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.109254 (+235931us) raft_consensus.cc:1685] finished
0709 13:06:11.109278 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.109440 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":105132,"threads_started":1,"wal-append.queue_time_us":130598}
I20260709 13:06:11.124987 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 263) took 1187 ms. Trace:
W20260709 13:06:11.134488 22175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1351) took 2438 ms (client timeout 1767 ms). Trace:
I20260709 13:06:11.173650 23833 consensus_queue.cc:1059] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:06:11.222596 22144 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:11.223984 22144 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:11.226521 22812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 257) took 1357 ms. Trace:
I20260709 13:06:11.230947 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:11.227114 22812 rpcz_store.cc:276] 0709 13:06:09.868616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.868782 (+   166us) service_pool.cc:224] Handling call
0709 13:06:09.900950 (+ 32168us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.465954 (+565004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.226174 (+760220us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b5400736c54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:11.226439 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280555264}
W20260709 13:06:11.234230 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.232401 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 227) took 1504 ms. Trace:
I20260709 13:06:11.244169 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:11.240298 22106 rpcz_store.cc:276] 0709 13:06:09.728337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.655234 (+926897us) service_pool.cc:224] Handling call
0709 13:06:10.655689 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.656120 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.656159 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.664964 (+  8805us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.813059 (+148095us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:10.813097 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.813158 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.232137 (+418979us) raft_consensus.cc:1685] finished
0709 13:06:11.232168 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.232326 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1674,"raft.queue_time_us":2077,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":3825,"thread_start_us":86440,"threads_started":1,"wal-append.queue_time_us":145921}
I20260709 13:06:11.266853 22144 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:11.132326 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1364) took 1254 ms. Trace:
I20260709 13:06:11.269956 22102 rpcz_store.cc:276] 0709 13:06:09.878368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.131293 (+1252925us) service_pool.cc:224] Handling call
0709 13:06:11.131708 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.131928 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.131965 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.132017 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:11.132044 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.132106 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.132257 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:11.245164 23863 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:11.237361 23606 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:11.315773 22144 leader_election.cc:400] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
I20260709 13:06:11.316741 22144 leader_election.cc:403] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:11.260785 23839 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:11.316309 23915 log.cc:927] Time spent T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
W20260709 13:06:11.200373 22175 rpcz_store.cc:269] 0709 13:06:08.688734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.077824 (+389090us) service_pool.cc:224] Handling call
0709 13:06:11.096865 (+2019041us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b540028d054. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:11.122134 (+ 25269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4440320}
I20260709 13:06:11.322392 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:11.276674 23872 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:11.324357 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:11.286398 23669 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:11.291731 23863 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:11.321162 23564 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.310619 23606 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:11.355703 23606 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.360492 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:11.362432 23919 log.cc:927] Time spent T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:06:11.367431 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:11.368310 22176 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:11.327129 23872 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:11.198096 22807 rpcz_store.cc:276] 0709 13:06:09.937415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.953225 (+ 15810us) service_pool.cc:224] Handling call
0709 13:06:11.105414 (+1152189us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:11.117331 (+ 11917us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132657536}
I20260709 13:06:11.354816 23863 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:11.358748 23669 raft_consensus.cc:697] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:11.379596 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.372414 23872 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.397708 22072 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:11.416646 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.379776 23861 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:11.422425 22099 raft_consensus.cc:1240] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:11.423391 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 217) took 2144 ms. Trace:
I20260709 13:06:11.423810 22099 rpcz_store.cc:276] 0709 13:06:09.279058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.279216 (+   158us) service_pool.cc:224] Handling call
0709 13:06:10.199560 (+920344us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b5800003398. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:11.421960 (+1222400us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b5800003398. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29e9c 00007f66a4e29a5b 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:11.422210 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.423023 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.423315 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85331072}
W20260709 13:06:11.429739 23865 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.051s	sys 0.075s
W20260709 13:06:11.428884 21991 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 252049d2bcdd4f329ca5015bf10c1b19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 765d912bde9e48959e50d9efec3c26b6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:11.413951 23833 consensus_queue.cc:1059] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 13:06:11.436390 23865 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.052s	sys 0.075s
W20260709 13:06:11.439343 23918 log.cc:927] Time spent T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:06:11.434026 23830 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:06:11.443127 23669 consensus_queue.cc:237] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:11.454425 23606 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:11.456655 23606 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:11.440109 23724 consensus_queue.cc:1059] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:06:11.449236 23833 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:11.457919 23833 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:11.458477 23833 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:11.464043 23921 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:06:11.457962 23724 consensus_queue.cc:1243] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:11.463898 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1354) took 1588 ms. Trace:
W20260709 13:06:11.454813 23913 log.cc:927] Time spent T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:06:11.472198 22104 rpcz_store.cc:276] 0709 13:06:09.875502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.806557 (+931055us) service_pool.cc:224] Handling call
0709 13:06:10.812743 (+  6186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.829678 (+ 16935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.829719 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.839354 (+  9635us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.089106 (+249752us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:11.089154 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.089228 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.463652 (+374424us) raft_consensus.cc:1685] finished
0709 13:06:11.463677 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.463838 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16538,"raft.queue_time_us":19637,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":1849,"thread_start_us":217256,"threads_started":1,"wal-append.queue_time_us":296256}
I20260709 13:06:11.480985 23856 raft_consensus.cc:3055] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:11.492156 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 94535.6us
I20260709 13:06:11.493467 22072 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:11.495293 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.495556 23927 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:11.494608 22072 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:11.512228 22072 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:11.514256 22072 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:11.500846 23856 raft_consensus.cc:740] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:11.517050 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 193) took 1092 ms. Trace:
I20260709 13:06:11.482442 23724 raft_consensus.cc:3055] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:11.503933 22176 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:11.504472 22071 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:11.505937 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1263) took 1711 ms. Trace:
W20260709 13:06:11.499550 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 219621us
I20260709 13:06:11.525352 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:11.512235 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 194729us
I20260709 13:06:11.519133 22103 rpcz_store.cc:276] 0709 13:06:09.794880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.665964 (+871084us) service_pool.cc:224] Handling call
0709 13:06:10.666279 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.667307 (+  1028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.716887 (+ 49580us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.717486 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.993532 (+276046us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:10.993596 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.993687 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.505641 (+511954us) raft_consensus.cc:1685] finished
0709 13:06:11.505671 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.505866 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2661,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":243658,"threads_started":1,"wal-append.queue_time_us":530405}
I20260709 13:06:11.518256 22178 rpcz_store.cc:276] 0709 13:06:10.426878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.138868 (+711990us) service_pool.cc:224] Handling call
0709 13:06:11.139266 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.139504 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:11.155768 (+ 16264us) log.cc:844] Serialized 14 byte log entry
0709 13:06:11.510465 (+354697us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.510546 (+    81us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:11.510608 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.516805 (+  6197us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.516968 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18423,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":35176,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":65,"thread_start_us":354210,"threads_started":2,"wal-append.queue_time_us":341952}
I20260709 13:06:11.530580 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:11.530686 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:11.531251 22178 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:11.532054 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:11.533154 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.534783 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:11.540012 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:11.541139 22176 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:11.542497 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:11.544111 22178 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.511317 23927 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.558185 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:11.558405 22072 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:11.560917 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.559849 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:11.558405 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 59547.2us
I20260709 13:06:11.534180 23830 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:11.539158 23839 raft_consensus.cc:697] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:11.559684 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:11.564621 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.565977 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:11.528836 23724 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:11.563030 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:11.534443 23545 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:11.562650 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:11.563144 22071 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:11.568051 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.567991 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:11.566264 23830 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:11.567329 23724 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:11.572854 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:11.588398 22178 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:11.589702 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:11.588845 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:11.591091 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:11.592939 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:11.559921 23927 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.598001 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:11.570185 23545 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:11.600275 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:11.600790 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:11.601397 22176 raft_consensus.cc:2393] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 2: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:11.571656 23839 consensus_queue.cc:237] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:11.559058 23929 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:11.575692 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:11.606892 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1368) took 1354 ms. Trace:
I20260709 13:06:11.606422 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:11.619381 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:11.583561 23830 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:11.623982 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 81459.5us
I20260709 13:06:11.626250 22176 raft_consensus.cc:3055] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:11.624015 22178 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:11.627516 23923 log.cc:927] Time spent T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:06:11.627688 23672 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.628242 23672 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:11.629513 23928 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:11.629997 23928 raft_consensus.cc:697] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:11.630375 23672 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:11.633548 22220 connection.cc:256] RPC call timeout handler was delayed by -1.0114754049999419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 13:06:11.634557 23672 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:11.635140 23672 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:11.637379 22220 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:11.640344 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 82010.9us
I20260709 13:06:11.627107 22176 raft_consensus.cc:740] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:11.579954 23937 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:11.644428 22220 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:11.642748 23865 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:11.643168 22176 consensus_queue.cc:260] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:11.642165 22072 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:11.645354 22178 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:11.619755 23545 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:11.648272 22176 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.649485 22178 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:11.621373 23724 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.622713 23929 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:11.639756 23911 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:11.674202 22220 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:11.641094 23935 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:11.623726 22098 rpcz_store.cc:276] 0709 13:06:10.252735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.205164 (+952429us) service_pool.cc:224] Handling call
0709 13:06:11.257863 (+ 52699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.289371 (+ 31508us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:11.353682 (+ 64311us) log.cc:844] Serialized 14 byte log entry
0709 13:06:11.606358 (+252676us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.606433 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:11.606562 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.606653 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.606816 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7658,"prepare.queue_time_us":17516,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":70092,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":98,"thread_start_us":217975,"threads_started":2,"wal-append.queue_time_us":257041}
I20260709 13:06:11.579015 23856 consensus_queue.cc:260] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:11.647776 23865 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.647953 23861 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:11.689311 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:11.689440 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.690050 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:11.695237 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.644011 23830 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:11.699594 22106 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.673885 23929 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.647053 23863 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:11.707484 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.679785 23937 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:11.714215 23672 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:11.716310 23863 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:11.698369 23865 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:11.719609 23932 log.cc:927] Time spent T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:06:11.630842 23928 consensus_queue.cc:237] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:11.724185 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.718506 23564 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
I20260709 13:06:11.727342 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.727463 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.743666 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.711956 23941 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:11.724619 23856 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.723479 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.725401 23861 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:11.749922 22103 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:11.756276 22144 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:11.759112 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:11.759088 22102 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:11.759795 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:11.761303 22106 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:11.762238 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.763190 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.764374 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:11.746037 22250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1447) took 1487 ms (client timeout 1785 ms). Trace:
W20260709 13:06:11.767584 22250 rpcz_store.cc:269] 0709 13:06:10.258895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.357855 (+ 98960us) service_pool.cc:224] Handling call
0709 13:06:11.741348 (+1383493us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b5400073ad4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:11.744815 (+  3467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162151168}
I20260709 13:06:11.769292 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:11.769896 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:10.881084 22101 rpcz_store.cc:276] 0709 13:06:09.357012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.629579 (+1272567us) service_pool.cc:224] Handling call
0709 13:06:10.629803 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.629965 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:10.801529 (+171564us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.880039 (+ 78510us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.880110 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:10.880167 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.880258 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.880424 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":198632,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":124,"thread_start_us":249242,"threads_started":2}
I20260709 13:06:11.751543 23947 consensus_queue.cc:1059] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:11.753885 22782 connection.cc:256] RPC call timeout handler was delayed by -1.0705454599999484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
I20260709 13:06:11.771942 22782 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:11.769376 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:11.775969 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:11.780433 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:11.779660 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:11.781150 22252 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.783720 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.767242 22247 raft_consensus.cc:1240] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:11.784108 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 221116us
I20260709 13:06:11.770684 23946 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.774147 23941 raft_consensus.cc:697] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:11.791280 23946 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:11.791949 23941 consensus_queue.cc:237] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:11.772913 23564 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:11.795311 23564 raft_consensus.cc:697] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:11.797343 23945 raft_consensus.cc:993] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:06:11.796303 23564 consensus_queue.cc:237] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:11.755970 23861 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:11.797842 23945 raft_consensus.cc:1081] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Signalling peer 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:06:11.784281 23814 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:11.780522 23836 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:11.780465 23931 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:11.748399 23872 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:11.807463 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.782292 23936 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:11.731444 23937 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:11.806607 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 132501us
I20260709 13:06:11.789425 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:11.816704 22102 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:11.818001 22102 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:11.787528 23672 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:11.812271 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:11.819725 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.813913 23936 raft_consensus.cc:697] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:11.768143 23935 consensus_queue.cc:1059] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:06:11.814543 22220 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:11.815685 23865 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:11.789609 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:11.804090 23946 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:11.803012 23861 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:11.809756 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:11.827736 23950 consensus_queue.cc:1059] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:06:11.835057 23865 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:11.835810 23865 raft_consensus.cc:3055] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:11.835915 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 183) took 3189 ms. Trace:
I20260709 13:06:11.825243 23672 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:11.836366 22173 rpcz_store.cc:276] 0709 13:06:08.646831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.512415 (+1865584us) service_pool.cc:224] Handling call
0709 13:06:10.512705 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.560778 (+ 48073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.835651 (+1274873us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b540013e554. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:11.835848 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52140928}
I20260709 13:06:11.837462 23955 consensus_queue.cc:1059] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:11.839186 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 161243us
I20260709 13:06:11.814838 23931 raft_consensus.cc:697] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:11.842181 22252 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:11.836266 23865 raft_consensus.cc:740] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:11.806707 23545 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:11.835947 23951 raft_consensus.cc:3055] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:11.866117 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 78875.7us
I20260709 13:06:11.829103 22811 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:11.841689 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57856 (request call id 191) took 1424 ms. Trace:
I20260709 13:06:11.864138 22174 raft_consensus.cc:1240] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:11.828966 23836 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 13:06:11.869045 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 47045.7us
I20260709 13:06:11.874440 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:11.880859 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:11.885757 22816 raft_consensus.cc:2393] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:11.867930 23830 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:11.870507 23951 raft_consensus.cc:740] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:11.820852 23936 consensus_queue.cc:237] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:11.870798 23952 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:06:11.879725 23955 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:06:11.898695 23931 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:11.878872 23733 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:06:11.909730 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:11.893659 23953 log.cc:927] Time spent T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:06:11.907702 22781 leader_election.cc:336] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.503s (SENT)
I20260709 13:06:11.878680 22172 rpcz_store.cc:276] 0709 13:06:10.414099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.506811 (+ 92712us) service_pool.cc:224] Handling call
0709 13:06:11.838402 (+1331591us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540031b5d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:11.838611 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439131008}
I20260709 13:06:11.913323 22781 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:11.903160 23789 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:11.947134 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 62612.8us
W20260709 13:06:11.953091 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 45408us
W20260709 13:06:11.954136 22781 leader_election.cc:336] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.533s (SENT)
I20260709 13:06:11.960949 22220 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:11.962704 22220 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:11.993357 22781 leader_election.cc:336] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.575s (SENT)
W20260709 13:06:11.994518 22781 leader_election.cc:336] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.799s (SENT)
I20260709 13:06:11.946911 23660 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:11.883651 23865 consensus_queue.cc:260] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:12.000977 23833 consensus_meta.cc:287] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.001s
I20260709 13:06:11.905930 23956 consensus_queue.cc:1059] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 13:06:11.900969 23960 consensus_queue.cc:1059] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:06:12.006422 23833 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:12.013892 23833 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:12.015169 23951 consensus_queue.cc:260] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:12.016103 23965 consensus_queue.cc:1059] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:06:12.016426 22175 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:12.017062 23965 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.017124 23951 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:11.948047 23672 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:06:12.009101 23872 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:12.114837 23545 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:12.121207 23927 consensus_meta.cc:287] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.000s
I20260709 13:06:12.121790 23927 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:12.163358 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 277255us
I20260709 13:06:12.122372 23861 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:12.083240 23836 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:12.167922 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 205314us
I20260709 13:06:12.174113 22220 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:12.175334 22220 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.176415 22220 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.184021 23965 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:12.184945 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 181520us
I20260709 13:06:12.188861 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:12.189723 22102 raft_consensus.cc:2376] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5. Re-sending same reply.
I20260709 13:06:12.147099 23872 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:12.204192 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:12.205715 22103 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:06:12.213626 22815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 591) took 1988 ms. Trace:
I20260709 13:06:12.186214 23969 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:12.173395 23836 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:12.214095 22097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1262) took 2419 ms (client timeout 2181 ms). Trace:
I20260709 13:06:12.206867 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.215070 22220 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.214036 22815 rpcz_store.cc:276] 0709 13:06:10.225273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.319655 (+ 94382us) service_pool.cc:224] Handling call
0709 13:06:10.319968 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.408789 (+ 88821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.408821 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.408859 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:10.408889 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.213390 (+1804501us) spinlock_profiling.cc:243] Waited 88.6 ms on lock 0x7b54005e01d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:12.213436 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.213568 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203783040}
W20260709 13:06:12.216012 22097 rpcz_store.cc:269] 0709 13:06:09.794586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.676627 (+882041us) service_pool.cc:224] Handling call
0709 13:06:12.203957 (+1527330us) spinlock_profiling.cc:243] Waited 8.13 ms on lock 0x7b5800003398. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:12.214031 (+ 10074us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18687872}
W20260709 13:06:12.217226 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 320638us
I20260709 13:06:12.217818 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:12.217126 22220 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.173111 23660 consensus_queue.cc:1059] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:06:12.220700 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:12.220871 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:12.223037 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:12.223999 22101 raft_consensus.cc:2393] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 2: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:12.212860 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:12.213112 23672 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.227262 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:12.216852 23836 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.207427 23872 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:12.238050 22071 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:12.215922 23965 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.235343 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:12.239049 22103 raft_consensus.cc:2393] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 2: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:12.224579 23930 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:12.240378 22071 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:12.241806 22779 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.245110 23969 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:12.245391 23866 raft_consensus.cc:3055] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:12.245834 23866 raft_consensus.cc:740] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:12.246610 23866 consensus_queue.cc:260] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:12.247941 23866 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.249599 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:12.239378 23669 consensus_queue.cc:1059] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:06:12.256845 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:12.255319 23976 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:12.240314 23724 consensus_queue.cc:1059] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:06:12.262375 23976 raft_consensus.cc:697] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:12.263451 23861 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:12.263299 23976 consensus_queue.cc:237] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:12.264948 22071 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:12.268891 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:12.251650 23952 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:12.243168 23930 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:12.256296 23863 raft_consensus.cc:3055] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:12.259768 23660 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:12.305465 23975 log.cc:927] Time spent T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:06:12.294219 23941 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:12.298870 23965 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.296147 23966 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:12.312345 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 404012us
I20260709 13:06:12.255118 23964 consensus_queue.cc:1059] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:06:12.303419 23930 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:12.312902 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 93557.1us
I20260709 13:06:12.303791 23863 raft_consensus.cc:740] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:12.313596 23965 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:12.335318 22181 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:12.335255 22180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57856 (request call id 187) took 2051 ms (client timeout 1503 ms). Trace:
W20260709 13:06:12.336385 22180 rpcz_store.cc:269] 0709 13:06:10.283467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.287408 (+  3941us) service_pool.cc:224] Handling call
0709 13:06:12.334983 (+2047575us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b540045fbd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:12.335163 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693559680}
I20260709 13:06:12.340826 22781 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.353865 23965 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:12.352972 23660 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:12.357573 23660 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:12.357990 23660 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:12.363790 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 146739us
I20260709 13:06:12.364662 22220 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.367239 22220 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.369762 22220 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:12.369959 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.378096 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:12.379452 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:12.381673 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:12.346108 23863 consensus_queue.cc:260] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:12.329984 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.366783 23976 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.385377 22180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:06:12.368850 23980 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.364905 23872 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:12.387745 22180 raft_consensus.cc:606] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
W20260709 13:06:12.390374 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 60466.3us
I20260709 13:06:12.388700 22220 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.391433 23990 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:12.387218 23977 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:12.392459 22180 raft_consensus.cc:614] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:12.404374 23985 raft_consensus.cc:3055] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:12.404814 23985 raft_consensus.cc:740] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:12.405596 23985 consensus_queue.cc:260] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:12.408631 22220 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:12.428140 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 79229.3us
I20260709 13:06:12.400888 23931 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.416445 23969 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:12.428081 23979 log.cc:927] Time spent T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:06:12.418025 23976 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:12.448794 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.449544 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.451176 22250 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:12.451285 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.452917 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.456198 22252 raft_consensus.cc:2410] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:12.456816 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.457652 22253 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:12.433578 22173 raft_consensus.cc:1240] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:12.444051 23925 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.932s	user 0.010s	sys 0.000s
W20260709 13:06:12.447693 23540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.067s	user 0.018s	sys 0.027s
I20260709 13:06:12.462296 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.463090 22250 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:12.466827 23983 log.cc:927] Time spent T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:06:12.461611 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.467417 22246 raft_consensus.cc:2376] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5. Re-sending same reply.
I20260709 13:06:12.468560 22246 raft_consensus.cc:1240] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:12.469070 23929 consensus_meta.cc:287] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.745s	user 0.012s	sys 0.000s
I20260709 13:06:12.469573 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.469449 23929 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:12.458850 23656 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:12.471712 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.472136 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.462098 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:12.474243 22255 raft_consensus.cc:1240] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:12.474797 22099 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:12.428900 23980 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:06:12.478142 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.478900 22249 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:12.479871 22252 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:12.483222 22072 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:12.486058 22072 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:12.475660 23540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.095s	user 0.018s	sys 0.028s
I20260709 13:06:12.491303 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1358) took 2614 ms. Trace:
I20260709 13:06:12.493335 22105 rpcz_store.cc:276] 0709 13:06:09.876652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.072156 (+1195504us) service_pool.cc:224] Handling call
0709 13:06:11.092042 (+ 19886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:11.099443 (+  7401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.099490 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:11.145890 (+ 46400us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.376243 (+230353us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:11.422767 (+ 46524us) log.cc:844] Serialized 14 byte log entry
0709 13:06:11.541277 (+118510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.541380 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.409993 (+868613us) spinlock_profiling.cc:243] Waited 9.69 ms on lock 0x7b240011f048. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4ce79c4 00007f66a4ce5acb 00007f66a4ea0dc9 00007f66a4ea0a55 00007f66a4ea009d 00007f66a7ad210e 00007f66a7ae988c 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221
0709 13:06:12.475040 (+ 65047us) raft_consensus.cc:1685] finished
0709 13:06:12.491112 (+ 16072us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.491248 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":459,"prepare.queue_time_us":46686,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":1247,"raft.queue_time_us":52617,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":25482,"spinlock_wait_cycles":22281088,"thread_start_us":301486,"threads_started":2,"wal-append.queue_time_us":322025}
I20260709 13:06:12.492113 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:12.462064 23976 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:12.470701 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:12.506660 23986 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:12.536713 22250 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:12.485575 22253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:51872
I20260709 13:06:12.538112 22253 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:12.538599 22253 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.538654 22072 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:12.507933 23912 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 1.536s	user 0.009s	sys 0.005s
I20260709 13:06:12.516660 23964 consensus_queue.cc:1059] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:12.546052 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.516850 22004 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40946 (request call id 275) took 8616 ms. Trace:
I20260709 13:06:12.491180 23832 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.519968 22002 catalog_manager.cc:5697] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 2, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:12.521307 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:06:12.522615 23856 consensus_meta.cc:287] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.774s	user 0.011s	sys 0.001s
I20260709 13:06:12.523275 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1613) took 2736 ms. Trace:
I20260709 13:06:12.524679 23836 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:12.499835 21991 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 252049d2bcdd4f329ca5015bf10c1b19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 765d912bde9e48959e50d9efec3c26b6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:12.485124 23575 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:12.485317 23660 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:12.527364 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:12.527894 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.555259 23994 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.541006 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:12.529116 23937 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:12.563920 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.564301 22104 raft_consensus.cc:2410] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:12.590070 22172 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:12.590585 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.591367 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1273) took 1031 ms. Trace:
I20260709 13:06:12.591709 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.592118 22106 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:06:12.592370 22255 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:12.548286 22246 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:12.597474 23927 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:12.598641 23770 raft_consensus.cc:3055] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:12.599041 23770 raft_consensus.cc:740] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:12.599738 23931 consensus_queue.cc:1059] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:12.599979 23770 consensus_queue.cc:260] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:12.600924 23804 raft_consensus.cc:3055] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:12.601308 23804 raft_consensus.cc:740] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:12.601502 23770 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:12.603314 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.604722 22255 raft_consensus.cc:2393] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 2: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:06:12.563758 21991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 72741.8us
I20260709 13:06:12.539970 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.607214 23945 raft_consensus.cc:3055] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:12.592590 22810 raft_consensus.cc:1240] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:12.607651 23945 raft_consensus.cc:740] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:12.608126 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.608503 23945 consensus_queue.cc:260] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:12.609208 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.609735 23945 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:12.610258 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:12.568423 23991 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:06:12.569031 23660 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:12.569186 23744 raft_consensus.cc:3055] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:12.569613 23962 raft_consensus.cc:3055] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:12.611713 23744 raft_consensus.cc:740] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:12.612015 23962 raft_consensus.cc:740] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:12.613014 23734 raft_consensus.cc:3055] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:12.612881 23962 consensus_queue.cc:260] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:12.614111 22250 raft_consensus.cc:2368] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
I20260709 13:06:12.614188 23962 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.570241 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.615145 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.615419 22249 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:12.616401 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.617067 22249 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:12.616375 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.617614 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:12.617921 22255 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:12.618719 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.619298 22255 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:12.619233 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:12.620177 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.557747 23935 consensus_queue.cc:1059] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:06:12.561939 22247 rpcz_store.cc:276] 0709 13:06:09.787233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.485039 (+697806us) service_pool.cc:224] Handling call
0709 13:06:11.743187 (+1258148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.790614 (+ 47427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.523027 (+732413us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400073ad0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:12.523196 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2888979328}
I20260709 13:06:12.573702 23966 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:12.565707 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 209023us
I20260709 13:06:12.578955 23832 raft_consensus.cc:3055] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:12.628763 23832 raft_consensus.cc:740] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:12.580713 23836 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:12.581187 23929 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:12.582048 22808 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:12.630436 23832 consensus_queue.cc:260] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:12.637737 23832 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.624569 23930 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:12.564167 23835 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:12.639539 23835 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:12.639976 23835 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.640021 23930 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:12.583649 22101 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:12.592489 22106 pending_rounds.cc:85] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 3
I20260709 13:06:12.644152 22106 pending_rounds.cc:107] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:06:12.644440 22106 raft_consensus.cc:2889] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:12.645221 23865 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.552927 23807 consensus_queue.cc:1059] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:06:12.593644 22816 raft_consensus.cc:2410] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 6 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:12.591719 22104 rpcz_store.cc:276] 0709 13:06:11.560239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.560387 (+   148us) service_pool.cc:224] Handling call
0709 13:06:12.591174 (+1030787us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b5400022454. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:12.591311 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2288148864}
I20260709 13:06:12.602340 23994 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:12.602070 23804 consensus_queue.cc:260] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:12.612594 23744 consensus_queue.cc:260] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:12.613394 23734 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:12.569521 22809 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:12.570683 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1659) took 3532 ms. Trace:
I20260709 13:06:12.569892 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:12.616690 22253 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:12.547209 22004 rpcz_store.cc:276] 0709 13:06:03.900329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.950184 (+ 49855us) service_pool.cc:224] Handling call
0709 13:06:06.823866 (+2873682us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b5400030800. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66ab8b8161 00007f66ab98cb89 00007f66ab9827ad 00007f66ab943e0b 00007f66ab943be4 00007f66ade442d1 00007f66ade44b2f 00007f66add03d4b 00007f66ade0bc3e 00007f66ac2cc2a4 00007f66ac2cc232
0709 13:06:12.516741 (+5692875us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:08.226446 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:08.239976 (+ 13530us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:08.240019 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:06:08.240037 (+    18us) tablet.cc:662] Decoding operations
0709 13:06:08.240669 (+   632us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:08.240747 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:08.240793 (+    46us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:06:08.241239 (+   446us) tablet.cc:701] Row locks acquired
0709 13:06:08.241260 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:08.360625 (+119365us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b2c00047a38. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6856a0a 00007f66a6856693 00007f66a6856631 00007f66a7f89902 00007f66a7f896dd 00007f66ab984243 00007f66ab983d58 00007f66ab9889f1 00007f66ab9889a9 00007f66ab988939
0709 13:06:08.360732 (+   107us) write_op.cc:270] Start()
0709 13:06:08.361009 (+   277us) write_op.cc:276] Timestamp: P: 1783602368245485 usec, L: 0
0709 13:06:08.361045 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:06:08.559451 (+198406us) log.cc:844] Serialized 1308 byte log entry
0709 13:06:09.441073 (+881622us) op_driver.cc:464] REPLICATION: finished
0709 13:06:09.857772 (+416699us) write_op.cc:301] APPLY: starting
0709 13:06:09.857854 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:09.857996 (+   142us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:09.858018 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:09.899667 (+ 41649us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:09.899874 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:06:09.899948 (+    74us) write_op.cc:312] APPLY: finished
0709 13:06:09.900245 (+   297us) log.cc:844] Serialized 35 byte log entry
0709 13:06:09.900432 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:09.900536 (+   104us) write_op.cc:454] Released schema lock
0709 13:06:09.900595 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:10.544912 (+644317us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b540001de54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f49e28 00007f66ab984581 00007f66ab983d58 00007f66ab9889f1 00007f66ab9889a9 00007f66ab988939 00007f66ab988901 00007f66ab987b2d 000000000038f354 000000000038f199
0709 13:06:10.545213 (+   301us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:10.545246 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"spinlock_wait_cycles":8064384,"child_traces":[["op",{"apply.queue_time_us":406257,"apply.run_cpu_time_us":3217,"apply.run_wall_time_us":68371,"num_ops":3,"prepare.queue_time_us":1322518,"prepare.run_cpu_time_us":47576,"prepare.run_wall_time_us":2340065,"raft.queue_time_us":268313,"raft.run_cpu_time_us":34875,"raft.run_wall_time_us":446933,"replication_time_us":1020303,"spinlock_wait_cycles":85753984,"thread_start_us":1851523,"threads_started":4,"wal-append.queue_time_us":452380,"wal-append.run_cpu_time_us":25260,"wal-append.run_wall_time_us":1926888}]]}
I20260709 13:06:12.621279 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 1678) took 1335 ms. Trace:
W20260709 13:06:12.621582 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.617942 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.622435 23944 raft_consensus.cc:3055] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:12.616523 23976 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:12.622717 22246 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:12.624933 22255 raft_consensus.cc:2410] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:12.567203 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 125730us
I20260709 13:06:12.631675 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.762238 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:12.674296 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1638) took 1945 ms. Trace:
I20260709 13:06:12.736590 22072 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:12.649901 22781 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.795773 22179 rpcz_store.cc:276] 0709 13:06:09.038178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.757289 (+1719111us) service_pool.cc:224] Handling call
0709 13:06:10.757522 (+   233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.757652 (+   130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.757666 (+    14us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.757984 (+   318us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.870772 (+112788us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:10.870822 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.870913 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.507287 (+1636374us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:12.570384 (+ 63097us) raft_consensus.cc:1685] finished
0709 13:06:12.570405 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.570624 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5412608,"thread_start_us":112442,"threads_started":1,"wal-append.queue_time_us":213076}
I20260709 13:06:12.804600 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:12.737202 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:12.803964 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:12.806114 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 365795us
W20260709 13:06:12.803447 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 66953.7us
I20260709 13:06:12.806059 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 268) took 1048 ms. Trace:
I20260709 13:06:12.807389 22179 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:06:12.805545 22253 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:12.806571 22246 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.806392 23944 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:12.796538 22248 rpcz_store.cc:276] 0709 13:06:10.729010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.949097 (+220087us) service_pool.cc:224] Handling call
0709 13:06:10.949641 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.159726 (+210085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.674022 (+1514296us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b5400345dd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:12.674232 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478640000}
W20260709 13:06:12.811127 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.805894 22782 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.726464 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.814447 23814 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.814981 22247 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:12.815490 22100 raft_consensus.cc:2376] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5. Re-sending same reply.
I20260709 13:06:12.816203 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.850613 22249 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:12.817135 22072 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:12.847167 22246 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:12.821362 22069 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:12.854686 22069 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:12.821695 22179 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:12.815853 23993 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.830379 23681 raft_consensus.cc:3055] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:12.740217 23836 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:12.835232 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 185426us
I20260709 13:06:12.866161 22781 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.776074 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1660) took 3737 ms. Trace:
I20260709 13:06:12.662580 23930 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:12.834712 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:12.840106 22252 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:12.871335 22178 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:12.834703 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 203106us
I20260709 13:06:12.845211 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.873584 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.768307 23963 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:12.853253 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.847029 23744 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:12.721681 23916 log.cc:927] Time spent T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 1.310s	user 0.017s	sys 0.037s
I20260709 13:06:12.828701 23945 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:12.884439 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:12.884660 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.884878 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.885412 22248 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.885900 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.828044 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.887518 22255 raft_consensus.cc:2393] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:12.795893 22175 rpcz_store.cc:276] 0709 13:06:11.285780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.354254 (+ 68474us) service_pool.cc:224] Handling call
0709 13:06:12.621125 (+1266871us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b5400069d54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:12.621226 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":888096000}
I20260709 13:06:12.816702 22809 rpcz_store.cc:276] 0709 13:06:11.757688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.768535 (+ 10847us) service_pool.cc:224] Handling call
0709 13:06:12.527260 (+758725us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29eee 0000000000375939 00007f66ace9d1e0 00007f66acf660c4 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:12.805992 (+278732us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4442880}
I20260709 13:06:12.857579 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:12.896921 22179 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:12.860781 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:12.861063 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:12.898633 22101 raft_consensus.cc:2393] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:12.863663 22218 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.899293 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:12.836656 23931 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.900405 22103 raft_consensus.cc:3055] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:12.873442 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.900949 22103 raft_consensus.cc:740] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:12.875622 22072 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:12.823451 23935 consensus_queue.cc:1059] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:12.879740 22246 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:12.888639 22255 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:12.834095 23804 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.888761 22252 raft_consensus.cc:1240] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:12.865271 23928 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:12.865432 23681 raft_consensus.cc:740] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:12.678996 23660 consensus_queue.cc:1059] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
I20260709 13:06:12.939411 22248 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:12.864850 23807 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:12.858131 23826 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:06:12.947224 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:12.893707 22172 raft_consensus.cc:1275] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:12.924959 22178 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:12.929005 22246 raft_consensus.cc:1275] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:12.865495 23927 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.955807 23994 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:12.957675 23994 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.893921 23734 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:12.958626 23734 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.930655 22252 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:12.897617 22097 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:12.902735 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.878861 23836 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:12.872253 23724 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 13:06:12.946244 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 123167us
W20260709 13:06:12.969175 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.972533 22782 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:12.950506 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:12.872040 22100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1356) took 2981 ms (client timeout 2124 ms). Trace:
I20260709 13:06:12.958827 22254 raft_consensus.cc:2410] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:12.922318 22249 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:12.967514 22253 raft_consensus.cc:2410] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:12.928321 23832 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:12.973393 22782 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.952092 22103 consensus_queue.cc:260] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:12.979024 22103 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:06:12.979444 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 113340us
I20260709 13:06:12.980803 22781 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:12.986495 22179 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:12.928756 23945 raft_consensus.cc:697] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:12.988489 22179 raft_consensus.cc:1240] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:12.891533 23930 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:12.942873 23996 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:12.896126 23669 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:06:12.969064 23836 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:12.989367 23927 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:06:12.959656 22175 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:12.963115 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:12.966845 23681 consensus_queue.cc:260] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:13.015045 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:12.993458 23869 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.963972 23575 consensus_queue.cc:1059] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:06:12.999325 23660 raft_consensus.cc:3055] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:12.998624 23951 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:06:12.946652 23931 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:06:12.973327 23807 raft_consensus.cc:697] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:12.873322 22174 rpcz_store.cc:276] 0709 13:06:09.038566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.763954 (+1725388us) service_pool.cc:224] Handling call
0709 13:06:11.840473 (+1076519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.884462 (+ 43989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.775754 (+891292us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540031b5d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:12.775983 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2470956288}
I20260709 13:06:12.927953 23963 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:12.894191 23944 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:13.033066 23744 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:13.037118 23916 log.cc:927] Time spent T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:13.050077 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:13.053452 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 159366us
I20260709 13:06:13.023789 23832 raft_consensus.cc:697] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:13.040438 23660 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:12.992313 23835 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:13.068575 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:13.058940 22247 raft_consensus.cc:2368] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3.
I20260709 13:06:13.077593 22252 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:06:13.080072 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:13.078349 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:13.082617 22248 raft_consensus.cc:2376] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4. Re-sending same reply.
W20260709 13:06:13.084124 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 110789us
I20260709 13:06:13.045122 23869 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:13.060762 24007 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.073092 23744 raft_consensus.cc:697] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:06:13.091061 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 107820us
I20260709 13:06:13.079509 23681 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.096215 23660 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:13.096325 23967 raft_consensus.cc:3055] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:13.099763 23967 raft_consensus.cc:740] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:13.088966 23807 consensus_queue.cc:237] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:13.100596 23967 consensus_queue.cc:260] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:13.096284 24005 log.cc:927] Time spent T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:06:13.103799 23835 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:13.104877 23744 consensus_queue.cc:237] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:13.105772 23962 raft_consensus.cc:3055] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:13.106019 23963 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:13.106228 23962 raft_consensus.cc:740] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:13.075173 23944 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:13.099140 23869 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:13.103125 23832 consensus_queue.cc:237] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:13.074968 23945 consensus_queue.cc:237] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:13.107985 24008 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.108255 24007 consensus_queue.cc:1059] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:06:13.140856 23985 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.143251 23930 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:13.144634 23998 raft_consensus.cc:3055] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:13.145267 23998 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:13.123128 23962 consensus_queue.cc:260] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:13.148640 23962 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.146508 23998 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:13.154942 23998 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.155637 23993 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:12.986184 22100 rpcz_store.cc:269] 0709 13:06:09.875988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.677961 (+801973us) service_pool.cc:224] Handling call
0709 13:06:12.569733 (+1891772us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b5800003398. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:12.855116 (+285383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15743744}
W20260709 13:06:13.190068 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 197967us
I20260709 13:06:13.192514 22072 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:13.196390 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:13.198351 22246 raft_consensus.cc:2393] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 2: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:13.200280 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:13.200671 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1648) took 4167 ms. Trace:
I20260709 13:06:13.202291 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:13.203745 22246 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 2: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:13.083977 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:13.205054 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.205768 22248 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:13.206296 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:13.207201 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:13.208254 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:13.209733 22247 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:13.210470 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:13.192144 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:13.212024 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.212445 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:13.215307 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:13.216852 22249 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:13.219030 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:13.222632 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:13.225304 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:13.225841 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.227716 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1360) took 4148 ms. Trace:
I20260709 13:06:13.228257 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:13.230855 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:13.235714 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:13.237732 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.238157 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:13.239351 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.234272 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:13.240837 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:13.248571 23743 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:13.241959 22175 raft_consensus.cc:1240] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:13.243036 22173 raft_consensus.cc:2393] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:13.201197 22177 rpcz_store.cc:276] 0709 13:06:09.033246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.626866 (+1593620us) service_pool.cc:224] Handling call
0709 13:06:10.627177 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.634708 (+  7531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.634738 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.639657 (+  4919us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.993901 (+354244us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:11.018310 (+ 24409us) log.cc:844] Serialized 14 byte log entry
0709 13:06:11.049092 (+ 30782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.049291 (+   199us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.720937 (+1671646us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:13.199841 (+478904us) raft_consensus.cc:1685] finished
0709 13:06:13.200037 (+   196us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.200367 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4463,"prepare.queue_time_us":6448,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":18334,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":30926,"spinlock_wait_cycles":24427264,"thread_start_us":345698,"threads_started":1,"wal-append.queue_time_us":722066}
I20260709 13:06:13.228307 22181 rpcz_store.cc:276] 0709 13:06:09.078840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.828253 (+1749413us) service_pool.cc:224] Handling call
0709 13:06:12.335142 (+1506889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:12.335974 (+   832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.227138 (+891164us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540045fbd0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:13.227479 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3464828672}
I20260709 13:06:13.247063 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:13.248654 23669 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.248448 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:13.249343 22255 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:13.208616 22248 raft_consensus.cc:2368] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
W20260709 13:06:13.253926 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 420542us
I20260709 13:06:13.284245 23927 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:13.285467 23927 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:13.287461 23951 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.288533 23951 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:13.274945 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:13.254123 23743 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:13.294452 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:13.299929 23807 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:13.304208 23951 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:13.299365 23872 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:13.308068 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:13.309122 22177 raft_consensus.cc:2393] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:13.312000 22179 raft_consensus.cc:1240] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:13.314396 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:13.320976 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.327759 22174 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:06:13.331118 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:13.331934 22816 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:13.335297 23743 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:13.337052 22251 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:13.337471 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 48909.7us
I20260709 13:06:13.338150 23743 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:13.338397 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:13.253579 23669 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:13.306397 23872 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:13.338651 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.355743 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:13.356729 22175 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
W20260709 13:06:13.357560 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 264740us
I20260709 13:06:13.359004 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:13.359234 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:13.360230 22249 raft_consensus.cc:2410] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:13.319353 23807 raft_consensus.cc:697] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:13.362222 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 277180us
I20260709 13:06:13.363412 23807 consensus_queue.cc:237] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:13.364797 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:13.365756 22810 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.366102 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:13.367960 22807 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:13.369765 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:13.366149 22815 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:13.375273 22247 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:13.375638 24019 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:13.376389 22104 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:13.377038 22247 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:13.376444 24019 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:13.379777 22249 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:06:13.381238 22249 pending_rounds.cc:85] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 1
I20260709 13:06:13.370721 22101 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:13.342691 23669 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:13.392119 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:13.393923 23937 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:13.394815 23937 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:13.400482 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.403195 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:13.405064 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:13.405860 22254 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:13.405969 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:13.408684 23927 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:13.386816 22249 pending_rounds.cc:107] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:06:13.410146 22249 raft_consensus.cc:2889] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:13.411068 24019 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:13.411660 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:13.413537 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:13.414057 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:13.414469 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:13.414848 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.414960 22810 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:13.416922 22097 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:13.417423 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:13.417913 23724 raft_consensus.cc:3055] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:13.418113 22104 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.418407 23724 raft_consensus.cc:740] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:13.413339 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:13.421468 22816 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:13.419538 23724 consensus_queue.cc:260] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:13.427779 23724 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.430079 22103 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:13.432574 22809 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:13.434056 22807 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:13.439400 22251 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:13.443720 23672 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.444454 23672 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:13.417465 22099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1370) took 1728 ms (client timeout 2235 ms). Trace:
I20260709 13:06:13.447973 23872 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:13.450256 22177 raft_consensus.cc:1240] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:13.452548 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.453876 22101 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:13.455610 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:13.457677 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:13.460013 22072 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:13.467236 22218 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:13.469228 22218 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:13.470323 23669 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:13.472854 23976 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:13.473083 23967 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.473927 23976 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:13.447759 22099 rpcz_store.cc:269] 0709 13:06:11.688893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.689031 (+   138us) service_pool.cc:224] Handling call
0709 13:06:13.417067 (+1728036us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b540001e854. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:13.417262 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784186240}
I20260709 13:06:13.478790 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:13.479961 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:13.480393 22250 raft_consensus.cc:2410] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:13.480610 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.481431 22071 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:13.483475 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:13.481534 22218 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:13.483777 23962 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:13.486706 23956 consensus_queue.cc:1059] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:13.487964 23956 raft_consensus.cc:3055] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:13.488421 23956 raft_consensus.cc:740] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:13.489287 22246 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:13.489379 23660 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.489506 23956 consensus_queue.cc:260] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:13.491521 23956 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.491873 23863 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.494357 22103 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:13.495992 22099 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:13.424603 23937 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:13.531059 22106 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:06:13.534600 23830 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 3 is higher.
I20260709 13:06:13.446818 23672 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:13.621061 24025 log.cc:927] Time spent T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.093s	user 0.003s	sys 0.000s
W20260709 13:06:13.621816 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 136769us
I20260709 13:06:13.623080 22180 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
W20260709 13:06:13.645180 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 134484us
W20260709 13:06:13.655740 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 138038us
W20260709 13:06:13.652678 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 163842us
W20260709 13:06:13.667889 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.672475 22104 raft_consensus.cc:2410] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:13.657860 22779 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:13.674226 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:13.674300 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 115047us
I20260709 13:06:13.676286 22177 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.683984 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:13.686046 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.655299 23937 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:06:13.700281 22175 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:13.686028 23985 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.702394 23985 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:13.708068 23833 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:13.708954 23985 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:13.711169 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 60921.8us
I20260709 13:06:13.686098 23540 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.721647 23661 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:13.726193 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:13.705055 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:13.726459 23661 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.714236 23672 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.731604 23661 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:13.710723 23952 consensus_queue.cc:1059] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:06:13.756461 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:13.702693 23963 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:06:13.769315 22816 raft_consensus.cc:2393] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:13.772027 22177 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:13.796579 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:13.798188 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.784438 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:13.782249 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:13.804373 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:13.805272 22103 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
W20260709 13:06:13.799922 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 53495.8us
I20260709 13:06:13.724983 23540 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:13.814531 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:13.817685 22103 raft_consensus.cc:2410] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:06:13.820875 23681 consensus_meta.cc:287] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.607s	user 0.007s	sys 0.007s
I20260709 13:06:13.818599 22099 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:13.813575 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 128171us
I20260709 13:06:13.768697 23669 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:06:13.826025 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:13.783257 23672 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:13.833882 23985 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.834933 22814 raft_consensus.cc:1240] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:13.836519 22812 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:13.839702 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:13.835851 24027 log.cc:927] Time spent T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:06:13.834463 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:13.839967 23996 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:13.861027 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 45706.9us
I20260709 13:06:13.834638 23985 consensus_queue.cc:1243] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer c0694f6572bf406a92d55f1f2ab46ef2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:13.847539 23976 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.855019 23937 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.869335 23976 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:13.860306 23993 consensus_queue.cc:1059] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:06:13.869566 23963 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.875381 23804 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:06:13.879145 23789 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:13.880366 23994 consensus_queue.cc:1059] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:13.870748 24024 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:06:13.872648 23997 consensus_queue.cc:1059] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:06:13.878490 22779 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:13.886590 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.888463 22218 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:13.869441 23807 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.893806 23937 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:13.927196 23656 consensus_queue.cc:1059] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:06:13.892889 23830 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 13:06:13.930646 24032 log.cc:927] Time spent T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:06:13.920389 23962 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:13.915408 23669 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:06:13.933720 23835 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.943353 23865 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:13.946786 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1676) took 1187 ms. Trace:
I20260709 13:06:13.922586 23807 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:13.949460 23672 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:13.950995 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:13.952307 23976 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:13.931344 23681 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:13.960631 22071 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:13.969864 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:13.969548 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 199739us
I20260709 13:06:13.939797 23962 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:13.952698 23575 consensus_queue.cc:1059] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:06:13.930763 24023 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:06:13.971889 23833 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:13.955353 22253 rpcz_store.cc:276] 0709 13:06:12.759388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.974810 (+215422us) service_pool.cc:224] Handling call
0709 13:06:12.975170 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:12.975480 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:12.975504 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:12.989833 (+ 14329us) log.cc:844] Serialized 26 byte log entry
0709 13:06:13.398329 (+408496us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b18003f10c0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee0d1 00007f66a7f09a0f
0709 13:06:13.713202 (+314873us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:13.713346 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.717665 (+  4319us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:13.946307 (+228642us) raft_consensus.cc:1685] finished
0709 13:06:13.946326 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.946607 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2884,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":7053,"spinlock_wait_cycles":8625024,"thread_start_us":259224,"threads_started":1,"wal-append.queue_time_us":821064}
I20260709 13:06:13.974484 23540 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:13.976495 23985 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:14.017448 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.966794 23835 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:13.989861 23833 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.024356 22781 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:14.030725 23807 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:14.035861 23833 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:14.053269 22147 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:14.038280 23937 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:14.063546 24037 log.cc:927] Time spent T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:06:14.064317 24033 log.cc:927] Time spent T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:06:14.064792 23863 consensus_meta.cc:287] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.001s
W20260709 13:06:14.070132 23660 consensus_meta.cc:287] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.002s
I20260709 13:06:14.033915 23789 raft_consensus.cc:697] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:14.071266 23944 consensus_meta.cc:287] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.960s	user 0.013s	sys 0.006s
I20260709 13:06:14.046657 23985 raft_consensus.cc:697] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:14.075294 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 185318us
W20260709 13:06:14.079692 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 214736us
I20260709 13:06:14.080157 22813 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:14.081660 22218 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:14.078734 23656 consensus_queue.cc:1243] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer c0694f6572bf406a92d55f1f2ab46ef2 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:06:14.093591 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 102229us
I20260709 13:06:14.094910 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:14.083719 23672 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:14.101483 22101 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:14.084476 23994 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.105865 24047 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:14.100595 23656 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.092144 23996 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:14.107610 24035 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:06:14.107837 23996 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.108132 24052 consensus_queue.cc:1059] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:14.093708 23863 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.110813 23863 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.112983 23863 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:14.078593 23661 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.115571 23672 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.115803 23835 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:14.116096 23672 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.118487 23956 raft_consensus.cc:3055] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.125519 22176 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:14.128528 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:14.129825 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.130508 22250 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:14.131152 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.132261 23661 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:14.118957 23956 raft_consensus.cc:740] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:14.106220 23789 consensus_queue.cc:237] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:14.139829 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 117113us
I20260709 13:06:14.142761 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:14.155678 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 121357us
W20260709 13:06:14.136336 23724 consensus_meta.cc:287] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.003s
I20260709 13:06:14.160480 22246 raft_consensus.cc:1240] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:14.133564 23872 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.167872 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:14.172394 22255 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:14.104741 23985 consensus_queue.cc:237] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:14.182590 23998 consensus_meta.cc:287] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.940s	user 0.011s	sys 0.005s
I20260709 13:06:14.184418 22173 raft_consensus.cc:1240] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:14.186815 23998 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.187449 23998 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.189939 23998 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:14.192775 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:14.197171 22175 raft_consensus.cc:3055] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.197641 22175 raft_consensus.cc:740] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:14.198793 22175 consensus_queue.cc:260] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.209394 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:14.210110 22103 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.213706 22072 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:14.214239 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:14.216251 22181 raft_consensus.cc:2393] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 3: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:06:14.212219 22147 leader_election.cc:336] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.582s (SENT)
W20260709 13:06:14.219010 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 111806us
I20260709 13:06:14.223232 22180 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:14.224462 22147 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:14.228166 22179 raft_consensus.cc:2393] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:14.201759 23872 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:14.233525 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 225321us
I20260709 13:06:14.225499 22175 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.247076 24055 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.247720 24055 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.250085 24055 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:14.250168 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:14.251246 22179 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:14.255524 24053 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.256583 23944 consensus_queue.cc:1059] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:14.263199 24050 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:14.263857 24050 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.266181 24050 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:14.266723 23937 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.269021 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:14.269734 22808 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:14.275472 22100 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:06:14.275931 22100 pending_rounds.cc:85] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 1
I20260709 13:06:14.276160 22100 pending_rounds.cc:107] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:14.276401 22100 raft_consensus.cc:2889] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:14.276748 22100 pending_rounds.cc:107] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:14.277010 22100 raft_consensus.cc:2889] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:14.277468 24042 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.242s	user 0.003s	sys 0.000s
W20260709 13:06:14.284303 22176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57856 (request call id 196) took 1906 ms (client timeout 1951 ms). Trace:
W20260709 13:06:14.284894 22176 rpcz_store.cc:269] 0709 13:06:12.377471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.377583 (+   112us) service_pool.cc:224] Handling call
0709 13:06:14.284021 (+1906438us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b5400068e54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:14.284209 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3896301312}
W20260709 13:06:14.291430 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 49734.8us
I20260709 13:06:14.292512 22069 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:14.295073 23944 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:14.295469 23944 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.295811 23944 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.300199 24019 raft_consensus.cc:3055] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:14.300678 24019 raft_consensus.cc:740] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:14.301688 24019 consensus_queue.cc:260] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.302532 22251 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:06:14.307492 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 67911.1us
I20260709 13:06:14.308339 22072 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:14.309199 23830 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:14.309631 23830 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:14.309880 23952 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.309986 23830 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.313848 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.314579 22246 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:14.318394 22782 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:14.318557 21991 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 252049d2bcdd4f329ca5015bf10c1b19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 765d912bde9e48959e50d9efec3c26b6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:14.319728 24046 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:14.319679 23830 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.320672 22218 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:14.322055 24056 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:14.322475 24056 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.322822 24056 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.323654 23830 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:14.324620 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 52440.6us
W20260709 13:06:14.322865 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.302772 24019 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.327649 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:14.328644 22246 raft_consensus.cc:2410] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:14.265729 23996 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.331465 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.333415 23976 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:14.334055 23976 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:14.335246 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 127047us
I20260709 13:06:14.346551 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:14.347563 22176 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:14.347791 24039 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:14.346812 23976 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:14.350276 22779 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:14.371757 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:14.374637 22106 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:14.371933 23865 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.377880 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.379479 22251 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:14.380359 23952 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.383118 22808 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:06:14.383229 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.383446 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:14.384068 23733 raft_consensus.cc:3055] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.384143 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:14.387454 23733 raft_consensus.cc:740] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:14.388401 23733 consensus_queue.cc:260] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.389109 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.390231 23962 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:14.390504 22781 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.951s (SENT) [suppressed 56 similar messages]
I20260709 13:06:14.388422 23996 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:14.392345 23835 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.392866 23835 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.393146 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.394517 22173 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:14.396652 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:14.396826 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:14.396934 23956 consensus_queue.cc:260] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:14.403841 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 53629.1us
W20260709 13:06:14.424875 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.417063 23672 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.418658 22103 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:14.431442 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:14.432621 22072 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:14.434267 22181 raft_consensus.cc:2393] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 3: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:14.428371 22179 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:14.440948 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:14.444389 22071 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:14.445605 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:14.423878 23830 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.429828 24039 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.456589 22071 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:14.457623 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 86017.1us
I20260709 13:06:14.453016 22176 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:06:14.465021 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 70755.7us
I20260709 13:06:14.469947 22220 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:14.481688 22220 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:14.482959 23865 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.483868 23865 consensus_queue.cc:1059] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:14.483958 22220 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:14.462662 23807 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:14.459292 24055 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:14.485496 23865 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:14.494793 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 84317.5us
I20260709 13:06:14.451968 23656 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.468024 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:14.486089 23976 consensus_queue.cc:1059] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
W20260709 13:06:14.507547 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.512971 24051 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.506870 24050 raft_consensus.cc:3055] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.514024 24050 raft_consensus.cc:740] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:14.513616 24051 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.513640 23733 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.514894 24050 consensus_queue.cc:260] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.516126 24051 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:14.516378 24050 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:14.518630 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 77818.7us
I20260709 13:06:14.493809 22100 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:06:14.520931 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:14.501354 23807 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:14.541205 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.499382 24055 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:14.529667 24074 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:14.530525 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 74034.9us
W20260709 13:06:14.546504 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 62651.2us
I20260709 13:06:14.531009 24077 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.532466 22147 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:14.518713 23835 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:14.518671 23656 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.565325 23656 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:14.539857 22175 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:14.567373 23804 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:06:14.534354 23833 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.535197 23963 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.538501 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:14.535333 24073 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.636507 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:14.539554 23807 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.553542 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:14.554104 23927 raft_consensus.cc:3055] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.554675 24058 consensus_queue.cc:1059] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.132s
I20260709 13:06:14.555927 24044 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:14.556474 24047 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:14.546307 24055 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:14.601593 24077 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.575798 24051 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.634200 22220 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:14.635115 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 102740us
I20260709 13:06:14.579602 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:14.516683 24049 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.185s
I20260709 13:06:14.521416 23830 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.571159 23996 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:14.678836 22176 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:14.659582 23927 raft_consensus.cc:740] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:14.663338 23804 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.685158 23830 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:14.670616 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:14.679836 22816 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:14.546602 24074 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.551064 23956 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:14.689194 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 219957us
I20260709 13:06:14.659555 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:14.696625 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:14.663403 24047 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:14.663904 23656 consensus_queue.cc:1059] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:06:14.695802 24024 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.707561 22779 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:14.572363 23952 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:14.701345 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:14.691359 23672 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:14.678867 24051 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.697862 23789 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:14.680681 24056 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.725436 22812 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:14.714349 24047 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.740862 22069 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:14.729343 24065 log.cc:927] Time spent T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.257s	user 0.000s	sys 0.002s
I20260709 13:06:14.729946 23927 consensus_queue.cc:260] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.731287 24045 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:14.732050 22174 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:14.732591 23656 raft_consensus.cc:3055] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:14.718428 24082 raft_consensus.cc:3055] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:14.723716 24024 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.761970 24045 raft_consensus.cc:697] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:14.763098 24045 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.763665 24024 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:14.705565 24074 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.709553 22147 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:14.766247 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 64462.8us
I20260709 13:06:14.735056 22098 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
W20260709 13:06:14.725870 24063 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:06:14.767627 22147 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:14.738263 23789 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.738483 22106 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:14.759708 23656 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:14.761873 24082 raft_consensus.cc:740] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:14.769922 23789 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:14.705638 23996 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.770701 24082 consensus_queue.cc:260] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.771296 23927 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:14.771535 24068 log.cc:927] Time spent T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:06:14.771873 23804 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.772575 23996 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:14.772650 23804 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:14.773283 23996 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:14.773320 23804 raft_consensus.cc:697] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:14.773803 23996 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:14.774235 23996 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.774483 23804 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.742861 23672 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.766101 24080 consensus_queue.cc:1059] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:14.780550 22147 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:14.789983 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:14.804647 24081 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:06:14.741945 23952 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:14.808228 24074 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.721143 24072 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.276s
I20260709 13:06:14.823084 23952 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.825886 23952 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:14.780766 23944 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.828986 23944 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:14.829645 23789 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.830607 22105 raft_consensus.cc:1240] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:14.779832 23833 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:14.777578 24051 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:14.724697 23976 consensus_queue.cc:1059] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
W20260709 13:06:14.831611 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 51180.1us
I20260709 13:06:14.777894 24049 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:14.780936 24056 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:14.835383 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 45519us
I20260709 13:06:14.833581 24051 raft_consensus.cc:3055] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.836112 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:14.836265 24051 raft_consensus.cc:740] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:14.835026 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 92710.1us
I20260709 13:06:14.777246 23830 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:06:14.845661 22071 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:14.781224 23672 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.833978 24049 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.851467 22147 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:14.832719 24077 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:14.843814 24072 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:14.853417 24082 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.860806 24093 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:14.852262 23944 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:14.861088 24077 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:14.851832 24074 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:14.862797 22147 leader_election.cc:400] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3.
I20260709 13:06:14.868026 22147 leader_election.cc:403] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:14.863260 23865 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.863318 23872 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:14.863910 23804 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.860570 22071 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:14.860569 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 283707us
I20260709 13:06:14.853348 24049 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:14.868614 22813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35198 (request call id 618) took 1453 ms (client timeout 1775 ms). Trace:
I20260709 13:06:14.880064 22246 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:14.880175 22813 rpcz_store.cc:269] 0709 13:06:13.412397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.412893 (+   496us) service_pool.cc:224] Handling call
0709 13:06:14.865125 (+1452232us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54005c0b54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:14.865243 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493845376}
I20260709 13:06:14.881930 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.882637 22255 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:14.883306 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.883265 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.883531 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.885370 22248 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:14.886081 22220 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:14.881589 23872 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 2. Current term is 3.
I20260709 13:06:14.884189 22253 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
W20260709 13:06:14.877070 23985 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.002s	sys 0.014s
I20260709 13:06:14.866637 23944 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.897205 22251 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:14.864890 24072 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.864261 23962 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:06:14.896735 23807 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.905221 24073 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.900701 23865 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:14.906375 23865 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:14.910197 23865 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:14.911180 24095 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:14.911639 24095 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.912003 24095 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.918407 24049 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:14.899530 23985 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.002s	sys 0.015s
I20260709 13:06:14.922012 23865 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.876458 24093 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.924894 22071 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:14.903115 23944 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.897673 24051 consensus_queue.cc:260] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:14.931185 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 68564.1us
I20260709 13:06:14.897917 22247 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:14.905064 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:14.931948 24049 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:14.940034 23672 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:14.941360 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:14.941476 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.942073 22178 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:14.943536 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:14.944131 22176 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:14.945272 22002 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40410 (request call id 193) took 10980 ms. Trace:
I20260709 13:06:14.945549 24056 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.946157 24056 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:14.948287 24056 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:14.925705 24093 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:14.948310 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:14.932209 22147 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:14.951342 22251 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.954327 22252 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:14.853518 23952 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:06:14.960580 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.961611 22252 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:14.962344 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:14.962656 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:14.963366 22147 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:14.962399 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.966957 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:14.980218 22176 raft_consensus.cc:2393] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 3: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:06:14.969894 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 91373.4us
I20260709 13:06:14.969975 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:14.951489 24072 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.978195 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:14.982681 22248 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:06:14.983881 22253 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:06:14.986196 22220 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:14.988909 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:14.989404 24092 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:14.990016 24092 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:14.990515 24092 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.995874 22218 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:14.997087 24050 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.997812 24088 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.999189 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:14.999640 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:15.000828 24050 consensus_queue.cc:1059] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:15.001497 24050 consensus_queue.cc:1243] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer c0694f6572bf406a92d55f1f2ab46ef2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:14.980468 22179 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.002688 24093 raft_consensus.cc:3055] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:15.003108 24093 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:15.003945 24093 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.005117 24093 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.005336 24055 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.006382 22103 raft_consensus.cc:1240] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:15.009047 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:15.009858 22098 raft_consensus.cc:2368] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:14.999291 24088 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:15.010567 24088 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:15.011107 24088 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.012965 23996 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.014093 22246 raft_consensus.cc:1240] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:15.016498 23996 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:14.990517 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:15.020924 24063 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:14.962352 23807 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:14.975919 23575 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:15.025470 22178 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:14.999256 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:15.026268 22253 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:15.027372 23993 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:15.027926 23993 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.028892 24095 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.030161 23993 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:15.031289 23993 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:15.032043 23656 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.033169 23656 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.032527 23993 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.035265 23814 raft_consensus.cc:3055] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:15.035686 23814 raft_consensus.cc:740] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:15.036526 23814 consensus_queue.cc:260] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.037467 22179 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:15.037909 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:15.038571 22813 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:15.040128 24044 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:15.040583 24044 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.042586 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:15.043005 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:15.043479 22106 raft_consensus.cc:2393] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:15.043373 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:15.044023 22097 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:15.044963 22069 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:15.037726 23814 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.968941 22071 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:15.061494 22218 leader_election.cc:400] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:15.067507 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:15.065899 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 96901.9us
I20260709 13:06:15.068307 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:15.062578 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.069715 22812 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.070457 22782 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:15.080098 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 116788us
I20260709 13:06:15.064337 23952 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:15.094422 22813 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:15.095371 22816 raft_consensus.cc:1240] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:15.069128 22218 leader_election.cc:403] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:15.071162 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:15.066548 23996 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.109637 22101 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:15.073983 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.986006 22175 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:15.091179 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:15.077973 23865 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.086658 23681 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:15.085985 24095 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:15.233982 23681 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.234558 23681 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.235132 23963 raft_consensus.cc:3055] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.235591 23963 raft_consensus.cc:740] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:15.235633 23865 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.236594 23963 consensus_queue.cc:260] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.237625 23963 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.237913 23865 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:15.073114 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:15.116662 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 55336.3us
I20260709 13:06:15.240518 22177 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.241418 22218 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:15.078109 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:15.242071 24083 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:15.242338 22252 raft_consensus.cc:2393] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 4: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:15.242506 24083 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.242977 24083 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.088160 23952 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:15.120244 24090 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.945703 22002 rpcz_store.cc:276] 0709 13:06:03.965134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.998404 (+ 33270us) service_pool.cc:224] Handling call
0709 13:06:14.945015 (+10946611us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:12.851619 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:12.966802 (+115183us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:12.966836 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:06:12.966855 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:12.967218 (+   363us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:12.967292 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:12.967325 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:12.967511 (+   186us) tablet.cc:701] Row locks acquired
0709 13:06:12.967530 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:06:12.967678 (+   148us) write_op.cc:270] Start()
0709 13:06:12.967813 (+   135us) write_op.cc:276] Timestamp: P: 1783602372967640 usec, L: 0
0709 13:06:12.967834 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:06:12.968494 (+   660us) log.cc:844] Serialized 536 byte log entry
0709 13:06:13.490953 (+522459us) op_driver.cc:464] REPLICATION: finished
0709 13:06:13.883605 (+392652us) write_op.cc:301] APPLY: starting
0709 13:06:13.883758 (+   153us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:13.883929 (+   171us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:13.884104 (+   175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:13.884513 (+   409us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:13.884850 (+   337us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:13.884937 (+    87us) write_op.cc:312] APPLY: finished
0709 13:06:13.953537 (+ 68600us) log.cc:844] Serialized 23 byte log entry
0709 13:06:13.976700 (+ 23163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:13.988830 (+ 12130us) write_op.cc:454] Released schema lock
0709 13:06:13.988904 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:14.071610 (+ 82706us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:14.071642 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":374327,"apply.run_cpu_time_us":3819,"apply.run_wall_time_us":172945,"num_ops":1,"prepare.queue_time_us":217127,"prepare.run_cpu_time_us":15485,"prepare.run_wall_time_us":248739,"raft.queue_time_us":355804,"raft.run_cpu_time_us":115910,"raft.run_wall_time_us":311538,"replication_time_us":522881,"thread_start_us":706537,"threads_started":4,"wal-append.queue_time_us":148925,"wal-append.run_cpu_time_us":14852,"wal-append.run_wall_time_us":1908382}]]}
I20260709 13:06:15.102178 23863 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:15.120855 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:15.104990 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:15.118554 22147 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:15.109077 24055 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:15.185292 23672 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.109457 24047 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:15.288591 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 162484us
I20260709 13:06:15.172890 23996 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.173902 23937 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.188619 22251 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
W20260709 13:06:15.174760 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 58148.2us
W20260709 13:06:15.203133 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.295351 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:15.221547 24059 log.cc:927] Time spent T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.966s	user 0.004s	sys 0.000s
I20260709 13:06:15.297691 24055 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:15.298208 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:15.298210 24055 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.299657 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:15.223557 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:15.300881 22178 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:15.174206 22071 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:15.302198 24055 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:15.260304 24101 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:06:15.303113 24049 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:15.252323 22814 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:15.263060 23744 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:06:15.304242 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 144120us
W20260709 13:06:15.312501 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 209320us
I20260709 13:06:15.238976 23789 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.296010 22813 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:15.301795 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:15.302251 24096 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:15.303174 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1678) took 1177 ms. Trace:
I20260709 13:06:15.304697 23744 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.251106 23952 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:15.269140 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:15.103246 23944 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.275231 22812 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:15.326148 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:15.317163 22249 rpcz_store.cc:276] 0709 13:06:14.125780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.126275 (+   495us) service_pool.cc:224] Handling call
0709 13:06:14.126703 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:14.127127 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.127153 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:14.127712 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:06:14.168938 (+ 41226us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:14.178067 (+  9129us) log.cc:844] Serialized 14 byte log entry
0709 13:06:14.178567 (+   500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.178656 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.220774 (+1042118us) spinlock_profiling.cc:243] Waited 55.5 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:15.302795 (+ 82021us) raft_consensus.cc:1685] finished
0709 13:06:15.302938 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.303087 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8538,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":61,"raft.queue_time_us":3266,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":242,"spinlock_wait_cycles":127761152,"thread_start_us":40773,"threads_started":1,"wal-append.queue_time_us":127284}
I20260709 13:06:15.306341 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:15.328169 22176 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.309718 22782 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:15.276268 23997 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:15.332726 22220 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:15.334410 22177 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:15.313144 22071 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:15.290548 23976 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:15.305959 24073 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.306298 24084 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.346589 24084 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.348973 24084 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:15.348742 24044 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.349623 23960 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:15.350131 23960 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.351120 23733 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:15.351779 23733 raft_consensus.cc:697] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:15.352414 24092 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.352818 23733 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.306551 23672 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.356668 23672 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:15.357470 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:15.335995 22071 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:15.359081 23944 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:15.325296 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 56223.8us
I20260709 13:06:15.359724 23944 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:15.360143 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:15.360477 23967 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:15.360244 23944 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.361011 23967 raft_consensus.cc:697] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:15.361903 23967 consensus_queue.cc:237] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.362389 23944 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:15.364132 23575 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:15.364601 23575 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.365305 23656 consensus_queue.cc:1059] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:15.321439 23789 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.367916 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:15.340610 22147 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:15.372822 24024 raft_consensus.cc:3055] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:15.373270 24024 raft_consensus.cc:740] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:15.374150 24024 consensus_queue.cc:260] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.375411 24024 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.371042 24050 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:15.369683 23835 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:15.342934 24053 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:15.369135 22220 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:15.331152 23865 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:15.392351 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.388042 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1301) took 1185 ms. Trace:
I20260709 13:06:15.344887 23976 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:15.398360 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 69111.4us
I20260709 13:06:15.368088 22175 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:15.399369 22147 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:15.399917 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:15.401499 22147 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:15.402230 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.343381 24049 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:15.403080 24050 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:15.403285 24049 raft_consensus.cc:697] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:15.403690 24050 raft_consensus.cc:697] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:15.404383 24049 consensus_queue.cc:237] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.404676 24050 consensus_queue.cc:237] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.350908 24044 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:15.378158 22103 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:06:15.407655 23872 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:15.408404 23872 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:15.399915 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.408768 23872 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:15.409183 23872 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:15.376484 24095 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.389715 24053 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.309998 23937 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.407011 24092 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:15.411500 22071 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:15.399621 24107 log.cc:927] Time spent T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:06:15.398744 24052 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:15.393540 22099 rpcz_store.cc:276] 0709 13:06:14.202322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.202565 (+   243us) service_pool.cc:224] Handling call
0709 13:06:14.210942 (+  8377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:14.237249 (+ 26307us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:14.237283 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:14.240550 (+  3267us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.225261 (+984711us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b18000d3000. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee0d1 00007f66a7f09a0f
0709 13:06:15.315524 (+ 90263us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:15.315568 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.315630 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.380438 (+ 64808us) raft_consensus.cc:1685] finished
0709 13:06:15.380460 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.387952 (+  7492us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4444,"raft.queue_time_us":15071,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":124,"spinlock_wait_cycles":56903552,"thread_start_us":90082,"threads_started":1,"wal-append.queue_time_us":1116560}
I20260709 13:06:15.414885 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:15.437587 22069 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:15.402704 22147 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:15.418598 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.418852 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:15.424887 22071 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:15.435978 22176 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:15.376993 23656 consensus_queue.cc:1059] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:06:15.440208 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:15.423197 23993 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:15.412038 23976 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.442325 22103 raft_consensus.cc:1275] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:15.442692 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:15.407027 23672 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:15.411628 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:15.441439 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:15.326969 24096 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.423568 24053 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.342573 23997 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.452553 22106 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:15.454237 22220 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:15.445744 23830 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:15.437008 23944 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:15.392549 23835 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.446046 23962 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:15.424563 24095 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.474529 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:15.478029 22101 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:15.494053 22815 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
W20260709 13:06:15.501367 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 47214.1us
I20260709 13:06:15.512516 22177 raft_consensus.cc:2368] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:15.478940 23960 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:15.481362 23863 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.496906 24073 raft_consensus.cc:3055] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:15.464179 23681 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.514741 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:15.516114 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.521183 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:15.497428 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:15.519053 22220 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:15.500353 24047 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:15.500998 22100 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:15.526688 22220 leader_election.cc:400] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:15.507905 23963 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:15.475301 24088 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.510574 23830 raft_consensus.cc:697] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:15.515172 23944 raft_consensus.cc:697] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:15.538949 22220 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:15.539496 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:15.540372 22176 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:15.541641 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:15.541822 22220 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:15.544075 22220 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:15.516986 23996 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:15.517561 24073 raft_consensus.cc:740] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:15.523947 23672 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:15.502668 24083 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.583321 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:15.530365 23865 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:15.533340 22808 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
W20260709 13:06:15.591874 24108 log.cc:927] Time spent T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:06:15.592489 23681 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:15.554874 23575 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.595942 23575 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:15.599718 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:15.606819 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.561954 22810 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:15.603510 24112 log.cc:927] Time spent T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:06:15.560782 24091 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:15.560618 24084 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:15.627122 24091 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.627599 24091 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.602572 23872 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.556893 23985 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.611837 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:15.615532 24088 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:15.616673 23944 consensus_queue.cc:237] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.623382 24090 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
W20260709 13:06:15.626185 24093 consensus_meta.cc:287] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.621s	user 0.013s	sys 0.000s
W20260709 13:06:15.630002 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 227345us
I20260709 13:06:15.586190 23789 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:15.586478 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:15.585863 24114 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:15.648079 24114 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.651909 24114 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:15.632273 24073 consensus_queue.cc:260] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.653662 24073 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.608157 23865 raft_consensus.cc:697] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:15.633792 23872 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:15.657780 23863 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.631628 23963 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.644568 23830 consensus_queue.cc:237] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.673758 23963 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:15.635962 24084 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:15.667263 24096 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:15.605798 23672 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.684677 22176 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:15.647989 22174 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.644083 24050 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:15.631963 23962 raft_consensus.cc:697] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:15.662664 22147 leader_election.cc:400] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
I20260709 13:06:15.665211 24052 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:15.666355 23997 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:15.631628 23937 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:15.684684 24072 consensus_meta.cc:287] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.620s	user 0.010s	sys 0.001s
I20260709 13:06:15.678149 24053 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.632167 23996 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:15.686690 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:15.635123 24104 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.329s	user 0.000s	sys 0.003s
I20260709 13:06:15.679292 24084 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.678908 24083 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:15.794050 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.679502 23865 consensus_queue.cc:237] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.683673 23952 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:15.798810 24120 log.cc:927] Time spent T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:06:15.800354 23672 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:15.811690 22174 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:15.814412 24123 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:15.742000 23937 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:06:15.828737 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.726476 24050 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.855031 24123 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.747349 24072 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.857098 24123 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:15.857131 24050 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:15.858714 24072 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:15.863750 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:15.864152 23835 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:15.868439 22071 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:15.834079 23960 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.870452 22104 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:15.851575 22106 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:15.872140 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 209606us
I20260709 13:06:15.873075 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:15.879302 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:15.867681 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:15.883996 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:15.839469 23996 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:15.893714 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 62089.5us
I20260709 13:06:15.900655 22103 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:06:15.903611 24125 log.cc:927] Time spent T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 13:06:15.891543 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:15.908149 22100 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:15.908500 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:15.879011 23835 consensus_queue.cc:1059] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:06:15.909492 23835 raft_consensus.cc:3055] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:15.909703 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:15.910342 22178 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:15.909824 23835 raft_consensus.cc:740] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:15.911413 22220 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:15.912102 24084 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:15.911922 23835 consensus_queue.cc:260] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.912536 24050 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:15.914243 22071 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:15.913245 23835 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:15.872452 24053 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:15.916220 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:15.921916 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:15.919158 23830 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:15.919996 23952 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:15.847748 23976 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:15.922613 22178 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:15.882761 24083 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:15.882951 23963 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:06:15.869925 23937 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:15.925612 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 43993.1us
I20260709 13:06:15.927384 22779 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:15.924330 22174 raft_consensus.cc:2368] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:15.875799 23960 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.923322 23830 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:15.936013 24083 raft_consensus.cc:697] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:15.941323 22147 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:15.942190 22218 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:15.878851 23962 consensus_queue.cc:237] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.955106 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:15.955693 22178 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.958648 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:15.953989 24055 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.927076 24095 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:15.945564 24083 consensus_queue.cc:237] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:15.966500 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:15.967166 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.938889 23830 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.979269 23963 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:15.954455 23967 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.976671 24123 consensus_queue.cc:1048] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:15.992036 23967 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.930200 24121 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:15.993451 24121 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.994102 23967 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:15.978045 24078 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.994397 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:15.940894 24056 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.986210 22175 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:15.986187 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:15.954632 23733 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.989913 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:15.990486 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:15.990582 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:16.009279 22101 raft_consensus.cc:2393] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:15.991318 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:15.990991 24055 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:15.956739 23927 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.934437 24114 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:15.993834 23937 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:15.989104 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:15.999284 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:16.003486 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:16.007272 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.009375 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:16.009876 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:16.010605 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 74137.4us
I20260709 13:06:16.011361 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:16.012460 22253 raft_consensus.cc:1240] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:16.024475 22249 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.013087 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:15.995364 24056 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:16.019213 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:16.020936 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:16.028582 22250 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:16.022823 22255 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.029431 22103 raft_consensus.cc:2393] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:16.017468 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:16.025916 22251 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:16.016289 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:16.053224 23967 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:16.014015 23733 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:16.794252 24121 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:16.436756 22220 leader_election.cc:400] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:16.794901 24054 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:16.352818 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.795884 24054 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:16.513278 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:16.412221 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:16.798084 22097 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:16.798456 24054 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:16.513181 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:16.216672 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 1729) took 1091 ms. Trace:
I20260709 13:06:16.799885 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:16.800163 22175 rpcz_store.cc:276] 0709 13:06:15.125509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.399609 (+274100us) service_pool.cc:224] Handling call
0709 13:06:16.216499 (+816890us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b540031a6d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:16.216608 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1028570368}
I20260709 13:06:16.801765 24137 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:16.802393 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:16.168331 23865 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.223948 22071 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:16.215418 24111 log.cc:927] Time spent T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.815s	user 0.009s	sys 0.012s
I20260709 13:06:16.167207 24095 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.588933 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:16.823180 22177 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:16.397459 23963 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.631569 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:16.018657 22809 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:16.069437 22249 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:16.359297 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:16.061430 24113 log.cc:927] Time spent T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.766s	user 0.000s	sys 0.008s
I20260709 13:06:16.805984 24055 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:16.434571 24088 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:16.843087 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:16.843605 24088 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:16.845970 24088 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:16.847345 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:16.848074 22808 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:16.841439 24095 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:16.851362 24095 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:16.840653 24137 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:16.854205 24137 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:16.546613 23833 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.855180 23833 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:16.856155 22102 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.827834 23960 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:16.836297 23865 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:16.366637 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:16.859218 22246 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:16.128882 22816 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:16.289402 22255 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:16.862054 22218 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:16.792687 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 664338us
I20260709 13:06:16.194275 22147 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:16.826540 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:16.864967 22072 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:16.865129 22251 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:06:16.215858 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:16.875383 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.126853 22178 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:16.190972 22252 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:16.795249 22220 leader_election.cc:403] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:16.460583 24090 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:16.793102 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:16.063323 24124 log.cc:927] Time spent T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.208s	user 0.002s	sys 0.000s
I20260709 13:06:16.587262 22173 raft_consensus.cc:1240] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 4. Ops: []
I20260709 13:06:16.130491 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:16.838784 22180 raft_consensus.cc:2393] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:16.825690 23997 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.728188 24024 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:16.130106 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:16.840767 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 616850us
I20260709 13:06:16.842763 22175 raft_consensus.cc:2393] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:16.843003 22810 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:16.893613 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:16.194769 24091 consensus_meta.cc:287] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.567s	user 0.005s	sys 0.006s
I20260709 13:06:16.711118 23993 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:16.547657 23575 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.872732 24049 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:16.022809 23927 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:16.874480 22250 consensus_meta.cc:287] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.753s	user 0.009s	sys 0.001s
I20260709 13:06:16.903843 22250 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:16.904752 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:16.211578 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:16.878434 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:16.879351 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:16.905777 22812 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:16.905977 22255 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:16.880177 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:16.906481 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:16.906729 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1726) took 1830 ms. Trace:
I20260709 13:06:16.907048 22815 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:16.880157 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:16.908197 22249 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:16.806844 24051 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.834743 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:16.223371 23976 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:16.222828 24056 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:16.914966 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1725) took 1954 ms. Trace:
I20260709 13:06:16.915266 23976 raft_consensus.cc:476] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 13:06:16.915939 23976 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:16.916596 23976 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:16.917675 22807 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:16.208938 23937 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:16.918696 23937 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:16.826480 22181 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:16.461241 24082 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:16.889093 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 452453us
I20260709 13:06:16.884055 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:16.889909 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.895119 24088 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:16.062163 23744 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:16.809011 23996 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:16.836658 24054 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.895567 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:16.839249 23967 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:16.896581 24024 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:16.936311 22102 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:16.896790 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:16.896862 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:16.891426 23835 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 13:06:16.734043 22247 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.012s	sys 0.005s
I20260709 13:06:16.840214 24139 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:16.899435 22781 leader_election.cc:336] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.951s (SENT)
I20260709 13:06:16.168504 23807 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.720s
I20260709 13:06:16.902902 22251 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:16.908800 22176 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:16.887025 23944 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:16.907153 22179 rpcz_store.cc:276] 0709 13:06:15.070598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.070740 (+   142us) service_pool.cc:224] Handling call
0709 13:06:15.082655 (+ 11915us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:15.121516 (+ 38861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:15.121560 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:15.229099 (+107539us) spinlock_profiling.cc:243] Waited 890 us on lock 0x7b2c00040298. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6857372 00007f66a7f89a01 00007f66a7f4e43a 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2
0709 13:06:15.229560 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.291654 (+ 62094us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:15.292811 (+  1157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.292874 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.215123 (+922249us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b24002ba858. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4ce79c4 00007f66a4ce5acb 00007f66a4ea0dc9 00007f66a4ea0a55 00007f66a4ea009d 00007f66a7ad210e 00007f66a7ae988c 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221
0709 13:06:16.900473 (+685350us) raft_consensus.cc:1685] finished
0709 13:06:16.900495 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.900615 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91311,"raft.queue_time_us":36293,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":58594,"spinlock_wait_cycles":32773632,"thread_start_us":61691,"threads_started":1,"wal-append.queue_time_us":170321}
I20260709 13:06:16.890506 22253 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:16.923796 22071 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:16.921756 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:16.947467 22255 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:06:16.922076 22181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1415) took 1670 ms (client timeout 1744 ms). Trace:
I20260709 13:06:16.927627 24088 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.923221 22252 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
W20260709 13:06:16.925488 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.840534 23963 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:16.935190 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1416) took 1550 ms. Trace:
I20260709 13:06:16.900697 24049 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.949808 24139 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:16.955435 24049 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.937796 22813 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.903743 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1409) took 1802 ms. Trace:
I20260709 13:06:16.938844 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:16.943121 23865 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:16.941798 22249 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:16.886912 24090 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:16.923316 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1713) took 2362 ms. Trace:
I20260709 13:06:16.922044 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:16.918880 23976 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:16.970191 22250 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:16.897495 23997 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:16.921350 22246 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
W20260709 13:06:16.948258 22181 rpcz_store.cc:269] 0709 13:06:15.251589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.626244 (+1374655us) service_pool.cc:224] Handling call
0709 13:06:16.922006 (+295762us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:16.899788 24091 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:16.911887 24055 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:16.906497 23575 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:16.927124 24050 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
W20260709 13:06:16.943997 22247 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.012s	sys 0.007s
I20260709 13:06:16.953719 22177 rpcz_store.cc:276] 0709 13:06:15.384596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.895323 (+1510727us) service_pool.cc:224] Handling call
0709 13:06:16.935128 (+ 39805us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:16.841084 22174 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:16.955099 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:16.985733 22176 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:16.988153 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:16.961120 24139 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:16.951601 24088 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.943801 23996 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.991966 23996 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:16.994189 23996 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:16.966814 22173 rpcz_store.cc:276] 0709 13:06:14.549338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.550893 (+  1555us) service_pool.cc:224] Handling call
0709 13:06:16.586752 (+2035859us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b5800165698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:16.587030 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.887331 (+300301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.911677 (+ 24346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12715264}
I20260709 13:06:16.995009 22254 raft_consensus.cc:2368] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6.
I20260709 13:06:16.915441 22172 rpcz_store.cc:276] 0709 13:06:14.960141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.006985 (+ 46844us) service_pool.cc:224] Handling call
0709 13:06:15.007422 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:15.096600 (+ 89178us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:15.101040 (+  4440us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:15.183867 (+ 82827us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.298460 (+114593us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:15.298507 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.298578 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.060810 (+762232us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:16.914533 (+853723us) raft_consensus.cc:1685] finished
0709 13:06:16.914561 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.914769 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87732,"raft.queue_time_us":92961,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":2019,"spinlock_wait_cycles":28141440,"thread_start_us":53738,"threads_started":1,"wal-append.queue_time_us":111088}
I20260709 13:06:16.995965 22173 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:16.963433 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:16.976070 23976 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.906399 23993 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:16.950001 23944 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:16.928735 24082 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:16.967602 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:16.938243 24054 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:16.921161 23937 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:16.962002 22175 rpcz_store.cc:276] 0709 13:06:15.103827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.801977 (+1698150us) service_pool.cc:224] Handling call
0709 13:06:16.899063 (+ 97086us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:16.974779 23997 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:16.982329 22104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1419) took 1614 ms (client timeout 1590 ms). Trace:
I20260709 13:06:16.983515 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:16.986541 22813 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:16.944991 22811 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:16.988826 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1417) took 1603 ms. Trace:
I20260709 13:06:17.024214 22176 rpcz_store.cc:276] 0709 13:06:15.384983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.945637 (+1560654us) service_pool.cc:224] Handling call
0709 13:06:16.988769 (+ 43132us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:16.959278 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 64591.5us
I20260709 13:06:17.025300 22181 raft_consensus.cc:2368] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5.
I20260709 13:06:16.988916 22178 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:17.026415 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1420) took 1192 ms. Trace:
I20260709 13:06:17.026856 22178 rpcz_store.cc:276] 0709 13:06:15.834348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.987883 (+1153535us) service_pool.cc:224] Handling call
0709 13:06:17.026340 (+ 38457us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:17.021767 22104 rpcz_store.cc:269] 0709 13:06:15.367562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.367685 (+   123us) service_pool.cc:224] Handling call
0709 13:06:16.982155 (+1614470us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b540042bb54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:16.982257 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154171776}
I20260709 13:06:16.972236 23865 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:16.997555 22814 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:17.002008 22816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 287) took 1042 ms. Trace:
I20260709 13:06:17.004145 22071 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:16.984618 23863 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.019171 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 1738) took 1149 ms. Trace:
I20260709 13:06:17.036799 22179 rpcz_store.cc:276] 0709 13:06:15.870205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.953322 (+1083117us) service_pool.cc:224] Handling call
0709 13:06:17.019079 (+ 65757us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:16.964457 22253 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:17.052037 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 1742) took 1131 ms. Trace:
I20260709 13:06:17.030380 22816 rpcz_store.cc:276] 0709 13:06:15.959199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.985933 (+ 26734us) service_pool.cc:224] Handling call
0709 13:06:17.001799 (+1015866us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400545454. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:17.001921 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305978624}
I20260709 13:06:17.009827 23733 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:17.105264 22176 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:17.106992 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1408) took 2017 ms. Trace:
I20260709 13:06:17.107405 22176 rpcz_store.cc:276] 0709 13:06:15.089802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.025034 (+1935232us) service_pool.cc:224] Handling call
0709 13:06:17.105079 (+ 80045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.106600 (+  1521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.106881 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:17.017009 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1396) took 1938 ms. Trace:
W20260709 13:06:17.135740 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 110189us
I20260709 13:06:17.010938 23976 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:17.119133 24141 log.cc:927] Time spent T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:06:17.159614 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:17.161250 22253 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:17.163003 22782 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:17.052584 22181 rpcz_store.cc:276] 0709 13:06:15.920290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.973204 (+1052914us) service_pool.cc:224] Handling call
0709 13:06:17.051971 (+ 78767us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:17.160405 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:17.160068 24024 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.164199 22782 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:17.171321 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 167250us
I20260709 13:06:17.172583 22071 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:17.174165 22071 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:17.087394 23863 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.125524 23927 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.115370 23865 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:17.188966 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 1.05821e+06us
I20260709 13:06:17.184689 22176 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
W20260709 13:06:17.200304 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 314920us
I20260709 13:06:17.203018 22072 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:17.189036 24024 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:17.205088 24024 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:17.208493 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1411) took 2032 ms. Trace:
I20260709 13:06:17.215703 22176 rpcz_store.cc:276] 0709 13:06:15.175854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.108291 (+1932437us) service_pool.cc:224] Handling call
0709 13:06:17.184317 (+ 76026us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:17.208140 (+ 23823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.208418 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:17.167037 23944 raft_consensus.cc:697] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:17.222052 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.224563 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 1745) took 1229 ms. Trace:
I20260709 13:06:17.225124 22177 rpcz_store.cc:276] 0709 13:06:15.994677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.987364 (+992687us) service_pool.cc:224] Handling call
0709 13:06:17.221837 (+234473us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b5800165698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:17.224493 (+  2656us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4910848}
I20260709 13:06:17.187520 23807 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:17.120332 22173 rpcz_store.cc:276] 0709 13:06:15.072555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.995345 (+1922790us) service_pool.cc:224] Handling call
0709 13:06:16.995720 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:16.996353 (+   633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.011331 (+ 14978us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:17.198714 24139 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:17.235950 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 401652us
I20260709 13:06:17.226701 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.226820 22000 catalog_manager.cc:5697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 2 to 3, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 3 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.241381 22147 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:17.200919 23744 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:17.206363 24095 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:17.201085 24096 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:17.243487 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 360901us
I20260709 13:06:17.248256 22071 leader_election.cc:400] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5.
I20260709 13:06:17.248574 22071 leader_election.cc:403] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:06:17.250281 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:17.251356 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.248452 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.253574 22176 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:17.217028 23927 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:17.247417 22000 catalog_manager.cc:5697] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 1 to 2, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 2 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:06:17.258320 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 159563us
I20260709 13:06:17.228710 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1702) took 2230 ms. Trace:
I20260709 13:06:17.263826 23996 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:17.264477 23996 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.265806 23833 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.266876 23996 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:17.267302 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.268729 22180 raft_consensus.cc:2393] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:17.263747 22247 rpcz_store.cc:276] 0709 13:06:14.977637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.981134 (+  3497us) service_pool.cc:224] Handling call
0709 13:06:15.955404 (+974270us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b5400345c28. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66ace77aa1 00007f66acef2ebc 00007f66acf2808c 00007f66acf1293b 00007f66acf123d2 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c
0709 13:06:15.958349 (+  2945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.998758 (+ 40409us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:16.991349 (+992591us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.161363 (+170014us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.161874 (+   511us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:17.161953 (+    79us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:17.162040 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.171004 (+  8964us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.207771 (+ 36767us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":791970,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":75,"raft.queue_time_us":206,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":195,"spinlock_wait_cycles":3297152,"thread_start_us":1125718,"threads_started":2,"wal-append.queue_time_us":240957}
I20260709 13:06:17.200737 23967 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:17.249873 24140 log.cc:927] Time spent T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:06:17.262089 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1712) took 1272 ms. Trace:
I20260709 13:06:17.230192 23963 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.234216 23807 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.279985 22251 rpcz_store.cc:276] 0709 13:06:15.989536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.949971 (+960435us) service_pool.cc:224] Handling call
0709 13:06:16.950278 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.950473 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:16.961826 (+ 11353us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.239900 (+278074us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.261752 (+ 21852us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:17.261803 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:17.261852 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.261913 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.262026 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52044,"prepare.queue_time_us":17114,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":68,"raft.queue_time_us":76351,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":7329152,"thread_start_us":246580,"threads_started":1,"wal-append.queue_time_us":287142}
I20260709 13:06:17.244834 22177 raft_consensus.cc:2393] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 2: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:17.273852 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:17.277225 22220 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:17.287214 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 73840.3us
I20260709 13:06:17.250722 24095 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:17.270375 24088 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.246526 23744 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:17.230427 23960 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:06:17.299984 22220 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:17.299602 22000 catalog_manager.cc:5697] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 1 to 2, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.302239 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.303316 22178 raft_consensus.cc:2410] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:17.249468 24090 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.306190 24095 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.547726 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:17.550534 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.323673 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.551306 22173 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:17.552394 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1728) took 2428 ms. Trace:
I20260709 13:06:17.552378 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.553180 22173 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:17.552917 22179 rpcz_store.cc:276] 0709 13:06:15.123674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.037857 (+1914183us) service_pool.cc:224] Handling call
0709 13:06:17.038346 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.059856 (+ 21510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.059903 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.115764 (+ 55861us) log.cc:844] Serialized 26 byte log entry
0709 13:06:17.224562 (+108798us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:17.224607 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.224677 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.551054 (+326377us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:17.552133 (+  1079us) raft_consensus.cc:1685] finished
0709 13:06:17.552152 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.552337 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1429,"raft.queue_time_us":178645,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":10818,"spinlock_wait_cycles":23824640,"thread_start_us":53032,"threads_started":1,"wal-append.queue_time_us":108468}
I20260709 13:06:17.554303 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.324095 23575 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.327296 23993 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:17.554937 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.328313 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.281708 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1410) took 2097 ms. Trace:
I20260709 13:06:17.555550 22179 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:17.555845 22177 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:17.334862 24091 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:17.556420 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:17.556815 24091 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:17.557183 22179 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:17.557444 24091 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.559475 24091 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.299147 23807 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.306903 23996 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.563115 23996 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:17.563527 23996 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.563609 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1733) took 2067 ms. Trace:
I20260709 13:06:17.564148 22173 rpcz_store.cc:276] 0709 13:06:15.495852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.562466 (+2066614us) service_pool.cc:224] Handling call
0709 13:06:17.562877 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.563145 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.563187 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:17.563257 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:17.563312 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.563392 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.563533 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:17.565171 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:17.566044 22810 raft_consensus.cc:2393] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:17.566468 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1734) took 2009 ms. Trace:
I20260709 13:06:17.309542 23744 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:17.567045 22173 rpcz_store.cc:276] 0709 13:06:15.556841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.565431 (+2008590us) service_pool.cc:224] Handling call
0709 13:06:17.565767 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.565994 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.566032 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:17.566093 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:17.566150 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.566233 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.566392 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:17.569352 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1741) took 1688 ms. Trace:
I20260709 13:06:17.569403 22069 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:17.569815 22173 rpcz_store.cc:276] 0709 13:06:15.881407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.568423 (+1687016us) service_pool.cc:224] Handling call
0709 13:06:17.568806 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.569000 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.569027 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:17.569073 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:17.569118 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.569178 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.569294 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:17.342188 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 294) took 1347 ms. Trace:
I20260709 13:06:17.335829 22000 catalog_manager.cc:5697] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 1 to 2, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.343598 24082 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:17.345913 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.570902 22255 rpcz_store.cc:276] 0709 13:06:15.995227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.950479 (+955252us) service_pool.cc:224] Handling call
0709 13:06:16.950719 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.980412 (+ 29693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:16.980443 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:16.980485 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:16.980531 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.341874 (+361343us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b54003bbd54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:17.341929 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.342098 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67842816}
I20260709 13:06:17.573050 24095 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.574028 22071 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:17.261339 24139 raft_consensus.cc:697] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:17.575335 24139 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.575812 23575 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:17.576067 24095 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:17.576649 24095 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.576370 23575 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.577026 24095 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.577391 24095 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:17.445075 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 203926us
I20260709 13:06:17.578492 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:17.299785 22782 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:17.579829 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:17.302032 23963 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:17.327945 23944 consensus_queue.cc:237] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.497843 24148 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.581375 23927 raft_consensus.cc:697] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:17.581671 24148 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.582221 24148 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.582366 23927 consensus_queue.cc:237] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.499300 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.499862 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.583968 22176 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:17.584024 24145 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:17.584651 24145 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.500082 23865 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.585093 24145 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.585137 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1743) took 1592 ms. Trace:
I20260709 13:06:17.586041 22178 rpcz_store.cc:276] 0709 13:06:15.992403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.584325 (+1591922us) service_pool.cc:224] Handling call
0709 13:06:17.584598 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.584758 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.584781 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:17.584819 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:17.584851 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.584900 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.584990 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:17.499444 24054 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.502704 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:17.503108 23830 consensus_meta.cc:287] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.503s	user 0.017s	sys 0.010s
I20260709 13:06:17.589025 23830 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.590070 22098 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
W20260709 13:06:17.590943 22811 consensus_meta.cc:287] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.567s	user 0.014s	sys 0.004s
I20260709 13:06:17.591223 23830 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:17.503587 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 262295us
W20260709 13:06:17.591953 22098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1320) took 1633 ms (client timeout 1652 ms). Trace:
W20260709 13:06:17.592387 22098 rpcz_store.cc:269] 0709 13:06:15.958777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.987159 (+ 28382us) service_pool.cc:224] Handling call
0709 13:06:17.591789 (+1604630us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54002ab2d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:17.591896 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3632190336}
I20260709 13:06:17.593532 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:17.594165 22098 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 1.
I20260709 13:06:17.282704 24024 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:06:17.505103 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:17.555814 22175 rpcz_store.cc:276] 0709 13:06:15.175449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.059205 (+1883756us) service_pool.cc:224] Handling call
0709 13:06:17.172317 (+113112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.217806 (+ 45489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.229869 (+ 12063us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:17.240871 (+ 11002us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:17.244016 (+  3145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.256350 (+ 12334us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.272390 (+ 16040us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8326,"raft.queue_time_us":43018,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":8171}
W20260709 13:06:17.595338 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 295614us
I20260709 13:06:17.282884 24050 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.596876 24050 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:17.597386 24050 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:17.598893 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 94626us
I20260709 13:06:17.507320 23863 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.593550 22147 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:17.601660 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:17.602054 22147 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:17.602416 22255 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:17.602663 23863 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.603264 23863 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:17.603771 23863 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.604784 24082 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.605201 24082 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:17.605597 24082 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.506214 24088 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:17.511929 21991 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 252049d2bcdd4f329ca5015bf10c1b19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 765d912bde9e48959e50d9efec3c26b6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:06:17.606473 21991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 94596.4us
I20260709 13:06:17.556836 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.512030 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.607576 22177 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:17.607990 22180 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
W20260709 13:06:17.502556 24051 consensus_meta.cc:287] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.581s	user 0.000s	sys 0.012s
I20260709 13:06:17.608771 22177 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:17.609309 22248 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
W20260709 13:06:17.610386 22248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1705) took 2614 ms (client timeout 2129 ms). Trace:
I20260709 13:06:17.516474 23976 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:17.515219 24144 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.282568 24147 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:17.610875 22248 rpcz_store.cc:269] 0709 13:06:14.995559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.999383 (+  3824us) service_pool.cc:224] Handling call
0709 13:06:17.610207 (+2610824us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b54001d1ad4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:17.610296 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6000297728}
I20260709 13:06:17.611596 24147 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.612919 22180 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:17.613202 24082 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.615444 24082 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.616981 24096 raft_consensus.cc:697] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:17.618469 24147 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:17.525084 24150 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.621847 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:17.622043 24150 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.623272 22147 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:17.624202 24150 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:17.525111 22102 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:17.527283 24162 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.519763 22220 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:17.539354 24154 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:17.540383 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1412) took 2364 ms. Trace:
I20260709 13:06:17.624487 22147 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:17.625906 24154 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:17.625710 22181 rpcz_store.cc:276] 0709 13:06:15.176206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.185368 (+2009162us) service_pool.cc:224] Handling call
0709 13:06:17.198749 (+ 13381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.199114 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:17.260674 (+ 61560us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.535518 (+274844us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:17.539908 (+  4390us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:17.539985 (+    77us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:17.540063 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.540150 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.540309 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":235764,"prepare.queue_time_us":321350,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":260076,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":14861696,"thread_start_us":54630,"threads_started":2,"wal-append.queue_time_us":267039}
I20260709 13:06:17.627538 24154 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:17.628525 24150 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.628949 24150 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:17.629796 24150 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.625763 22782 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:17.636068 23744 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.636734 24137 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:17.636785 24054 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.637303 24137 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:17.637723 24137 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.638373 23744 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:17.640426 23976 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.249243 23952 consensus_queue.cc:1059] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:06:17.641077 23976 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.322664 23832 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.643185 23937 raft_consensus.cc:3055] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:17.643589 23937 raft_consensus.cc:740] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:17.643652 23976 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:17.644379 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 124684us
I20260709 13:06:17.644529 23937 consensus_queue.cc:260] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.646365 23937 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:17.323503 24157 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:17.545143 22099 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:17.546195 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:17.546610 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:17.648481 22815 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:17.547319 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:17.509754 22174 consensus_meta.cc:287] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.003s
I20260709 13:06:17.574199 22100 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:17.578509 23575 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.651324 24169 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.501797 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:17.652400 22101 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:17.504309 24121 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.653725 22178 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:17.595288 22809 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:17.596478 22175 raft_consensus.cc:1275] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:17.502506 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:17.610416 22177 raft_consensus.cc:1275] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:17.654986 22174 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
W20260709 13:06:17.655742 22174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 1736) took 2056 ms (client timeout 2159 ms). Trace:
I20260709 13:06:17.655946 22172 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:17.656169 22174 rpcz_store.cc:269] 0709 13:06:15.599231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.984880 (+385649us) service_pool.cc:224] Handling call
0709 13:06:17.655684 (+1670804us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:17.518128 22779 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:17.656854 22147 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:17.657531 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1398) took 2584 ms. Trace:
I20260709 13:06:17.611428 24093 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.656179 22811 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:17.658565 24093 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.659121 22147 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:17.659878 24054 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:17.611320 24144 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.624950 24162 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.661135 22106 raft_consensus.cc:2393] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:17.661031 22147 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:17.662079 24162 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.538614 24136 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.662772 24136 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.664964 24136 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:17.653386 24121 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.595969 23993 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.666105 23993 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.666489 23993 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.657917 22172 rpcz_store.cc:276] 0709 13:06:15.073447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.996033 (+1922586us) service_pool.cc:224] Handling call
0709 13:06:17.655702 (+659669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.656442 (+   740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.657337 (+   895us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b540017aa50. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:17.657471 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1516338432}
I20260709 13:06:17.667331 24121 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.570344 23967 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:17.667659 24162 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:17.668016 22104 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:17.668325 23967 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:17.668897 23967 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.668035 24093 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:17.670056 24162 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:17.671856 24144 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:17.671962 24121 consensus_queue.cc:1048] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:17.674103 22071 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:17.674010 23993 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:17.542510 24049 consensus_meta.cc:287] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.582s	user 0.013s	sys 0.001s
I20260709 13:06:17.658000 24082 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:17.617952 24096 consensus_queue.cc:237] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.665243 23996 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.646621 22072 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:17.674743 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.713585 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 195529us
I20260709 13:06:17.678572 23807 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.722103 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.723026 22180 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:17.709390 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.713897 24157 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:17.704546 24093 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.724663 22177 raft_consensus.cc:2410] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:17.724606 24157 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:06:17.710224 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 73710.5us
W20260709 13:06:17.602276 24152 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.298s	user 0.004s	sys 0.006s
I20260709 13:06:17.725871 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:17.726428 22178 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:17.727401 22218 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:17.696419 22147 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:17.729063 22147 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:17.729219 24144 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:17.730063 24082 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.730346 22147 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:17.688273 24148 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:17.731112 24082 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.685976 24121 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:17.701313 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1747) took 1477 ms. Trace:
I20260709 13:06:17.637068 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1414) took 2460 ms. Trace:
I20260709 13:06:17.725281 24157 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.732630 22176 rpcz_store.cc:276] 0709 13:06:16.224172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.584618 (+1360446us) service_pool.cc:224] Handling call
0709 13:06:17.584865 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.585073 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:17.585348 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.700680 (+115332us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.700869 (+   189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:17.700911 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:17.700987 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.701074 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.701233 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10390,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":133,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":121,"thread_start_us":114790,"threads_started":1,"wal-append.queue_time_us":110192}
I20260709 13:06:17.691516 24054 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:17.734499 23993 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:17.691712 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:17.724699 24093 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.708634 22220 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:17.759325 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 178390us
W20260709 13:06:17.761193 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 52675.6us
I20260709 13:06:17.762140 22220 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:17.571456 22069 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:17.736482 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 89928us
I20260709 13:06:17.732227 24121 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:17.737305 23833 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:17.737752 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.773370 22180 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:17.773591 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:17.738570 24182 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:06:17.739392 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:17.774547 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:17.739130 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:17.779314 22809 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:17.738417 24137 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.732878 22179 rpcz_store.cc:276] 0709 13:06:15.176802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.557801 (+2380999us) service_pool.cc:224] Handling call
0709 13:06:17.558073 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.558255 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:17.558553 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.636394 (+ 77841us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.636750 (+   356us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:17.636796 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:17.636843 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.636897 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.637004 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14813,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":934,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":189,"thread_start_us":63045,"threads_started":2,"wal-append.queue_time_us":44816}
I20260709 13:06:17.729033 22218 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:17.778076 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:17.781275 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 52301.8us
I20260709 13:06:17.783128 24136 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.783571 24136 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.783918 24136 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.786746 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:17.724016 23807 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:17.750326 22178 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:17.760926 24054 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:17.766167 22072 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:17.766335 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.763284 22220 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:17.767624 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 196234us
I20260709 13:06:17.768370 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.737905 23996 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.794561 22177 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:17.775151 22176 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.772600 24144 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.747812 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:17.760741 23744 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.683522 24150 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.808411 22069 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:17.812911 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 46801.5us
I20260709 13:06:17.812916 22069 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:17.757221 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:17.815578 22248 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.766953 24049 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.818199 24049 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:17.819617 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:17.820194 22180 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.820803 24051 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:17.821208 24051 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:17.821552 24051 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:17.823203 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.794201 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.825577 22069 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:17.826452 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 48458.7us
I20260709 13:06:17.772913 23833 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:17.780452 23976 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.780014 24121 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.690974 24145 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.789117 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:17.836647 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 47599.6us
I20260709 13:06:17.837221 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.774811 24171 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:17.810811 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 47632.3us
I20260709 13:06:17.787125 24154 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:17.791306 24090 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:17.789032 24024 consensus_queue.cc:1059] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:17.827669 23937 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:17.827236 24162 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.807603 24144 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.838585 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:17.827698 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:17.831251 23833 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.839347 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:17.855322 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:17.864799 22251 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:17.840710 22072 leader_election.cc:400] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6.
I20260709 13:06:17.839733 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:17.839828 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.789927 24147 consensus_queue.cc:1059] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:06:17.850592 22069 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:17.850623 22220 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:17.828979 22181 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:17.797022 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.833011 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:17.868048 22220 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:17.868407 22177 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.839025 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:17.854938 22254 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:17.868996 22220 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:17.851953 23996 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.904449 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:17.833565 24049 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:17.830427 23976 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:17.863409 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:17.865799 22250 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:17.855067 24137 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:17.871169 24157 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.933405 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:17.871609 24145 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.875339 24148 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:06:17.875865 22179 raft_consensus.cc:1240] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:17.822551 23744 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.893149 22253 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:17.855800 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:17.854606 24093 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:17.856314 23937 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.851723 24169 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:17.897351 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:17.850234 24171 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.865229 24144 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.900895 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:17.928983 23993 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.928759 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:17.923358 22779 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:17.933902 24088 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.906570 22251 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:06:17.861666 24162 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:18.268929 24162 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.938082 22815 raft_consensus.cc:2410] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:18.274657 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:17.853324 24050 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:18.275664 22172 raft_consensus.cc:2410] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:18.276677 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:17.895756 23963 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:18.276939 23807 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:17.876061 24154 raft_consensus.cc:697] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:18.277310 22246 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:18.277545 23807 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:18.278132 24154 consensus_queue.cc:237] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:18.279739 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:18.280098 23807 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:17.863207 23967 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:17.947692 22176 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:17.947701 22104 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:17.868986 24082 raft_consensus.cc:3055] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:17.912459 23832 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5.
I20260709 13:06:17.908653 23927 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.937352 24054 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:17.935949 22249 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.966347 22106 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:17.913396 24091 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:18.242803 24095 consensus_meta.cc:287] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.000s
I20260709 13:06:17.939411 23976 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:17.967489 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 128635us
I20260709 13:06:17.967881 22180 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:17.968918 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:17.971390 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:17.971783 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:18.007234 24171 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:18.222247 24136 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:17.928574 24170 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.200s
W20260709 13:06:18.117197 24185 log.cc:927] Time spent T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:06:18.001451 24088 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.053155 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:18.125649 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:17.969357 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:18.229521 23744 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:18.217000 23863 consensus_meta.cc:287] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.003s
W20260709 13:06:18.222867 24186 log.cc:927] Time spent T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.109s	user 0.000s	sys 0.002s
I20260709 13:06:18.218696 24150 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:18.233096 22177 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:17.949681 23937 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:18.054333 24179 log.cc:927] Time spent T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:06:18.238894 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.224167 24157 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:18.257484 24024 raft_consensus.cc:3055] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:18.258839 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:18.259197 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.260206 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:18.260703 24051 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:18.216570 24137 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:18.219129 23993 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:18.265414 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:18.276772 24050 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:17.938077 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:18.277266 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:18.306380 22248 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:18.393272 22251 pending_rounds.cc:85] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 3
I20260709 13:06:18.393386 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:18.403486 22781 leader_election.cc:336] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.559s (SENT)
I20260709 13:06:18.398849 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:17.966799 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:18.620214 22072 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:18.628930 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 225487us
I20260709 13:06:18.587170 22106 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:18.631862 22102 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:18.632452 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:18.632891 22251 pending_rounds.cc:107] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:06:18.633184 22251 raft_consensus.cc:2889] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:18.634209 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:18.634444 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:18.635072 22176 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:18.631562 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:18.553289 22249 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:18.637090 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:18.637233 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:18.637627 22249 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:18.637877 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:18.631561 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:18.618629 22218 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:18.643929 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:18.648083 22218 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:18.277249 23963 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:18.656806 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:18.664848 22176 raft_consensus.cc:2393] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 5: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:18.657536 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:18.587886 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:18.665419 22252 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:18.658221 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:18.666519 22177 raft_consensus.cc:2376] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3. Re-sending same reply.
I20260709 13:06:18.667461 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:18.668427 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:18.669291 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:18.658454 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:18.672451 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:18.656257 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:18.660315 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:18.660588 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:18.658959 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:18.673604 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:18.674289 22106 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:18.397192 23927 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:18.656222 24093 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:18.686087 23927 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:18.602208 24121 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:18.663692 23575 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:18.687549 23575 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:18.687211 24121 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:18.687947 23575 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:18.689431 24121 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:18.629132 24137 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.643559 23996 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:06:18.658272 24095 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:18.692262 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:18.693004 22251 raft_consensus.cc:2393] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
W20260709 13:06:18.423557 24096 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.004s	sys 0.012s
I20260709 13:06:18.674886 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:18.693744 24095 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:18.694160 22251 raft_consensus.cc:1275] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:18.694536 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:18.695367 23833 consensus_meta.cc:287] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.825s	user 0.009s	sys 0.000s
I20260709 13:06:18.695660 22179 raft_consensus.cc:1240] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 5. Ops: []
I20260709 13:06:18.695814 23833 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:18.697211 22179 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:18.698302 22179 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:18.677470 22248 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 3: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:18.675552 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:18.699396 22104 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:18.699569 22253 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:18.700851 22253 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:18.383941 24082 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:18.601898 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:18.698665 23833 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:18.678903 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:18.679502 24050 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:18.456707 23967 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:18.679602 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:18.680006 24150 consensus_queue.cc:1059] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:18.680671 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:18.681746 24136 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:18.646129 24024 raft_consensus.cc:740] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:18.587267 24054 raft_consensus.cc:697] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:18.647301 24088 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.683394 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:18.396942 24159 raft_consensus.cc:2764] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:06:18.683862 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:18.684396 24051 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:18.629868 23865 consensus_queue.cc:1059] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:06:18.618625 24198 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.685385 22808 raft_consensus.cc:2393] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:18.645804 24055 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:18.423128 24091 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.691303 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:19.029760 22813 raft_consensus.cc:2368] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:18.678391 22814 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:18.663291 24146 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:06:18.440946 22098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:06:18.676554 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:19.040655 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:19.041760 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:19.042906 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:19.041760 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:18.810954 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1765) took 1058 ms. Trace:
I20260709 13:06:18.659482 23863 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:19.000641 22253 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:19.000294 24082 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:19.001260 24139 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.710675 22815 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:18.753965 22105 raft_consensus.cc:2393] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 4: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:18.687227 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:18.423344 22172 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:18.829348 22252 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:18.691176 24137 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:18.675375 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:18.763695 22782 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:19.007902 22101 raft_consensus.cc:2410] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:18.738566 22220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.000s	sys 0.031s
W20260709 13:06:19.098605 22220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.168s	user 0.000s	sys 0.044s
W20260709 13:06:19.098963 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 1.18481e+06us
W20260709 13:06:18.708031 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 48430.9us
I20260709 13:06:19.099632 22181 raft_consensus.cc:1240] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:19.100235 22072 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:18.703373 22179 raft_consensus.cc:1240] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:18.823098 22102 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:18.944371 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:19.101140 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 280) took 1074 ms. Trace:
I20260709 13:06:18.685304 23993 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:18.713245 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 74823.6us
I20260709 13:06:19.105505 22812 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:19.108019 22071 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:19.022930 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:18.948243 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:19.027607 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 230114us
I20260709 13:06:19.108925 22816 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:19.023782 22251 raft_consensus.cc:1275] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:18.774995 22247 raft_consensus.cc:2368] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6.
I20260709 13:06:19.037776 24054 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:18.672490 23963 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:19.012259 24096 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.006s	sys 0.023s
I20260709 13:06:18.676368 24189 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.676821 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:18.815891 24164 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:19.049355 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:18.663972 23952 consensus_queue.cc:1059] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.378s
I20260709 13:06:19.087172 22176 raft_consensus.cc:2393] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 2: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:06:19.022783 24144 consensus_meta.cc:287] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.917s	user 0.010s	sys 0.000s
I20260709 13:06:19.089387 22815 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:19.192983 24164 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.195498 24144 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:18.799266 23744 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.040277 24091 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:19.094642 22813 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:19.094782 24082 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:19.095562 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:19.001993 24198 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:19.104363 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:19.103910 24024 consensus_queue.cc:260] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:19.101598 22102 rpcz_store.cc:276] 0709 13:06:18.026885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.027004 (+   119us) service_pool.cc:224] Handling call
0709 13:06:19.101068 (+1074064us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:19.013338 24154 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.064s	sys 0.075s
I20260709 13:06:19.110455 22218 leader_election.cc:400] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:19.034165 22814 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:18.807243 23575 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:19.118456 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 390388us
I20260709 13:06:19.119441 22220 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:19.126147 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:19.045409 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35198 (request call id 651) took 1133 ms. Trace:
I20260709 13:06:19.127082 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:18.763368 24162 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.134685 24093 consensus_queue.cc:1059] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:06:19.129593 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:19.148495 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.049033 24131 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.043690 22174 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:19.151746 22072 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:19.152496 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 44595.7us
I20260709 13:06:19.224416 22071 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:19.154264 23807 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:19.154428 24146 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:19.155254 24161 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:19.225842 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:19.135192 23993 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:19.206804 22253 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:19.158083 24049 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:19.096546 24139 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:19.214718 22218 leader_election.cc:403] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:06:19.239717 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 129353us
I20260709 13:06:19.240442 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:19.215054 22106 raft_consensus.cc:2368] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:19.215165 22179 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:19.215809 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 96472.4us
I20260709 13:06:19.216320 22255 raft_consensus.cc:2368] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3.
I20260709 13:06:19.217108 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:19.242538 22220 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:18.798391 23927 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:19.215293 22782 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:19.220083 22251 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:19.215266 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:19.222913 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:19.153864 24194 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:19.225200 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.233543 22103 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:19.266350 22220 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:19.267254 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:19.267769 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:19.234578 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 82936.8us
I20260709 13:06:19.269177 22072 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:19.236974 22253 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:19.233220 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:19.238674 23807 raft_consensus.cc:697] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:19.262727 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:19.263067 22781 leader_election.cc:336] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.530s (SENT)
W20260709 13:06:19.263792 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.221434 24136 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:19.220530 24154 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.066s	sys 0.082s
I20260709 13:06:19.225715 24024 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:19.323388 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 60490.3us
I20260709 13:06:19.187839 24189 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.268090 22220 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:19.273766 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:19.280617 22779 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:19.319479 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:19.319862 24154 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:19.320137 24144 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:19.270776 24083 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:19.316381 24150 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:19.213796 22808 rpcz_store.cc:276] 0709 13:06:17.912018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.912692 (+   674us) service_pool.cc:224] Handling call
0709 13:06:19.042657 (+1129965us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:19.233534 24146 consensus_queue.cc:1243] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:19.316329 22781 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:19.370554 24157 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:19.367973 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:19.367271 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:19.367627 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:19.375703 22069 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:19.320910 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1766) took 1580 ms. Trace:
I20260709 13:06:19.442237 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:19.261351 23993 raft_consensus.cc:697] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:19.330307 22179 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:19.366994 24198 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:19.323177 23833 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:19.326340 24190 log.cc:927] Time spent T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.563s	user 0.000s	sys 0.001s
I20260709 13:06:19.488138 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:19.220641 23744 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:19.316299 23952 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:19.364588 24161 consensus_queue.cc:1048] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 13:06:19.467907 24114 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:19.367379 24090 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:06:19.455753 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:19.451293 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 218144us
I20260709 13:06:19.483192 24138 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:19.330909 22816 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:19.464396 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:19.517424 22251 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:19.325498 24193 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:19.271360 24051 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:19.227073 24131 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:19.444211 22147 connection.cc:256] RPC call timeout handler was delayed by -1.5920631060000687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:06:19.239391 24049 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:19.322973 24194 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:19.467669 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 138499us
I20260709 13:06:19.475018 22813 raft_consensus.cc:2393] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:19.475592 22815 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
W20260709 13:06:19.475474 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 212413us
I20260709 13:06:19.535249 22072 leader_election.cc:400] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6.
I20260709 13:06:19.535722 22072 leader_election.cc:403] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:06:19.536542 22781 leader_election.cc:336] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.671s (SENT)
I20260709 13:06:19.476320 22814 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:19.371364 22809 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:19.478355 22218 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:19.365571 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:19.368196 24162 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:19.442836 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:19.366122 23575 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:19.516710 24209 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:19.243170 24096 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:19.390090 22247 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:19.444487 22100 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:19.325541 23967 consensus_queue.cc:1059] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.156s
W20260709 13:06:19.492245 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 277018us
I20260709 13:06:19.450080 24205 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:19.486902 22172 raft_consensus.cc:2393] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 2: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:06:19.508229 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 240215us
I20260709 13:06:19.570868 22220 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:19.537429 24193 raft_consensus.cc:697] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:19.510910 24121 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:19.511706 24212 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:19.457877 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 177362us
I20260709 13:06:19.446290 24154 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.520186 24164 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:19.486865 24157 raft_consensus.cc:697] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:19.487792 23863 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:19.324644 24136 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:19.367895 23807 consensus_queue.cc:237] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.528702 24093 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:19.537887 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:19.537151 22781 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:19.541821 22251 raft_consensus.cc:3055] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:19.483623 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:19.548923 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 173350us
W20260709 13:06:19.549963 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 71722.9us
I20260709 13:06:19.552264 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1742) took 1277 ms. Trace:
I20260709 13:06:19.553296 22104 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
I20260709 13:06:19.532647 24049 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:19.495954 23833 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.549417 24209 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.480414 22173 rpcz_store.cc:276] 0709 13:06:17.740490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.766823 (+ 26333us) service_pool.cc:224] Handling call
0709 13:06:17.791218 (+ 24395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.836508 (+ 45290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.839957 (+  3449us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:18.670713 (+830756us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b2c00040298. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6857372 00007f66a7f89a01 00007f66a7f4e43a 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2
0709 13:06:18.796155 (+125442us) log.cc:844] Serialized 26 byte log entry
0709 13:06:19.225464 (+429309us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:19.235706 (+ 10242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.260610 (+ 24904us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.320612 (+ 60002us) raft_consensus.cc:1685] finished
0709 13:06:19.320639 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.320854 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5371,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7683,"spinlock_wait_cycles":2576128,"thread_start_us":419451,"threads_started":1,"wal-append.queue_time_us":522596}
I20260709 13:06:19.590015 24189 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:19.591918 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:19.609809 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1767) took 1866 ms. Trace:
I20260709 13:06:19.674201 22178 rpcz_store.cc:276] 0709 13:06:17.743557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.892590 (+149033us) service_pool.cc:224] Handling call
0709 13:06:17.892922 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.937515 (+ 44593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.937544 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.937998 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.245663 (+307665us) spinlock_profiling.cc:243] Waited 6.68 ms on lock 0x7b4800271a58. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66ace77aa1 00007f66ace6eb37 00007f66ace6e9ca 00007f66acf6626f 00007f66acf65f37 00007f66acf7a55c 00007f66acf7a508 00007f66acf7a488 00007f66acf7a443 00007f66acf796ec 00007f66abea3a96
0709 13:06:18.420648 (+174985us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:18.420718 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.420820 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.570967 (+1150147us) raft_consensus.cc:1685] finished
0709 13:06:19.570988 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.609712 (+ 38724us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38354,"raft.queue_time_us":40594,"raft.run_cpu_time_us":3116,"raft.run_wall_time_us":307311,"spinlock_wait_cycles":15365888,"thread_start_us":305610,"threads_started":1,"wal-append.queue_time_us":739975}
I20260709 13:06:19.045387 22175 rpcz_store.cc:276] 0709 13:06:17.716189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.717302 (+  1113us) service_pool.cc:224] Handling call
0709 13:06:17.717764 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.718279 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:17.718633 (+   354us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.807536 (+ 88903us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.816713 (+  9177us) log.cc:844] Serialized 26 byte log entry
0709 13:06:17.816880 (+   167us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:17.816921 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.816998 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:18.683809 (+866811us) raft_consensus.cc:1685] finished
0709 13:06:18.683827 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.774346 (+ 90519us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3447,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":22008,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":203,"thread_start_us":72648,"threads_started":1,"wal-append.queue_time_us":125577}
I20260709 13:06:19.550225 24096 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:19.678028 24096 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:19.554276 24051 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:19.639065 22779 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.65:33421 timed out after 1.589s (SENT) [suppressed 16 similar messages]
I20260709 13:06:19.683013 24051 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:19.683161 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 44135.1us
I20260709 13:06:19.683831 24051 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:19.630426 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.553047 22174 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:19.685442 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:19.685750 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:19.568778 24200 log.cc:927] Time spent T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.521s	user 0.000s	sys 0.001s
I20260709 13:06:19.459214 22253 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:19.643910 22814 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:19.549193 24083 raft_consensus.cc:697] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:19.650599 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 107029us
I20260709 13:06:19.651715 24139 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:19.570632 24050 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:19.658905 22251 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:19.692718 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:19.698719 22251 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.699440 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:19.662861 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:19.700203 22253 raft_consensus.cc:2393] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:19.700524 22179 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:19.700990 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:19.563356 24146 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6.
I20260709 13:06:19.701332 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:19.667948 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:19.702353 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:19.702666 22218 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:19.667689 22069 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:19.699613 22251 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:19.694911 24083 consensus_queue.cc:237] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.658226 22249 rpcz_store.cc:276] 0709 13:06:18.275349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.001589 (+726240us) service_pool.cc:224] Handling call
0709 13:06:19.001858 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.002063 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:19.488829 (+486766us) log.cc:844] Serialized 14 byte log entry
0709 13:06:19.551757 (+ 62928us) log.cc:844] Serialized 14 byte log entry
0709 13:06:19.551909 (+   152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:19.551955 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:19.552002 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.552067 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.552189 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20435,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":7217,"raft.queue_time_us":24952,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":11514,"spinlock_wait_cycles":59717504,"thread_start_us":547976,"threads_started":2}
I20260709 13:06:19.707731 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:19.708516 22249 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:19.709256 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:19.702853 22179 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:19.692399 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 279) took 1665 ms. Trace:
I20260709 13:06:19.696327 22174 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:19.712549 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:19.713454 22174 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:19.711994 22099 rpcz_store.cc:276] 0709 13:06:18.026585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.026692 (+   107us) service_pool.cc:224] Handling call
0709 13:06:18.217439 (+190747us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:18.273250 (+ 55811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:18.273290 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:18.273765 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.433385 (+159620us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:18.433458 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.433566 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.691883 (+1258317us) raft_consensus.cc:1685] finished
0709 13:06:19.691905 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.692323 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44336,"raft.queue_time_us":44676,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":170054,"threads_started":2,"wal-append.queue_time_us":653880}
I20260709 13:06:19.714442 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:19.715802 22174 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:19.714807 22099 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:19.719048 24051 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:19.725595 24051 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.727945 24051 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.751784 22174 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:19.757236 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:19.763402 22174 raft_consensus.cc:2368] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3.
I20260709 13:06:19.764724 24051 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:19.588438 24144 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:19.565341 23575 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.097s
W20260709 13:06:19.776322 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 263875us
W20260709 13:06:19.645264 24192 log.cc:927] Time spent T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.549s	user 0.002s	sys 0.000s
I20260709 13:06:19.782475 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:19.783465 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 137653us
W20260709 13:06:19.784447 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.643601 24136 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:19.789096 22179 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
W20260709 13:06:19.790598 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 123021us
I20260709 13:06:19.793576 22251 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:06:19.795547 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:19.655205 24164 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.645566 24205 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:19.796514 22251 raft_consensus.cc:2393] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 2: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:19.807335 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:19.660881 23996 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:19.577805 24213 consensus_queue.cc:1059] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.201s
I20260709 13:06:19.658250 24090 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.805672 22099 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:06:19.808069 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 105454us
I20260709 13:06:19.808420 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:19.790396 24139 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:19.811326 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:19.578715 24114 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.202s
W20260709 13:06:19.789407 24201 log.cc:927] Time spent T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.474s	user 0.001s	sys 0.001s
I20260709 13:06:19.791779 24150 raft_consensus.cc:697] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:19.672242 24209 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:19.778846 23927 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:19.765647 23863 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:06:19.766984 24137 consensus_meta.cc:287] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.001s
I20260709 13:06:19.822199 22218 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:19.782029 24189 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:19.570053 23993 consensus_queue.cc:237] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:19.670796 24093 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.803205 24121 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:19.805143 24144 raft_consensus.cc:697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:19.822937 23976 consensus_meta.cc:287] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 1.157s	user 0.008s	sys 0.004s
I20260709 13:06:19.790787 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:19.854769 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 157451us
I20260709 13:06:19.866987 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:19.866592 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:19.823119 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:19.874675 22176 raft_consensus.cc:2410] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:06:19.860527 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.821712 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:19.647305 24212 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.818234 24051 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:19.879014 24189 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.884979 24150 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:19.885926 23835 raft_consensus.cc:3055] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:19.826171 24090 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.869336 23863 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:19.959676 24090 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:19.959702 24234 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.852869 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:19.887017 24144 consensus_queue.cc:237] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:19.888808 24093 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:19.889284 24206 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:19.889410 24159 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:19.879860 23976 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:19.890460 23807 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.892443 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:19.895423 24209 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.956566 23835 raft_consensus.cc:740] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:19.898965 24170 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:06:19.903784 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1343) took 1179 ms. Trace:
I20260709 13:06:19.875391 24137 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:19.880769 23744 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:19.889454 23575 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:19.854033 24193 consensus_queue.cc:237] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.879760 24157 consensus_queue.cc:237] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:19.826118 24096 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.847714 24219 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:19.928679 23833 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:19.929980 24194 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:19.992991 22176 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:19.993710 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 227) took 1755 ms. Trace:
I20260709 13:06:19.994030 22176 rpcz_store.cc:276] 0709 13:06:18.238088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.973664 (+1735576us) service_pool.cc:224] Handling call
0709 13:06:19.992688 (+ 19024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.993480 (+   792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.993656 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:19.992813 22253 raft_consensus.cc:2393] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:19.825107 24164 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.940043 24229 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:19.814709 24205 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:19.942521 24224 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:19.954195 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 417670us
I20260709 13:06:19.973265 22174 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
W20260709 13:06:19.876952 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 78332.5us
I20260709 13:06:19.967394 22147 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:19.968611 22220 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:19.961036 24091 consensus_meta.cc:287] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.747s	user 0.010s	sys 0.002s
I20260709 13:06:19.947829 22173 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:19.960723 24199 log.cc:927] Time spent T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.804s	user 0.004s	sys 0.000s
W20260709 13:06:19.975818 22105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 276) took 2006 ms (client timeout 2324 ms). Trace:
I20260709 13:06:19.953951 22247 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:19.984673 22104 rpcz_store.cc:276] 0709 13:06:18.724070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.041546 (+317476us) service_pool.cc:224] Handling call
0709 13:06:19.903543 (+861997us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b5400023854. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:19.903700 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1170849152}
W20260709 13:06:20.023408 22781 leader_election.cc:336] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.813s (SENT)
W20260709 13:06:19.910544 24171 consensus_meta.cc:287] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.253s	user 0.007s	sys 0.003s
I20260709 13:06:19.963450 24131 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:19.935822 23963 consensus_meta.cc:287] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.748s	user 0.012s	sys 0.000s
I20260709 13:06:19.997959 22180 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:06:20.030196 22180 pending_rounds.cc:85] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 6
I20260709 13:06:20.030447 22180 pending_rounds.cc:107] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:06:19.965068 22172 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:20.001505 24219 raft_consensus.cc:697] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:19.982937 24221 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.987289 23865 raft_consensus.cc:3055] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:19.823679 23996 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:19.999382 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 313773us
I20260709 13:06:19.976106 24206 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:20.012583 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1770) took 1625 ms. Trace:
I20260709 13:06:20.021673 22810 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:20.029613 24229 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:20.023873 22781 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:20.018718 22105 rpcz_store.cc:269] 0709 13:06:17.969212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.971081 (+  1869us) service_pool.cc:224] Handling call
0709 13:06:19.975563 (+2004482us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b540008ded4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:19.975747 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188266880}
I20260709 13:06:20.027523 22069 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:20.005544 24148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.002s	sys 0.022s
I20260709 13:06:20.030948 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:20.030735 22180 raft_consensus.cc:2889] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:20.032748 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:19.998528 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:19.987771 23807 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:19.992803 23575 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:20.029975 24082 consensus_meta.cc:287] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.816s	user 0.009s	sys 0.003s
I20260709 13:06:20.113493 22178 raft_consensus.cc:2410] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:20.113767 24082 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:20.114264 24082 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:20.024688 24091 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:20.047788 22814 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:20.039978 24232 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:20.021900 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 53356.7us
I20260709 13:06:20.128321 22220 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:20.087841 24148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.002s	sys 0.022s
I20260709 13:06:19.970605 24234 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:20.088038 22252 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
W20260709 13:06:20.088946 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 65564.1us
I20260709 13:06:20.089819 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 283) took 1491 ms. Trace:
W20260709 13:06:20.133235 22781 leader_election.cc:336] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.874s (SENT)
I20260709 13:06:20.129266 22220 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:19.990857 24159 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:20.033980 22809 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:20.006095 24231 consensus_queue.cc:1059] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:06:20.044502 23865 raft_consensus.cc:740] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:20.099280 23996 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:20.099478 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 228) took 1861 ms. Trace:
I20260709 13:06:20.146374 22180 rpcz_store.cc:276] 0709 13:06:18.238384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.978553 (+1740169us) service_pool.cc:224] Handling call
0709 13:06:19.997585 (+ 19032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.099124 (+101539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.099397 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:20.100378 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:20.046550 24024 consensus_meta.cc:287] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.713s	user 0.007s	sys 0.006s
I20260709 13:06:20.103567 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1771) took 1716 ms. Trace:
I20260709 13:06:20.104791 24209 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:20.133402 24121 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:20.107625 24096 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:20.108505 24189 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:20.034127 23835 consensus_queue.cc:260] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:20.110605 23807 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:20.111364 24219 consensus_queue.cc:237] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:20.163292 23835 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:20.164218 24161 raft_consensus.cc:3055] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:20.164649 24235 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:20.165412 24235 raft_consensus.cc:697] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:20.112368 23575 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:20.003659 22101 raft_consensus.cc:2393] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:06:20.126272 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 98828.1us
I20260709 13:06:20.168476 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:20.169273 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 1781) took 1050 ms. Trace:
I20260709 13:06:20.169107 23865 consensus_queue.cc:260] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:20.169675 22175 rpcz_store.cc:276] 0709 13:06:19.118718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.677394 (+558676us) service_pool.cc:224] Handling call
0709 13:06:20.168322 (+490928us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b5800165698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:20.169206 (+   884us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20333312}
I20260709 13:06:20.170290 23865 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:20.170514 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.027657 23833 consensus_queue.cc:1059] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:06:20.171347 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 207) took 2378 ms. Trace:
I20260709 13:06:20.172056 24114 consensus_queue.cc:1059] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:20.168495 22069 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:20.029553 23963 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:20.127002 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:20.092670 24088 consensus_meta.cc:287] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 1.064s	user 0.012s	sys 0.000s
I20260709 13:06:20.133303 22103 rpcz_store.cc:276] 0709 13:06:18.598661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.631327 (+ 32666us) service_pool.cc:224] Handling call
0709 13:06:20.089624 (+1458297us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b540042b654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:20.089755 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1373739776}
I20260709 13:06:20.140933 22252 raft_consensus.cc:1240] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:06:20.144304 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1344) took 1095 ms. Trace:
I20260709 13:06:20.145082 22246 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:20.147841 22104 raft_consensus.cc:2410] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:20.101024 24210 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:20.105507 24233 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:20.207971 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:20.044415 24216 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:06:20.032331 24171 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:20.048105 24221 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:20.153394 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 186071us
I20260709 13:06:20.154875 22177 raft_consensus.cc:2410] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:20.162390 23976 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:20.164736 24161 raft_consensus.cc:740] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:20.153317 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 331188us
I20260709 13:06:20.049676 22176 rpcz_store.cc:276] 0709 13:06:18.386843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.994787 (+1607944us) service_pool.cc:224] Handling call
0709 13:06:20.011898 (+ 17111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.012144 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.012183 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.012243 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:20.012289 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.012368 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.012510 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:20.140940 24194 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.270187 22248 raft_consensus.cc:1240] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:20.162670 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1772) took 1775 ms. Trace:
I20260709 13:06:20.177011 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:20.271826 22180 rpcz_store.cc:276] 0709 13:06:18.387519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.147192 (+1759673us) service_pool.cc:224] Handling call
0709 13:06:20.162160 (+ 14968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.162345 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.162372 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.162416 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:20.162444 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.162491 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.162614 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:20.171808 22181 rpcz_store.cc:276] 0709 13:06:17.793023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.873000 (+ 79977us) service_pool.cc:224] Handling call
0709 13:06:17.873331 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.100016 (+1226685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.171112 (+1071096us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540031abd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:20.171294 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2819861248}
I20260709 13:06:20.197672 22099 rpcz_store.cc:276] 0709 13:06:19.048638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.719853 (+671215us) service_pool.cc:224] Handling call
0709 13:06:19.720161 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.820899 (+100738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.136097 (+315198us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b540001ed54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:20.144240 (+  8143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195727616}
I20260709 13:06:20.208730 22814 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:20.275341 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:20.211285 24245 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:20.212095 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 76931.8us
I20260709 13:06:20.212277 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:20.207967 23575 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:20.147159 24224 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:20.217712 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:20.268213 22218 leader_election.cc:400] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4.
I20260709 13:06:20.166306 24235 consensus_queue.cc:237] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:20.236806 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57856 (request call id 244) took 1041 ms. Trace:
I20260709 13:06:20.300078 22178 rpcz_store.cc:276] 0709 13:06:19.195837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.676727 (+480890us) service_pool.cc:224] Handling call
0709 13:06:20.236555 (+559828us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b540028c154. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:20.236745 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":981660416}
I20260709 13:06:20.275913 22069 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:20.154830 24148 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:20.276800 22147 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:20.270385 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:20.214797 23937 consensus_meta.cc:287] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.551s	user 0.013s	sys 0.001s
I20260709 13:06:20.285568 24024 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.324663 22105 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:20.216216 24137 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:20.287871 22102 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:06:20.269723 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:20.292373 24221 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:20.294601 22218 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:20.269145 24121 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.334161 22218 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:20.302048 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:20.132166 24232 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:20.289649 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:20.307303 24157 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:20.308651 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:20.213764 24088 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:20.231724 24238 raft_consensus.cc:3055] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:20.233173 24050 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.318877 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:20.323732 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:20.231683 24049 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:20.328644 24219 consensus_queue.cc:1059] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:20.308440 24249 consensus_queue.cc:1059] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:20.340159 22176 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:20.339781 22181 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:20.340389 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 63665.5us
I20260709 13:06:20.361441 22252 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:20.327139 24193 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:20.287307 24194 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:20.332392 22098 raft_consensus.cc:606] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:20.324018 23575 raft_consensus.cc:697] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:20.388705 22250 raft_consensus.cc:2368] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3.
W20260709 13:06:20.390861 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:20.364532 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.392845 22180 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:20.396440 22147 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:20.399102 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.340917 24121 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:20.154176 22174 rpcz_store.cc:276] 0709 13:06:18.387205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.038738 (+1651533us) service_pool.cc:224] Handling call
0709 13:06:20.087438 (+ 48700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.103135 (+ 15697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.103182 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.103229 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:20.103274 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.103346 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.103484 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:20.343729 23976 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:20.391278 24091 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:20.342252 24148 raft_consensus.cc:697] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:20.437908 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.316967 24224 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:20.442037 22071 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:20.438429 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.334971 24164 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:20.345193 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1773) took 1957 ms. Trace:
I20260709 13:06:20.448486 22220 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:20.449124 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 147601us
I20260709 13:06:20.388142 24082 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:20.360634 24238 raft_consensus.cc:740] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:20.392958 23996 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.385277 24242 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.395869 24050 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:20.460453 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.444708 23976 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.336997 23937 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:20.463385 22071 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:20.515125 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 51822.9us
W20260709 13:06:20.463675 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 67287.7us
I20260709 13:06:20.387189 24088 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:20.408666 24193 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:20.525781 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1436) took 1876 ms. Trace:
I20260709 13:06:20.526228 22102 rpcz_store.cc:276] 0709 13:06:18.649754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.274235 (+624481us) service_pool.cc:224] Handling call
0709 13:06:19.334131 (+ 59896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.326351 (+992220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.525499 (+199148us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b54000ba254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:20.525713 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2192863104}
I20260709 13:06:20.527086 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:20.527434 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:20.527956 22102 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:20.516141 24249 consensus_queue.cc:1059] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:06:20.471889 24206 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:20.384884 24236 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:20.530745 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 445) took 1899 ms. Trace:
I20260709 13:06:20.402863 22098 raft_consensus.cc:614] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:20.468758 23807 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:20.347075 24144 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
W20260709 13:06:20.531773 22250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1732) took 2619 ms (client timeout 1612 ms). Trace:
I20260709 13:06:20.304328 24245 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:20.532478 23963 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:20.532707 24157 raft_consensus.cc:3055] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:20.384976 24161 consensus_queue.cc:260] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:20.337288 24024 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:20.387943 24241 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:20.477705 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:20.470736 24209 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:20.519326 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:20.521603 24171 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:20.521688 23575 consensus_queue.cc:237] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:20.501281 23996 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:20.514763 23976 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:21.028636 22102 consensus_meta.cc:287] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.000s
W20260709 13:06:21.085309 22181 consensus_meta.cc:287] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.001s
I20260709 13:06:21.226452 22102 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:20.554064 22106 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:20.631376 24055 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:21.227933 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:21.094010 22173 consensus_meta.cc:287] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 1.072s	user 0.010s	sys 0.000s
I20260709 13:06:21.167557 24049 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:21.229419 22173 raft_consensus.cc:2410] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:06:21.230108 22173 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1442) took 1656 ms (client timeout 2135 ms). Trace:
W20260709 13:06:20.930766 22100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 275) took 2910 ms (client timeout 1589 ms). Trace:
W20260709 13:06:21.230633 22173 rpcz_store.cc:269] 0709 13:06:19.573566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.790888 (+217322us) service_pool.cc:224] Handling call
0709 13:06:21.230032 (+1439144us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:21.231508 22100 rpcz_store.cc:269] 0709 13:06:17.968762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.968920 (+   158us) service_pool.cc:224] Handling call
0709 13:06:20.841576 (+2872656us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b540009e7d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:20.866114 (+ 24538us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708763904}
I20260709 13:06:21.231907 24216 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:21.229437 24050 consensus_meta.cc:287] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.003s
I20260709 13:06:21.232836 24050 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:21.233861 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:21.235327 24050 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:20.551800 24194 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:20.635298 24136 consensus_meta.cc:287] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.820s	user 0.012s	sys 0.000s
I20260709 13:06:21.236946 24136 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:20.533574 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33706 (request call id 14) took 2257 ms. Trace:
I20260709 13:06:21.238706 22098 rpcz_store.cc:276] 0709 13:06:18.275725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.383713 (+107988us) service_pool.cc:224] Handling call
0709 13:06:20.533355 (+2149642us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000ba254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f48853 00007f66acf1660a 00007f66a649c7d4 00007f66a649c762 00007f66a649c691 00007f66a649c60c 00007f66a649b8c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:20.533475 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2879906560}
I20260709 13:06:21.239583 24136 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:21.225816 24209 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:20.450402 22175 rpcz_store.cc:276] 0709 13:06:18.387817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.170731 (+1782914us) service_pool.cc:224] Handling call
0709 13:06:20.212758 (+ 42027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.277376 (+ 64618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.288319 (+ 10943us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.294301 (+  5982us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:20.318279 (+ 23978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.332545 (+ 14266us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.342607 (+ 10062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.270571 24209 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:21.271471 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:21.271548 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:21.272527 24055 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:21.272895 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:21.272966 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:21.274240 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:20.534279 24245 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:20.532182 22250 rpcz_store.cc:269] 0709 13:06:17.912653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.941523 (+ 28870us) service_pool.cc:224] Handling call
0709 13:06:20.531574 (+2590051us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54001cbbd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:20.531700 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4047069952}
I20260709 13:06:20.540303 24154 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:20.503660 24164 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:21.240456 22252 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:21.275988 24154 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.277796 24024 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:21.278199 24154 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:21.276235 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:21.280293 24154 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:20.531318 22810 rpcz_store.cc:276] 0709 13:06:18.631747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.643536 (+ 11789us) service_pool.cc:224] Handling call
0709 13:06:18.679200 (+ 35664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.085158 (+1405958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.530447 (+445289us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54007201d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:20.530654 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3044868992}
I20260709 13:06:20.549120 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1346) took 1400 ms. Trace:
W20260709 13:06:20.855731 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:20.842638 22099 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.011s	sys 0.016s
W20260709 13:06:21.282766 22099 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.018s	sys 0.027s
I20260709 13:06:21.145049 24121 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:20.574687 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 58232.5us
I20260709 13:06:20.537940 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:21.276319 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:20.543278 24250 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.233s	user 0.000s	sys 0.008s
W20260709 13:06:20.552374 22255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45738 (request call id 315) took 2805 ms (client timeout 1636 ms). Trace:
W20260709 13:06:21.289681 22255 rpcz_store.cc:269] 0709 13:06:17.747316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.747509 (+   193us) service_pool.cc:224] Handling call
0709 13:06:20.551896 (+2804387us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54002cc4d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:20.552235 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3250743552}
I20260709 13:06:21.244792 22176 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:21.276933 24164 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:21.084739 22180 consensus_meta.cc:287] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.002s
W20260709 13:06:20.536621 22246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1744) took 2260 ms (client timeout 1735 ms). Trace:
I20260709 13:06:20.535468 24210 raft_consensus.cc:3055] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:20.542855 24240 raft_consensus.cc:3055] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:20.503404 24242 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:20.552910 24159 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:21.235954 24232 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:21.251307 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:21.226657 22181 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:21.254320 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:21.257313 22102 raft_consensus.cc:2393] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:21.233109 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:21.262079 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:20.849341 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 175902us
W20260709 13:06:21.267048 22179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57856 (request call id 248) took 1481 ms (client timeout 1589 ms). Trace:
I20260709 13:06:21.280259 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:20.542326 23863 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:21.360255 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:21.281387 22101 rpcz_store.cc:276] 0709 13:06:19.148447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.222697 (+ 74250us) service_pool.cc:224] Handling call
0709 13:06:20.548850 (+1326153us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54000744d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:20.549041 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1704909696}
W20260709 13:06:20.536146 24248 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:06:20.550285 22097 raft_consensus.cc:2368] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5.
W20260709 13:06:20.928346 24251 log.cc:927] Time spent T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.497s	user 0.001s	sys 0.000s
W20260709 13:06:21.045336 24150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.008s	sys 0.023s
W20260709 13:06:20.984258 23835 consensus_meta.cc:287] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.820s	user 0.010s	sys 0.000s
I20260709 13:06:21.286803 22071 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:21.289060 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 46283.7us
I20260709 13:06:21.290798 22252 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
W20260709 13:06:21.292557 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.274891 22174 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 1.
I20260709 13:06:21.290809 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:21.314661 22180 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:21.380590 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1457) took 1107 ms. Trace:
W20260709 13:06:20.550117 22809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 296) took 2266 ms (client timeout 2697 ms). Trace:
I20260709 13:06:20.533080 24157 raft_consensus.cc:740] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:20.549824 23937 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:21.315167 22246 rpcz_store.cc:269] 0709 13:06:18.275993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.279506 (+  3513us) service_pool.cc:224] Handling call
0709 13:06:20.536397 (+2256891us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b540019bc54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:20.536547 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4288017152}
I20260709 13:06:21.334997 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1452) took 1006 ms. Trace:
I20260709 13:06:20.547595 24148 consensus_queue.cc:237] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:21.409400 22104 rpcz_store.cc:276] 0709 13:06:20.329032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.537659 (+208627us) service_pool.cc:224] Handling call
0709 13:06:21.334908 (+797249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.410624 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:21.338428 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:21.274753 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:21.340044 22781 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.025s	sys 0.022s
W20260709 13:06:21.415233 22781 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.026s	sys 0.023s
I20260709 13:06:21.286933 24154 consensus_queue.cc:1059] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:06:21.357901 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1458) took 1084 ms. Trace:
I20260709 13:06:21.340946 24088 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:21.347898 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 114642us
I20260709 13:06:21.363200 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1355) took 1019 ms. Trace:
I20260709 13:06:21.428299 22105 rpcz_store.cc:276] 0709 13:06:20.343403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.235379 (+891976us) service_pool.cc:224] Handling call
0709 13:06:21.363105 (+127726us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.289923 24121 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:21.365144 22253 raft_consensus.cc:2368] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3.
I20260709 13:06:21.322165 24164 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:21.321591 24210 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:21.322274 24024 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.369313 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:21.369835 22103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.015s	sys 0.013s
I20260709 13:06:21.283321 24049 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:06:21.371519 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1358) took 1005 ms. Trace:
I20260709 13:06:21.321987 24240 raft_consensus.cc:740] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:21.373189 22176 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:21.450766 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1459) took 1055 ms. Trace:
I20260709 13:06:21.451186 22176 rpcz_store.cc:276] 0709 13:06:20.395187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.446349 (+ 51162us) service_pool.cc:224] Handling call
0709 13:06:21.450707 (+1004358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.339021 24054 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.381083 22180 rpcz_store.cc:276] 0709 13:06:20.272965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.273258 (+   293us) service_pool.cc:224] Handling call
0709 13:06:21.380511 (+1107253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.356714 24159 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:21.415571 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 964380us
W20260709 13:06:21.357587 22179 rpcz_store.cc:269] 0709 13:06:19.785844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.790536 (+  4692us) service_pool.cc:224] Handling call
0709 13:06:21.266800 (+1476264us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b540013db54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:21.266970 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020378880}
I20260709 13:06:21.419159 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:21.411629 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1357) took 1046 ms. Trace:
I20260709 13:06:21.422142 22181 rpcz_store.cc:276] 0709 13:06:20.273203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.274134 (+   931us) service_pool.cc:224] Handling call
0709 13:06:21.357838 (+1083704us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:20.632653 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1757) took 1184 ms. Trace:
W20260709 13:06:21.373831 22807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.020s	sys 0.023s
I20260709 13:06:21.426047 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:21.005167 24238 consensus_queue.cc:260] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:21.372094 24150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.010s	sys 0.023s
I20260709 13:06:21.369208 23863 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.448167 22102 rpcz_store.cc:276] 0709 13:06:20.365848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.227554 (+861706us) service_pool.cc:224] Handling call
0709 13:06:21.371407 (+143853us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.375985 23996 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:21.381070 24235 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:21.448028 22250 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:21.449015 22103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.015s	sys 0.021s
I20260709 13:06:21.364807 22173 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:21.373868 24224 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:21.448812 22101 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 1.
I20260709 13:06:21.575296 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1454) took 1245 ms. Trace:
I20260709 13:06:21.575752 22101 rpcz_store.cc:276] 0709 13:06:20.329558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.369024 (+1039466us) service_pool.cc:224] Handling call
0709 13:06:21.575222 (+206198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:21.408367 22809 rpcz_store.cc:269] 0709 13:06:18.283698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.384088 (+100390us) service_pool.cc:224] Handling call
0709 13:06:20.549854 (+2165766us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54005d1454. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:20.550006 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396367744}
I20260709 13:06:21.471246 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:21.580319 22105 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:21.457837 22253 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:21.506490 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:21.506490 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:21.475611 22104 rpcz_store.cc:276] 0709 13:06:20.365510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.410298 (+1044788us) service_pool.cc:224] Handling call
0709 13:06:21.411552 (+  1254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.508546 22781 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:21.432919 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1359) took 1063 ms. Trace:
I20260709 13:06:21.508436 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 335) took 1370 ms. Trace:
I20260709 13:06:21.429629 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1453) took 1095 ms. Trace:
I20260709 13:06:21.512698 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:21.458418 24024 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:21.432049 23937 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:21.432790 24050 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:21.470561 22175 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:21.382095 24236 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:21.448917 24136 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:21.514547 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:21.524451 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.456884 23865 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:21.473382 24054 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
W20260709 13:06:21.564870 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 278120us
W20260709 13:06:21.565574 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 167265us
W20260709 13:06:21.566066 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 202997us
I20260709 13:06:21.567389 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1532) took 1745 ms. Trace:
W20260709 13:06:21.517786 22807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.028s	sys 0.035s
I20260709 13:06:21.513458 23575 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:21.448768 24121 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:21.437368 24088 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:21.516187 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:21.629278 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:21.624763 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 193334us
I20260709 13:06:21.648202 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:21.736413 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1356) took 1391 ms. Trace:
I20260709 13:06:21.736783 22104 rpcz_store.cc:276] 0709 13:06:20.364785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.647886 (+1283101us) service_pool.cc:224] Handling call
0709 13:06:21.736353 (+ 88467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.582237 22179 raft_consensus.cc:2393] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:21.738020 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:21.738541 22179 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:21.581712 22176 raft_consensus.cc:2410] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:21.579566 24235 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:21.651713 22181 raft_consensus.cc:2410] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:21.435639 23963 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:21.507714 24252 consensus_queue.cc:1059] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:06:21.622272 22246 rpcz_store.cc:276] 0709 13:06:20.138233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.475403 (+1337170us) service_pool.cc:224] Handling call
0709 13:06:21.507706 (+ 32303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.507958 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:21.507996 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:21.508054 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:21.508109 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.508195 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.508356 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.583005 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 334) took 1445 ms. Trace:
I20260709 13:06:21.658692 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1758) took 2202 ms. Trace:
I20260709 13:06:21.508415 24159 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:21.571156 23996 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.577659 23833 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:21.694669 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:21.622189 22098 rpcz_store.cc:276] 0709 13:06:20.366116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.279995 (+913879us) service_pool.cc:224] Handling call
0709 13:06:21.429390 (+149395us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:21.702131 22206 heartbeater.cc:646] Failed to heartbeat to 127.20.130.126:34457 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.130.126:34457 timed out after 15.000s (SENT)
I20260709 13:06:21.579294 24150 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.656925 24154 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.656621 24224 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:21.713107 22180 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:21.582381 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 1792) took 1104 ms. Trace:
I20260709 13:06:21.650820 24241 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:21.722172 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.723744 22250 rpcz_store.cc:276] 0709 13:06:19.822559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.423128 (+1600569us) service_pool.cc:224] Handling call
0709 13:06:21.447845 (+ 24717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.567149 (+119304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.567336 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.566047 23863 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:21.741650 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1454) took 1469 ms. Trace:
I20260709 13:06:21.580981 22220 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:21.577235 24264 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.152s
I20260709 13:06:21.744557 22104 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:21.745481 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.514145 24157 consensus_queue.cc:260] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:21.693218 24050 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:21.578111 24240 consensus_queue.cc:260] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:21.689916 23937 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:21.726698 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1460) took 1322 ms. Trace:
I20260709 13:06:21.720667 24262 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.745918 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:21.651059 22100 rpcz_store.cc:276] 0709 13:06:20.329317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.232826 (+903509us) service_pool.cc:224] Handling call
0709 13:06:21.424553 (+191727us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.127381 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1442) took 2617 ms. Trace:
I20260709 13:06:22.142763 22104 rpcz_store.cc:276] 0709 13:06:19.509997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.744037 (+2234040us) service_pool.cc:224] Handling call
0709 13:06:21.744373 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.127127 (+382754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.127322 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.144080 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:21.849288 22179 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:22.124197 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:22.145222 22180 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:22.146071 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:22.147261 22180 raft_consensus.cc:2410] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:22.107297 24232 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:22.092639 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 634526us
I20260709 13:06:22.124701 22176 rpcz_store.cc:276] 0709 13:06:20.272263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.458242 (+1185979us) service_pool.cc:224] Handling call
0709 13:06:21.741589 (+283347us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:22.152644 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:21.906303 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 183602us
I20260709 13:06:22.125435 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1455) took 1795 ms. Trace:
I20260709 13:06:22.124490 22251 rpcz_store.cc:276] 0709 13:06:19.456229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.093583 (+637354us) service_pool.cc:224] Handling call
0709 13:06:20.172407 (+ 78824us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b5800111698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:20.172596 (+   189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.172810 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.172835 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:20.173285 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:06:20.308219 (+134934us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:20.308267 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.308331 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:21.658315 (+1349984us) raft_consensus.cc:1685] finished
0709 13:06:21.658348 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.658623 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41178368,"thread_start_us":134563,"threads_started":1,"wal-append.queue_time_us":133954}
I20260709 13:06:22.124501 22218 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:22.129828 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:22.040108 23976 consensus_meta.cc:287] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.800s	user 0.011s	sys 0.000s
I20260709 13:06:22.151458 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1452) took 1879 ms. Trace:
I20260709 13:06:21.742177 24269 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:21.721067 24136 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:21.718976 24236 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:21.727349 23865 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:22.278812 24258 log.cc:927] Time spent T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.552s	user 0.000s	sys 0.001s
W20260709 13:06:22.279381 22172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57856 (request call id 241) took 3125 ms (client timeout 2051 ms). Trace:
W20260709 13:06:22.279842 22172 rpcz_store.cc:269] 0709 13:06:19.154339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.591503 (+437164us) service_pool.cc:224] Handling call
0709 13:06:22.279161 (+2687658us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540013d654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:22.279287 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441079680}
I20260709 13:06:22.280620 23865 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:22.281497 22172 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:22.281808 23865 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:22.282301 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1776) took 3884 ms. Trace:
I20260709 13:06:22.271760 23832 raft_consensus.cc:3055] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:22.264719 22178 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:06:22.276435 24265 log.cc:927] Time spent T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.564s	user 0.000s	sys 0.000s
I20260709 13:06:22.276584 24024 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:22.277038 24259 log.cc:927] Time spent T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.616s	user 0.000s	sys 0.001s
W20260709 13:06:22.264453 24272 log.cc:927] Time spent T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.456s	user 0.000s	sys 0.000s
I20260709 13:06:22.283237 24267 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:06:22.269098 24254 log.cc:927] Time spent T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.755s	user 0.000s	sys 0.001s
I20260709 13:06:22.283440 24050 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:22.307365 24253 log.cc:927] Time spent T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.783s	user 0.000s	sys 0.001s
I20260709 13:06:22.263019 23863 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:22.260902 24235 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:22.307652 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1775) took 3919 ms. Trace:
I20260709 13:06:22.259975 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:22.343847 22250 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:22.314421 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 189994us
I20260709 13:06:22.307307 23832 raft_consensus.cc:740] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:22.240692 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1774) took 3852 ms. Trace:
I20260709 13:06:22.352707 22176 rpcz_store.cc:276] 0709 13:06:18.388145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.239773 (+3851628us) service_pool.cc:224] Handling call
0709 13:06:22.240151 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.240317 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.240344 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.240389 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:22.240426 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.240496 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.240618 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.354538 22176 raft_consensus.cc:1275] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:22.128039 23937 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:22.315182 22102 rpcz_store.cc:276] 0709 13:06:20.329798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.620669 (+1290871us) service_pool.cc:224] Handling call
0709 13:06:22.125369 (+504700us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:22.151590 24256 log.cc:927] Time spent T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.694s	user 0.000s	sys 0.001s
I20260709 13:06:22.239611 22179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:06:22.369370 22179 raft_consensus.cc:606] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:22.369843 22179 raft_consensus.cc:614] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:22.195806 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:22.197600 22781 leader_election.cc:400] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3.
I20260709 13:06:22.370786 22181 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:22.246492 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:22.371373 22101 raft_consensus.cc:2376] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4. Re-sending same reply.
I20260709 13:06:22.372387 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:22.321131 22180 rpcz_store.cc:276] 0709 13:06:20.271697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.145809 (+1874112us) service_pool.cc:224] Handling call
0709 13:06:22.151394 (+  5585us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:22.281533 24209 consensus_meta.cc:287] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 1.010s	user 0.006s	sys 0.003s
W20260709 13:06:22.300623 22099 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.004s	sys 0.018s
I20260709 13:06:22.266238 24252 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:22.119763 24242 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:22.128121 22253 rpcz_store.cc:276] 0709 13:06:20.137833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.455378 (+1317545us) service_pool.cc:224] Handling call
0709 13:06:21.457664 (+  2286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.582743 (+125079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.582952 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:22.264972 24275 log.cc:927] Time spent T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:06:22.072257 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 1794) took 1421 ms. Trace:
I20260709 13:06:22.339572 22252 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:22.131690 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:22.402304 22101 raft_consensus.cc:1240] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:22.137702 24150 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:22.340576 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:22.285125 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:22.411424 22098 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:22.412765 22098 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:22.413340 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1447) took 2439 ms. Trace:
I20260709 13:06:22.413647 22098 rpcz_store.cc:276] 0709 13:06:19.973688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.412113 (+2438425us) service_pool.cc:224] Handling call
0709 13:06:22.412427 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.413114 (+   687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.413289 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.258872 24283 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:22.415496 24283 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:22.343482 22178 rpcz_store.cc:276] 0709 13:06:18.388459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.263975 (+3875516us) service_pool.cc:224] Handling call
0709 13:06:22.264316 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.307142 (+ 42826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.307587 (+   445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.405740 24252 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:22.419459 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1448) took 2330 ms. Trace:
I20260709 13:06:22.420019 22098 rpcz_store.cc:276] 0709 13:06:20.088705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.414386 (+2325681us) service_pool.cc:224] Handling call
0709 13:06:22.414671 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.419048 (+  4377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.419096 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.419150 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:22.419197 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.419272 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.419400 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82}
I20260709 13:06:22.345747 22218 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:22.300809 22254 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.009s	sys 0.013s
W20260709 13:06:22.423236 22254 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.010s	sys 0.013s
I20260709 13:06:22.129624 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:22.424077 22810 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:22.274873 24278 log.cc:927] Time spent T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.520s	user 0.001s	sys 0.000s
I20260709 13:06:22.315153 22172 rpcz_store.cc:276] 0709 13:06:18.397702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.280944 (+3883242us) service_pool.cc:224] Handling call
0709 13:06:22.281310 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.281973 (+   663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.282244 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:22.346719 22069 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.000s	sys 0.006s
I20260709 13:06:22.280051 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 666) took 1800 ms. Trace:
W20260709 13:06:22.428933 22069 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.002s	sys 0.006s
I20260709 13:06:22.139158 24262 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:22.428659 22807 rpcz_store.cc:276] 0709 13:06:20.479878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.501073 (+ 21195us) service_pool.cc:224] Handling call
0709 13:06:20.521047 (+ 19974us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.535041 (+ 13994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.535101 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:20.535807 (+   706us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.724096 (+1188289us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:21.724157 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.724260 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.279827 (+555567us) raft_consensus.cc:1685] finished
0709 13:06:22.279845 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.279982 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13422,"raft.queue_time_us":26946,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"thread_start_us":1187798,"threads_started":1,"wal-append.queue_time_us":1030502}
I20260709 13:06:22.430580 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1352) took 3039 ms. Trace:
W20260709 13:06:22.431252 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 85611.5us
I20260709 13:06:22.432926 22218 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:22.308246 24121 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:22.237169 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:22.133338 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 552411us
W20260709 13:06:22.356146 22072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.016s	sys 0.012s
W20260709 13:06:22.438977 22072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.016s	sys 0.012s
I20260709 13:06:22.194738 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:22.125049 22173 rpcz_store.cc:276] 0709 13:06:20.477910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.231981 (+754071us) service_pool.cc:224] Handling call
0709 13:06:21.582307 (+350326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.282320 23865 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:22.145444 23963 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:22.334717 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:22.134960 24273 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:22.371055 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 217908us
I20260709 13:06:22.330008 24288 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:22.396714 22099 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.006s	sys 0.025s
I20260709 13:06:22.127543 24154 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:22.262280 24205 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:22.403102 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1443) took 2892 ms. Trace:
I20260709 13:06:22.403163 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:22.454764 22144 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:22.466039 24154 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:22.363962 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 48082us
I20260709 13:06:22.380403 22181 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:22.368728 24050 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:22.454017 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.468156 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1464) took 1129 ms. Trace:
I20260709 13:06:22.468531 22181 rpcz_store.cc:276] 0709 13:06:21.338654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.134329 (+795675us) service_pool.cc:224] Handling call
0709 13:06:22.468095 (+333766us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.134464 23996 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:22.127023 24224 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:22.355583 24280 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.005s	sys 0.024s
I20260709 13:06:22.429065 24236 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:22.132085 22175 rpcz_store.cc:276] 0709 13:06:20.397856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.274431 (+876575us) service_pool.cc:224] Handling call
0709 13:06:21.720269 (+445838us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.421600 24252 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:22.421785 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:22.410638 22174 rpcz_store.cc:276] 0709 13:06:20.651436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.450844 (+799408us) service_pool.cc:224] Handling call
0709 13:06:22.050867 (+600023us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.357707 23976 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:22.599104 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 131282us
I20260709 13:06:22.430969 22103 rpcz_store.cc:276] 0709 13:06:19.364364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.294326 (+929962us) service_pool.cc:224] Handling call
0709 13:06:20.294713 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.297877 (+  3164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.297921 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:20.317523 (+ 19602us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.567284 (+1249761us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:21.567318 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.567378 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.403131 (+835753us) raft_consensus.cc:1685] finished
0709 13:06:22.403148 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.403264 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":420,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":24047,"thread_start_us":1249471,"threads_started":1,"wal-append.queue_time_us":1205949}
I20260709 13:06:22.355225 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1777) took 3725 ms. Trace:
I20260709 13:06:22.195139 24264 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.152318 24240 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:22.435024 22105 consensus_meta.cc:287] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.840s	user 0.008s	sys 0.002s
I20260709 13:06:22.640790 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:22.443456 22104 raft_consensus.cc:2393] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:22.444875 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1531) took 2649 ms. Trace:
I20260709 13:06:22.641201 22105 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:22.449196 22250 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:22.450825 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 288) took 2576 ms. Trace:
I20260709 13:06:22.332979 24269 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:22.443729 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:22.363665 24292 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.399983 24232 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.436870 24148 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.444082 24054 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:06:22.427205 24282 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:22.398192 24209 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:22.337164 24267 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:22.135124 24241 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:22.469389 22781 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:22.456409 22782 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:22.471722 22178 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:22.468504 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.473696 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:22.464814 22101 rpcz_store.cc:276] 0709 13:06:19.510821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.401834 (+2891013us) service_pool.cc:224] Handling call
0709 13:06:22.402111 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.402804 (+   693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.403036 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.465238 22246 raft_consensus.cc:2393] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:22.455765 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1351) took 3091 ms. Trace:
I20260709 13:06:22.474205 22144 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:22.579942 24050 raft_consensus.cc:697] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:22.621626 22249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1522) took 2957 ms (client timeout 1894 ms). Trace:
I20260709 13:06:22.637537 22251 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:22.129236 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:22.500898 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:22.606734 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 127873us
I20260709 13:06:22.640370 22176 rpcz_store.cc:276] 0709 13:06:18.630331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.353851 (+3723520us) service_pool.cc:224] Handling call
0709 13:06:22.354156 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.354977 (+   821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.355172 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.439196 22220 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:22.642122 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:22.467278 24194 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.457787 24295 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:22.457252 24287 log.cc:927] Time spent T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:22.672935 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:22.673487 22253 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:22.698282 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1537) took 1125 ms. Trace:
W20260709 13:06:22.641716 22105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1363) took 1263 ms (client timeout 1581 ms). Trace:
I20260709 13:06:22.450579 23835 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:22.453589 24242 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.685928 22071 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:22.461390 24164 consensus_meta.cc:287] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 1.003s	user 0.009s	sys 0.000s
I20260709 13:06:22.463327 23863 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.464346 24136 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:22.720686 22255 raft_consensus.cc:2393] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 3: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:06:22.638310 24280 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.016s	sys 0.040s
I20260709 13:06:22.673314 22102 rpcz_store.cc:276] 0709 13:06:19.874860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.407098 (+2532238us) service_pool.cc:224] Handling call
0709 13:06:22.450311 (+ 43213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.450486 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.450508 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.450553 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:22.450582 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.450637 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.450765 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:22.723727 22177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57856 (request call id 234) took 4000 ms (client timeout 2009 ms). Trace:
I20260709 13:06:22.603919 23937 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.459077 24216 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.721208 24232 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:21.508291 22247 rpcz_store.cc:276] 0709 13:06:19.448322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.046046 (+597724us) service_pool.cc:224] Handling call
0709 13:06:20.114011 (+ 67965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.114395 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.114428 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:20.114956 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:06:20.430020 (+315064us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:20.449341 (+ 19321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.461801 (+ 12460us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:20.632323 (+170522us) raft_consensus.cc:1685] finished
0709 13:06:20.632362 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.632565 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5277,"raft.queue_time_us":4611,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4327,"spinlock_wait_cycles":25856,"thread_start_us":278294,"threads_started":1,"wal-append.queue_time_us":506963,"wal-append.run_cpu_time_us":3615,"wal-append.run_wall_time_us":1028663}
I20260709 13:06:22.676748 24224 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:22.459209 23865 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:22.457597 24088 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:23.584364 22816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 458) took 3267 ms. Trace:
I20260709 13:06:22.680447 24150 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:22.752831 24267 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:22.641538 22254 rpcz_store.cc:276] 0709 13:06:19.795939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.437115 (+641176us) service_pool.cc:224] Handling call
0709 13:06:21.243262 (+806147us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:21.292158 (+ 48896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:21.292199 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:21.292753 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.563636 (+270883us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:22.423606 (+859970us) log.cc:844] Serialized 14 byte log entry
0709 13:06:22.444543 (+ 20937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.444616 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.444660 (+    44us) raft_consensus.cc:1685] finished
0709 13:06:22.444685 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.444816 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80606,"prepare.queue_time_us":770774,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":75133,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":34329,"thread_start_us":1052597,"threads_started":2,"wal-append.queue_time_us":310047}
I20260709 13:06:22.697824 22098 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:22.457486 23832 consensus_queue.cc:260] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:22.778818 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 304682us
W20260709 13:06:22.628024 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.580699 22810 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:22.699118 24154 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:22.474910 22100 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:22.516587 24205 consensus_queue.cc:1059] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.211s
W20260709 13:06:22.748543 22252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1773) took 1506 ms (client timeout 1681 ms). Trace:
I20260709 13:06:22.627050 24301 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.184s
I20260709 13:06:22.706671 24292 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:22.475668 24273 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:22.675884 24264 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:22.751267 24241 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:22.789029 24194 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:22.747786 24209 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:23.385933 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 470130us
W20260709 13:06:22.940863 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.739084 24299 consensus_queue.cc:1059] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.473s
W20260709 13:06:22.811537 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.635812 24292 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:23.581103 23937 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:23.566560 23863 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:23.581311 24216 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:23.639770 23863 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:23.640373 23863 consensus_queue.cc:1059] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:23.640810 24216 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:22.788707 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 349580us
W20260709 13:06:23.635849 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.784652 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1545) took 1206 ms. Trace:
I20260709 13:06:22.788100 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1455) took 2515 ms. Trace:
I20260709 13:06:23.643251 22251 rpcz_store.cc:276] 0709 13:06:21.577977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.421514 (+843537us) service_pool.cc:224] Handling call
0709 13:06:22.784588 (+363074us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.643329 22176 rpcz_store.cc:276] 0709 13:06:20.272490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.787260 (+2514770us) service_pool.cc:224] Handling call
0709 13:06:22.787587 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.787772 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.787794 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.787831 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:22.787866 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.787916 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.788029 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.778370 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1544) took 1200 ms. Trace:
I20260709 13:06:23.644974 22246 rpcz_store.cc:276] 0709 13:06:21.577693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.402944 (+825251us) service_pool.cc:224] Handling call
0709 13:06:22.778311 (+375367us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:22.776114 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 306759us
W20260709 13:06:22.881206 22779 connection.cc:256] RPC call timeout handler was delayed by -1.2813607079999656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
W20260709 13:06:23.647500 22779 connection.cc:256] RPC call timeout handler was delayed by -1.1832607080000344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 13:06:23.647709 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1447) took 4072 ms. Trace:
W20260709 13:06:23.647851 22779 connection.cc:256] RPC call timeout handler was delayed by -1.1145657629999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
I20260709 13:06:22.774287 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:23.649155 22813 raft_consensus.cc:2368] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5.
W20260709 13:06:23.649521 22813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35198 (request call id 662) took 3473 ms (client timeout 1858 ms). Trace:
W20260709 13:06:23.649749 22813 rpcz_store.cc:269] 0709 13:06:20.175777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.175902 (+   125us) service_pool.cc:224] Handling call
0709 13:06:22.743398 (+2567496us) spinlock_profiling.cc:243] Waited 974 us on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:23.649467 (+906069us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2239232}
W20260709 13:06:22.778384 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 322011us
I20260709 13:06:22.748796 23996 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:22.978492 22809 raft_consensus.cc:2393] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:23.623848 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35198 (request call id 668) took 1494 ms. Trace:
I20260709 13:06:22.749571 24286 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:23.213063 24240 consensus_meta.cc:287] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.002s
I20260709 13:06:23.180593 24235 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:23.559338 22253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45738 (request call id 341) took 1994 ms (client timeout 1763 ms). Trace:
I20260709 13:06:23.551786 22250 rpcz_store.cc:276] 0709 13:06:21.572604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.145232 (+572628us) service_pool.cc:224] Handling call
0709 13:06:22.698217 (+552985us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.747660 23963 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:22.748615 24221 raft_consensus.cc:3055] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:23.149114 24049 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.748236 24297 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:22.739154 24279 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:22.726480 24148 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:22.789105 24298 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:23.694056 24298 raft_consensus.cc:697] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:23.694180 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:23.694808 24273 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:23.695057 24298 consensus_queue.cc:237] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:22.890125 22811 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:23.696375 24194 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:23.696529 22811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 673) took 1218 ms. Trace:
I20260709 13:06:23.696594 22808 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:22.781625 24054 raft_consensus.cc:2764] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:22.747435 23976 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:22.751163 23833 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:22.779423 24252 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:23.701000 23833 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:23.669543 24286 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:23.551206 24295 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:23.565765 23835 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:23.626212 24159 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:22.739127 24282 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:23.704360 23937 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:23.564631 24242 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:23.566875 24164 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:23.704947 24148 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:23.705642 23835 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:23.007617 24050 consensus_queue.cc:237] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:22.747673 24303 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.641443 24216 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:23.697710 24306 log.cc:927] Time spent T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.691s	user 0.004s	sys 0.004s
I20260709 13:06:23.688338 24221 raft_consensus.cc:740] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:23.701459 24252 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:06:23.609284 24212 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:23.699002 24205 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.703413 24286 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.708089 24216 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.715385 24216 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.715489 24221 consensus_queue.cc:260] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:23.709365 24303 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:23.711143 24232 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:23.711926 24264 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:23.689661 24235 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:23.720053 24235 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:23.712025 24295 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:23.709782 24242 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:23.720053 24303 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:23.708567 24299 consensus_queue.cc:1059] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:06:23.713747 24282 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:23.723369 24282 raft_consensus.cc:3055] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:23.723779 24282 raft_consensus.cc:740] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:23.724625 24282 consensus_queue.cc:260] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:23.727713 24286 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:23.766642 22000 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40934 (request call id 283) took 19488 ms (client timeout 15000 ms). Trace:
I20260709 13:06:22.786823 22072 leader_election.cc:400] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3.
I20260709 13:06:23.772681 22072 leader_election.cc:403] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:23.179850 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:23.775848 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 989122us
W20260709 13:06:23.776690 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.777575 22072 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:23.614975 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 929057us
W20260709 13:06:23.624850 22100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 291) took 1885 ms (client timeout 2078 ms). Trace:
I20260709 13:06:23.785835 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1353) took 3609 ms. Trace:
W20260709 13:06:23.565395 22097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1348) took 4337 ms (client timeout 1890 ms). Trace:
I20260709 13:06:22.778504 22099 rpcz_store.cc:276] 0709 13:06:19.364046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.286042 (+921996us) service_pool.cc:224] Handling call
0709 13:06:20.286402 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.286612 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:21.283334 (+996722us) log.cc:844] Serialized 14 byte log entry
0709 13:06:22.455443 (+1172109us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.455500 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:22.455548 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.455608 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.455714 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30411,"prepare.queue_time_us":1161621,"prepare.run_cpu_time_us":1460,"prepare.run_wall_time_us":15720,"raft.queue_time_us":337381,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":31615,"thread_start_us":2167475,"threads_started":3,"wal-append.queue_time_us":852207,"wal-append.run_cpu_time_us":1248,"wal-append.run_wall_time_us":1124483}
W20260709 13:06:23.786114 22100 rpcz_store.cc:269] 0709 13:06:21.738362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.258935 (+520573us) service_pool.cc:224] Handling call
0709 13:06:23.623359 (+1364424us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:23.786888 22097 rpcz_store.cc:269] 0709 13:06:19.223347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.262360 (+ 39013us) service_pool.cc:224] Handling call
0709 13:06:23.560654 (+4298294us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540001e354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:23.560814 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2834954112}
I20260709 13:06:23.788380 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:23.788282 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:23.789089 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:23.790253 22099 raft_consensus.cc:2393] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:23.790192 22100 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:23.790966 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1374) took 1320 ms. Trace:
I20260709 13:06:23.791482 22100 rpcz_store.cc:276] 0709 13:06:22.470896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.787711 (+1316815us) service_pool.cc:224] Handling call
0709 13:06:23.790877 (+  3166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40064}
I20260709 13:06:23.792555 22097 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:23.786412 22098 rpcz_store.cc:276] 0709 13:06:20.175892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.452236 (+2276344us) service_pool.cc:224] Handling call
0709 13:06:22.633096 (+180860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.611799 (+978703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.785562 (+173763us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.793823 22097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1354) took 3454 ms. Trace:
I20260709 13:06:22.778064 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:23.794342 22097 rpcz_store.cc:276] 0709 13:06:20.339371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.791367 (+3451996us) service_pool.cc:224] Handling call
0709 13:06:23.792123 (+   756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.793377 (+  1254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.793710 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.795385 22101 raft_consensus.cc:2368] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5.
I20260709 13:06:23.796115 22104 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
W20260709 13:06:23.767762 22000 rpcz_store.cc:269] 0709 13:06:04.277498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.284871 (+  7373us) service_pool.cc:224] Handling call
0709 13:06:04.629585 (+344714us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b540001de54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb8090 00007f66a7f56f3a 00007f66add0d1cc 00007f66ade0b37e 00007f66ac2cc2a4 00007f66ac2cc232 00007f66ac2cc161 00007f66ac2cc0dc 00007f66ac2cb392 00007f66a628948c 00007f66a62888c6
0709 13:06:23.766265 (+19136680us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:17.939072 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:18.251892 (+312820us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b5c001d068c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66ae140331 00007f66ae140221 00007f66ae13af6c 00007f66ab998d69 00007f66ab9840a6 00007f66ab983d58 00007f66ab9889f1 00007f66ab9889a9 00007f66ab988939 00007f66ab988901 00007f66ab987b2d
0709 13:06:18.252014 (+   122us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:18.252080 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:06:18.252107 (+    27us) tablet.cc:662] Decoding operations
0709 13:06:18.253083 (+   976us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:18.253162 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:18.253187 (+    25us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:06:18.253736 (+   549us) tablet.cc:701] Row locks acquired
0709 13:06:18.253784 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:06:18.253952 (+   168us) write_op.cc:270] Start()
0709 13:06:18.254182 (+   230us) write_op.cc:276] Timestamp: P: 1783602378253882 usec, L: 0
0709 13:06:18.254205 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:18.255383 (+  1178us) log.cc:844] Serialized 1691 byte log entry
0709 13:06:19.092533 (+837150us) op_driver.cc:464] REPLICATION: finished
0709 13:06:19.460020 (+367487us) write_op.cc:301] APPLY: starting
0709 13:06:19.460135 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:19.460349 (+   214us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:19.460376 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:19.461230 (+   854us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:19.461472 (+   242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:06:19.461542 (+    70us) write_op.cc:312] APPLY: finished
0709 13:06:19.461895 (+   353us) log.cc:844] Serialized 41 byte log entry
0709 13:06:19.462124 (+   229us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:19.462252 (+   128us) write_op.cc:454] Released schema lock
0709 13:06:19.462308 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:19.487677 (+ 25369us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:19.491199 (+  3522us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"spinlock_wait_cycles":580306176,"child_traces":[["op",{"apply.queue_time_us":360407,"apply.run_cpu_time_us":2799,"apply.run_wall_time_us":21379,"num_ops":4,"prepare.queue_time_us":293475,"prepare.run_cpu_time_us":9389,"prepare.run_wall_time_us":361193,"raft.queue_time_us":675787,"raft.run_cpu_time_us":25207,"raft.run_wall_time_us":463785,"replication_time_us":776170,"spinlock_wait_cycles":13539712,"thread_start_us":715166,"threads_started":4,"wal-append.queue_time_us":2328,"wal-append.run_cpu_time_us":61478,"wal-append.run_wall_time_us":2218127}]]}
I20260709 13:06:23.608848 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:23.798096 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1373) took 1327 ms. Trace:
W20260709 13:06:23.551554 22105 rpcz_store.cc:269] 0709 13:06:21.378216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.447861 (+ 69645us) service_pool.cc:224] Handling call
0709 13:06:22.641668 (+1193807us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.796277 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1369) took 1338 ms. Trace:
I20260709 13:06:23.799603 22101 rpcz_store.cc:276] 0709 13:06:22.458307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.777807 (+319500us) service_pool.cc:224] Handling call
0709 13:06:23.796150 (+1018343us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.801051 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 292) took 2062 ms. Trace:
I20260709 13:06:23.553042 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1375) took 1078 ms. Trace:
I20260709 13:06:23.801522 22105 rpcz_store.cc:276] 0709 13:06:21.738593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.799482 (+2060889us) service_pool.cc:224] Handling call
0709 13:06:23.800008 (+   526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.800557 (+   549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:23.800590 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:23.800652 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:23.800683 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.800743 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.800870 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.802078 22103 rpcz_store.cc:276] 0709 13:06:22.474951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.672619 (+197668us) service_pool.cc:224] Handling call
0709 13:06:23.552973 (+880354us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.563064 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1440) took 4562 ms. Trace:
I20260709 13:06:23.798619 22102 rpcz_store.cc:276] 0709 13:06:22.470621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.576374 (+1105753us) service_pool.cc:224] Handling call
0709 13:06:23.797847 (+221473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.803355 22106 rpcz_store.cc:276] 0709 13:06:19.006686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.514452 (+507766us) service_pool.cc:224] Handling call
0709 13:06:20.553830 (+1039378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.227765 (+673935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.562847 (+2335082us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000744d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:23.563004 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2389603200}
I20260709 13:06:23.804042 22103 raft_consensus.cc:1240] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:23.804680 22102 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:23.805087 22098 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:23.805955 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1367) took 2393 ms. Trace:
W20260709 13:06:23.814893 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.815256 22098 rpcz_store.cc:276] 0709 13:06:21.412469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.793727 (+2381258us) service_pool.cc:224] Handling call
0709 13:06:23.794203 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.805601 (+ 11398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.805875 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.798723 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1371) took 1339 ms. Trace:
I20260709 13:06:22.915772 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1444) took 3316 ms. Trace:
I20260709 13:06:22.746166 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1449) took 3120 ms. Trace:
W20260709 13:06:23.818287 22147 leader_election.cc:336] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.705s (SENT)
I20260709 13:06:23.818573 22172 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:22.748149 22175 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:06:23.819252 22172 pending_rounds.cc:85] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 5
I20260709 13:06:23.819818 22172 pending_rounds.cc:107] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:23.648135 22181 rpcz_store.cc:276] 0709 13:06:19.575413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.469281 (+2893868us) service_pool.cc:224] Handling call
0709 13:06:22.469641 (+   360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:22.515781 (+ 46140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.515822 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:22.628273 (+112451us) log.cc:844] Serialized 52 byte log entry
0709 13:06:22.941523 (+313250us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:23.613117 (+671594us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.647375 (+ 34258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.647451 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.647495 (+    44us) raft_consensus.cc:1685] finished
0709 13:06:23.647508 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.647653 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4439,"prepare.queue_time_us":607216,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":28324,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":122335,"thread_start_us":412014,"threads_started":3,"wal-append.queue_time_us":945644}
I20260709 13:06:23.820429 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1450) took 4193 ms. Trace:
I20260709 13:06:23.820218 22172 raft_consensus.cc:2889] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:23.821000 22175 rpcz_store.cc:276] 0709 13:06:19.626602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.699496 (+3072894us) service_pool.cc:224] Handling call
0709 13:06:22.747888 (+ 48392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:23.819643 (+1071755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.820190 (+   547us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:23.811657 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 185491us
I20260709 13:06:23.814640 24326 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3.
I20260709 13:06:23.824548 24326 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.825184 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1780) took 4714 ms. Trace:
I20260709 13:06:23.825312 24326 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:23.825788 22178 rpcz_store.cc:276] 0709 13:06:19.110765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.418259 (+3307494us) service_pool.cc:224] Handling call
0709 13:06:22.471416 (+ 53157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.777485 (+306069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.824671 (+1047186us) spinlock_profiling.cc:243] Waited 52.8 ms on lock 0x7b540003b950. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:23.824968 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121482112}
W20260709 13:06:23.607372 22179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.017s	sys 0.034s
W20260709 13:06:23.571787 22177 rpcz_store.cc:269] 0709 13:06:18.723864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.049118 (+325254us) service_pool.cc:224] Handling call
0709 13:06:22.723491 (+3674373us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b54003296d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:22.723645 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2222992128}
W20260709 13:06:23.827499 22179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.017s	sys 0.034s
I20260709 13:06:23.817993 22173 rpcz_store.cc:276] 0709 13:06:19.574213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.461679 (+2887466us) service_pool.cc:224] Handling call
0709 13:06:22.462027 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.462266 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.462294 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:22.462787 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:06:22.637328 (+174541us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:22.641929 (+  4601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.683017 (+ 41088us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.781700 (+ 98683us) raft_consensus.cc:1685] finished
0709 13:06:22.781718 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.890303 (+108585us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":143598,"threads_started":1,"wal-append.queue_time_us":264810}
I20260709 13:06:23.818737 22174 rpcz_store.cc:276] 0709 13:06:19.626199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.682416 (+3056217us) service_pool.cc:224] Handling call
0709 13:06:22.745475 (+ 63059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.745762 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.745795 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.745841 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:22.745884 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.745950 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.746097 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.830112 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1785) took 4640 ms. Trace:
I20260709 13:06:23.816669 22104 rpcz_store.cc:276] 0709 13:06:22.458817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.641812 (+182995us) service_pool.cc:224] Handling call
0709 13:06:23.798491 (+1156679us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540040f1d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:23.798652 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2315382016}
I20260709 13:06:23.819140 22147 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:23.831696 22180 raft_consensus.cc:1240] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:23.834065 22147 leader_election.cc:336] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.714s (SENT)
I20260709 13:06:23.834370 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1779) took 4724 ms. Trace:
I20260709 13:06:23.835529 22181 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:23.836087 22176 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:06:23.836352 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1790) took 3359 ms. Trace:
I20260709 13:06:23.836867 22181 rpcz_store.cc:276] 0709 13:06:20.477331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.821509 (+3344178us) service_pool.cc:224] Handling call
0709 13:06:23.834965 (+ 13456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.836041 (+  1076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.836263 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.837607 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1789) took 3360 ms. Trace:
I20260709 13:06:23.839923 22175 raft_consensus.cc:1275] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:23.840387 24326 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:23.642741 22220 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:23.845260 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 202458us
W20260709 13:06:23.688311 22809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35198 (request call id 667) took 1550 ms (client timeout 2001 ms). Trace:
W20260709 13:06:23.847648 22809 rpcz_store.cc:269] 0709 13:06:22.128826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.128972 (+   146us) service_pool.cc:224] Handling call
0709 13:06:23.679557 (+1550585us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:23.633177 22247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1547) took 2054 ms (client timeout 1894 ms). Trace:
W20260709 13:06:23.849169 22247 rpcz_store.cc:269] 0709 13:06:21.578541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.624490 (+2045949us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:23.630558 (+  6068us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:23.838109 22176 rpcz_store.cc:276] 0709 13:06:20.477102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.644804 (+3167702us) service_pool.cc:224] Handling call
0709 13:06:23.835263 (+190459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.836555 (+  1292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.837337 (+   782us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540017aa50. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:23.837528 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436872576}
I20260709 13:06:23.834867 22180 rpcz_store.cc:276] 0709 13:06:19.110424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.398167 (+3287743us) service_pool.cc:224] Handling call
0709 13:06:22.398516 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.832429 (+1433913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.834035 (+  1606us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540031a6d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:23.834308 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3294318848}
I20260709 13:06:23.851733 22220 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:23.855095 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:23.856743 22809 raft_consensus.cc:2368] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5.
I20260709 13:06:23.667912 22810 rpcz_store.cc:276] 0709 13:06:22.129120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.129285 (+   165us) service_pool.cc:224] Handling call
0709 13:06:23.616826 (+1487541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.859297 22220 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:23.696974 22811 rpcz_store.cc:276] 0709 13:06:22.478226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.598341 (+120115us) service_pool.cc:224] Handling call
0709 13:06:22.715262 (+116921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.696267 (+981005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.696470 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.840744 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1795) took 3115 ms. Trace:
I20260709 13:06:23.860463 22175 rpcz_store.cc:276] 0709 13:06:20.725821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.822238 (+3096417us) service_pool.cc:224] Handling call
0709 13:06:23.822820 (+   582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.840384 (+ 17564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.840650 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:23.861042 22247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1550) took 2271 ms (client timeout 2065 ms). Trace:
W20260709 13:06:23.861639 22247 rpcz_store.cc:269] 0709 13:06:21.579449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.850617 (+2271168us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:23.850804 (+   187us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:23.863091 22247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1551) took 2283 ms (client timeout 2104 ms). Trace:
W20260709 13:06:23.863497 22247 rpcz_store.cc:269] 0709 13:06:21.579722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.862781 (+2283059us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:23.863011 (+   230us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:23.864740 22247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1539) took 2291 ms (client timeout 2117 ms). Trace:
I20260709 13:06:23.864892 23937 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:23.865203 22247 rpcz_store.cc:269] 0709 13:06:21.573173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.864481 (+2291308us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:23.864624 (+   143us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:23.866514 22247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1538) took 2293 ms (client timeout 2164 ms). Trace:
I20260709 13:06:23.860934 22220 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:23.869084 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:23.869449 22220 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:23.830703 22179 rpcz_store.cc:276] 0709 13:06:19.189419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.439748 (+3250329us) service_pool.cc:224] Handling call
0709 13:06:22.440042 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.440248 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:22.787739 (+347491us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.829078 (+1041339us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.829427 (+   349us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:23.829558 (+   131us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:23.829704 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.829810 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.830043 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1108216,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"thread_start_us":1360623,"threads_started":2,"wal-append.queue_time_us":905000}
I20260709 13:06:23.809911 22105 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:23.657403 22246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1549) took 2067 ms (client timeout 2029 ms). Trace:
I20260709 13:06:23.584326 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 325) took 5157 ms. Trace:
W20260709 13:06:22.783576 22249 rpcz_store.cc:269] 0709 13:06:19.664700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.709043 (+ 44343us) service_pool.cc:224] Handling call
0709 13:06:22.621356 (+2912313us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b540023b254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:22.621531 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011274624}
W20260709 13:06:23.673406 22250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1552) took 2093 ms (client timeout 2058 ms). Trace:
W20260709 13:06:23.657925 22251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1548) took 2066 ms (client timeout 1900 ms). Trace:
W20260709 13:06:23.913031 22250 rpcz_store.cc:269] 0709 13:06:21.580016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.673184 (+2093168us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:23.673335 (+   151us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:23.913527 22249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1553) took 2333 ms (client timeout 2189 ms). Trace:
W20260709 13:06:23.914252 22249 rpcz_store.cc:269] 0709 13:06:21.580297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.913085 (+2332788us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:23.913305 (+   220us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:23.914954 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:23.915316 24148 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:23.915985 22250 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:23.916121 24148 raft_consensus.cc:697] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:23.916824 22250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1546) took 2338 ms (client timeout 2783 ms). Trace:
W20260709 13:06:23.625057 22252 rpcz_store.cc:269] 0709 13:06:21.242220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.379555 (+137335us) service_pool.cc:224] Handling call
0709 13:06:22.748315 (+1368760us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b540023b754. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:22.748453 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897268608}
W20260709 13:06:23.672178 22253 rpcz_store.cc:269] 0709 13:06:21.565178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.401978 (+836800us) service_pool.cc:224] Handling call
0709 13:06:23.559254 (+1157276us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:23.624665 22254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1542) took 2047 ms (client timeout 1889 ms). Trace:
W20260709 13:06:23.920022 22254 rpcz_store.cc:269] 0709 13:06:21.576888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.624451 (+2047563us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:23.624581 (+   130us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:23.790812 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1370) took 1332 ms. Trace:
I20260709 13:06:23.922881 22099 rpcz_store.cc:276] 0709 13:06:22.458548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.787568 (+1329020us) service_pool.cc:224] Handling call
0709 13:06:23.790735 (+  3167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8960}
I20260709 13:06:23.666648 22779 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:22.604404 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:23.913218 22251 rpcz_store.cc:269] 0709 13:06:21.578853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.644549 (+2065696us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:23.644707 (+   158us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:23.924916 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 258232us
I20260709 13:06:23.925210 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35198 (request call id 672) took 1469 ms. Trace:
I20260709 13:06:23.925758 22807 rpcz_store.cc:276] 0709 13:06:22.455180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.467413 (+ 12233us) service_pool.cc:224] Handling call
0709 13:06:23.924970 (+1457557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.672441 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:23.927292 23993 raft_consensus.cc:2764] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:23.692744 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:23.927765 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:23.928606 22813 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:23.660619 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:23.708702 24164 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:23.927652 22812 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:23.908739 24286 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:23.585062 22816 rpcz_store.cc:276] 0709 13:06:20.309693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.309882 (+   189us) service_pool.cc:224] Handling call
0709 13:06:20.310175 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.395414 (+ 85239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.395442 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.395481 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:20.395513 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.577121 (+3181608us) spinlock_profiling.cc:243] Waited 84.9 ms on lock 0x7b54005c0b54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:23.577165 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.577302 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2058,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":50736,"spinlock_wait_cycles":195345664}
W20260709 13:06:23.678504 23807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.006s	sys 0.005s
I20260709 13:06:23.933938 22069 leader_election.cc:400] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5.
I20260709 13:06:23.934311 22069 leader_election.cc:403] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:06:23.626900 23832 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:23.949970 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:23.952069 24316 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:23.692337 24049 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:23.876389 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1368) took 1418 ms. Trace:
I20260709 13:06:23.834707 22147 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:23.871433 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:23.882292 22220 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:23.882251 22808 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:23.882028 24205 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:23.960770 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 78725.4us
I20260709 13:06:23.961229 24049 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:23.961983 22220 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:23.962138 24205 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:23.962244 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:23.963069 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:23.883000 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 232423us
I20260709 13:06:23.883386 24054 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.883469 24321 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:23.884653 24159 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.858582 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:23.969955 22809 raft_consensus.cc:2393] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:23.885972 24212 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:06:23.971072 24193 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:23.898524 22246 rpcz_store.cc:269] 0709 13:06:21.579168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.645936 (+2066768us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:23.646104 (+   168us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:23.899246 24303 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:23.899854 24235 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:23.903585 24295 consensus_queue.cc:1059] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:06:23.904758 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.972848 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:23.956275 24148 consensus_queue.cc:237] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:23.905507 24279 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:23.973843 22246 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:23.906315 24297 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.974119 22781 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:23.974473 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1782) took 1184 ms. Trace:
I20260709 13:06:23.907151 24298 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:23.909572 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 258077us
I20260709 13:06:23.976069 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:23.910550 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:23.977811 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:23.974876 22246 rpcz_store.cc:276] 0709 13:06:22.790065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.972481 (+1182416us) service_pool.cc:224] Handling call
0709 13:06:23.974396 (+  1915us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.928995 22248 rpcz_store.cc:276] 0709 13:06:18.421443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.018832 (+597389us) service_pool.cc:224] Handling call
0709 13:06:19.019149 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.270800 (+1251651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.578910 (+3308110us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002db254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:23.579113 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2876542336}
I20260709 13:06:23.979563 24054 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:23.980832 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 146900us
I20260709 13:06:23.980981 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:23.981727 22147 leader_election.cc:336] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.783s (SENT)
I20260709 13:06:23.981901 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1776) took 1203 ms. Trace:
I20260709 13:06:23.982272 22147 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:23.982316 22248 rpcz_store.cc:276] 0709 13:06:22.778434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.980616 (+1202182us) service_pool.cc:224] Handling call
0709 13:06:23.981840 (+  1224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:23.871917 22247 rpcz_store.cc:269] 0709 13:06:21.572885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.866214 (+2293329us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:23.866417 (+   203us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:23.954705 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:23.958472 22251 raft_consensus.cc:2410] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:23.956722 22105 rpcz_store.cc:276] 0709 13:06:22.458031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.802829 (+1344798us) service_pool.cc:224] Handling call
0709 13:06:23.809706 (+  6877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.876044 (+ 66338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.876306 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.915823 24216 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:23.916952 24210 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:23.968581 24159 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:23.971487 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:23.971989 23833 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:23.917346 22250 rpcz_store.cc:269] 0709 13:06:21.578269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.914266 (+2335997us) service_pool.cc:224] Handling call
0709 13:06:23.916739 (+  2473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.978790 22807 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 2.
I20260709 13:06:23.928872 22249 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:23.983866 22813 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:23.990697 22816 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:23.983157 24229 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:24.001112 24321 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:24.001646 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:24.002960 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.999372 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 294) took 2247 ms. Trace:
I20260709 13:06:24.003930 24216 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:24.004498 23976 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:24.005349 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 43599.1us
I20260709 13:06:23.982796 24054 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:24.029505 22101 rpcz_store.cc:276] 0709 13:06:21.745367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.800764 (+2055397us) service_pool.cc:224] Handling call
0709 13:06:23.801376 (+   612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.801942 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:23.802590 (+   648us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.966434 (+163844us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:23.966507 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:23.992289 (+ 25782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.992396 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.992567 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15192,"prepare.queue_time_us":74694,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":19768,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":1417,"thread_start_us":139036,"threads_started":1,"wal-append.queue_time_us":184907}
I20260709 13:06:24.035256 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:24.036221 22101 raft_consensus.cc:2393] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:24.036680 22815 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:24.037076 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:24.038129 22101 raft_consensus.cc:2393] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:24.039211 22808 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:24.042332 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:24.008800 24283 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:24.011544 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:24.012672 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 79138.1us
I20260709 13:06:23.979373 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:23.974228 24279 raft_consensus.cc:697] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:24.015384 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.041720 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:23.979403 24269 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:23.972820 24235 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:24.017617 24263 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:24.018101 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.019145 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.041687 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:23.999060 22251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1541) took 2417 ms (client timeout 3208 ms). Trace:
I20260709 13:06:24.020668 22099 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
W20260709 13:06:24.024441 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 50814.4us
W20260709 13:06:24.047220 22251 rpcz_store.cc:269] 0709 13:06:21.573748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.949585 (+2375837us) service_pool.cc:224] Handling call
0709 13:06:23.990778 (+ 41193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:23.983349 24212 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:24.028342 22249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1540) took 2451 ms (client timeout 3088 ms). Trace:
I20260709 13:06:24.048271 22105 raft_consensus.cc:2393] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:06:24.048185 22249 rpcz_store.cc:269] 0709 13:06:21.573457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.927255 (+2353798us) service_pool.cc:224] Handling call
0709 13:06:24.024418 (+ 97163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:24.015978 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.020556 23937 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.019776 24295 raft_consensus.cc:3055] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:24.020027 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.051172 22103 raft_consensus.cc:2393] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:24.056640 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51860 (request call id 88) took 3610 ms. Trace:
I20260709 13:06:24.056923 22811 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:24.057176 22246 rpcz_store.cc:276] 0709 13:06:20.446428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.027082 (+3580654us) service_pool.cc:224] Handling call
0709 13:06:24.056515 (+ 29433us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:24.058008 24262 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:24.058377 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:24.059051 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 77448us
I20260709 13:06:24.060221 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.062947 22250 pending_rounds.cc:85] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 2
I20260709 13:06:24.070003 22250 pending_rounds.cc:107] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:24.058770 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:24.060477 22104 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:24.058772 22069 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:24.061040 23833 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:24.052551 22810 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.049531 24235 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:24.051018 23976 raft_consensus.cc:697] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:24.079030 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.080183 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.059092 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:24.050556 24295 raft_consensus.cc:740] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:24.049326 24263 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:24.082810 22813 raft_consensus.cc:2410] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:24.060545 24159 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:24.070598 22250 raft_consensus.cc:2889] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:24.083827 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.085116 22097 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
W20260709 13:06:24.087221 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.076777 24164 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:24.088251 22105 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:24.088867 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1766) took 3640 ms. Trace:
I20260709 13:06:24.089309 22249 rpcz_store.cc:276] 0709 13:06:20.448313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.049047 (+3600734us) service_pool.cc:224] Handling call
0709 13:06:24.088115 (+ 39068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.088481 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.088513 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:24.088594 (+    81us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:24.088635 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.088688 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.088796 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:24.089123 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:24.083647 24262 consensus_queue.cc:1059] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:06:24.094208 24321 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:24.084263 24263 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.068243 23937 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:24.099045 24241 raft_consensus.cc:3055] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:24.099145 24279 consensus_queue.cc:237] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:24.099459 24295 consensus_queue.cc:260] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:24.101135 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:24.101999 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.105870 24301 raft_consensus.cc:3055] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:24.107475 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.108161 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:24.108569 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:24.101877 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:24.119009 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:24.114986 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 245354us
I20260709 13:06:24.095736 23833 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:24.122172 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.123972 22106 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:24.125141 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.101197 22811 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:24.127280 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.133912 24216 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:24.135041 24159 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.135811 24159 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:24.138465 24159 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:24.138552 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:24.139122 22179 raft_consensus.cc:2410] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:24.140034 22144 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:24.140381 22249 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:24.141028 24262 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:24.141500 24262 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.142032 24262 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:24.142480 22249 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:24.142431 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:24.143276 24212 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:24.143299 22252 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
I20260709 13:06:24.140085 24157 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.118897 24301 raft_consensus.cc:740] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:24.148248 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:24.115823 24241 raft_consensus.cc:740] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:24.172318 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.131419 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1777) took 1347 ms. Trace:
I20260709 13:06:24.190830 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1768) took 3724 ms. Trace:
I20260709 13:06:24.149950 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:24.126365 24164 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:06:24.150300 23976 consensus_queue.cc:237] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:24.151563 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:24.190363 22782 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:24.153039 22175 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:24.153201 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.154357 22101 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:24.198380 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:24.199106 22177 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:06:24.199200 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.200054 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.200525 24301 consensus_queue.cc:260] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:24.201944 24301 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.203238 22173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:06:24.204161 22173 raft_consensus.cc:606] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:24.204557 22173 raft_consensus.cc:614] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:24.207470 22178 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:24.208007 22179 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:24.208006 22255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1770) took 3737 ms (client timeout 1973 ms). Trace:
W20260709 13:06:24.211622 22781 leader_election.cc:336] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 2.009s (SENT)
I20260709 13:06:24.212901 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 247) took 4849 ms. Trace:
W20260709 13:06:24.214082 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 59584.7us
I20260709 13:06:24.215054 24328 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:24.215553 24328 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:24.215924 24328 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:24.217967 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.217669 24241 consensus_queue.cc:260] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:24.219194 24241 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.219008 24266 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:24.220655 24221 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.213438 22172 rpcz_store.cc:276] 0709 13:06:19.363735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.463619 (+3099884us) service_pool.cc:224] Handling call
0709 13:06:22.464002 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.821530 (+1357528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.212577 (+391047us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540028c154. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:24.212839 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3112778112}
I20260709 13:06:24.220775 22071 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:06:24.211534 22255 rpcz_store.cc:269] 0709 13:06:20.470184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.290549 (+820365us) service_pool.cc:224] Handling call
0709 13:06:24.207418 (+2916869us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001ccad4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:24.207772 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3047848832}
W20260709 13:06:24.223835 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 81525.1us
I20260709 13:06:24.223441 24266 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:24.224709 22144 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:24.224623 24266 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:24.225777 24266 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:24.226081 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:24.226958 24283 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:24.128695 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1364) took 2743 ms. Trace:
I20260709 13:06:24.227428 24283 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.227909 24283 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.227629 22100 rpcz_store.cc:276] 0709 13:06:21.379064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.793005 (+2413941us) service_pool.cc:224] Handling call
0709 13:06:23.793536 (+   531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:23.839577 (+ 46041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:23.839625 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:23.840438 (+   813us) log.cc:844] Serialized 26 byte log entry
0709 13:06:24.049915 (+209477us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:24.051887 (+  1972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.052071 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:24.110533 (+ 58462us) raft_consensus.cc:1685] finished
0709 13:06:24.114600 (+  4067us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.120696 (+  6096us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77098,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":301,"thread_start_us":236704,"threads_started":2,"wal-append.queue_time_us":245997}
W20260709 13:06:24.189992 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.231940 22779 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:24.232736 24295 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.233330 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:24.234182 22253 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:24.234627 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1785) took 1291 ms. Trace:
I20260709 13:06:24.191571 22249 rpcz_store.cc:276] 0709 13:06:20.448879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.141462 (+3692583us) service_pool.cc:224] Handling call
0709 13:06:24.142061 (+   599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:24.172918 (+ 30857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.173262 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:24.240190 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.194150 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 61269.7us
W20260709 13:06:24.192162 22252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45738 (request call id 344) took 1589 ms (client timeout 2095 ms). Trace:
I20260709 13:06:24.225219 24159 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:24.240088 22253 rpcz_store.cc:276] 0709 13:06:22.943430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.232854 (+1289424us) service_pool.cc:224] Handling call
0709 13:06:24.234556 (+  1702us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:24.227164 24054 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:24.235133 22176 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:24.237373 24282 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.237608 24263 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:24.191327 22254 rpcz_store.cc:276] 0709 13:06:22.778725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.100725 (+1322000us) service_pool.cc:224] Handling call
0709 13:06:24.126023 (+ 25298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:24.234719 22779 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:24.190745 22180 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:24.248968 22177 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
W20260709 13:06:24.241017 22252 rpcz_store.cc:269] 0709 13:06:22.602573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.101448 (+1498875us) service_pool.cc:224] Handling call
0709 13:06:24.192088 (+ 90640us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:24.171238 23833 raft_consensus.cc:697] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:24.249523 22144 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:24.254938 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:24.193351 24212 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:24.224884 24161 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.247635 24159 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.262954 24271 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.263234 24159 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.263962 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:24.264290 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:24.253150 24054 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:24.263715 24164 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:24.273041 22255 raft_consensus.cc:1275] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:24.261286 24212 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.275278 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1774) took 3032 ms. Trace:
I20260709 13:06:24.283629 22255 rpcz_store.cc:276] 0709 13:06:21.242540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.223928 (+2981388us) service_pool.cc:224] Handling call
0709 13:06:24.224324 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.275010 (+ 50686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.275218 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:24.284339 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:24.275490 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.276448 24299 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:24.277345 22807 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:24.277887 22069 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:24.279659 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 339) took 2715 ms. Trace:
I20260709 13:06:24.285970 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:24.286046 22249 rpcz_store.cc:276] 0709 13:06:21.564529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.256351 (+2691822us) service_pool.cc:224] Handling call
0709 13:06:24.256775 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.279270 (+ 22495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.279303 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:24.279362 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:24.279396 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.279476 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.279600 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:24.289191 24234 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:24.294477 23833 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:24.295570 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:24.296262 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1779) took 1516 ms. Trace:
I20260709 13:06:24.276484 22254 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:24.296940 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:24.297544 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 343) took 1695 ms. Trace:
I20260709 13:06:24.297629 22815 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:24.297958 22254 rpcz_store.cc:276] 0709 13:06:22.602207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.256718 (+1654511us) service_pool.cc:224] Handling call
0709 13:06:24.276285 (+ 19567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.297301 (+ 21016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.297478 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:24.259300 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:24.281399 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 340) took 2716 ms. Trace:
I20260709 13:06:24.261144 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:24.303854 22253 rpcz_store.cc:276] 0709 13:06:21.564861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.255826 (+2690965us) service_pool.cc:224] Handling call
0709 13:06:24.280754 (+ 24928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.281076 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.281100 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:24.281161 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:24.281189 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.281241 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.281343 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:24.296635 22249 rpcz_store.cc:276] 0709 13:06:22.779376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.287392 (+1508016us) service_pool.cc:224] Handling call
0709 13:06:24.287769 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.287995 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.288021 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:24.288091 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:24.295990 (+  7899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.296072 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.296180 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:24.303969 22175 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:24.274467 24054 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.311266 22779 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:24.311698 22071 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:24.309057 22176 raft_consensus.cc:2410] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:24.274890 24164 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.285755 24299 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:24.303375 24280 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:24.325773 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:24.316838 24328 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:24.329057 24321 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:24.329527 24321 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:24.329922 24321 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.330897 24328 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:24.331813 21991 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 252049d2bcdd4f329ca5015bf10c1b19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 765d912bde9e48959e50d9efec3c26b6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:24.334779 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:24.335623 22181 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:24.336409 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:24.338222 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:24.339372 22004 catalog_manager.cc:5697] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 3, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 3 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:24.341357 22004 catalog_manager.cc:5697] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 1 to 3, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 3 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:24.343811 22782 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:24.344192 24263 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:24.345309 24263 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:24.345850 24263 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:24.346374 24263 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.323583 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:24.325829 24280 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.348946 24280 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:24.349916 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.350463 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.350370 24245 consensus_queue.cc:1059] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:24.332271 22252 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:24.355736 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:24.358686 24318 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:24.359086 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1775) took 1581 ms. Trace:
I20260709 13:06:24.359256 24318 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.359647 24318 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.316514 22811 raft_consensus.cc:2376] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4. Re-sending same reply.
I20260709 13:06:24.359463 22252 rpcz_store.cc:276] 0709 13:06:22.778139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.272113 (+1493974us) service_pool.cc:224] Handling call
0709 13:06:24.331903 (+ 59790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.358775 (+ 26872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.358997 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:24.351729 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 65823.7us
I20260709 13:06:24.321440 24164 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:24.369076 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.369268 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:24.351269 24245 consensus_queue.cc:1243] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:06:24.371479 22147 leader_election.cc:336] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.841s (SENT)
I20260709 13:06:24.372296 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:24.373925 22181 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:24.326692 24299 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:24.374888 22177 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:24.324316 22810 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:24.376003 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:24.371222 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:24.392387 22172 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 2.
W20260709 13:06:24.392766 24339 log.cc:927] Time spent T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:06:24.378180 24096 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:24.376145 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:24.379245 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:24.379966 24338 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:06:24.380625 24238 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.380505 24138 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:24.378170 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.401307 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:24.382357 24266 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:24.420357 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.387040 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:24.388504 24328 raft_consensus.cc:3055] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:24.391327 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.342820 22004 catalog_manager.cc:5697] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 1 to 4, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 4 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.398260 22255 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:06:24.400278 24336 log.cc:927] Time spent T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:06:24.404805 22147 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:24.412462 22252 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.412918 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1767) took 3949 ms. Trace:
I20260709 13:06:24.453881 22004 catalog_manager.cc:5697] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 4, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 4 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:24.413384 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.421867 24266 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:24.451567 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.459957 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 338) took 4320 ms. Trace:
I20260709 13:06:24.455636 22246 rpcz_store.cc:276] 0709 13:06:20.448558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.058253 (+3609695us) service_pool.cc:224] Handling call
0709 13:06:24.067634 (+  9381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:24.095450 (+ 27816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.095473 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:24.122240 (+ 26767us) log.cc:844] Serialized 52 byte log entry
0709 13:06:24.189892 (+ 67652us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:24.189932 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.192625 (+  2693us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:24.397266 (+204641us) raft_consensus.cc:1685] finished
0709 13:06:24.397286 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.397431 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16377,"raft.queue_time_us":8357,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":18741,"thread_start_us":49728,"threads_started":1,"wal-append.queue_time_us":158626}
I20260709 13:06:24.460435 22248 rpcz_store.cc:276] 0709 13:06:20.139185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.020544 (+3881359us) service_pool.cc:224] Handling call
0709 13:06:24.039551 (+ 19007us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:24.040206 (+   655us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:24.082490 (+ 42284us) log.cc:844] Serialized 14 byte log entry
0709 13:06:24.192712 (+110222us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:24.259120 (+ 66408us) log.cc:844] Serialized 26 byte log entry
0709 13:06:24.259295 (+   175us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:24.259332 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.259397 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:24.459750 (+200353us) raft_consensus.cc:1685] finished
0709 13:06:24.459767 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.459895 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56540,"prepare.queue_time_us":210054,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":9788,"raft.queue_time_us":28595,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":14935,"thread_start_us":116965,"threads_started":2,"wal-append.queue_time_us":79930}
I20260709 13:06:24.452689 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1778) took 1644 ms. Trace:
I20260709 13:06:24.462754 22255 rpcz_store.cc:276] 0709 13:06:22.779092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.306412 (+1527320us) service_pool.cc:224] Handling call
0709 13:06:24.363204 (+ 56792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.423179 (+ 59975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.423402 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:24.466974 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.478214 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1786) took 1529 ms. Trace:
I20260709 13:06:24.489158 22248 rpcz_store.cc:276] 0709 13:06:22.948561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.462288 (+1513727us) service_pool.cc:224] Handling call
0709 13:06:24.462585 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.477760 (+ 15175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.477790 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:24.477844 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:24.477882 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.477950 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.478131 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:24.453971 22174 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:24.455114 24328 raft_consensus.cc:740] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:06:24.491853 22072 leader_election.cc:336] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.735s (SENT)
I20260709 13:06:24.423969 24316 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5.
I20260709 13:06:24.523674 22105 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:24.527863 22255 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:24.601527 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1764) took 4153 ms. Trace:
I20260709 13:06:24.523692 22811 raft_consensus.cc:2410] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:24.615684 22103 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:06:24.616875 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.617765 22101 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
W20260709 13:06:24.618790 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.619347 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:24.620172 22176 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:24.627512 24322 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.632993 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1765) took 4185 ms. Trace:
I20260709 13:06:24.636005 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:24.641150 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 380751us
I20260709 13:06:24.602139 22250 rpcz_store.cc:276] 0709 13:06:20.447785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.042972 (+3595187us) service_pool.cc:224] Handling call
0709 13:06:24.062515 (+ 19543us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:24.120620 (+ 58105us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.120654 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:24.142637 (+ 21983us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b2c000ad588. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6857372 00007f66a7f89a01 00007f66a7f4e43a 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2
0709 13:06:24.144726 (+  2089us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b180047c3e0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e2f2a6 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66ace77aa1 00007f66ace6eb37 00007f66ace6e9ca 00007f66acf6626f
0709 13:06:24.223012 (+ 78286us) log.cc:844] Serialized 52 byte log entry
0709 13:06:24.286855 (+ 63843us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:24.326505 (+ 39650us) log.cc:844] Serialized 14 byte log entry
0709 13:06:24.326963 (+   458us) log.cc:844] Serialized 14 byte log entry
0709 13:06:24.327158 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.327226 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:24.394769 (+ 67543us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b180047c3e0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:06:24.522314 (+127545us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b180047c3e0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:06:24.528300 (+  5986us) raft_consensus.cc:1685] finished
0709 13:06:24.528318 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.601418 (+ 73100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17991,"prepare.queue_time_us":125425,"prepare.run_cpu_time_us":154,"prepare.run_wall_time_us":19738,"raft.queue_time_us":26394,"raft.run_cpu_time_us":2540,"raft.run_wall_time_us":20129,"spinlock_wait_cycles":122497920,"thread_start_us":47765,"threads_started":1,"wal-append.queue_time_us":174252}
I20260709 13:06:24.645792 22248 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:24.601630 22004 catalog_manager.cc:5697] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 5, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 5 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:24.652407 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 47654.7us
I20260709 13:06:24.650904 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.633620 22251 rpcz_store.cc:276] 0709 13:06:20.448067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.064307 (+3616240us) service_pool.cc:224] Handling call
0709 13:06:24.091712 (+ 27405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:24.100893 (+  9181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.100928 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:24.101512 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:06:24.193896 (+ 92384us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:24.193942 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.194020 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:24.223873 (+ 29853us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4800240258. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66ace77aa1 00007f66ace6eb37 00007f66ace6e9ca 00007f66acf6626f 00007f66acf65f37 00007f66acf7a55c 00007f66acf7a508 00007f66acf7a488 00007f66acf7a443 00007f66acf796ec 00007f66abea3a96
0709 13:06:24.621874 (+398001us) raft_consensus.cc:1685] finished
0709 13:06:24.621900 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.632881 (+ 10981us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30329,"raft.queue_time_us":8055,"raft.run_cpu_time_us":2782,"raft.run_wall_time_us":121735,"spinlock_wait_cycles":28716928,"thread_start_us":91967,"threads_started":1,"wal-append.queue_time_us":251291}
I20260709 13:06:24.663488 22248 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:24.514664 24328 consensus_queue.cc:260] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:24.684877 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.681058 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:24.683787 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.697214 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.700217 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.701201 22101 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
W20260709 13:06:24.702834 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 274686us
W20260709 13:06:24.703493 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 336895us
I20260709 13:06:24.704562 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:24.707486 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:24.714593 24154 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.668883 23937 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:24.734745 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:24.737649 22105 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:24.729096 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:24.696415 22004 catalog_manager.cc:5697] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 1 to 4, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 4 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:24.743026 22248 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:24.747267 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:24.723557 24154 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:24.749053 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:24.749780 22104 raft_consensus.cc:2393] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:24.750213 22144 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:24.747880 22251 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
W20260709 13:06:24.745419 22147 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.889s (SENT) [suppressed 35 similar messages]
I20260709 13:06:24.752067 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:24.755139 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:24.756151 24157 consensus_meta.cc:287] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.015s
I20260709 13:06:24.750339 24096 consensus_queue.cc:1059] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:06:24.761679 24328 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.752259 24216 consensus_queue.cc:1048] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:06:24.755287 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:24.763981 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.742074 22810 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:24.735109 24266 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:24.727767 24205 consensus_queue.cc:1059] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:06:24.729130 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1760) took 4282 ms. Trace:
I20260709 13:06:24.731313 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.775182 24205 raft_consensus.cc:3055] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:24.775708 24262 consensus_meta.cc:287] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.633s	user 0.017s	sys 0.008s
I20260709 13:06:24.763232 24255 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.776162 24262 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:24.776356 24255 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:24.777499 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:24.778263 24262 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:24.778682 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:24.779716 24235 consensus_meta.cc:287] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.010s
I20260709 13:06:24.780030 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:24.780133 24235 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:24.781243 22250 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:24.782043 24295 consensus_meta.cc:287] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.015s
I20260709 13:06:24.782351 22251 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:24.783561 22812 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:24.784796 22144 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:24.786481 22180 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:24.782971 24054 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:24.788558 24234 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:24.788990 24234 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.789381 24234 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:24.792212 24271 consensus_meta.cc:287] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.529s	user 0.018s	sys 0.017s
I20260709 13:06:24.792629 24271 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:24.792699 24054 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:24.791929 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.775635 24205 raft_consensus.cc:740] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:24.708374 24316 consensus_queue.cc:1048] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:06:24.771472 22004 catalog_manager.cc:5697] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 3 to 6, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 6 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.797693 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:24.802026 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:24.795955 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:24.770521 24221 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:24.807842 22176 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:24.716620 24283 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:24.823997 22004 catalog_manager.cc:5697] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 1 to 3, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 3 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:24.729308 24139 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:06:24.860110 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:24.729259 23833 consensus_queue.cc:1059] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:06:24.755426 24281 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:06:24.727487 23863 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.113s
I20260709 13:06:24.910672 22246 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:06:24.995869 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.996622 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.998828 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.975069 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.961351 22103 raft_consensus.cc:2393] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:25.000382 22104 raft_consensus.cc:1275] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:06:24.978055 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 178805us
I20260709 13:06:24.861034 22174 raft_consensus.cc:2368] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4.
W20260709 13:06:25.006732 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.996518 22004 catalog_manager.cc:5697] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 1 to 3, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 3 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.869549 24235 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:25.012714 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 215103us
I20260709 13:06:25.016561 22072 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:25.020807 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.021947 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 276529us
I20260709 13:06:24.898452 24054 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:25.007477 24241 consensus_meta.cc:287] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.788s	user 0.011s	sys 0.005s
I20260709 13:06:24.862498 24221 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.961194 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:24.925844 24161 consensus_meta.cc:287] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.663s	user 0.017s	sys 0.013s
I20260709 13:06:25.031756 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:25.124234 22172 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:25.036695 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:25.025796 22004 catalog_manager.cc:5697] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 3, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 3 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:25.030263 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 278408us
I20260709 13:06:24.989495 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:25.126271 24216 raft_consensus.cc:3055] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:25.133878 24216 raft_consensus.cc:740] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:25.049034 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:25.134101 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:25.134778 22103 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:25.135273 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:25.135918 24055 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:25.050284 22147 leader_election.cc:336] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.894s (SENT)
I20260709 13:06:25.051069 23996 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:25.136809 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 86638.5us
I20260709 13:06:25.136590 22004 catalog_manager.cc:5697] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 1 to 2, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 2 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
W20260709 13:06:25.137552 22147 leader_election.cc:336] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.900s (SENT)
I20260709 13:06:25.053977 22144 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:25.137988 22147 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:25.138262 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 84382.7us
I20260709 13:06:25.057407 22177 raft_consensus.cc:2410] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:25.138986 22144 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:25.139281 24266 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:25.139701 24255 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:25.139868 24266 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:25.067309 24262 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:25.135958 22255 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
W20260709 13:06:25.153901 22147 leader_election.cc:336] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.029s (SENT)
I20260709 13:06:25.087386 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1781) took 2305 ms. Trace:
W20260709 13:06:25.054600 24299 consensus_meta.cc:287] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.007s
I20260709 13:06:25.088925 24210 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:25.158846 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:25.159214 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:25.159269 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:25.118251 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.120467 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.126942 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:25.054600 24280 consensus_meta.cc:287] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.705s	user 0.012s	sys 0.014s
I20260709 13:06:25.125905 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:25.049045 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:25.134845 24216 consensus_queue.cc:260] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:25.137250 23996 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:24.770737 22247 rpcz_store.cc:276] 0709 13:06:20.446722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.023763 (+3577041us) service_pool.cc:224] Handling call
0709 13:06:24.026834 (+  3071us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:24.095043 (+ 68209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.096007 (+   964us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:24.152180 (+ 56173us) log.cc:844] Serialized 26 byte log entry
0709 13:06:24.196181 (+ 44001us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:24.248466 (+ 52285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.254407 (+  5941us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:24.728838 (+474431us) raft_consensus.cc:1685] finished
0709 13:06:24.728855 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.729049 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16082,"raft.queue_time_us":15513,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":4267,"thread_start_us":36874,"threads_started":1,"wal-append.queue_time_us":279055}
I20260709 13:06:25.140173 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:25.136384 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:25.138741 22004 catalog_manager.cc:5697] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.197621 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:25.198215 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:25.198513 22004 catalog_manager.cc:5697] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:25.200116 22004 catalog_manager.cc:5697] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 4, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 4 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:06:25.148429 22175 consensus_meta.cc:287] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.789s	user 0.006s	sys 0.023s
I20260709 13:06:25.154449 22147 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:25.136436 24055 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.203286 22175 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:25.204059 22102 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:25.158962 24241 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:25.201922 22004 catalog_manager.cc:5697] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 3, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 3 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.119570 24221 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:25.160501 24212 consensus_meta.cc:287] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.872s	user 0.003s	sys 0.007s
I20260709 13:06:25.157886 24054 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:25.194274 24216 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.194902 22172 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
W20260709 13:06:25.155529 24282 consensus_meta.cc:287] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.899s	user 0.004s	sys 0.009s
W20260709 13:06:25.166236 24301 consensus_meta.cc:287] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.964s	user 0.015s	sys 0.000s
I20260709 13:06:25.155117 22253 rpcz_store.cc:276] 0709 13:06:22.782305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.307494 (+1525189us) service_pool.cc:224] Handling call
0709 13:06:24.389796 (+ 82302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:24.651399 (+261603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.651435 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:24.674684 (+ 23249us) log.cc:844] Serialized 26 byte log entry
0709 13:06:24.909756 (+235072us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:24.909790 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.909853 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:25.087011 (+177158us) raft_consensus.cc:1685] finished
0709 13:06:25.087045 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.087292 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3630,"raft.queue_time_us":11248,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":7031,"thread_start_us":168149,"threads_started":1,"wal-append.queue_time_us":359600}
I20260709 13:06:25.127513 24271 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:25.203981 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 50147.6us
I20260709 13:06:25.154398 24266 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:25.190793 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 174345us
W20260709 13:06:25.211943 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 71876.6us
I20260709 13:06:25.206840 23863 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:25.234146 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:25.204852 24241 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.223455 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:25.238719 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:25.236582 23976 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.256881 23976 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.258175 24055 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:25.259362 23976 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:25.236910 22815 raft_consensus.cc:1240] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:25.260192 24164 consensus_meta.cc:287] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.848s	user 0.005s	sys 0.024s
I20260709 13:06:25.259552 24234 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:25.260599 24164 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.238766 24161 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:25.261742 22177 raft_consensus.cc:2393] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:25.261623 24161 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:25.262936 24234 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:06:25.240928 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1780) took 2459 ms. Trace:
I20260709 13:06:25.261030 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:25.215080 22252 consensus_meta.cc:287] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.756s	user 0.016s	sys 0.016s
I20260709 13:06:25.241803 22105 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.245656 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:25.246449 24241 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.247269 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:25.219208 24054 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.229413 24271 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:25.248158 22147 leader_election.cc:336] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.065s (SENT)
I20260709 13:06:25.251087 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:25.190532 24299 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.284664 24299 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:25.284823 24271 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:25.285472 22813 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:25.253902 24154 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:25.255226 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:25.261119 22180 raft_consensus.cc:2393] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:25.287056 22147 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:25.206391 24280 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:25.288468 22147 leader_election.cc:336] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.104s (SENT)
I20260709 13:06:25.288916 22147 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:25.290083 24280 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:25.295120 22810 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.299158 24262 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:25.303838 24356 log.cc:927] Time spent T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.169s	user 0.001s	sys 0.001s
I20260709 13:06:25.271473 24164 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:25.305238 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1783) took 2453 ms. Trace:
I20260709 13:06:25.218818 24212 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.305683 22249 rpcz_store.cc:276] 0709 13:06:22.852316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.308994 (+1456678us) service_pool.cc:224] Handling call
0709 13:06:24.399466 (+ 90472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:24.504901 (+105435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.504943 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:24.630872 (+125929us) log.cc:844] Serialized 26 byte log entry
0709 13:06:24.926629 (+295757us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:24.926686 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.926783 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:25.304985 (+378202us) raft_consensus.cc:1685] finished
0709 13:06:25.305009 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.305168 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":185896,"threads_started":1,"wal-append.queue_time_us":419583}
W20260709 13:06:25.304569 24159 consensus_meta.cc:287] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 1.041s	user 0.012s	sys 0.020s
I20260709 13:06:25.307852 24212 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:25.307528 24159 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.308663 23996 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:25.273470 24316 consensus_queue.cc:1059] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:06:25.276949 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:25.257404 22816 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
W20260709 13:06:25.310859 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 82861us
I20260709 13:06:25.312614 22816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 308) took 1304 ms. Trace:
W20260709 13:06:25.314400 24263 consensus_meta.cc:287] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.951s	user 0.006s	sys 0.010s
I20260709 13:06:25.314666 22100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a4e641637cf41118865c96aec55b340"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:06:25.314908 24263 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.313751 22816 rpcz_store.cc:276] 0709 13:06:24.008481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.083016 (+ 74535us) service_pool.cc:224] Handling call
0709 13:06:25.312338 (+1229322us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400720e54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:25.312523 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2600498048}
I20260709 13:06:25.265942 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:25.266238 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:25.267140 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:25.189327 22173 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:25.239140 24295 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:25.260931 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:25.272082 22252 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:25.270706 22254 rpcz_store.cc:276] 0709 13:06:22.781961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.307645 (+1525684us) service_pool.cc:224] Handling call
0709 13:06:24.365245 (+ 57600us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:24.401483 (+ 36238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.401516 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:24.609939 (+208423us) log.cc:844] Serialized 52 byte log entry
0709 13:06:24.996674 (+386735us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:24.996722 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.997336 (+   614us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:25.240698 (+243362us) raft_consensus.cc:1685] finished
0709 13:06:25.240719 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.240865 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10057,"raft.queue_time_us":16018,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":246751,"threads_started":1,"wal-append.queue_time_us":573514}
I20260709 13:06:25.273187 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:25.323431 22250 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
W20260709 13:06:25.275730 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.323876 22097 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.271251 22220 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:25.259620 24121 raft_consensus.cc:3055] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:25.278443 22253 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
W20260709 13:06:25.274811 24321 consensus_meta.cc:287] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.944s	user 0.023s	sys 0.003s
I20260709 13:06:25.263773 24161 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:25.312781 22218 leader_election.cc:400] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5.
I20260709 13:06:25.315442 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:25.329149 22815 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.227893 22004 catalog_manager.cc:5697] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 4, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 4 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.314193 23996 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:25.330881 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:25.331554 22816 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.332980 22103 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:25.333566 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:25.319555 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:25.264967 24283 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:25.321993 22104 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:25.323487 22105 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:25.276527 24054 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:25.321920 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.315423 22100 raft_consensus.cc:606] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:25.337204 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 94588.7us
I20260709 13:06:25.338817 22177 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.335657 22004 catalog_manager.cc:5697] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:25.339231 22172 raft_consensus.cc:2393] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 3: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:25.337136 24210 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.341663 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1784) took 2452 ms. Trace:
I20260709 13:06:25.328440 24235 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:25.343591 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.346290 22097 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:25.346099 24241 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:25.346786 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 299) took 1330 ms. Trace:
I20260709 13:06:25.349843 22220 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:25.351384 22144 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:25.352116 22100 raft_consensus.cc:614] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:25.353865 24318 consensus_meta.cc:287] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.994s	user 0.000s	sys 0.022s
I20260709 13:06:25.355330 22246 rpcz_store.cc:276] 0709 13:06:22.889286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.461322 (+1572036us) service_pool.cc:224] Handling call
0709 13:06:24.461660 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:25.004951 (+543291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.341378 (+336427us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b540019b754. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:25.341595 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031878016}
I20260709 13:06:25.326099 24121 raft_consensus.cc:740] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:25.354570 22807 raft_consensus.cc:1240] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:25.360015 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:25.360472 24210 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.394073 22810 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:25.363250 22102 rpcz_store.cc:276] 0709 13:06:24.015879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.016518 (+   639us) service_pool.cc:224] Handling call
0709 13:06:24.016898 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:25.204432 (+1187534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.346495 (+142063us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002b8c54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:25.346710 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2729358592}
I20260709 13:06:25.334596 23996 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.364380 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:25.365271 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:25.355470 22071 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:25.367722 22147 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:25.352787 24295 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:25.373220 24121 consensus_queue.cc:260] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:25.370205 23976 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:25.368840 24234 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:25.374872 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:25.361462 24159 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:25.414655 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 64891.1us
I20260709 13:06:25.376433 22172 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:25.393288 24096 raft_consensus.cc:3055] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:25.330931 24321 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.395895 24210 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:25.425493 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:25.426352 22811 raft_consensus.cc:1240] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:25.399158 22104 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:25.364681 24299 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.427533 24299 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.428483 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:25.428562 22172 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:25.429221 22811 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.429711 24299 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:25.408999 24283 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:25.384071 22180 raft_consensus.cc:1275] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:25.426376 22812 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:25.378844 22177 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:25.402465 22815 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:25.385138 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:25.399457 24322 raft_consensus.cc:3055] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:25.406399 22144 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:25.369742 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:25.407285 23996 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:25.417483 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 49807.3us
I20260709 13:06:25.410352 24234 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.409319 23976 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:25.420799 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 69814.3us
I20260709 13:06:25.424713 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 685) took 1106 ms. Trace:
I20260709 13:06:25.425333 24321 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:25.426569 22174 raft_consensus.cc:2393] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:06:25.361763 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 49121.3us
I20260709 13:06:25.396042 22816 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:25.444389 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:25.421705 24096 raft_consensus.cc:740] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:25.414655 24280 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:25.371168 24318 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:25.422359 24238 consensus_meta.cc:287] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.967s	user 0.012s	sys 0.009s
I20260709 13:06:25.456053 22102 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:25.457758 22144 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:25.420804 24121 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.507777 23744 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.508319 23744 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.422394 24235 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 13:06:25.469242 22782 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.002s	sys 0.002s
I20260709 13:06:25.520401 24318 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:25.473253 22072 leader_election.cc:336] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.553s (SENT)
I20260709 13:06:25.475821 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 686) took 1153 ms. Trace:
I20260709 13:06:25.520988 22072 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:25.522029 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 48834.7us
I20260709 13:06:25.521046 22809 rpcz_store.cc:276] 0709 13:06:24.322242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.461129 (+138887us) service_pool.cc:224] Handling call
0709 13:06:24.461427 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.461724 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:24.764761 (+303037us) log.cc:844] Serialized 14 byte log entry
0709 13:06:25.475338 (+710577us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:25.475409 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:25.475459 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.475562 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.475754 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":267541,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":2500,"thread_start_us":725644,"threads_started":2,"wal-append.queue_time_us":640095}
I20260709 13:06:25.522944 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:25.523886 22218 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:25.524086 24121 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:25.485188 24262 consensus_queue.cc:1059] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:06:25.526517 24262 raft_consensus.cc:3055] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:25.526906 24262 raft_consensus.cc:740] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:25.527757 24262 consensus_queue.cc:260] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.529227 24262 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:25.421267 24205 consensus_queue.cc:260] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.479749 24263 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:25.481509 22220 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:25.482620 22177 raft_consensus.cc:1240] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:25.483224 24328 consensus_meta.cc:287] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.721s	user 0.007s	sys 0.007s
I20260709 13:06:25.489121 22147 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:25.490880 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.456214 24322 raft_consensus.cc:740] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:25.465344 24295 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:25.431636 24255 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:06:25.456131 24283 raft_consensus.cc:697] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:25.498766 24096 consensus_queue.cc:260] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.483976 22807 rpcz_store.cc:276] 0709 13:06:24.318440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.460356 (+141916us) service_pool.cc:224] Handling call
0709 13:06:24.460665 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:25.379074 (+918409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.424448 (+ 45374us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b5400690fd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:25.424636 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2040189184}
I20260709 13:06:25.496142 24216 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:06:25.503854 24241 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:25.505873 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:25.417522 23863 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:25.577572 24121 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.483659 23976 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.432385 24054 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:25.513481 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 55778.6us
I20260709 13:06:25.514190 23744 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:25.515533 24212 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:25.470974 22814 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.002s	sys 0.002s
I20260709 13:06:25.584412 24159 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:25.479264 24234 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:25.534921 24205 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:25.534238 22071 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:25.563361 24229 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:25.487231 24193 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:06:25.484774 24164 consensus_queue.cc:1059] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:06:25.577646 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:25.521302 22810 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:25.589422 22812 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:25.575408 24154 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:25.509562 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.598182 24295 raft_consensus.cc:697] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:25.518903 24266 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.601063 22144 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:25.602533 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:25.603549 22814 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.003s	sys 0.002s
W20260709 13:06:25.520740 22782 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.002s	sys 0.002s
I20260709 13:06:25.581835 22808 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:25.579474 24235 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:06:25.610855 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:25.628476 22099 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:25.612902 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.629478 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.629936 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.591722 23863 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:25.617093 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.639314 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.593197 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 104177us
W20260709 13:06:25.620162 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 66537.8us
W20260709 13:06:25.621941 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 877727us
I20260709 13:06:25.599567 24280 consensus_queue.cc:1059] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:06:25.610594 24229 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:25.652612 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 118423us
I20260709 13:06:25.617712 24318 raft_consensus.cc:3055] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:25.614846 24375 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:25.659579 24212 raft_consensus.cc:697] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:25.663954 24368 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:06:25.675655 22147 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:25.620930 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:25.621219 24316 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:25.675890 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:25.738526 22246 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:25.742399 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:25.738804 22782 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:25.627486 24164 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:25.742594 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:25.743217 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:25.614842 24121 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:25.747262 22814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 474) took 1133 ms. Trace:
I20260709 13:06:25.756927 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:25.764642 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 89089.2us
I20260709 13:06:25.753719 22814 rpcz_store.cc:276] 0709 13:06:24.604890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.656356 (+ 51466us) service_pool.cc:224] Handling call
0709 13:06:24.675450 (+ 19094us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:24.752379 (+ 76929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.752411 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:24.801058 (+ 48647us) log.cc:844] Serialized 26 byte log entry
0709 13:06:25.628128 (+827070us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:25.628169 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.628236 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:25.738142 (+109906us) raft_consensus.cc:1685] finished
0709 13:06:25.738161 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.738290 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32755,"raft.queue_time_us":32984,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6805,"thread_start_us":763898,"threads_started":1,"wal-append.queue_time_us":696818}
I20260709 13:06:25.774026 22147 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:25.765401 24263 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:25.775678 24263 raft_consensus.cc:697] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:25.775527 24212 consensus_queue.cc:237] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:25.781903 23996 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.783685 24193 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:25.618618 24322 consensus_queue.cc:260] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:25.799162 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 339787us
W20260709 13:06:25.676896 22781 leader_election.cc:336] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.636s (SENT)
I20260709 13:06:25.830209 22812 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:25.747673 24328 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:06:25.824512 22220 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:25.653342 23863 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.844071 22248 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:25.846112 22781 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:25.658317 24229 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:25.864677 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 340863us
I20260709 13:06:25.824214 24235 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:25.665783 24318 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:25.872470 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 282182us
I20260709 13:06:25.832317 24193 raft_consensus.cc:697] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:25.888996 22072 leader_election.cc:336] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.889s (SENT)
I20260709 13:06:25.890468 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:25.889092 22782 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:25.874867 24255 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:25.891821 24369 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:25.895653 24054 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:25.895742 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 121829us
I20260709 13:06:25.896137 24392 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:25.857106 24164 raft_consensus.cc:697] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:25.892776 22782 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:25.831126 24373 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
W20260709 13:06:25.904412 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 227525us
I20260709 13:06:25.911809 22099 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
W20260709 13:06:25.913743 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.916208 22072 leader_election.cc:336] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.681s (SENT)
I20260709 13:06:25.916968 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:25.918144 24280 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:25.927539 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 59818us
I20260709 13:06:25.927712 24385 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:06:25.898780 24054 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:25.932478 22218 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:25.933079 24391 consensus_queue.cc:1059] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:25.892205 24301 raft_consensus.cc:3055] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:25.832559 24263 consensus_queue.cc:237] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.901279 24316 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:25.901403 24392 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:25.941130 22147 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:25.944715 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 121867us
I20260709 13:06:25.678403 24283 consensus_queue.cc:237] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.877306 24235 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:25.832870 24295 consensus_queue.cc:237] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:25.963567 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.964471 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.974570 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:25.973034 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 116823us
I20260709 13:06:25.915486 24369 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:25.911682 24382 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:25.978135 24193 consensus_queue.cc:237] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:25.978513 24381 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:25.941417 24301 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:06:25.997668 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 56645.7us
I20260709 13:06:26.003984 22102 raft_consensus.cc:1275] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:26.012203 22814 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:25.966559 24392 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.018558 22147 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:26.020762 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 286673us
I20260709 13:06:26.026392 22220 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:26.027100 22104 raft_consensus.cc:1275] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:25.995929 24321 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:25.997905 24205 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:25.993127 24395 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:26.054260 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.058861 22147 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:26.060985 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:26.061695 22071 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:26.026374 24371 log.cc:927] Time spent T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:06:26.000588 24266 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:26.066962 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:26.069443 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 46616.8us
I20260709 13:06:26.073016 24393 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:26.073947 24262 consensus_meta.cc:287] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.002s
I20260709 13:06:26.074064 24393 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:26.074599 24393 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.075244 22807 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:26.076831 24205 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.077391 22254 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:26.077543 24205 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:26.060587 23996 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:26.091384 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.074735 24262 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.092200 24262 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:26.060739 24372 log.cc:927] Time spent T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.274s	user 0.002s	sys 0.000s
I20260709 13:06:26.089432 23937 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:26.092381 24280 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:26.096871 22071 leader_election.cc:400] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4.
I20260709 13:06:26.064653 24164 consensus_queue.cc:237] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:26.084748 22811 consensus_meta.cc:287] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.004s
I20260709 13:06:26.109597 22071 leader_election.cc:403] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:25.990731 24318 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:25.996272 24381 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:26.132009 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.027550 24397 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
W20260709 13:06:26.145856 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 88900.4us
I20260709 13:06:26.107389 24395 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:26.148805 22144 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:26.109017 23937 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.064077 24316 consensus_queue.cc:1048] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
W20260709 13:06:26.158972 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 100232us
I20260709 13:06:26.130223 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:26.065623 24321 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:26.129669 23996 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:26.176414 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.130193 22811 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:26.139097 24400 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:26.145089 24381 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:26.184420 22815 raft_consensus.cc:1240] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 6. Ops: []
W20260709 13:06:26.208425 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 48358.2us
W20260709 13:06:26.189213 22781 leader_election.cc:336] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 2.127s (SENT)
W20260709 13:06:26.174841 24380 log.cc:927] Time spent T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.262s	user 0.001s	sys 0.001s
I20260709 13:06:26.158685 23937 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.116942 23976 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.211212 22816 raft_consensus.cc:2410] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:06:26.219303 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.219295 22147 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:26.180979 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:26.206743 24388 log.cc:927] Time spent T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.315s	user 0.002s	sys 0.000s
I20260709 13:06:26.129995 24301 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:26.235016 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 148240us
I20260709 13:06:26.219506 24396 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:26.237035 22218 connection.cc:256] RPC call timeout handler was delayed by -2.6667804100000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21000000000000002s for a response
W20260709 13:06:26.246744 22218 connection.cc:256] RPC call timeout handler was delayed by -2.6298804099999415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
I20260709 13:06:26.246531 24396 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.250406 24396 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.250506 24405 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:26.252380 24322 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:26.253216 24389 log.cc:927] Time spent T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:06:26.256711 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1812) took 1027 ms. Trace:
I20260709 13:06:26.257153 22172 rpcz_store.cc:276] 0709 13:06:25.229270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.429804 (+200534us) service_pool.cc:224] Handling call
0709 13:06:25.430245 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:25.466627 (+ 36382us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:06:25.481815 (+ 15188us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:25.525538 (+ 43723us) log.cc:844] Serialized 26 byte log entry
0709 13:06:25.868003 (+342465us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:25.900813 (+ 32810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.914957 (+ 14144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:26.256456 (+341499us) raft_consensus.cc:1685] finished
0709 13:06:26.256486 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.256646 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5930,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":19889,"thread_start_us":321002,"threads_started":1,"wal-append.queue_time_us":338660}
I20260709 13:06:26.235162 22807 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:26.259979 24373 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:26.260733 24373 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.261293 24262 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:26.241294 24138 consensus_queue.cc:1175] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "765d912bde9e48959e50d9efec3c26b6" responder_term: 6 status { last_received { term: 5 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:06:26.264531 24383 log.cc:927] Time spent T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.371s	user 0.003s	sys 0.001s
I20260709 13:06:26.209491 24400 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.237088 24205 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:26.297850 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:26.299088 22104 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:26.269445 24392 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.271426 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:26.274204 24234 consensus_meta.cc:287] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.000s
I20260709 13:06:26.281158 24393 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.261219 24398 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4.
I20260709 13:06:26.287047 22814 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
W20260709 13:06:26.290412 22218 connection.cc:256] RPC call timeout handler was delayed by -2.6100804100000232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2163s for a response
W20260709 13:06:26.301297 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 231114us
I20260709 13:06:26.327445 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:26.327823 22071 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:26.311561 22099 raft_consensus.cc:1240] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:26.328328 22175 raft_consensus.cc:2410] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:26.328270 22252 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
W20260709 13:06:26.329326 22218 connection.cc:256] RPC call timeout handler was delayed by -1.8797571090000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
I20260709 13:06:26.326562 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:26.302636 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:26.282739 24235 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:26.332523 22178 raft_consensus.cc:2410] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:06:26.334044 22071 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:26.311589 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 155654us
I20260709 13:06:26.333784 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:26.336362 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:26.337024 22782 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:26.331713 22218 connection.cc:256] RPC call timeout handler was delayed by -1.8347571090000656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
W20260709 13:06:26.338598 22218 connection.cc:256] RPC call timeout handler was delayed by -1.6241571090000662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 13:06:26.339300 22218 connection.cc:256] RPC call timeout handler was delayed by -1.3796730719999459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 13:06:26.339684 22218 connection.cc:256] RPC call timeout handler was delayed by -1.3661730719999241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
W20260709 13:06:26.340029 22218 connection.cc:256] RPC call timeout handler was delayed by -1.2752730719998908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
W20260709 13:06:26.340399 22218 connection.cc:256] RPC call timeout handler was delayed by -1.1717730719999508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
W20260709 13:06:26.336558 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 357372us
I20260709 13:06:26.341214 22220 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:26.261307 24373 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:26.345145 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:26.346284 22104 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.367853 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:26.368708 22220 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:26.369058 22099 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:26.309360 24271 consensus_queue.cc:1059] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:06:26.367856 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.369843 22781 leader_election.cc:336] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 2.324s (SENT)
I20260709 13:06:26.337544 24161 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:26.342979 24398 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:26.372805 22178 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:26.374939 22781 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:26.343699 24369 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:26.325839 24234 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.379899 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:26.380508 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.349318 22810 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:26.371678 24235 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:26.389773 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:26.395714 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:26.371945 24405 raft_consensus.cc:697] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:26.395439 22104 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:26.350183 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:26.400974 22178 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:26.402401 22144 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:26.398837 22220 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:26.389779 22172 raft_consensus.cc:2368] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 4. Current term is 5.
I20260709 13:06:26.374677 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:26.377477 24398 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:26.410200 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:26.398873 24221 consensus_meta.cc:287] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 1.167s	user 0.014s	sys 0.000s
I20260709 13:06:26.389853 24397 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:26.390659 24238 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:26.413966 24234 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:26.414968 24405 consensus_queue.cc:237] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.391373 24369 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.434296 24369 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.426959 24392 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:26.404837 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1819) took 1155 ms. Trace:
W20260709 13:06:26.407151 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.416548 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 71715.4us
I20260709 13:06:26.419595 22178 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
W20260709 13:06:26.412195 24375 consensus_meta.cc:287] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.001s
I20260709 13:06:26.417718 24283 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:26.446911 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.435549 22179 rpcz_store.cc:276] 0709 13:06:25.249114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.559937 (+310823us) service_pool.cc:224] Handling call
0709 13:06:25.560402 (+   465us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:25.588338 (+ 27936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:25.588368 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:25.605048 (+ 16680us) log.cc:844] Serialized 52 byte log entry
0709 13:06:25.665400 (+ 60352us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:25.665444 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.665520 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:26.264092 (+598572us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b24002ba7c8. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4ce79c4 00007f66a4ce5acb 00007f66a4ea0dc9 00007f66a4ea0a55 00007f66a4ea009d 00007f66a7ad210e 00007f66a7ae988c 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221
0709 13:06:26.399333 (+135241us) raft_consensus.cc:1685] finished
0709 13:06:26.399358 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.404774 (+  5416us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29623,"raft.queue_time_us":27276,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4008,"spinlock_wait_cycles":63696640,"thread_start_us":41203,"threads_started":1,"wal-append.queue_time_us":218629}
I20260709 13:06:26.394001 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:26.450773 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:26.428606 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:26.429646 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:26.418128 24321 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:26.421262 24398 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.431890 22811 raft_consensus.cc:2410] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:26.391705 24407 consensus_queue.cc:1059] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:06:26.399981 24235 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:26.418568 24205 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:26.398468 24164 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:26.453586 22252 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:26.454286 22104 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:26.452364 24241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.000s	sys 0.022s
I20260709 13:06:26.459453 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:26.440567 24121 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:26.487252 24241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.000s	sys 0.022s
I20260709 13:06:26.459961 24375 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:26.461688 24412 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:26.461870 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:26.491402 24412 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.491724 22172 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:26.491883 24412 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.492952 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:26.493741 22172 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:26.462810 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:26.463076 24411 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:26.463733 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 69259.4us
W20260709 13:06:26.466112 24229 consensus_meta.cc:287] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.000s
I20260709 13:06:26.466862 22807 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:26.422801 24397 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:26.468492 24373 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:26.470064 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:26.503926 22175 raft_consensus.cc:2368] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 4. Current term is 5.
I20260709 13:06:26.433033 24393 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:26.480204 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:26.486367 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:26.508389 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:26.497537 22220 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:26.427547 24221 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.459286 24161 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.472105 24399 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:26.500253 22782 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:26.471863 24283 raft_consensus.cc:697] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:26.480865 24235 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.485538 24164 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.447400 24392 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:06:26.506763 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:26.498200 24205 raft_consensus.cc:697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:26.512867 22811 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
W20260709 13:06:26.513525 24404 log.cc:927] Time spent T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:06:26.504124 24229 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:26.513646 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:26.503726 24397 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:26.535413 22176 raft_consensus.cc:2393] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:26.524084 22781 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:26.543205 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 56932.7us
I20260709 13:06:26.534584 22220 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:26.537405 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:26.523670 24321 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:26.552984 22144 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:26.526558 24375 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:26.540864 22104 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:26.514351 24405 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.523732 24164 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:26.698207 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.711568 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.518815 24161 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.714013 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:26.719802 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 185309us
I20260709 13:06:26.726406 22220 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:26.539760 24411 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:26.538410 24400 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:26.734344 22175 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:26.556795 24375 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:26.564323 24373 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:26.723719 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.723927 22251 raft_consensus.cc:1240] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:26.730420 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 186463us
I20260709 13:06:26.736133 24399 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:26.558233 24321 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:26.535990 24393 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:26.725461 24420 log.cc:927] Time spent T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.215s	user 0.003s	sys 0.007s
I20260709 13:06:26.736735 24381 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:26.731777 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 207748us
I20260709 13:06:26.757714 22781 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:26.743286 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:26.741405 22144 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:26.807593 24054 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:26.808139 24054 raft_consensus.cc:697] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:26.809100 24054 consensus_queue.cc:237] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:26.811543 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 70316.8us
I20260709 13:06:26.812501 24382 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:26.812971 24382 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:26.749542 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.720397 24238 raft_consensus.cc:2764] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:26.732860 24411 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:26.758970 22808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35214 (request call id 472) took 2154 ms (client timeout 1627 ms). Trace:
I20260709 13:06:26.759912 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 358) took 1100 ms. Trace:
I20260709 13:06:26.760076 24229 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:26.760249 24161 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:26.730521 24205 consensus_queue.cc:237] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:26.740378 24373 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:26.752954 24374 log.cc:927] Time spent T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
I20260709 13:06:26.761801 23976 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:26.755646 24392 consensus_queue.cc:1059] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:06:26.765049 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:26.767050 24396 consensus_meta.cc:287] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.006s
I20260709 13:06:26.758282 24321 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.768133 24393 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.768643 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 1805) took 1756 ms. Trace:
I20260709 13:06:26.837333 22176 rpcz_store.cc:276] 0709 13:06:25.012517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.025554 (+ 13037us) service_pool.cc:224] Handling call
0709 13:06:26.768359 (+1742805us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400302854. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:26.768540 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3101896448}
I20260709 13:06:26.769299 24398 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:26.740371 24375 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.775288 22813 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:26.794586 24397 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.776068 24221 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:26.777029 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.777315 23937 consensus_meta.cc:287] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.543s	user 0.003s	sys 0.007s
I20260709 13:06:26.757529 24385 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:06:26.737880 24283 consensus_queue.cc:237] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.738401 24405 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:26.793515 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1821) took 1411 ms. Trace:
I20260709 13:06:26.882742 22181 rpcz_store.cc:276] 0709 13:06:25.382336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.580364 (+198028us) service_pool.cc:224] Handling call
0709 13:06:25.595953 (+ 15589us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:25.618447 (+ 22494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:25.618482 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:25.644541 (+ 26059us) log.cc:844] Serialized 52 byte log entry
0709 13:06:25.898648 (+254107us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:25.945971 (+ 47323us) log.cc:844] Serialized 14 byte log entry
0709 13:06:25.975124 (+ 29153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.780181 (+805057us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b180037e5e0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:06:26.793040 (+ 12859us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b540028c654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:26.793111 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:26.793178 (+    67us) raft_consensus.cc:1685] finished
0709 13:06:26.793198 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.793429 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31622,"prepare.queue_time_us":61443,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2799,"raft.queue_time_us":44609,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":60235,"spinlock_wait_cycles":47051776,"thread_start_us":160490,"threads_started":1,"wal-append.queue_time_us":340661}
I20260709 13:06:26.795290 24212 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:26.796947 24416 log.cc:927] Time spent T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.290s	user 0.000s	sys 0.002s
I20260709 13:06:26.798000 23835 raft_consensus.cc:3055] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:26.802065 22069 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:26.802947 24216 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:06:26.806255 23863 consensus_meta.cc:287] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.932s	user 0.001s	sys 0.018s
I20260709 13:06:26.811617 24369 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:26.748942 22220 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:26.898069 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 149232us
I20260709 13:06:26.819137 22104 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:26.822064 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:26.823426 22101 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:26.806368 24318 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.817530 23744 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:26.748153 24399 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:06:26.843243 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.820246 24411 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.822481 24373 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.756933 24400 consensus_queue.cc:1048] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
W20260709 13:06:26.886523 24425 log.cc:927] Time spent T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.156s	user 0.001s	sys 0.001s
I20260709 13:06:26.888321 24412 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.839500 24396 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:26.893921 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 91944us
I20260709 13:06:26.891605 23835 raft_consensus.cc:740] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:26.897694 24238 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:26.896346 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.897825 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:26.889701 24164 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:26.845189 24161 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:26.904191 22172 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
W20260709 13:06:26.905850 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 148208us
I20260709 13:06:26.892663 24322 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.896417 24381 raft_consensus.cc:697] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:26.940652 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:26.940990 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:26.853514 23937 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.893870 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:26.941897 22246 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.942003 22176 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
W20260709 13:06:26.819322 22808 rpcz_store.cc:269] 0709 13:06:24.604349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.620998 (+ 16649us) service_pool.cc:224] Handling call
0709 13:06:24.795833 (+174835us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29eee 0000000000375939 00007f66ace9d1e0 00007f66acf660c4 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:26.758705 (+1962872us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b5400736c54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:26.758837 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1767910528}
I20260709 13:06:26.943333 23937 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:26.919548 22181 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:06:26.746503 24419 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.198s	user 0.001s	sys 0.009s
I20260709 13:06:26.944839 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:26.908363 24399 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.895448 24414 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:26.916507 24221 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:06:26.947001 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:26.947404 24414 raft_consensus.cc:697] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:26.947621 22248 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:26.922871 23835 consensus_queue.cc:260] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:26.948524 23835 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.949083 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:26.948717 24414 consensus_queue.cc:237] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:26.950619 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:26.892371 24212 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.952095 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:26.952795 22248 raft_consensus.cc:2368] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6.
I20260709 13:06:26.953389 24212 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:26.912194 24280 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.954355 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:26.954130 24280 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:26.954908 22248 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:26.944839 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:26.956468 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:26.956820 22181 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:26.957131 22248 raft_consensus.cc:2393] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:26.957751 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:26.958046 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:26.958341 22181 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:26.958577 22254 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.959081 23976 consensus_queue.cc:1059] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:06:26.959745 22810 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:26.960321 22814 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:26.923801 24238 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:26.819597 22247 rpcz_store.cc:276] 0709 13:06:25.652757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.675505 (+ 22748us) service_pool.cc:224] Handling call
0709 13:06:25.806650 (+131145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:25.946289 (+139639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:25.946323 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:25.947001 (+   678us) log.cc:844] Serialized 26 byte log entry
0709 13:06:26.283420 (+336419us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:26.291531 (+  8111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.304010 (+ 12479us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:26.737852 (+433842us) raft_consensus.cc:1685] finished
0709 13:06:26.739907 (+  2055us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.753089 (+ 13182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14172,"raft.queue_time_us":73569,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"thread_start_us":336750,"threads_started":2,"wal-append.queue_time_us":377927}
I20260709 13:06:26.937768 24161 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:26.966318 24161 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:26.967108 24369 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:26.969012 22174 raft_consensus.cc:2368] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6.
I20260709 13:06:26.969628 24164 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:26.917332 24235 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.923792 24431 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:26.971452 24431 raft_consensus.cc:697] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:26.972273 24235 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:26.905372 23863 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:26.972513 24431 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:26.941229 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:26.974879 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:26.920899 23744 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.975113 22180 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:26.963973 24238 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:26.980209 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:26.985451 22181 raft_consensus.cc:2393] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:26.987435 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:26.987773 24397 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:26.988782 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:26.989338 22176 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.991398 22254 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:26.979646 22246 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:26.927891 22781 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:26.991842 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:26.986552 24212 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:06:26.998662 24398 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:26.998478 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:27.001744 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 73988.1us
I20260709 13:06:27.002524 22781 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:27.008982 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:27.009361 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 191717us
I20260709 13:06:27.010116 22781 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:27.010316 22218 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:26.986403 24164 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:06:27.021706 22177 raft_consensus.cc:2410] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:26.986392 23744 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.027053 24412 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:27.029068 23744 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:26.992842 24382 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:27.031116 22808 raft_consensus.cc:1240] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.032756 24396 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:27.019078 24429 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:27.035385 24429 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.035740 24429 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:27.040319 24375 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:27.008534 24433 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:27.034873 24280 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:27.043275 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:27.041893 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:27.015632 24385 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:27.044514 22253 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:27.045367 22254 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:26.979117 24322 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.045192 23863 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:27.048089 24375 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:27.048245 24322 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:27.014003 24238 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:27.049750 22816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 330) took 1012 ms. Trace:
I20260709 13:06:27.057273 22816 rpcz_store.cc:276] 0709 13:06:26.037507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.060687 (+ 23180us) service_pool.cc:224] Handling call
0709 13:06:27.049527 (+988840us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54001405d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:27.049689 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342955264}
I20260709 13:06:27.050040 22252 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:27.023871 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:27.044827 22176 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:27.054184 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:27.054780 22253 raft_consensus.cc:3055] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:27.054184 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:27.059461 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:27.059737 22812 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:27.060112 22250 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:27.059461 22253 raft_consensus.cc:740] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:27.042445 24321 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.063287 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:27.064574 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:27.066571 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:27.067034 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:27.068743 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.060921 24238 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.078751 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:27.077181 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:27.080935 22812 raft_consensus.cc:2393] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:27.081712 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:27.082283 22812 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:27.083124 22814 raft_consensus.cc:1240] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:27.079826 24399 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:27.073457 24375 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:27.086373 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:27.084419 24096 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:27.090427 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:27.087728 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:27.091074 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:27.091419 22254 raft_consensus.cc:2393] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:27.079303 22253 consensus_queue.cc:260] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.088481 22177 raft_consensus.cc:2393] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:27.093130 22218 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:27.099154 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:27.101744 22246 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:27.103538 22253 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.107754 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:27.109452 22254 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:27.112169 24405 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:27.108695 22815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 476) took 1878 ms. Trace:
I20260709 13:06:27.114823 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:27.114475 22815 rpcz_store.cc:276] 0709 13:06:25.230467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.457478 (+227011us) service_pool.cc:224] Handling call
0709 13:06:26.184202 (+726724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:26.207643 (+ 23441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.108386 (+900743us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b540007fdd0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:27.108616 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611752704}
I20260709 13:06:27.115748 22172 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
W20260709 13:06:27.116894 24424 log.cc:927] Time spent T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.378s	user 0.003s	sys 0.000s
I20260709 13:06:27.115692 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:27.111971 22069 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:27.117805 22811 raft_consensus.cc:2393] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:27.118714 24280 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:27.119161 24280 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:27.119441 22072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.015s	sys 0.011s
I20260709 13:06:27.119524 24280 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:27.121151 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:27.121743 22173 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:27.122084 22179 raft_consensus.cc:2410] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:27.138379 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:27.124873 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1814) took 1877 ms. Trace:
I20260709 13:06:27.123129 22181 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:27.142459 22179 raft_consensus.cc:2393] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:27.144345 22180 rpcz_store.cc:276] 0709 13:06:25.247647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.465332 (+217685us) service_pool.cc:224] Handling call
0709 13:06:25.483652 (+ 18320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:26.979355 (+1495703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.124606 (+145251us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540013e054. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:27.124809 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3429616512}
I20260709 13:06:27.088034 24238 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:27.148525 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.131117 23835 consensus_queue.cc:1059] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:06:27.154137 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:27.153913 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:27.156656 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:27.149027 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:27.157446 22179 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:27.159032 22072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.015s	sys 0.012s
W20260709 13:06:27.159498 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 1.07555e+06us
I20260709 13:06:27.164352 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:27.165066 22177 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:27.122848 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:27.147395 24395 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:27.170903 24395 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:27.173827 24301 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.163796 23835 raft_consensus.cc:3055] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:27.175225 23835 raft_consensus.cc:740] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:27.176522 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:27.176401 23835 consensus_queue.cc:260] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.177385 22178 raft_consensus.cc:2410] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:27.177800 23835 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.131384 24229 raft_consensus.cc:3055] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:27.179343 24229 raft_consensus.cc:740] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:27.179432 24393 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:27.180454 24229 consensus_queue.cc:260] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.167706 24382 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:27.128316 24280 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.182791 24263 raft_consensus.cc:3055] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:27.187207 24263 raft_consensus.cc:740] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:27.187825 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:27.188035 24263 consensus_queue.cc:260] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.189620 24280 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:27.189857 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:27.188467 22181 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:27.193270 22181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:06:27.193877 22181 raft_consensus.cc:606] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:27.194236 22181 raft_consensus.cc:614] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:27.086373 24429 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.206158 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:27.216681 22254 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:06:27.206403 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 114985us
I20260709 13:06:27.213275 22177 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:27.218065 22218 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:27.218758 22177 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:27.189064 24263 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:27.220322 22072 leader_election.cc:336] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.973s (SENT)
I20260709 13:06:27.225580 24399 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:27.190771 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:27.220646 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:27.169028 24375 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:27.235563 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:27.236266 22246 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:27.240371 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:27.092501 24381 consensus_queue.cc:237] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:27.241117 22248 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:27.246878 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 356) took 1603 ms. Trace:
I20260709 13:06:27.247349 22251 rpcz_store.cc:276] 0709 13:06:25.643537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.656322 (+ 12785us) service_pool.cc:224] Handling call
0709 13:06:25.739330 (+ 83008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:26.744942 (+1005612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.246629 (+501687us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b540005cdd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:27.246820 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988957056}
W20260709 13:06:27.249019 22072 connection.cc:256] RPC call timeout handler was delayed by -1.0616151599999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25910000000000005s for a response
I20260709 13:06:27.252971 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:27.233302 24229 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.253659 22246 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:27.256795 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.243412 22173 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:27.259136 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:27.259825 22103 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:27.260171 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:27.257400 22253 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:06:27.262385 22253 pending_rounds.cc:85] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 4
I20260709 13:06:27.262635 22253 pending_rounds.cc:107] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:06:27.262946 22253 raft_consensus.cc:2889] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:27.244249 24159 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.446s	user 0.019s	sys 0.019s
I20260709 13:06:27.240473 24431 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:27.242313 22810 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:27.256803 22072 leader_election.cc:336] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.943s (SENT)
I20260709 13:06:27.258212 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:27.274784 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.301842 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.313789 22252 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:27.316211 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:27.262014 24216 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:27.300197 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:27.284621 22218 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:27.318986 22102 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:27.249364 24382 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.310319 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:27.321753 22099 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:27.310319 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:27.299840 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:27.323027 22104 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.313632 22144 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:27.320664 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 63887us
I20260709 13:06:27.317723 24216 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.262034 24280 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:27.302981 24159 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.510s	user 0.020s	sys 0.020s
I20260709 13:06:27.262105 24316 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:27.338037 22813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 328) took 1301 ms. Trace:
W20260709 13:06:27.339419 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.334725 22246 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:27.337716 24393 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:27.344410 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 158985us
I20260709 13:06:27.344512 24393 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.345827 22177 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:27.345831 22144 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:27.346305 22781 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:27.348307 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:27.348650 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 64114.8us
I20260709 13:06:27.339751 22813 rpcz_store.cc:276] 0709 13:06:26.036894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.061848 (+ 24954us) service_pool.cc:224] Handling call
0709 13:06:26.762532 (+700684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:26.840836 (+ 78304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.337831 (+496995us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b5400736c50. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:27.337977 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1610609536}
I20260709 13:06:27.357713 22218 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:27.357445 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 69390.8us
I20260709 13:06:27.321244 24234 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:06:27.352283 24393 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.365373 23744 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:27.365415 22781 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:27.345384 24321 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:27.366010 23744 raft_consensus.cc:697] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:27.345722 24280 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.330385 24382 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:27.352521 24316 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.421940 22104 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:27.368373 24283 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:27.498394 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.522326 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:27.531090 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.531203 22104 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
W20260709 13:06:27.498697 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.358014 23976 consensus_queue.cc:1059] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:06:27.499320 22099 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:27.501802 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.505934 22250 raft_consensus.cc:2410] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:27.350447 24431 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:27.507223 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 140134us
W20260709 13:06:27.511742 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 158427us
I20260709 13:06:27.512746 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:27.513938 22106 raft_consensus.cc:1240] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:27.500005 24369 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:27.516264 24449 log.cc:927] Time spent T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.183s	user 0.003s	sys 0.006s
I20260709 13:06:27.561296 22218 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:27.550647 22179 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:27.520529 24437 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:27.560384 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.579430 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:27.530779 24283 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.599083 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:27.602545 22179 raft_consensus.cc:1240] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:27.604902 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1831) took 1147 ms. Trace:
I20260709 13:06:27.542375 24431 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:27.602523 22106 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:27.605348 22179 rpcz_store.cc:276] 0709 13:06:26.457645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.601986 (+1144341us) service_pool.cc:224] Handling call
0709 13:06:27.602368 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:27.604585 (+  2217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.604844 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:27.610148 24452 log.cc:927] Time spent T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:06:27.610737 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:27.564196 24321 consensus_queue.cc:1059] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:06:27.565600 24216 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:27.603227 24283 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.602167 24399 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:27.626813 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 87675.5us
I20260709 13:06:27.638324 22779 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:27.605626 24384 raft_consensus.cc:3055] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:27.614189 24431 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.605466 24437 raft_consensus.cc:697] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:27.623646 24096 consensus_meta.cc:287] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.004s
I20260709 13:06:27.649621 24384 raft_consensus.cc:740] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:27.660677 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 57137.5us
I20260709 13:06:27.662618 24458 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.670403 24321 consensus_queue.cc:1059] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:06:27.670641 24458 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:27.670898 22218 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:27.670416 22179 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:27.673300 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:27.656492 24433 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:27.675666 24433 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.676153 24433 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.686393 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:27.692219 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:27.693156 22179 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.689711 22071 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:27.621601 24405 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.704442 22071 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:27.715065 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:27.716212 22250 raft_consensus.cc:2393] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:27.716403 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:27.646337 24399 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.720748 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:27.721210 22179 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:27.711802 22071 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:27.743149 22176 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:27.744540 22176 raft_consensus.cc:1240] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:27.746049 22176 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:27.751886 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:27.756445 22180 raft_consensus.cc:2410] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:27.656570 24429 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:27.767293 22147 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:27.768209 22812 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:27.768471 22172 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:27.779256 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:27.792611 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 70556.2us
W20260709 13:06:27.792083 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.814428 22179 raft_consensus.cc:1240] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:27.820605 22176 raft_consensus.cc:1240] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:27.811882 22250 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:27.706770 24454 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:27.741756 24411 consensus_meta.cc:287] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.824s	user 0.012s	sys 0.000s
I20260709 13:06:27.643787 23744 consensus_queue.cc:237] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.813455 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:27.734730 24375 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:27.812413 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:27.734750 24399 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.645584 24412 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:06:27.864562 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:27.825431 22246 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:27.814806 22180 raft_consensus.cc:2376] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5. Re-sending same reply.
I20260709 13:06:27.867353 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:27.829418 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:27.764972 24410 raft_consensus.cc:3055] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:27.857985 22178 raft_consensus.cc:2393] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:27.814293 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:27.811914 24446 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.868310 22172 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:27.741407 24405 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:27.879989 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 168262us
I20260709 13:06:27.877359 22781 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:27.878615 22220 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:27.873852 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:27.813369 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:27.853840 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 104831us
W20260709 13:06:27.855072 24445 log.cc:927] Time spent T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.472s	user 0.002s	sys 0.000s
W20260709 13:06:27.882839 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.885799 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:27.886698 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 69401.9us
I20260709 13:06:27.886947 22246 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:27.888425 24464 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:27.889040 24464 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.889400 24464 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.888537 24316 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:27.872668 23835 consensus_meta.cc:287] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.689s	user 0.020s	sys 0.003s
W20260709 13:06:27.867754 24416 log.cc:927] Time spent T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:06:27.868561 24373 consensus_meta.cc:287] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.952s	user 0.008s	sys 0.012s
W20260709 13:06:27.868861 22810 consensus_meta.cc:287] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.009s
W20260709 13:06:27.867748 24238 consensus_meta.cc:287] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.006s
I20260709 13:06:27.812707 24477 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.148s
I20260709 13:06:27.863138 24454 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.893592 22246 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:06:28.425734 22172 consensus_meta.cc:287] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.549s	user 0.007s	sys 0.007s
I20260709 13:06:28.060572 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:27.895095 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.513211 22248 raft_consensus.cc:2393] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:06:28.513949 22781 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.005s	sys 0.009s
W20260709 13:06:28.514343 22781 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.005s	sys 0.009s
W20260709 13:06:28.514726 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 637407us
W20260709 13:06:28.309595 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 485037us
I20260709 13:06:28.515973 22781 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:28.512355 22172 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
W20260709 13:06:27.953435 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 71732.5us
I20260709 13:06:28.432922 22816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 493) took 1432 ms. Trace:
I20260709 13:06:27.960402 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:28.045915 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:27.920001 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:28.071132 24455 log.cc:927] Time spent T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.369s	user 0.001s	sys 0.000s
I20260709 13:06:28.644045 22251 raft_consensus.cc:2393] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 3: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:06:28.424908 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 657663us
I20260709 13:06:27.978590 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:28.430207 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.521117 22816 rpcz_store.cc:276] 0709 13:06:27.000233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.093144 (+ 92911us) service_pool.cc:224] Handling call
0709 13:06:27.113887 (+ 20743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:27.114794 (+   907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:27.114831 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:27.115554 (+   723us) log.cc:844] Serialized 26 byte log entry
0709 13:06:27.220920 (+105366us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:27.220982 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.221064 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:28.432624 (+1211560us) raft_consensus.cc:1685] finished
0709 13:06:28.432653 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.432845 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":280,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":103961,"threads_started":1,"wal-append.queue_time_us":182920}
I20260709 13:06:27.873477 24410 raft_consensus.cc:740] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:28.351105 24393 consensus_meta.cc:287] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.986s	user 0.009s	sys 0.004s
I20260709 13:06:28.557192 22105 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
W20260709 13:06:28.070545 24459 log.cc:927] Time spent T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 13:06:28.090854 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:06:28.526096 24318 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.003s	sys 0.018s
I20260709 13:06:28.594170 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:28.643929 22253 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.432410 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:28.618767 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 102879us
I20260709 13:06:28.683274 22246 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
W20260709 13:06:28.361745 24431 consensus_meta.cc:287] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.000s
W20260709 13:06:28.363935 24433 consensus_meta.cc:287] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.682s	user 0.007s	sys 0.001s
I20260709 13:06:28.687055 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:28.290392 24301 consensus_meta.cc:287] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 1.116s	user 0.014s	sys 0.000s
W20260709 13:06:28.353394 24283 consensus_meta.cc:287] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.698s	user 0.008s	sys 0.000s
I20260709 13:06:28.733424 24283 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:28.555327 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.876133 24384 consensus_queue.cc:260] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:28.736507 24479 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.737191 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:28.737489 24479 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:28.738636 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:28.658466 22147 leader_election.cc:400] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6.
I20260709 13:06:28.739580 22147 leader_election.cc:403] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:28.739814 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:28.740319 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:28.663177 22099 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:06:28.643313 24369 consensus_meta.cc:287] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 1.055s	user 0.011s	sys 0.009s
I20260709 13:06:28.241204 24412 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.980619 24382 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:28.680855 22255 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.033s	sys 0.030s
W20260709 13:06:28.749985 22255 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.033s	sys 0.030s
W20260709 13:06:27.916911 24263 consensus_meta.cc:287] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.000s
I20260709 13:06:27.917768 22220 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:28.139335 24472 consensus_queue.cc:1059] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.564s
I20260709 13:06:27.955621 24375 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:28.048382 24280 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:28.001544 22247 raft_consensus.cc:2368] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5.
I20260709 13:06:28.046576 24461 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:28.687028 22781 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:27.880621 24321 raft_consensus.cc:3055] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:27.863344 24411 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:28.363449 24405 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:28.527132 22810 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:28.694005 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:28.787979 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 129688us
I20260709 13:06:28.810779 22246 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:28.776546 24375 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:28.811836 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:28.812047 24375 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.812717 22246 raft_consensus.cc:2410] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:28.813496 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:28.814463 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:28.787789 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 102500us
I20260709 13:06:28.694073 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:28.071100 24096 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:28.036562 24474 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.509378 24458 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:28.703207 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:28.704206 22248 raft_consensus.cc:2393] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:28.701822 24431 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:28.821539 22172 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: [3.6-4.7]
I20260709 13:06:28.822130 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:28.706689 24433 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:28.708190 24410 consensus_queue.cc:260] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:28.713936 24464 consensus_meta.cc:287] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.000s
W20260709 13:06:28.681308 24229 consensus_meta.cc:287] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 1.416s	user 0.014s	sys 0.009s
I20260709 13:06:28.553833 24238 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:28.662138 23744 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:28.682657 24318 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.003s	sys 0.024s
I20260709 13:06:28.715683 24138 raft_consensus.cc:3055] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:28.715852 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 263) took 2304 ms. Trace:
I20260709 13:06:28.643076 24481 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:28.719471 24487 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:28.670540 23835 consensus_queue.cc:1059] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:06:28.662654 24316 consensus_queue.cc:1059] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:06:28.720861 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:28.723829 24483 consensus_queue.cc:1059] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:28.725016 24441 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 1.394s	user 0.005s	sys 0.007s
I20260709 13:06:28.015360 24437 consensus_queue.cc:237] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.890987 24446 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:27.941906 22807 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:28.728462 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1497) took 1470 ms. Trace:
I20260709 13:06:28.844379 24464 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:28.749104 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:28.749305 22106 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:28.750384 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:28.752590 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 834827us
I20260709 13:06:28.898180 22220 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:28.896734 22101 rpcz_store.cc:276] 0709 13:06:27.257968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.259124 (+  1156us) service_pool.cc:224] Handling call
0709 13:06:27.299206 (+ 40082us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:27.314406 (+ 15200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:27.314455 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:27.315367 (+   912us) log.cc:844] Serialized 52 byte log entry
0709 13:06:27.376039 (+ 60672us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:27.517554 (+141515us) log.cc:844] Serialized 14 byte log entry
0709 13:06:27.627535 (+109981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.627664 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:28.728211 (+1100547us) raft_consensus.cc:1685] finished
0709 13:06:28.728231 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.728390 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":263,"prepare.queue_time_us":144436,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":144809,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":6290,"thread_start_us":169736,"threads_started":2,"wal-append.queue_time_us":284324}
I20260709 13:06:28.753089 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:28.757939 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:28.758567 24412 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:28.616988 24373 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:28.136144 24457 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.610s
I20260709 13:06:28.930476 24433 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:28.933866 24431 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:28.691352 24378 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:28.934667 24431 consensus_queue.cc:1059] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:28.263537 24476 consensus_queue.cc:1059] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.468s
I20260709 13:06:28.935242 24378 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:28.936343 24476 raft_consensus.cc:3055] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:28.936713 24476 raft_consensus.cc:740] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:28.752125 24369 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:28.784051 22218 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:28.937544 24476 consensus_queue.cc:260] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:28.785355 22253 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:28.666427 24393 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:28.939169 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45738 (request call id 374) took 1020 ms. Trace:
I20260709 13:06:28.939662 22253 rpcz_store.cc:276] 0709 13:06:27.919018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.919561 (+   543us) service_pool.cc:224] Handling call
0709 13:06:28.939073 (+1019512us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:28.940491 24393 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:28.783601 22780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.010s	sys 0.065s
W20260709 13:06:28.941147 22780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.011s	sys 0.065s
I20260709 13:06:28.777495 24382 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6.
I20260709 13:06:28.822777 22180 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:28.854719 23744 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:28.943959 24238 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:28.944356 24412 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:28.944891 24283 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:28.815516 22781 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:28.941743 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:28.945811 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 130367us
I20260709 13:06:28.823683 22147 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:28.827934 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:28.947270 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:28.947921 22246 raft_consensus.cc:2393] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 3: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:28.832027 22782 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:28.837212 22254 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:28.917014 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:28.837410 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:28.783864 24321 raft_consensus.cc:740] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:28.779220 24461 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:28.841847 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:28.949944 22176 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.823158 24405 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:28.842974 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:28.962308 22103 raft_consensus.cc:2393] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:28.820206 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1787) took 1095 ms. Trace:
I20260709 13:06:28.788671 24263 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:28.850867 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:28.975260 22248 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:28.821334 24096 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:28.975859 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 143939us
I20260709 13:06:28.848188 22177 rpcz_store.cc:276] 0709 13:06:26.411251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.351285 (+940034us) service_pool.cc:224] Handling call
0709 13:06:27.351598 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:27.358216 (+  6618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:27.358250 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:27.365707 (+  7457us) log.cc:844] Serialized 26 byte log entry
0709 13:06:27.607888 (+242181us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:27.830583 (+222695us) log.cc:844] Serialized 14 byte log entry
0709 13:06:28.424938 (+594355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.425035 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:28.715606 (+290571us) raft_consensus.cc:1685] finished
0709 13:06:28.715626 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.715792 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164083,"prepare.queue_time_us":546623,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":904768,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":257,"thread_start_us":584667,"threads_started":3,"wal-append.queue_time_us":340702}
W20260709 13:06:28.823060 22810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35214 (request call id 492) took 1845 ms (client timeout 2045 ms). Trace:
I20260709 13:06:28.868693 24480 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:28.874241 24399 consensus_meta.cc:287] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.985s	user 0.009s	sys 0.000s
I20260709 13:06:28.876621 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:28.883606 24498 consensus_queue.cc:1048] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:28.884193 24479 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:28.850214 24477 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.853888 24410 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:28.848026 24138 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:28.856932 24463 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.830412 24474 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:28.862814 24487 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:28.263366 24462 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:28.900414 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 220789us
I20260709 13:06:29.033627 22071 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:28.907490 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:28.856357 24229 consensus_queue.cc:1048] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:06:29.035681 22071 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:28.910002 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:28.912040 24485 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.927405 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:29.006075 24490 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.928483 22175 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:28.929309 24373 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:28.934002 24411 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:28.941237 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:28.695621 24381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.030s	sys 0.034s
I20260709 13:06:28.961220 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:28.962472 22172 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:28.849157 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:28.965351 22180 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:29.061678 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:28.974167 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.062467 22255 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.062840 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:29.063948 22180 raft_consensus.cc:2368] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6.
I20260709 13:06:29.064675 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:28.978428 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:28.981398 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:28.992170 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:29.065917 22251 raft_consensus.cc:2393] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:28.993494 22106 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:06:28.935385 24431 consensus_queue.cc:1243] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:28.998167 22103 raft_consensus.cc:1275] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:29.054960 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:28.907866 23976 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.897430 24429 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:29.069792 22177 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:06:29.003849 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 95614.6us
I20260709 13:06:29.014868 22812 raft_consensus.cc:1240] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:29.013733 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:29.015113 22814 raft_consensus.cc:1240] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 6. Ops: []
I20260709 13:06:29.000946 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:28.920928 22809 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
W20260709 13:06:29.018107 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 234123us
I20260709 13:06:28.917323 24501 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:29.020975 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 209821us
W20260709 13:06:29.075943 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 130800us
I20260709 13:06:28.995311 24238 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:29.061328 24490 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.081377 24509 raft_consensus.cc:2764] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:29.082486 24493 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.083096 24493 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.085911 24138 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.087172 24138 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.087024 24429 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:28.961772 24461 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.087496 23976 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.088265 24428 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.995004 24369 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:28.992756 24480 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:29.088757 24428 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.089433 24480 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.089692 23976 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:29.032819 24462 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.090451 24462 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:28.995632 24481 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.911983 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:29.013022 24476 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.091236 24481 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.030421 22176 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:29.092753 22102 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:28.927744 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35198 (request call id 704) took 1221 ms. Trace:
I20260709 13:06:29.093171 22102 pending_rounds.cc:85] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 2
I20260709 13:06:29.002166 24497 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:29.046077 24485 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:28.974296 22247 rpcz_store.cc:276] 0709 13:06:27.690093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.702638 (+ 12545us) service_pool.cc:224] Handling call
0709 13:06:28.785035 (+1082397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:29.042373 24457 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:29.039381 22098 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:28.994817 24405 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:28.926611 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:28.999194 24399 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.070856 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:29.076604 22147 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:29.077869 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:29.032299 24487 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.099988 22218 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:29.076095 22811 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 13:06:29.079124 24460 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.428s	user 0.000s	sys 0.004s
I20260709 13:06:29.079437 24506 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.079712 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:28.992264 24096 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.076773 24498 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:29.089381 24501 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:29.093433 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:29.040788 22071 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:29.128463 22814 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:29.093448 22102 pending_rounds.cc:107] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:29.129065 22102 raft_consensus.cc:2889] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:28.979167 22810 rpcz_store.cc:269] 0709 13:06:26.977300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.978994 (+  1694us) service_pool.cc:224] Handling call
0709 13:06:27.190611 (+211617us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:28.819944 (+1629333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9473792}
I20260709 13:06:29.093327 22807 rpcz_store.cc:276] 0709 13:06:27.706402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.709566 (+  3164us) service_pool.cc:224] Handling call
0709 13:06:28.912259 (+1202693us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:29.060631 24381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.030s	sys 0.034s
I20260709 13:06:29.097779 22815 raft_consensus.cc:2393] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:29.078219 22101 raft_consensus.cc:1217] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Deduplicated request from leader. Original: 3.5->[4.6-4.6]   Dedup: 4.6->[]
W20260709 13:06:29.099089 22781 leader_election.cc:336] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.519s (SENT)
I20260709 13:06:29.133674 22069 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:29.103466 22218 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:29.104548 22248 raft_consensus.cc:1240] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:29.135589 22781 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:29.103366 22147 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:29.134712 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.101847 23744 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:29.132010 24301 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:29.023784 24463 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:29.139330 24301 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.140807 24463 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:29.141610 24301 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:28.938817 24395 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:28.941745 24454 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:28.929455 24446 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:29.141747 24480 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:29.091149 24490 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:29.142891 24399 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:29.143244 24229 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:29.143635 24399 consensus_queue.cc:1059] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:29.143246 24492 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:29.144851 24399 raft_consensus.cc:3055] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:29.145219 24399 raft_consensus.cc:740] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:29.145694 22248 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:29.123611 24431 consensus_queue.cc:1059] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:06:29.147289 22248 raft_consensus.cc:1240] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:29.149104 22097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 326) took 1650 ms. Trace:
I20260709 13:06:29.116460 24405 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:29.126442 22180 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.131296 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 267) took 2718 ms. Trace:
W20260709 13:06:29.132149 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 91441.3us
I20260709 13:06:29.123142 24464 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:29.021034 24477 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.135440 22101 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:29.046646 24474 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:28.937422 24378 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:29.138654 24316 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:29.134756 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:29.125578 24221 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:29.132385 24138 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.137854 24504 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:29.098202 23976 consensus_queue.cc:1059] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:06:29.147559 24431 raft_consensus.cc:3055] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:29.188938 24138 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.194386 24431 raft_consensus.cc:740] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:29.102031 24321 consensus_queue.cc:260] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.099335 24497 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:29.199411 24138 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:29.121737 24375 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:29.201311 22810 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:29.149762 24411 consensus_queue.cc:1059] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:06:29.180917 24316 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:29.150770 22248 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:29.202893 24316 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.204030 22248 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:29.105581 24458 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:29.205499 24458 raft_consensus.cc:697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:29.153555 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 50233.4us
I20260709 13:06:29.207360 24458 consensus_queue.cc:237] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:29.208796 22147 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:29.209643 24221 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:29.154652 22255 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:29.210441 22147 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:29.165483 22252 raft_consensus.cc:1240] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:29.168699 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 69642.3us
I20260709 13:06:29.175166 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:29.155788 22174 rpcz_store.cc:276] 0709 13:06:26.412401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.364661 (+952260us) service_pool.cc:224] Handling call
0709 13:06:28.720929 (+1356268us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b5800165698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:28.721124 (+   195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:28.726661 (+  5537us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:28.727004 (+   343us) log.cc:844] Serialized 14 byte log entry
0709 13:06:28.958952 (+231948us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:28.959621 (+   669us) log.cc:844] Serialized 26 byte log entry
0709 13:06:28.959876 (+   255us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:28.959926 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.960022 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.125965 (+165943us) raft_consensus.cc:1685] finished
0709 13:06:29.131066 (+  5101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.131238 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27211,"prepare.queue_time_us":251,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":103931,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":18066,"spinlock_wait_cycles":10094848,"thread_start_us":165759,"threads_started":1,"wal-append.queue_time_us":274292}
I20260709 13:06:29.085299 24493 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:29.167933 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1826) took 2759 ms. Trace:
I20260709 13:06:29.146018 24399 consensus_queue.cc:260] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:29.131049 24506 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:29.132191 24501 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.189245 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:29.168347 24395 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:29.195706 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 100441us
I20260709 13:06:29.150147 24498 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.149485 22097 rpcz_store.cc:276] 0709 13:06:27.499241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.499362 (+   121us) service_pool.cc:224] Handling call
0709 13:06:27.517788 (+ 18426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:27.556514 (+ 38726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:27.556560 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:27.556619 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:27.556666 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.148852 (+1592186us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b540042c054. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:29.148902 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.149045 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88482688}
I20260709 13:06:29.195294 24431 consensus_queue.cc:260] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.199580 24497 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:29.202340 24375 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:29.158305 22071 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:29.211433 22781 leader_election.cc:336] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.585s (SENT)
W20260709 13:06:29.285431 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 74013us
I20260709 13:06:29.125002 24369 raft_consensus.cc:697] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:29.212352 22102 raft_consensus.cc:1240] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:29.132591 24507 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:29.211788 22181 rpcz_store.cc:276] 0709 13:06:26.408704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.227827 (+819123us) service_pool.cc:224] Handling call
0709 13:06:27.228288 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:27.243576 (+ 15288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:27.243604 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:27.264497 (+ 20893us) log.cc:844] Serialized 26 byte log entry
0709 13:06:27.620801 (+356304us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:27.620850 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.620933 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.078593 (+1457660us) spinlock_profiling.cc:243] Waited 9.74 ms on lock 0x7b24002ba978. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4ce79c4 00007f66a4ce5acb 00007f66a4ea0dc9 00007f66a4ea0a55 00007f66a4ea009d 00007f66a7ad210e 00007f66a7ae988c 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221
0709 13:06:29.149101 (+ 70508us) raft_consensus.cc:1685] finished
0709 13:06:29.149138 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.167866 (+ 18728us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7984,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":7024,"spinlock_wait_cycles":22393216,"thread_start_us":290269,"threads_started":1,"wal-append.queue_time_us":1002012}
I20260709 13:06:29.218786 22101 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.220656 22147 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:29.196828 22180 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:29.179790 24490 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:29.283555 24321 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.316002 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:29.319329 22101 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
W20260709 13:06:29.278152 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.320437 22181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51110
I20260709 13:06:29.320984 22181 raft_consensus.cc:606] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:06:29.321363 22181 raft_consensus.cc:614] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:29.222425 24493 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:29.290402 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 98824.7us
W20260709 13:06:29.294777 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 74205.5us
W20260709 13:06:29.296389 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 138113us
I20260709 13:06:29.228865 22220 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:29.222738 24381 raft_consensus.cc:3055] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:29.283710 22255 raft_consensus.cc:1240] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:29.404398 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1827) took 1045 ms. Trace:
I20260709 13:06:29.319882 24266 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:29.412029 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 183230us
I20260709 13:06:29.411952 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:29.413034 22220 leader_election.cc:400] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6.
W20260709 13:06:29.332849 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.226950 24221 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.180s
I20260709 13:06:29.407096 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:29.228889 24411 consensus_queue.cc:1243] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:29.448529 22813 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:29.325700 24405 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:29.407785 22248 raft_consensus.cc:1240] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:29.408593 24506 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:29.408901 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:29.409245 24511 consensus_queue.cc:1059] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:29.411370 24498 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:29.404795 22255 rpcz_store.cc:276] 0709 13:06:28.358712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.221957 (+863245us) service_pool.cc:224] Handling call
0709 13:06:29.283515 (+ 61558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.404140 (+120625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.404347 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:29.496899 22176 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
W20260709 13:06:29.497922 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 171022us
I20260709 13:06:29.495633 22172 raft_consensus.cc:2393] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:29.498559 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:29.413359 22220 leader_election.cc:403] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:06:29.197341 24504 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.292043 24378 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:29.503873 22181 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:29.504848 22147 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:29.293697 24395 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:29.466106 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:29.528818 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:29.530354 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:29.535488 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 122563us
I20260709 13:06:29.414539 24431 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.284875 24229 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.213s
W20260709 13:06:29.558988 22144 connection.cc:256] RPC call timeout handler was delayed by -1.0973669659999814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
I20260709 13:06:29.509737 24369 consensus_queue.cc:237] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.560501 22220 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:29.558336 22071 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:29.511312 22147 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:29.511404 24493 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:29.571266 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:29.556741 24498 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.574601 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:29.511435 24480 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:29.515594 24511 raft_consensus.cc:3055] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:29.575807 24511 raft_consensus.cc:740] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:29.519379 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:29.413725 22100 raft_consensus.cc:1240] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:29.403730 24381 raft_consensus.cc:740] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:29.578990 22071 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:29.413182 22815 raft_consensus.cc:2368] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5.
I20260709 13:06:29.404731 24399 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.526229 24373 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.549639 24487 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:29.591483 24381 consensus_queue.cc:260] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:29.592418 24266 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:29.592862 24381 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:29.551090 24454 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.553781 24316 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.555624 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:29.584555 24492 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:29.556806 22102 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:29.500445 24507 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:29.559504 22144 connection.cc:256] RPC call timeout handler was delayed by -1.0711895490001098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
I20260709 13:06:29.510665 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 376) took 1082 ms. Trace:
I20260709 13:06:29.607131 22255 rpcz_store.cc:276] 0709 13:06:28.428557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.509866 (+1081309us) service_pool.cc:224] Handling call
0709 13:06:29.510203 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.510356 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.510379 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.510412 (+    33us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:29.510441 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.510492 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.510599 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:29.608726 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:29.497922 24476 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:29.563195 24485 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:29.563844 22175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57856 (request call id 272) took 3150 ms (client timeout 1886 ms). Trace:
I20260709 13:06:29.564380 24461 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:29.567255 24504 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:29.570102 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:29.323685 24375 consensus_queue.cc:1059] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.247s
I20260709 13:06:29.572660 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:29.617580 22255 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:29.617988 22812 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.618386 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 377) took 1174 ms. Trace:
I20260709 13:06:29.572696 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:29.554201 24462 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:29.588569 22105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 325) took 2089 ms (client timeout 1654 ms). Trace:
W20260709 13:06:29.623539 22105 rpcz_store.cc:269] 0709 13:06:27.498860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.499045 (+   185us) service_pool.cc:224] Handling call
0709 13:06:29.588185 (+2089140us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b5400021f54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:29.588478 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272775552}
I20260709 13:06:29.592983 24487 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:29.593935 22781 leader_election.cc:336] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.886s (SENT)
I20260709 13:06:29.628178 22781 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:29.552191 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.590775 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:29.598685 22101 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:29.413657 22247 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:29.616266 24476 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.584445 24405 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:29.635129 24405 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.635545 24405 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.636535 24476 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:29.637310 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:29.598029 24511 consensus_queue.cc:260] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.641001 24511 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.586252 24463 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:29.602622 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.643388 24463 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.643795 24463 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.603328 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:29.610033 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:29.648327 24487 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:29.648746 22144 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:29.589937 24480 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:29.593962 22173 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 4. Ops: []
W20260709 13:06:29.614236 22175 rpcz_store.cc:269] 0709 13:06:26.413783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.743015 (+329232us) service_pool.cc:224] Handling call
0709 13:06:29.563606 (+2820591us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b540028d054. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:29.563748 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4989524864}
I20260709 13:06:29.611544 24221 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.576614 24378 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:29.521750 22172 raft_consensus.cc:1240] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:29.618959 22255 rpcz_store.cc:276] 0709 13:06:28.443637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.616937 (+1173300us) service_pool.cc:224] Handling call
0709 13:06:29.617254 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.618073 (+   819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.618317 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:29.619339 22097 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.616895 22178 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:29.595613 24373 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.633997 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:29.659720 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:29.660949 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:29.661240 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:29.661646 22101 raft_consensus.cc:2393] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:29.648902 24487 raft_consensus.cc:697] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:29.662809 24462 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:29.662638 24221 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.539973 24395 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.602273 24492 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:29.649456 24461 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:29.642724 24410 consensus_meta.cc:287] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.623s	user 0.007s	sys 0.001s
I20260709 13:06:29.664068 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:29.680130 22179 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:29.638788 24497 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:29.662835 22101 raft_consensus.cc:1275] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:06:29.672363 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.677570 24487 consensus_queue.cc:237] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.683907 24497 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:29.686594 22101 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:29.686862 22176 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:29.688443 24437 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:29.692234 24437 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.702495 23976 raft_consensus.cc:3055] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:29.703116 23976 raft_consensus.cc:740] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:29.704164 23976 consensus_queue.cc:260] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:29.695779 22101 raft_consensus.cc:1275] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:29.707336 24499 raft_consensus.cc:3055] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:29.601569 24454 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:29.708143 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.655036 24485 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:29.621140 24507 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:29.706713 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1823) took 1349 ms. Trace:
I20260709 13:06:29.703418 22807 raft_consensus.cc:2410] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:29.695441 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:29.698585 24384 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.627125 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:29.679294 24492 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:29.735406 21991 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 252049d2bcdd4f329ca5015bf10c1b19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 765d912bde9e48959e50d9efec3c26b6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:06:29.738808 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.731737 24499 raft_consensus.cc:740] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:29.710295 24461 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.653672 24405 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.744755 24485 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.759744 24405 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:29.742206 22811 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 6: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:29.744065 24373 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:29.747473 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:29.744002 24395 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:29.729799 24454 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:29.759966 24485 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.755456 24461 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:29.752851 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:29.756510 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:29.740974 24437 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:29.745472 22248 rpcz_store.cc:276] 0709 13:06:28.357752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.204809 (+847057us) service_pool.cc:224] Handling call
0709 13:06:29.205087 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.496336 (+291249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.706427 (+210091us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54001cc0d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:29.706650 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465675520}
I20260709 13:06:29.763384 22253 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:29.746096 22175 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:06:29.744480 22072 connection.cc:256] RPC call timeout handler was delayed by -1.5239443960000472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:06:29.771193 22781 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 2.180s (SENT) [suppressed 44 similar messages]
I20260709 13:06:29.823247 22172 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:29.827353 22072 connection.cc:256] RPC call timeout handler was delayed by -1.17404030900002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260709 13:06:29.835711 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:29.836018 22103 raft_consensus.cc:1240] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:29.836941 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:29.837314 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:29.837499 22248 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.837924 22101 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.832804 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:29.841132 22175 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:29.843393 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:29.757601 24221 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:29.810214 23976 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.757261 24316 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:29.875515 22172 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:29.880932 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:29.855563 24378 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:29.855710 22100 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:29.833393 24483 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.745347 24507 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:29.857564 24461 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:29.859617 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:29.844239 22103 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 2.
I20260709 13:06:29.854288 22812 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:29.857647 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:29.897087 22172 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:29.899032 22218 leader_election.cc:336] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Timed out: RequestConsensusVote RPC to 127.20.130.68:35973 timed out after 1.537s (SENT)
I20260709 13:06:29.908156 24490 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:29.910307 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:29.908468 22253 raft_consensus.cc:2410] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:29.913002 22101 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:29.911054 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:29.913939 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:29.752454 24499 consensus_queue.cc:260] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:29.922875 22254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1604) took 2702 ms (client timeout 1563 ms). Trace:
W20260709 13:06:29.923445 22254 rpcz_store.cc:269] 0709 13:06:27.220283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.220395 (+   112us) service_pool.cc:224] Handling call
0709 13:06:29.922651 (+2702256us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540005dcd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:29.922803 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3686438784}
I20260709 13:06:29.902666 24378 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:29.936889 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:29.898528 24492 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:29.938913 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:29.946862 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:29.953136 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.951028 22072 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:29.957409 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.905099 24483 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:29.957324 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:29.941310 24501 consensus_meta.cc:287] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.000s
I20260709 13:06:29.940865 24499 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.960481 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:29.963903 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:29.918432 24461 consensus_queue.cc:1059] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:06:29.922766 24498 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6.
I20260709 13:06:29.943037 24378 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:30.036270 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 265105us
I20260709 13:06:30.049882 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 332) took 2409 ms. Trace:
I20260709 13:06:30.050350 22099 rpcz_store.cc:276] 0709 13:06:27.637795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.639068 (+  1273us) service_pool.cc:224] Handling call
0709 13:06:27.639445 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.742067 (+1102622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.046407 (+1304340us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540042a254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:30.046626 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336578304}
W20260709 13:06:30.022509 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 511222us
I20260709 13:06:29.993619 22815 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:06:30.032543 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.939954 24480 raft_consensus.cc:697] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:29.963749 22072 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:30.053414 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:30.063956 22253 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
W20260709 13:06:29.966234 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:29.994901 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.065279 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.976073 22097 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:29.980851 22101 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:29.982802 22172 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
W20260709 13:06:30.002141 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 351077us
I20260709 13:06:30.052430 22147 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:29.979300 22105 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:29.957158 24518 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:29.995857 24321 consensus_meta.cc:287] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.683s	user 0.013s	sys 0.005s
I20260709 13:06:30.069626 22246 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:30.076201 22246 pending_rounds.cc:85] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 5
I20260709 13:06:30.076570 22246 pending_rounds.cc:107] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:30.076891 22246 raft_consensus.cc:2889] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:29.957140 24375 consensus_queue.cc:1243] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:06:30.072870 24517 log.cc:927] Time spent T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:06:30.073050 24524 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:30.073145 24516 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
W20260709 13:06:30.072875 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 109203us
I20260709 13:06:30.085510 22072 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:30.088013 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.073760 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:30.074644 22144 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:29.966974 24096 consensus_meta.cc:287] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.814s	user 0.008s	sys 0.004s
I20260709 13:06:30.021991 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:30.076241 22069 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.034s	sys 0.064s
W20260709 13:06:30.144439 22069 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.034s	sys 0.064s
W20260709 13:06:30.144937 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 704591us
I20260709 13:06:30.147285 22218 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:30.153734 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:29.991604 22809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 329) took 3954 ms (client timeout 1771 ms). Trace:
I20260709 13:06:30.079972 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:29.989300 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 259) took 3556 ms. Trace:
I20260709 13:06:30.157353 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:30.081948 22147 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:30.154053 22812 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:30.155067 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:30.157698 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 72291.1us
I20260709 13:06:29.977967 24316 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:30.158825 22072 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:30.160352 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 78509.3us
I20260709 13:06:30.161516 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:30.160333 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 85811.4us
I20260709 13:06:30.163153 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:30.167547 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:30.168080 22097 raft_consensus.cc:1240] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:30.168371 22104 raft_consensus.cc:2393] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 3: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:30.167557 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:30.170061 22172 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:30.173017 22248 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
I20260709 13:06:30.174403 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:30.176403 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:30.182768 22254 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:29.979651 24501 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.038065 24463 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.182888 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:30.188614 22172 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:30.201156 22172 raft_consensus.cc:1240] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:30.205003 22172 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:30.205359 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.208689 24501 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:30.209380 22251 raft_consensus.cc:1240] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:30.200039 24395 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:30.211944 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1813) took 1857 ms. Trace:
W20260709 13:06:30.159960 22809 rpcz_store.cc:269] 0709 13:06:26.037196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.045627 (+  8431us) service_pool.cc:224] Handling call
0709 13:06:29.991361 (+3945734us) spinlock_profiling.cc:243] Waited 2.57 s on lock 0x7b5400625a54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:29.991513 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5906684160}
I20260709 13:06:30.212884 24463 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:30.213770 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:30.214560 24477 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:30.215103 22808 raft_consensus.cc:2410] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:30.215632 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 333) took 1238 ms. Trace:
I20260709 13:06:30.215994 22808 rpcz_store.cc:276] 0709 13:06:28.976965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.991518 (+ 14553us) service_pool.cc:224] Handling call
0709 13:06:30.016921 (+1025403us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:30.215567 (+198646us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16068864}
I20260709 13:06:30.216531 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:30.217285 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:30.157027 22173 rpcz_store.cc:276] 0709 13:06:26.410082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.329350 (+919268us) service_pool.cc:224] Handling call
0709 13:06:29.579721 (+2250371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.654659 (+ 74938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.951660 (+297001us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b540028d050. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:29.966468 (+ 14808us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5080613632}
I20260709 13:06:30.217902 22808 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 2.
I20260709 13:06:30.218484 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:30.189440 24483 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:30.220444 24492 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:30.222029 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:30.222945 22173 raft_consensus.cc:2393] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 5: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:30.223866 24472 raft_consensus.cc:3055] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:30.224305 24472 raft_consensus.cc:740] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:30.224124 24485 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:30.171710 24498 consensus_queue.cc:1048] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
W20260709 13:06:30.227263 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 62897.7us
I20260709 13:06:30.159336 24096 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.228766 22144 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:30.229970 24096 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:30.189321 24473 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:30.198746 24512 consensus_queue.cc:1059] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:30.187943 24531 consensus_queue.cc:1059] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:06:30.232335 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:30.233413 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 72156.8us
I20260709 13:06:30.178180 24405 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:30.233150 22102 raft_consensus.cc:2393] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:30.224051 22173 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:30.235240 22175 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 6: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:06:30.210722 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 51998.2us
I20260709 13:06:30.243075 22072 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:30.078730 24487 consensus_queue.cc:1059] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 13:06:30.222236 24428 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:30.239414 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:30.239462 22147 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:30.212324 22250 rpcz_store.cc:276] 0709 13:06:28.354792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.098343 (+743551us) service_pool.cc:224] Handling call
0709 13:06:29.101138 (+  2795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.212446 (+111308us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:29.290526 (+ 78080us) log.cc:844] Serialized 14 byte log entry
0709 13:06:29.598108 (+307582us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.600880 (+  2772us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.601030 (+   150us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:29.601067 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.601133 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.211722 (+610589us) raft_consensus.cc:1685] finished
0709 13:06:30.211739 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.211890 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22281,"prepare.queue_time_us":64038,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":27130,"raft.queue_time_us":36978,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":202,"thread_start_us":362214,"threads_started":2,"wal-append.queue_time_us":509603}
I20260709 13:06:30.175292 24526 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:30.243702 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:30.251626 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:30.196368 24316 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:30.246259 22172 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:30.245884 22069 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:30.255275 22101 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:30.255414 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:30.110193 24518 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:30.263568 22172 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:30.264832 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:30.265694 22172 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:30.269747 22173 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:30.204641 24493 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:30.218853 24280 raft_consensus.cc:3055] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:30.303663 24280 raft_consensus.cc:740] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:30.304950 24280 consensus_queue.cc:260] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.271510 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:30.271354 24096 consensus_queue.cc:1059] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.253845 24501 consensus_queue.cc:1059] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:06:30.307864 22809 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:30.253655 24395 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:06:30.309584 24395 raft_consensus.cc:3055] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:30.309784 22069 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:30.247418 24405 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:30.278712 24518 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:30.310410 24526 raft_consensus.cc:3055] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:30.279444 24473 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:30.310595 24405 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.311028 24473 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.311561 24473 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.280769 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1415) took 1462 ms. Trace:
I20260709 13:06:30.310840 24526 raft_consensus.cc:740] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:30.312904 22098 rpcz_store.cc:276] 0709 13:06:28.818078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.165953 (+347875us) service_pool.cc:224] Handling call
0709 13:06:29.198335 (+ 32382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.687818 (+489483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.687857 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.687905 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:29.687953 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.280405 (+592452us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b540008f2d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:30.280476 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.280683 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4662,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"spinlock_wait_cycles":1091482880}
I20260709 13:06:30.313512 24526 consensus_queue.cc:260] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.242383 24221 consensus_queue.cc:1048] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:06:30.280673 24512 raft_consensus.cc:3055] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:30.309962 24395 raft_consensus.cc:740] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:30.315132 24512 raft_consensus.cc:740] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:30.315640 24395 consensus_queue.cc:260] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:30.316987 24395 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:30.316324 24512 consensus_queue.cc:260] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.317939 24512 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.252931 24159 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:30.193320 24266 consensus_queue.cc:1059] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:06:30.189864 24525 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 13:06:30.321278 24096 raft_consensus.cc:3055] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:30.321736 24096 raft_consensus.cc:740] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:30.321980 24519 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.312s	user 0.002s	sys 0.000s
I20260709 13:06:30.322614 24096 consensus_queue.cc:260] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.323243 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 339) took 1036 ms. Trace:
I20260709 13:06:30.323683 22810 rpcz_store.cc:276] 0709 13:06:29.286730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.291803 (+  5073us) service_pool.cc:224] Handling call
0709 13:06:29.500613 (+208810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.510082 (+  9469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.510128 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.510618 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.915304 (+404686us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:29.923019 (+  7715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.939380 (+ 16361us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.321415 (+382035us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:30.322878 (+  1463us) raft_consensus.cc:1685] finished
0709 13:06:30.322913 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.323165 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1044,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":10619648,"thread_start_us":386128,"threads_started":1,"wal-append.queue_time_us":447486}
I20260709 13:06:30.295012 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:30.331701 22178 raft_consensus.cc:1275] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:30.249390 24485 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:30.306617 24280 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.338027 22173 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:30.323884 24096 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.287813 24520 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:30.315516 24221 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:30.264719 24461 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:30.296764 24511 consensus_meta.cc:287] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.006s
I20260709 13:06:30.378067 22072 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:30.375303 22173 raft_consensus.cc:1240] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:30.338534 24493 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.345049 24504 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:30.350303 24381 consensus_meta.cc:287] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.757s	user 0.013s	sys 0.000s
W20260709 13:06:30.383224 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 179820us
I20260709 13:06:30.383718 24493 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.393299 22181 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:06:30.353260 24457 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:30.395705 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.397068 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.401968 22782 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:30.404016 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.256330 24480 consensus_queue.cc:237] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.404961 22072 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:30.405968 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.389145 22811 raft_consensus.cc:2393] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:30.410010 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:30.411003 22248 raft_consensus.cc:2410] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:30.381862 24520 raft_consensus.cc:697] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:30.415843 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1800) took 2065 ms. Trace:
I20260709 13:06:30.419866 22252 rpcz_store.cc:276] 0709 13:06:28.350691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.076687 (+725996us) service_pool.cc:224] Handling call
0709 13:06:29.088909 (+ 12222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.211114 (+122205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.415556 (+1204442us) spinlock_profiling.cc:243] Waited 76.4 ms on lock 0x7b540019c154. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:30.415767 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175647104}
I20260709 13:06:30.417582 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1843) took 1089 ms. Trace:
I20260709 13:06:30.421653 22072 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:30.423834 22072 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:30.421172 22179 rpcz_store.cc:276] 0709 13:06:29.328163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.328314 (+   151us) service_pool.cc:224] Handling call
0709 13:06:29.409602 (+ 81288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.680637 (+271035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.417390 (+736753us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54001ed554. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:30.417526 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":621271424}
I20260709 13:06:30.371562 24492 consensus_queue.cc:1059] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 13:06:30.433573 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 194620us
I20260709 13:06:30.443334 22147 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:30.407577 24055 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:30.399435 24457 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:06:30.447775 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.412304 23937 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:30.389762 24463 consensus_queue.cc:1059] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:06:30.395583 24464 consensus_queue.cc:1059] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:06:30.427779 24428 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:30.395974 24316 consensus_queue.cc:1059] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:06:30.425768 24161 raft_consensus.cc:3055] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:30.430409 24216 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:30.477207 22147 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:30.453363 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:30.498379 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.517323 22147 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:30.470691 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 47985.3us
I20260709 13:06:30.393846 24504 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:30.481791 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 58055.6us
W20260709 13:06:30.503364 22781 leader_election.cc:336] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 2.971s (SENT)
I20260709 13:06:30.517124 22814 raft_consensus.cc:2393] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:30.450454 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:30.451907 24457 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.518838 22781 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:30.522447 22072 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:30.444828 24378 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:30.528342 22810 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:30.530994 24482 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:30.451341 24539 raft_consensus.cc:2764] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:30.429950 24369 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:06:30.481516 24454 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:30.479213 24266 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:30.535941 24536 log.cc:927] Time spent T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
W20260709 13:06:30.536702 24537 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:06:30.537657 22179 raft_consensus.cc:1240] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:30.540438 22147 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:30.546337 22072 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:30.517802 24161 raft_consensus.cc:740] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:30.622008 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 81674.7us
I20260709 13:06:30.622890 22147 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:30.624153 24532 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
W20260709 13:06:30.625622 24535 log.cc:927] Time spent T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:06:30.527982 24428 raft_consensus.cc:697] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:30.627731 24539 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:30.627687 24428 consensus_queue.cc:237] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:30.540856 24524 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:30.635824 24541 log.cc:927] Time spent T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:06:30.635974 22249 raft_consensus.cc:3055] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:30.636445 22249 raft_consensus.cc:740] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:30.636458 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:30.533157 24485 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:30.640524 22179 raft_consensus.cc:2393] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 5: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:30.641130 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:30.641732 22254 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:06:30.642216 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 95968.6us
I20260709 13:06:30.527100 24543 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:30.532555 24216 raft_consensus.cc:3055] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:30.638134 22250 raft_consensus.cc:3055] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:30.539330 24518 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.639917 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:30.478578 24221 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.142s
I20260709 13:06:30.645850 22250 raft_consensus.cc:740] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:30.613129 24055 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:30.646196 22181 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.639799 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:30.619268 24266 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.653949 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:30.653961 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.656735 22781 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:30.647832 22250 consensus_queue.cc:260] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.677140 22147 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:30.671023 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:30.678886 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.631160 24373 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:30.685523 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:30.687906 22250 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:30.688596 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:30.689563 22101 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:30.664193 22249 consensus_queue.cc:260] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:30.691407 22181 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:30.551195 24473 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:30.646979 24216 raft_consensus.cc:740] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:30.716846 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:30.702878 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:30.718230 22249 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.648808 24553 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:30.539726 24520 consensus_queue.cc:237] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.724684 22252 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:06:30.725986 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 69344us
I20260709 13:06:30.726110 22104 raft_consensus.cc:2393] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:30.682910 24266 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.731118 22250 raft_consensus.cc:1275] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:06:30.681620 24055 raft_consensus.cc:697] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:30.622856 24161 consensus_queue.cc:260] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:30.658619 24518 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:30.691043 24539 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:30.732854 22250 pending_rounds.cc:85] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 4
I20260709 13:06:30.749745 22250 pending_rounds.cc:107] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:06:30.750124 22250 raft_consensus.cc:2889] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:30.730152 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:30.680428 24543 raft_consensus.cc:697] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:30.734653 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:30.725497 24369 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.729339 24504 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:30.724184 24553 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.755997 24553 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:30.757438 22252 raft_consensus.cc:2393] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 3: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:30.757578 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:30.758898 22250 raft_consensus.cc:2393] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:30.762481 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:30.763332 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:30.768541 24543 consensus_queue.cc:237] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.751973 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:30.783039 22249 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:30.770486 24216 consensus_queue.cc:260] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.783557 22249 pending_rounds.cc:85] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 5
I20260709 13:06:30.784305 22249 pending_rounds.cc:107] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 13:06:30.782531 24399 consensus_meta.cc:287] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 1.191s	user 0.003s	sys 0.012s
I20260709 13:06:30.783284 22811 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:30.796136 22069 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:30.798738 24463 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:30.799304 24463 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.799990 24463 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:30.799188 24055 consensus_queue.cc:237] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:30.795987 24553 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.772660 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:30.784698 22249 raft_consensus.cc:2889] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:30.807816 24405 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.809283 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:30.810063 22249 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:30.762315 24161 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.817773 22250 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:30.791141 24499 consensus_meta.cc:287] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.734s	user 0.005s	sys 0.007s
I20260709 13:06:30.791666 22098 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:30.792610 24518 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:06:30.787952 22252 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
W20260709 13:06:30.824683 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.833889 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:30.833864 22249 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:30.836004 22250 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:30.836946 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:30.837383 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:30.838384 22250 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:30.810715 24405 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:30.840963 24431 consensus_meta.cc:287] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 1.282s	user 0.012s	sys 0.003s
W20260709 13:06:30.844398 23976 consensus_meta.cc:287] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.945s	user 0.013s	sys 0.000s
I20260709 13:06:30.832856 24457 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:30.840096 24216 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:30.841200 24554 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:06:30.863754 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1521) took 1243 ms. Trace:
I20260709 13:06:30.864105 22172 rpcz_store.cc:276] 0709 13:06:29.620509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.267625 (+647116us) service_pool.cc:224] Handling call
0709 13:06:30.267991 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:30.384888 (+116897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:30.384935 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:30.408124 (+ 23189us) log.cc:844] Serialized 26 byte log entry
0709 13:06:30.620543 (+212419us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:30.620599 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.620697 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.863555 (+242858us) raft_consensus.cc:1685] finished
0709 13:06:30.863573 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.863701 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52246,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":259844,"threads_started":2,"wal-append.queue_time_us":269741}
I20260709 13:06:30.862485 24457 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:30.857512 24512 consensus_meta.cc:287] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.539s	user 0.005s	sys 0.009s
I20260709 13:06:30.859066 24473 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:30.862424 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1805) took 2510 ms. Trace:
I20260709 13:06:30.871902 22251 rpcz_store.cc:276] 0709 13:06:28.352255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.075652 (+723397us) service_pool.cc:224] Handling call
0709 13:06:29.095393 (+ 19741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.209885 (+1114492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.862189 (+652304us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540019cb54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:30.862365 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2561494400}
W20260709 13:06:30.873119 24395 consensus_meta.cc:287] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.005s
I20260709 13:06:30.873183 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1512) took 1295 ms. Trace:
I20260709 13:06:30.873584 22251 raft_consensus.cc:1275] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:06:30.873983 22251 pending_rounds.cc:85] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 2
I20260709 13:06:30.874348 22251 pending_rounds.cc:107] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:30.874616 22251 raft_consensus.cc:2889] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:30.875502 24493 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.879735 22255 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:30.880436 24511 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.880890 24511 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:30.881783 24503 log.cc:927] Time spent T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 1.781s	user 0.004s	sys 0.008s
I20260709 13:06:30.883711 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1851) took 1365 ms. Trace:
I20260709 13:06:30.884095 22176 rpcz_store.cc:276] 0709 13:06:29.518280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.587322 (+ 69042us) service_pool.cc:224] Handling call
0709 13:06:29.599754 (+ 12432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.690392 (+ 90638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.883480 (+1193088us) spinlock_profiling.cc:243] Waited 86.9 ms on lock 0x7b5400328cd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:30.883654 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199778048}
I20260709 13:06:30.885072 24369 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:30.881819 24266 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:30.887807 24280 consensus_meta.cc:287] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
W20260709 13:06:30.888454 22813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 336) took 1907 ms (client timeout 1934 ms). Trace:
I20260709 13:06:30.879933 24493 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:30.888839 22813 rpcz_store.cc:269] 0709 13:06:28.980834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.981003 (+   169us) service_pool.cc:224] Handling call
0709 13:06:30.888283 (+1907280us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400690354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:30.888392 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322894208}
I20260709 13:06:30.890970 24266 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:30.891358 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:30.892616 22100 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:30.893143 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 338) took 1034 ms. Trace:
I20260709 13:06:30.873855 22105 rpcz_store.cc:276] 0709 13:06:29.577984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.630463 (+ 52479us) service_pool.cc:224] Handling call
0709 13:06:30.872995 (+1242532us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b540042bb54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:30.873118 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784919936}
I20260709 13:06:30.897958 22250 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:06:30.910807 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.893455 22100 rpcz_store.cc:276] 0709 13:06:29.858878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.891050 (+1032172us) service_pool.cc:224] Handling call
0709 13:06:30.893072 (+  2022us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:30.827152 24553 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:30.913952 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:30.937726 22176 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:30.938974 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:30.940780 24481 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:30.942003 24411 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:06:30.942304 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:30.944396 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:30.945216 22176 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:30.946120 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:30.946761 22176 raft_consensus.cc:2376] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5. Re-sending same reply.
I20260709 13:06:30.947922 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:30.948534 22176 raft_consensus.cc:2376] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5. Re-sending same reply.
I20260709 13:06:30.951331 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:30.951937 22173 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:30.952864 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1835) took 1206 ms. Trace:
I20260709 13:06:30.953521 22248 rpcz_store.cc:276] 0709 13:06:29.746440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.174041 (+427601us) service_pool.cc:224] Handling call
0709 13:06:30.952601 (+778560us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400228dd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:30.952781 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525036928}
I20260709 13:06:30.957267 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 343) took 1633 ms. Trace:
I20260709 13:06:30.957978 22807 rpcz_store.cc:276] 0709 13:06:29.324349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.574257 (+249908us) service_pool.cc:224] Handling call
0709 13:06:30.956846 (+1382589us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b5400700154. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:30.957160 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171769088}
I20260709 13:06:30.939978 24263 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.962885 24263 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:30.965338 24263 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:30.967543 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:30.967705 24463 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:30.968214 22172 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:30.942022 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:30.973482 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1514) took 1377 ms. Trace:
I20260709 13:06:30.973927 22175 rpcz_store.cc:276] 0709 13:06:29.595835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.841843 (+246008us) service_pool.cc:224] Handling call
0709 13:06:30.973290 (+1131447us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54003291d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:30.973421 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754268544}
I20260709 13:06:30.976462 24463 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:30.977576 24511 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:30.978181 24446 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:30.978820 24412 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 13:06:30.979141 22102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1514) took 1394 ms (client timeout 1843 ms). Trace:
I20260709 13:06:30.978722 24446 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:30.979506 22102 rpcz_store.cc:269] 0709 13:06:29.584847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.603082 (+ 18235us) service_pool.cc:224] Handling call
0709 13:06:30.978941 (+1375859us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54000744d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:30.979075 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342521216}
I20260709 13:06:30.981468 22175 raft_consensus.cc:1240] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:30.982743 22179 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:30.981997 24544 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.986192 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1814) took 2631 ms. Trace:
I20260709 13:06:30.986218 22179 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:30.986557 24429 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:30.986699 22247 rpcz_store.cc:276] 0709 13:06:28.355125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.112689 (+757564us) service_pool.cc:224] Handling call
0709 13:06:29.113032 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.634705 (+521673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.985961 (+1351256us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540023bc54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:30.986132 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415019392}
I20260709 13:06:30.987815 24446 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:30.983960 24544 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:30.990182 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.990165 24544 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:30.993366 22181 raft_consensus.cc:1240] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:30.994109 24511 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:30.994696 24511 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:30.995584 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.996093 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.996809 24511 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:30.996922 22147 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:30.997141 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:30.997438 24511 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.997761 22173 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:30.998203 22147 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:30.998003 24511 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:30.998977 24486 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:30.999312 22180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1508) took 2175 ms (client timeout 1869 ms). Trace:
I20260709 13:06:30.999640 24486 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:30.999692 22180 rpcz_store.cc:269] 0709 13:06:28.824306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.064453 (+240147us) service_pool.cc:224] Handling call
0709 13:06:30.999151 (+1934698us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b54000db6d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:30.999250 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140873984}
I20260709 13:06:31.000461 24511 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:31.001113 24486 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:31.002406 22147 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:31.003509 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.996830 22172 raft_consensus.cc:1240] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:31.003855 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1831) took 1258 ms. Trace:
I20260709 13:06:31.004199 22255 rpcz_store.cc:276] 0709 13:06:29.745394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.752605 (+  7211us) service_pool.cc:224] Handling call
0709 13:06:30.998854 (+1246249us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54002292d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:31.003797 (+  4943us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296213376}
I20260709 13:06:31.001288 24469 raft_consensus.cc:3055] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:31.006718 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.008165 22147 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:31.008487 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:31.009975 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:31.011235 22147 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:31.009277 22781 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:31.012169 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.013397 22781 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:31.014812 24539 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:31.012207 24446 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:06:31.015790 24263 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:31.015899 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:31.016274 24263 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.016685 24263 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:31.016860 24429 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:31.017465 24472 consensus_queue.cc:260] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.018603 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:31.019254 22248 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:31.019570 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:31.020088 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:31.020588 22174 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:31.019258 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:31.015195 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:31.009300 24469 raft_consensus.cc:740] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:31.021546 22181 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:31.021574 22250 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:31.024561 22147 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:31.021589 22781 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:31.022372 22249 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:31.020257 22251 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 1.
I20260709 13:06:31.009693 24544 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:31.027752 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:31.027943 24429 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:31.028513 22251 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:31.028741 22247 raft_consensus.cc:1240] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:31.029728 24481 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:31.030172 24481 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:31.030553 24481 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:31.030705 24483 raft_consensus.cc:3055] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:31.035070 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:31.036561 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:31.023322 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:31.026285 22781 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:31.038556 22220 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:31.031271 24483 raft_consensus.cc:740] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:31.040374 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:31.040920 22813 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:31.044462 22812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 348) took 1303 ms. Trace:
I20260709 13:06:31.044955 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:31.046692 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.048199 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:31.048614 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1523) took 1085 ms. Trace:
I20260709 13:06:31.048957 22178 rpcz_store.cc:276] 0709 13:06:29.963303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.282554 (+319251us) service_pool.cc:224] Handling call
0709 13:06:30.283029 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.334635 (+ 51606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.048397 (+713762us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b54000019d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:31.048557 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110807936}
W20260709 13:06:31.042744 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.050683 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.049753 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:31.050853 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:31.051250 22181 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.052306 22173 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:31.053594 22147 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:31.053689 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:31.056510 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:31.057523 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:31.044850 22812 rpcz_store.cc:276] 0709 13:06:29.740735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.907755 (+167020us) service_pool.cc:224] Handling call
0709 13:06:31.044310 (+1136555us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b540064f354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:31.044407 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552146304}
I20260709 13:06:31.059609 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:31.040889 24472 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.060760 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:31.034117 24539 raft_consensus.cc:697] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:31.063019 24161 consensus_queue.cc:1059] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.064073 24161 raft_consensus.cc:3055] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:31.064476 24161 raft_consensus.cc:740] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:31.064568 24429 raft_consensus.cc:697] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:31.065261 24161 consensus_queue.cc:260] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:31.065465 24429 consensus_queue.cc:237] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.066486 24161 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.067238 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:31.067391 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:31.068013 22172 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:31.068540 22105 raft_consensus.cc:3055] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:31.068903 22779 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:31.069005 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:31.069265 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:31.069744 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 43555.4us
I20260709 13:06:31.070339 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:31.070947 22104 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:31.071812 22102 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:31.071894 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:31.072227 24555 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.072852 24428 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.073246 22099 raft_consensus.cc:1240] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:31.073411 24428 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.073997 22815 raft_consensus.cc:1240] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:31.074324 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:31.075086 24557 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:31.075498 24557 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.075814 24557 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.068913 22105 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:31.076333 23937 raft_consensus.cc:3055] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:31.076542 22779 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:31.076771 23937 raft_consensus.cc:740] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:31.076843 22105 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:31.077913 22105 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:31.077656 23937 consensus_queue.cc:260] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:31.078192 24395 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:31.078267 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:31.020570 24412 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.068029 22097 raft_consensus.cc:2368] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:31.079962 24412 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.082021 24412 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:31.039731 24378 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:31.082652 24437 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.083259 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1806) took 2730 ms. Trace:
I20260709 13:06:31.083220 24437 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.083683 22246 rpcz_store.cc:276] 0709 13:06:28.352555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.077112 (+724557us) service_pool.cc:224] Handling call
0709 13:06:29.077391 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.048063 (+1970672us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b540018c020. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7ec5b06 00007f66a7f5114a 00007f66a7f50fb7 00007f66a7f51470 00007f66a7f4dd8f 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91
0709 13:06:31.082252 (+ 34189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.082966 (+   714us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b540019b254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:31.083204 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2283408128}
I20260709 13:06:31.084964 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:31.086217 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:31.086866 22103 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:31.087428 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 341) took 1185 ms. Trace:
I20260709 13:06:31.087631 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:31.087764 22103 rpcz_store.cc:276] 0709 13:06:29.901807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.085941 (+1184134us) service_pool.cc:224] Handling call
0709 13:06:31.087378 (+  1437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.088373 24428 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:31.084538 24263 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.060273 22807 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.093364 22072 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:31.094156 24526 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.095147 22072 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:31.072780 24555 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.096225 22179 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:31.097690 24316 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:31.097895 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:31.098315 24316 raft_consensus.cc:697] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:31.098673 22106 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:31.057183 22782 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:31.099743 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:31.100689 22782 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:31.100806 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:31.101693 22098 raft_consensus.cc:2393] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:31.101590 24469 consensus_queue.cc:260] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:31.102777 24469 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.102810 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:31.103660 22097 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:31.097417 24456 consensus_queue.cc:1059] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:31.094648 24395 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:31.104990 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1842) took 1777 ms. Trace:
I20260709 13:06:31.122334 22174 rpcz_store.cc:276] 0709 13:06:29.327659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.413677 (+ 86018us) service_pool.cc:224] Handling call
0709 13:06:31.001636 (+1587959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.023612 (+ 21976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.103487 (+ 79875us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b54000db6d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:31.104674 (+  1187us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54000db6d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:31.104825 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3480840192}
I20260709 13:06:31.088280 22811 raft_consensus.cc:2376] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3. Re-sending same reply.
W20260709 13:06:31.107136 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.102003 22782 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:31.109011 22779 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:31.109949 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 71640.2us
I20260709 13:06:31.110733 22813 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:31.128640 22220 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:31.129832 22069 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:31.146759 22071 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:31.114729 22181 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:31.097311 24555 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:31.063745 24539 consensus_queue.cc:237] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:31.121062 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.167852 22105 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:31.168965 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:31.178315 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.170087 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:31.179039 22812 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:31.175839 22177 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:31.171588 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:31.181846 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.086750 24437 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:31.182982 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:31.183105 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 75351.4us
I20260709 13:06:31.183573 22179 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:31.087221 24321 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:31.185036 22144 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:31.069667 22100 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:31.095137 24263 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:31.188483 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 134931us
W20260709 13:06:31.187273 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 58718.6us
I20260709 13:06:31.204319 22220 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:31.190408 22181 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:31.206018 22220 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:31.206881 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.193773 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:31.201418 22218 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:31.175834 24412 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.121493 24428 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:31.210348 22812 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:31.144564 24369 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:31.169708 24482 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:31.212384 22147 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:31.179426 24509 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:29.910987 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:31.237933 22147 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:31.283754 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 156834us
I20260709 13:06:31.289866 22782 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:31.298069 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:31.214684 22220 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:31.184459 24378 raft_consensus.cc:697] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:31.188457 24520 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:31.228852 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 99083.4us
I20260709 13:06:31.097462 24483 consensus_queue.cc:260] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:31.189539 24511 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.202363 24486 consensus_queue.cc:1059] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:06:31.202819 24446 consensus_queue.cc:1059] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:06:31.216450 24506 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:31.341135 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 134826us
I20260709 13:06:31.291652 24512 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:31.293426 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 184459us
I20260709 13:06:31.210511 24321 raft_consensus.cc:697] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:31.209712 24543 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:31.207279 24525 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:31.303999 24553 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:06:31.215903 24221 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:31.188895 24454 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:31.313546 22069 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:31.360954 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 47514.6us
I20260709 13:06:31.213917 22218 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:31.228781 24369 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.322218 23835 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.222777 24490 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:31.318639 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:31.217621 24437 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:31.367090 22252 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
W20260709 13:06:31.315079 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 100442us
I20260709 13:06:31.210801 24456 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:06:31.291767 24263 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.291347 24405 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:31.284263 24501 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.369767 24263 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.304281 24266 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:31.224094 24375 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:31.210060 24560 consensus_queue.cc:1059] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 13:06:31.348521 24544 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:31.346086 22779 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:31.397302 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 51289.4us
I20260709 13:06:31.307855 24509 raft_consensus.cc:697] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:31.201998 24463 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:31.228503 24412 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.364244 24221 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.372650 24458 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:31.224653 24493 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.112s
I20260709 13:06:31.224382 24411 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 13:06:31.370332 24501 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:31.283350 24414 consensus_queue.cc:1059] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:06:31.338059 24431 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:31.356292 24512 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:31.236963 24540 consensus_queue.cc:1048] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.127s
I20260709 13:06:31.374354 24369 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:31.287318 24316 consensus_queue.cc:237] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:31.391947 24266 raft_consensus.cc:697] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:31.344673 24574 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:31.341359 24398 consensus_queue.cc:1059] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 13:06:31.402053 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 164218us
I20260709 13:06:31.471483 22147 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:31.378203 24375 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:31.377012 24506 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.372005 24437 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.338753 24511 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.216233 24055 consensus_queue.cc:1059] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 13:06:31.342490 22179 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
W20260709 13:06:31.414014 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.386507 23976 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:31.407258 24221 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.399811 24378 consensus_queue.cc:237] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:31.312143 22071 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:31.497212 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 185183us
W20260709 13:06:31.497448 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.497956 22071 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:31.391423 24530 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.417001 24482 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:31.386541 23835 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.472430 24375 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:31.482388 24572 log.cc:927] Time spent T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:06:31.482307 24506 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:31.422900 24458 raft_consensus.cc:697] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:31.439654 24431 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:31.501452 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 287583us
I20260709 13:06:31.519574 22071 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:31.510425 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 111876us
I20260709 13:06:31.483287 24437 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:31.533008 22218 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:31.499733 24504 raft_consensus.cc:3055] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:31.505139 24553 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:31.526170 22097 raft_consensus.cc:1275] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:31.551555 22812 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:31.489823 24574 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:06:31.570775 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:31.531993 24456 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:31.580055 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.473819 24321 consensus_queue.cc:237] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.504493 24411 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:06:31.545454 24431 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.554688 24055 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:31.522665 23976 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:06:31.631517 22815 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:31.550004 24504 raft_consensus.cc:740] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:31.629432 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:31.630412 24580 log.cc:927] Time spent T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:06:31.506975 24530 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:31.632925 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.650678 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 268494us
I20260709 13:06:31.643256 22814 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:31.545145 24414 consensus_queue.cc:1059] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:06:31.633404 22813 raft_consensus.cc:1240] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:31.601354 24553 raft_consensus.cc:697] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:31.610400 24446 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:31.562369 24482 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:06:31.628576 24525 raft_consensus.cc:697] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:31.652303 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:31.667589 22816 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:31.659904 22220 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:31.665498 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:31.632292 24456 raft_consensus.cc:697] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:31.558995 24509 consensus_queue.cc:237] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:31.601078 24560 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:06:31.661118 24446 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:31.684648 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 213242us
I20260709 13:06:31.650411 24263 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:31.663589 23937 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.670336 24414 consensus_queue.cc:1243] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:31.569799 24266 consensus_queue.cc:237] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:31.679104 24573 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.284s	user 0.001s	sys 0.001s
I20260709 13:06:31.712757 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:31.716101 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.716394 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:31.718611 22781 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:31.712968 22106 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.012s	sys 0.033s
W20260709 13:06:31.720341 22106 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.013s	sys 0.033s
I20260709 13:06:31.702536 24446 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:31.725133 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:31.806471 24395 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.701022 22811 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:31.758083 24493 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.758587 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:31.809989 22816 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:31.712360 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:31.766665 24437 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:31.767673 24593 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:31.768060 24465 raft_consensus.cc:3055] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:31.768105 24589 consensus_queue.cc:1059] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:31.773670 24429 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.774186 24591 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.776906 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:31.861569 22179 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:31.779074 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:31.862831 22172 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:31.779233 24490 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:31.782030 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:31.785365 22181 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:31.722947 24574 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:31.717226 24501 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:31.670892 24458 consensus_queue.cc:237] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:31.790131 24570 log.cc:927] Time spent T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:06:31.748301 24456 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.723294 24590 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.791296 23835 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:31.791376 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:31.792671 24576 log.cc:927] Time spent T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:06:31.792788 24530 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:31.793422 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:31.901793 22178 raft_consensus.cc:2410] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:31.749805 24412 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:31.750584 24512 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:31.799192 24375 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:31.802054 22052 auto_rebalancer.cc:893] Removing replace marker failed: Replica 79683575881f4334bd4dc6d9bdbb45c3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:31.802764 22174 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:31.727522 22815 raft_consensus.cc:2393] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:31.849870 22813 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:31.718863 24553 consensus_queue.cc:237] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:31.858708 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:31.803388 24511 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:31.808771 24411 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:31.874243 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 354715us
I20260709 13:06:31.830120 24543 raft_consensus.cc:3055] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:31.809177 24599 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:31.842546 24593 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.790793 24525 consensus_queue.cc:237] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:31.888341 22781 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:31.974236 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 85981.4us
I20260709 13:06:31.977671 22173 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:31.844065 24465 raft_consensus.cc:740] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:31.893458 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.893567 22097 raft_consensus.cc:1240] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:06:31.984105 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.895965 22814 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:31.894340 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:31.823357 24395 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:31.807197 24369 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:31.903630 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 369181us
I20260709 13:06:31.895363 24414 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:31.883816 24461 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:31.935643 22052 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:06:31.937410 24594 log.cc:927] Time spent T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:06:31.897572 24526 consensus_meta.cc:287] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.803s	user 0.012s	sys 0.000s
W20260709 13:06:31.999467 22052 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:06:31.960193 24543 raft_consensus.cc:740] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:31.932832 24486 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.935920 24601 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:31.944957 24520 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:31.950598 24469 consensus_meta.cc:287] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.847s	user 0.008s	sys 0.003s
I20260709 13:06:31.906509 23835 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.957100 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:31.997455 24482 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:32.046845 22179 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:31.897322 24501 raft_consensus.cc:3055] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:31.999094 24055 raft_consensus.cc:697] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:31.941123 24557 consensus_meta.cc:287] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.856s	user 0.007s	sys 0.005s
W20260709 13:06:31.980338 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 324578us
I20260709 13:06:31.934837 24587 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:31.982981 22175 raft_consensus.cc:1240] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:31.985507 22106 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:31.876221 24591 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.995502 22218 leader_election.cc:400] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:32.055707 22218 leader_election.cc:403] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:31.829495 24493 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:31.961385 24481 consensus_meta.cc:287] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.930s	user 0.006s	sys 0.006s
I20260709 13:06:32.009127 22172 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:31.961382 22811 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:31.869390 24429 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.880550 24490 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.943089 24560 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.983973 24593 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:31.899869 24590 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.048354 22071 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:31.952991 24375 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:32.024343 22807 consensus_meta.cc:287] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.930s	user 0.012s	sys 0.000s
W20260709 13:06:32.098197 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 49973.1us
I20260709 13:06:32.020586 24485 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.062754 22220 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:32.048523 24520 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:32.066677 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 71392.7us
I20260709 13:06:32.000334 24575 consensus_queue.cc:1059] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:06:32.052459 24483 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:32.013830 24414 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:32.050129 24501 raft_consensus.cc:740] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:32.016592 24461 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:32.048262 24486 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:31.984125 24599 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.063542 24384 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.055244 23835 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:32.060361 24431 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:32.073382 24511 consensus_queue.cc:1059] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:06:32.059769 24557 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:32.064353 24587 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.047482 24601 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:32.066174 24465 consensus_queue.cc:260] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.068780 24481 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:32.240716 22808 raft_consensus.cc:2393] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:32.242385 24604 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.242734 24481 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:32.073760 24603 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:06:32.243436 24608 log.cc:927] Time spent T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:06:32.166127 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.197232 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.246541 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 59103.4us
I20260709 13:06:32.116451 22218 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:32.342677 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 226331us
I20260709 13:06:32.097921 24263 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.109889 24469 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.243147 24604 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:32.369379 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 266958us
I20260709 13:06:32.099133 22807 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
W20260709 13:06:32.162562 24472 consensus_meta.cc:287] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.102s	user 0.013s	sys 0.000s
W20260709 13:06:32.166046 24600 log.cc:927] Time spent T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:06:32.107977 24316 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:32.368536 22812 raft_consensus.cc:2393] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:32.121506 24375 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.261s
I20260709 13:06:32.110708 24437 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:32.111519 24588 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:32.144682 24575 raft_consensus.cc:3055] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:32.177968 23937 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:32.180435 24607 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.376611 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:32.402542 22172 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:32.354085 24369 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:32.379025 22173 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:06:32.377411 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:32.097379 24560 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.122519 24512 consensus_queue.cc:1048] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.246s
I20260709 13:06:32.393095 22099 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:32.088164 24543 consensus_queue.cc:260] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:32.427594 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.355017 24465 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:32.376911 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:32.132274 24411 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.252s
I20260709 13:06:32.376061 24606 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.352748 24395 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:32.395010 22175 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: [5.6-6.7]
I20260709 13:06:32.373344 24609 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:32.386746 24316 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.144186 24055 consensus_queue.cc:237] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.378527 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35198 (request call id 722) took 1342 ms. Trace:
W20260709 13:06:32.436949 24161 consensus_meta.cc:287] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.330s	user 0.015s	sys 0.002s
I20260709 13:06:32.351532 24384 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.392462 24575 raft_consensus.cc:740] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:32.110832 24485 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:32.441751 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.404578 24437 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.425470 22177 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:32.440455 24609 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.449402 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:32.449923 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.357299 24469 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:32.374230 24263 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:32.431232 24509 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.421442 24591 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:32.453886 24395 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:32.437719 24602 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.435287 24493 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:32.459542 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:32.482580 22172 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
W20260709 13:06:32.459993 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.405583 24458 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:32.448979 24316 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:32.450527 24590 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:32.422430 23937 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:32.453490 24543 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:32.492242 22220 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:32.427757 24607 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.484468 22254 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:32.496619 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 152417us
I20260709 13:06:32.484707 22246 raft_consensus.cc:1275] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:32.403147 24501 consensus_queue.cc:260] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.486339 23835 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:32.470453 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.440483 24606 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:32.450806 22807 rpcz_store.cc:276] 0709 13:06:31.036063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.039973 (+  3910us) service_pool.cc:224] Handling call
0709 13:06:32.378433 (+1338460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.486647 24431 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:32.473055 24161 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.467880 24437 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.537551 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:32.538378 22103 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:32.513144 24411 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:32.539578 24411 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.493584 24458 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.540077 24411 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:32.541749 24458 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:32.541923 24221 consensus_meta.cc:287] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 1.035s	user 0.008s	sys 0.003s
I20260709 13:06:32.479447 24509 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.474409 24609 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:32.506604 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:32.520344 24552 raft_consensus.cc:2764] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:32.520686 24414 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:32.521062 24493 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:32.521898 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:32.522576 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:32.487882 24395 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:32.524430 24615 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.323s	user 0.000s	sys 0.003s
I20260709 13:06:32.524928 23937 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:32.526660 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:32.527070 24614 raft_consensus.cc:3055] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:32.527288 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:32.607502 24560 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:32.607803 22810 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:32.543717 22069 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:32.545637 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:32.510039 24557 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:32.528030 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:32.539583 24618 log.cc:927] Time spent T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 13:06:32.553785 24626 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.612507 24509 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:32.612327 24626 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.554569 24601 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:32.535524 24161 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.559021 24606 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:32.556743 22102 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:32.498706 22218 leader_election.cc:400] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5.
I20260709 13:06:32.625909 22218 leader_election.cc:403] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:06:32.626632 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 128119us
I20260709 13:06:32.627408 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:32.628505 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:32.507965 24602 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:32.548273 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:32.595534 24583 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:32.603296 24617 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:06:32.606088 24587 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:32.606654 24599 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:32.507213 24373 consensus_queue.cc:1059] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:06:32.646011 24373 raft_consensus.cc:3055] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:32.646495 24373 raft_consensus.cc:740] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:32.647837 24446 consensus_meta.cc:287] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.804s	user 0.006s	sys 0.007s
I20260709 13:06:32.542383 24221 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:32.618451 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 74802.3us
W20260709 13:06:32.657377 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.628583 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 1865) took 1578 ms. Trace:
I20260709 13:06:32.630062 22218 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:32.559317 24607 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:32.607079 24614 raft_consensus.cc:740] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:32.659513 22180 rpcz_store.cc:276] 0709 13:06:31.050528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.050636 (+   108us) service_pool.cc:224] Handling call
0709 13:06:32.628403 (+1577767us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003287d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:32.628523 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2391776128}
I20260709 13:06:32.571098 24429 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:32.634884 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.630149 24560 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:32.624979 24461 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:32.643260 24626 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:32.643922 24627 log.cc:927] Time spent T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:06:32.644541 24263 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:32.608208 24604 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:32.633920 24509 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:32.635843 24590 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:32.658635 22069 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:32.661646 24633 log.cc:927] Time spent T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:06:32.630810 24512 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5.
I20260709 13:06:32.667603 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:32.510314 24575 consensus_queue.cc:260] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:32.647516 24373 consensus_queue.cc:260] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.662190 24614 consensus_queue.cc:260] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:32.701982 22246 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:32.686607 22180 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:32.666265 24221 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:32.668644 24583 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.695884 22254 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:06:32.770049 22254 pending_rounds.cc:85] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 6
I20260709 13:06:32.770371 22254 pending_rounds.cc:107] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:06:32.770654 22254 raft_consensus.cc:2889] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:32.703810 24625 log.cc:927] Time spent T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:06:32.709285 24482 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.715183 22812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35214 (request call id 498) took 1160 ms. Trace:
I20260709 13:06:32.660964 24446 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.782050 22812 rpcz_store.cc:276] 0709 13:06:31.554489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.554621 (+   132us) service_pool.cc:224] Handling call
0709 13:06:32.714937 (+1160316us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b54005e01d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:32.715113 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832417536}
I20260709 13:06:32.716547 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:32.783595 22181 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:32.717832 24161 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:32.718887 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.720184 24411 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:32.720949 22782 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:32.723220 24629 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:06:32.691262 22809 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:06:32.688812 24463 consensus_meta.cc:287] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.274s	user 0.015s	sys 0.000s
I20260709 13:06:32.688117 24560 raft_consensus.cc:697] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:32.699224 24456 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:32.733374 24593 consensus_meta.cc:287] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.000s
I20260709 13:06:32.739272 24575 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:32.740525 24437 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:32.667455 24599 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.811183 22249 raft_consensus.cc:1240] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:32.769263 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:32.922247 22106 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:32.930111 22250 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:32.777179 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35214 (request call id 506) took 1124 ms. Trace:
I20260709 13:06:32.955439 22808 rpcz_store.cc:276] 0709 13:06:31.653116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.657762 (+  4646us) service_pool.cc:224] Handling call
0709 13:06:32.776910 (+1119148us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b540007fdd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:32.777086 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957084032}
W20260709 13:06:32.959178 24603 consensus_meta.cc:287] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.000s
I20260709 13:06:32.959885 24603 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 2. Current term is 3.
I20260709 13:06:32.964924 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:32.966203 22179 raft_consensus.cc:2393] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:06:32.968243 24483 consensus_meta.cc:287] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.715s	user 0.004s	sys 0.008s
I20260709 13:06:32.780985 24614 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:32.784508 24482 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:32.797585 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.756194 24601 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.801558 24485 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:32.699929 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:32.889089 22178 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:06:32.768250 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:32.947295 24610 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.774s	user 0.000s	sys 0.002s
I20260709 13:06:32.825800 24504 consensus_queue.cc:260] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:32.824760 24454 raft_consensus.cc:3055] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:32.950212 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:32.950814 24506 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:32.780609 24373 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:32.687729 22103 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:32.785198 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:32.975668 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:32.976390 22250 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:32.864791 24405 raft_consensus.cc:3055] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:32.977193 24632 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.980310 24501 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:32.882252 24583 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:32.824061 24469 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:32.912612 24446 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:32.910526 24613 log.cc:927] Time spent T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.760s	user 0.003s	sys 0.000s
I20260709 13:06:32.803786 24395 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:32.917906 24411 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:32.983636 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 280098us
W20260709 13:06:32.987162 22174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.031s	sys 0.022s
I20260709 13:06:32.989696 22101 raft_consensus.cc:1240] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:33.004745 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 283861us
I20260709 13:06:33.007037 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:33.401316 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:33.401969 22180 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.403095 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:33.391794 22181 consensus_meta.cc:287] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.002s
I20260709 13:06:33.404058 22181 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:33.217773 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:33.012781 24626 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:33.322935 24486 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:33.405112 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 775057us
W20260709 13:06:33.192988 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.013098 24553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.017s	sys 0.038s
I20260709 13:06:33.405292 24589 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:33.406328 24553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.029s	sys 0.054s
I20260709 13:06:33.406179 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:33.406507 24589 raft_consensus.cc:697] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:33.403056 22174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.353s	user 0.036s	sys 0.032s
W20260709 13:06:33.407212 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.399828 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:33.407513 24589 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:33.405100 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:33.403702 24504 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.405376 24486 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.409250 22181 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
W20260709 13:06:33.399407 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.404101 24454 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:33.411495 24486 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:33.407516 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:33.191912 24464 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.412231 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:33.413678 24486 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:33.413321 24464 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:33.413378 24437 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:06:33.402861 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.411517 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.449105 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.252437 22175 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.037s	sys 0.087s
W20260709 13:06:33.450822 22175 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.037s	sys 0.091s
W20260709 13:06:33.134387 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.450639 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.295476 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:33.453097 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.419324 22218 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:33.453461 22812 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
W20260709 13:06:33.393764 22255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.004s	sys 0.007s
W20260709 13:06:33.454846 22255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.004s	sys 0.008s
I20260709 13:06:33.414014 22181 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:33.017333 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:33.221186 22177 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.029s	sys 0.060s
I20260709 13:06:33.457559 22253 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
W20260709 13:06:33.457978 22177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.030s	sys 0.068s
I20260709 13:06:33.459430 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:33.460916 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:33.047345 22071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.024s	sys 0.036s
I20260709 13:06:33.463501 24602 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:33.400897 22254 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:32.970960 24463 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:32.970072 24456 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:33.427634 22247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.007s	sys 0.004s
I20260709 13:06:33.206099 24398 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.970690 24490 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:32.959165 24384 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:33.473970 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 54746.9us
I20260709 13:06:33.403792 22179 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:33.509618 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1547) took 1021 ms. Trace:
I20260709 13:06:33.510777 22218 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:33.456010 24405 raft_consensus.cc:740] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:33.366511 24525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.024s	sys 0.052s
W20260709 13:06:33.166654 24375 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.035s	sys 0.036s
W20260709 13:06:33.338800 24378 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.037s	sys 0.031s
W20260709 13:06:33.218693 24520 consensus_meta.cc:287] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 1.103s	user 0.013s	sys 0.000s
I20260709 13:06:33.489552 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:33.490639 22181 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:33.527540 22813 raft_consensus.cc:2393] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:33.528007 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:33.528824 22181 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 3.
I20260709 13:06:33.482957 24552 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:33.529902 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:33.493276 22071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.026s	sys 0.054s
W20260709 13:06:33.302488 24543 consensus_meta.cc:287] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.799s	user 0.008s	sys 0.003s
I20260709 13:06:33.494712 22180 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:33.302796 24631 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.422310 24482 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:33.470329 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:33.502887 24456 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:33.522276 24525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.025s	sys 0.053s
I20260709 13:06:33.429014 24630 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.429150 24635 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:33.040679 24369 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:33.541584 24384 raft_consensus.cc:2764] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:33.464299 23976 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:33.465130 24483 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:33.464951 24429 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:33.482231 22172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.019s	sys 0.042s
W20260709 13:06:33.652923 22172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.019s	sys 0.043s
I20260709 13:06:32.971180 24593 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:33.510162 22179 rpcz_store.cc:276] 0709 13:06:32.488379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.402838 (+914459us) service_pool.cc:224] Handling call
0709 13:06:33.509536 (+106698us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:33.484964 24506 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:32.965107 24316 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:33.525357 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:33.532577 22180 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:06:33.498571 22247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.008s	sys 0.004s
I20260709 13:06:33.499670 24583 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.982193 24599 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:33.017762 24601 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:33.553608 22181 raft_consensus.cc:1240] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:33.666112 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1549) took 1169 ms. Trace:
I20260709 13:06:33.666559 22181 rpcz_store.cc:276] 0709 13:06:32.496771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.542751 (+1045980us) service_pool.cc:224] Handling call
0709 13:06:33.553300 (+ 10549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.665733 (+112433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.666042 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:33.412468 24454 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:33.529232 24375 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.041s	sys 0.037s
I20260709 13:06:33.405210 24626 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:33.526741 24378 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.038s	sys 0.031s
I20260709 13:06:33.498059 24263 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:06:33.498991 22253 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:06:33.631276 22781 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.015s	sys 0.039s
I20260709 13:06:33.503634 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:33.472332 24632 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:33.538353 24602 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.654325 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:33.694278 22106 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:33.694479 22179 raft_consensus.cc:2393] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:33.510450 24398 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:33.648875 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 303) took 1876 ms. Trace:
I20260709 13:06:33.660864 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1551) took 1043 ms. Trace:
W20260709 13:06:33.557929 24604 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.022s	sys 0.022s
W20260709 13:06:33.706324 24604 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.022s	sys 0.022s
I20260709 13:06:33.338866 24560 consensus_queue.cc:237] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:33.706842 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:33.707865 24602 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:33.710807 24398 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:33.711086 22102 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:33.665189 22807 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:33.712111 24398 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.712559 24398 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:33.699559 22180 rpcz_store.cc:276] 0709 13:06:32.617037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.531834 (+914797us) service_pool.cc:224] Handling call
0709 13:06:33.532173 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.660235 (+128062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.660619 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:33.715332 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:33.670478 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 145198us
I20260709 13:06:33.723286 22179 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:33.724361 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:33.726015 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:33.680467 22254 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:33.698599 22176 rpcz_store.cc:276] 0709 13:06:31.772119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.773095 (+   976us) service_pool.cc:224] Handling call
0709 13:06:31.773498 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.773901 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.773941 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.774484 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.985100 (+210616us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:31.985155 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.985546 (+   391us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.905208 (+919662us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:33.642906 (+737698us) raft_consensus.cc:1685] finished
0709 13:06:33.642952 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.648737 (+  5785us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1190,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":10414336,"thread_start_us":210255,"threads_started":1,"wal-append.queue_time_us":323501}
I20260709 13:06:33.727558 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:33.727967 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:33.687716 22220 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:33.645826 24369 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.543483 24520 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:33.549959 24552 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:33.694806 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:33.740433 22173 raft_consensus.cc:2393] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:33.696658 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:33.648118 24553 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.695736 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:33.723310 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:33.665419 24429 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:33.726667 22179 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:33.642159 24630 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:33.760735 22179 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:33.560989 24631 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:33.647081 24469 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.681926 24635 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:33.729794 22180 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:33.729487 22220 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:33.783354 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.741187 24369 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.741948 24384 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.783389 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 311) took 1052 ms. Trace:
W20260709 13:06:33.762461 24539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.095s	user 0.029s	sys 0.034s
W20260709 13:06:33.680264 22781 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.015s	sys 0.039s
W20260709 13:06:33.799639 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 795815us
I20260709 13:06:33.761503 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1878) took 1047 ms. Trace:
I20260709 13:06:33.659111 24483 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:33.776460 24609 consensus_meta.cc:287] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 1.205s	user 0.013s	sys 0.000s
W20260709 13:06:33.774679 22144 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.260s	user 0.013s	sys 0.024s
W20260709 13:06:33.801330 22144 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.287s	user 0.014s	sys 0.024s
I20260709 13:06:33.739152 24506 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:33.732872 22811 raft_consensus.cc:1240] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:33.732847 24454 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:33.781100 22181 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
W20260709 13:06:33.783787 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 54611.4us
I20260709 13:06:33.812791 22220 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:33.800514 24635 raft_consensus.cc:697] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:33.814395 22220 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:33.738644 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:33.753651 24412 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.015s	sys 0.018s
W20260709 13:06:33.818221 22099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 346) took 2709 ms (client timeout 2856 ms). Trace:
I20260709 13:06:33.815186 22176 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
W20260709 13:06:33.818819 22099 rpcz_store.cc:269] 0709 13:06:31.097823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.099506 (+  1683us) service_pool.cc:224] Handling call
0709 13:06:33.806703 (+2707197us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003e0654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:33.806848 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2972857600}
I20260709 13:06:33.790508 22779 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:33.696134 24525 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:06:33.690977 24583 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:33.792773 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:33.728111 22254 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:33.759326 22253 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:33.793715 22180 rpcz_store.cc:276] 0709 13:06:32.734027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.782600 (+1048573us) service_pool.cc:224] Handling call
0709 13:06:33.782902 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.783085 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.783108 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:33.783150 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:33.783183 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.783234 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.783335 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:33.798599 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1544) took 1422 ms. Trace:
W20260709 13:06:33.762612 22251 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.220s	user 0.017s	sys 0.017s
W20260709 13:06:33.801681 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 1.28711e+06us
I20260709 13:06:33.792399 24464 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:33.760399 24553 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:33.800618 22179 rpcz_store.cc:276] 0709 13:06:32.713913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.760080 (+1046167us) service_pool.cc:224] Handling call
0709 13:06:33.760395 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.761205 (+   810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.761445 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:33.698912 24405 consensus_queue.cc:260] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:33.826584 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 345432us
I20260709 13:06:33.863353 22249 raft_consensus.cc:2368] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6.
I20260709 13:06:33.863596 22782 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:33.799242 24539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.029s	sys 0.035s
I20260709 13:06:33.791425 24490 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:33.786525 22000 catalog_manager.cc:5697] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 5, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 5 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.822322 22220 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:33.823010 22252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.315s	user 0.067s	sys 0.077s
I20260709 13:06:33.780416 24492 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:06:33.907239 24405 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:33.908291 24642 log.cc:927] Time spent T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:06:33.864606 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:33.864903 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.865870 22180 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
W20260709 13:06:33.866034 22251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.324s	user 0.020s	sys 0.020s
I20260709 13:06:33.815410 24263 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:33.817263 22100 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:33.866786 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:33.801107 24384 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:33.818621 24412 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.016s	sys 0.019s
I20260709 13:06:33.825311 24509 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:33.794426 24437 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:33.860311 24637 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:33.899886 22252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.392s	user 0.067s	sys 0.077s
I20260709 13:06:33.813198 24398 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:33.804337 24506 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:33.901456 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 79225.4us
I20260709 13:06:33.955720 22220 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:33.912529 24464 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.792239 24469 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:33.926565 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.930020 22249 raft_consensus.cc:2368] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6.
I20260709 13:06:33.862566 24411 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:33.919770 22180 pending_rounds.cc:85] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 6
I20260709 13:06:33.808418 24609 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:33.826129 22181 raft_consensus.cc:1240] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:33.939116 22071 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:33.940635 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:33.970112 22254 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:33.970821 22144 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:33.973263 22144 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:33.944828 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1873) took 1988 ms. Trace:
W20260709 13:06:33.944689 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 144405us
I20260709 13:06:33.913364 22811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 733) took 1223 ms. Trace:
I20260709 13:06:33.919677 24632 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:33.965613 22180 pending_rounds.cc:107] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:06:33.970999 22181 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:33.980242 22180 raft_consensus.cc:2889] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:33.980581 22180 pending_rounds.cc:107] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:06:33.980810 22180 raft_consensus.cc:2889] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:33.974138 22174 rpcz_store.cc:276] 0709 13:06:31.956027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.956146 (+   119us) service_pool.cc:224] Handling call
0709 13:06:31.981753 (+ 25607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.996449 (+ 14696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.996480 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.997137 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.407375 (+1410238us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:33.779800 (+372425us) log.cc:844] Serialized 14 byte log entry
0709 13:06:33.780010 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.780081 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:33.944623 (+164542us) raft_consensus.cc:1685] finished
0709 13:06:33.944642 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.944768 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14217,"raft.queue_time_us":19512,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":27985,"thread_start_us":1729328,"threads_started":2,"wal-append.queue_time_us":1674807}
I20260709 13:06:33.946013 24437 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.914407 24589 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:33.943070 24509 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.982194 22180 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:33.982069 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:33.977078 22781 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:33.917564 24581 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 13:06:33.996873 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 133348us
I20260709 13:06:33.961227 24506 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.957615 24637 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:34.017133 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:34.018432 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:34.019107 22249 raft_consensus.cc:2376] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8. Re-sending same reply.
I20260709 13:06:34.019780 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:34.020932 22103 raft_consensus.cc:2410] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:33.989590 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:33.991580 24552 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:33.992437 24648 log.cc:927] Time spent T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:06:33.918722 24490 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:34.005195 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.996021 24509 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:34.015020 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.932309 24539 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:06:34.022059 22174 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:33.989566 22144 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:33.987335 24378 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:33.983526 24482 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:34.063395 24483 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:34.065582 24504 consensus_meta.cc:287] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.657s	user 0.000s	sys 0.010s
I20260709 13:06:34.066488 22097 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:34.067574 24429 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.067680 22097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1543) took 1079 ms. Trace:
I20260709 13:06:33.984004 24437 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:33.983166 24589 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.017521 24601 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:34.022974 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 202227us
I20260709 13:06:34.013715 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:33.996622 24463 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:33.994812 24606 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:34.035032 22782 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:34.047641 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:34.013217 24395 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:34.049620 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:34.058274 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:34.141937 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 107003us
I20260709 13:06:34.060063 22808 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:34.142871 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:34.143266 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 734) took 1155 ms. Trace:
I20260709 13:06:34.143496 22249 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
W20260709 13:06:34.066546 24501 consensus_meta.cc:287] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.000s
I20260709 13:06:33.997881 24316 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:34.147954 24637 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:33.997352 24584 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:06:34.150903 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1874) took 2194 ms. Trace:
W20260709 13:06:34.151688 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.151304 22178 rpcz_store.cc:276] 0709 13:06:31.956294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.956433 (+   139us) service_pool.cc:224] Handling call
0709 13:06:31.986481 (+ 30048us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.403076 (+1416595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.150651 (+747575us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b540003c354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:34.150846 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2074935040}
I20260709 13:06:34.152482 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45738 (request call id 405) took 1203 ms. Trace:
I20260709 13:06:34.026669 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:34.152854 22248 rpcz_store.cc:276] 0709 13:06:32.949661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.949840 (+   179us) service_pool.cc:224] Handling call
0709 13:06:34.130409 (+1180569us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b540019c654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:34.152420 (+ 22011us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950502144}
I20260709 13:06:34.153353 22101 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:33.948871 24263 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:33.966477 24464 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:34.159663 24609 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:34.160091 24464 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.160303 24609 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.160823 24609 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:34.133623 24482 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:34.162708 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 400) took 1492 ms. Trace:
I20260709 13:06:34.163290 22246 rpcz_store.cc:276] 0709 13:06:32.670478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.670772 (+   294us) service_pool.cc:224] Handling call
0709 13:06:32.694269 (+ 23497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.702471 (+  8202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.162482 (+1460011us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b54002283d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:34.162648 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16730880}
I20260709 13:06:34.027163 24593 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:34.130306 24589 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.055832 24552 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:34.135289 24446 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.134473 24520 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:34.144371 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:34.189306 22179 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:06:34.145840 24646 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:06:34.156424 22253 raft_consensus.cc:2410] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:34.155692 24660 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.069607 24465 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.068957 24602 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:34.149434 24456 consensus_meta.cc:287] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.587s	user 0.005s	sys 0.003s
I20260709 13:06:34.134171 24378 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:34.137769 22812 raft_consensus.cc:2393] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
W20260709 13:06:34.150311 24638 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.371s	user 0.001s	sys 0.001s
I20260709 13:06:33.979923 22811 rpcz_store.cc:276] 0709 13:06:32.690096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.691049 (+   953us) service_pool.cc:224] Handling call
0709 13:06:33.732439 (+1041390us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:33.732659 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.821040 (+ 88381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.909224 (+ 88184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6503680}
I20260709 13:06:34.139344 24375 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:34.162776 24482 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.164579 24485 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.154819 24463 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.188581 24552 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.165019 24395 raft_consensus.cc:697] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:34.168313 24501 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:34.207512 24663 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:34.185905 24640 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.031705 24635 consensus_queue.cc:237] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:34.194131 24593 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.193902 24583 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.209280 24630 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:34.191428 24599 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:34.190064 24657 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:34.213745 24482 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.191521 24446 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:34.223897 24463 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:34.228261 24552 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.211387 24631 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.227869 24375 raft_consensus.cc:697] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:34.068117 22097 rpcz_store.cc:276] 0709 13:06:32.988706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.991027 (+  2321us) service_pool.cc:224] Handling call
0709 13:06:32.991378 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.066894 (+1075516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.067451 (+   557us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002b9154. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:34.067612 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2471655808}
I20260709 13:06:34.140323 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:34.073014 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:34.154219 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:34.509334 22098 raft_consensus.cc:2410] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:34.510365 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:34.359746 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 420476us
I20260709 13:06:34.515823 24667 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:34.517100 24667 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:34.506582 24263 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:34.132143 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 142659us
I20260709 13:06:34.519645 22099 raft_consensus.cc:2393] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 6: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:34.520421 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:34.521351 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:34.170398 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:34.524734 24583 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:34.525079 22176 raft_consensus.cc:2393] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 5: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:34.525360 24583 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:34.384315 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1545) took 1378 ms. Trace:
I20260709 13:06:34.525928 24583 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.526252 22100 rpcz_store.cc:276] 0709 13:06:33.006198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.012611 (+  6413us) service_pool.cc:224] Handling call
0709 13:06:34.383849 (+1371238us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b540012fa54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:34.384115 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906198272}
I20260709 13:06:34.389917 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1547) took 1209 ms. Trace:
W20260709 13:06:34.181372 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 225698us
I20260709 13:06:34.391427 22102 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:34.534179 22220 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:34.527660 22106 rpcz_store.cc:276] 0709 13:06:33.180580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.295094 (+114514us) service_pool.cc:224] Handling call
0709 13:06:34.389530 (+1094436us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54003ff7d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:34.389746 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509236608}
I20260709 13:06:34.505903 24599 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.167826 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:34.504863 24454 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:34.538460 24454 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:34.539934 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:34.183513 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1633) took 1702 ms. Trace:
I20260709 13:06:34.168783 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:34.541477 24454 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:34.542496 22248 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:34.543944 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:34.545069 22248 raft_consensus.cc:2410] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:33.865226 22175 rpcz_store.cc:276] 0709 13:06:32.375853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.472763 (+ 96910us) service_pool.cc:224] Handling call
0709 13:06:32.476991 (+  4228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.477503 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:33.451717 (+974214us) log.cc:844] Serialized 14 byte log entry
0709 13:06:33.797974 (+346257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:33.798048 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:33.798109 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.798370 (+   261us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.798525 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1316138,"prepare.run_wall_time_us":39,"raft.queue_time_us":102,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":12552,"spinlock_wait_cycles":7864064,"thread_start_us":1305943,"threads_started":2}
I20260709 13:06:34.143693 22808 rpcz_store.cc:276] 0709 13:06:32.987846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.005763 (+ 17917us) service_pool.cc:224] Handling call
0709 13:06:34.059542 (+1053779us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29eee 0000000000375939 00007f66ace9d1e0 00007f66acf660c4 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:34.059711 (+   169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.143007 (+ 83296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.143213 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6141824}
I20260709 13:06:34.413081 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1636) took 1929 ms. Trace:
I20260709 13:06:34.426015 23976 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.548038 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:34.548648 23976 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:34.426769 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.428750 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:34.288501 24446 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.282703 24437 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:34.210703 24456 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:34.528908 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:34.569984 22100 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:34.571704 24456 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:34.205246 24465 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:34.575358 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 52055us
I20260709 13:06:34.578029 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:34.282311 24469 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:34.579257 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 440672us
I20260709 13:06:34.579816 22104 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:34.280774 24482 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:34.224079 24485 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:34.290148 24490 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.585424 24437 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:34.585651 24482 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.585681 24485 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.313984 24506 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:34.587566 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 53704.1us
I20260709 13:06:34.588888 24506 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:34.589800 24506 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:34.590276 24506 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.311964 24509 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:34.593128 24509 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:34.594806 24673 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:34.595389 23976 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:34.316918 24552 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:34.556244 24375 consensus_queue.cc:237] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:34.598476 22249 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
W20260709 13:06:34.311458 24575 consensus_meta.cc:287] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 1.340s	user 0.012s	sys 0.000s
I20260709 13:06:34.609210 24485 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:34.318496 24589 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:34.615880 24446 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.616106 24429 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.616570 24446 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:34.616788 24429 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:34.617522 24589 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:34.247212 24593 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:34.619254 22246 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.619922 24667 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:34.620330 24593 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:34.268776 24603 raft_consensus.cc:3055] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:34.234697 24609 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:34.302161 24614 consensus_meta.cc:287] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 1.316s	user 0.010s	sys 0.000s
I20260709 13:06:34.621450 24603 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:34.271739 24626 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:34.265906 24636 log.cc:927] Time spent T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.559s	user 0.000s	sys 0.002s
I20260709 13:06:34.623311 24603 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:34.262988 24643 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.554s	user 0.003s	sys 0.002s
W20260709 13:06:34.259173 24644 log.cc:927] Time spent T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:06:34.626447 24465 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.628890 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1542) took 2253 ms. Trace:
W20260709 13:06:34.281370 24645 log.cc:927] Time spent T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.334s	user 0.002s	sys 0.000s
W20260709 13:06:34.273114 24649 log.cc:927] Time spent T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.525s	user 0.001s	sys 0.000s
W20260709 13:06:34.262451 24650 log.cc:927] Time spent T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:06:34.280396 24655 log.cc:927] Time spent T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:06:34.644852 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1546) took 2159 ms. Trace:
I20260709 13:06:34.645294 22172 rpcz_store.cc:276] 0709 13:06:32.485043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.485189 (+   146us) service_pool.cc:224] Handling call
0709 13:06:32.508088 (+ 22899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.510149 (+  2061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.510185 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.519672 (+  9487us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.653452 (+1133780us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:33.653510 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.653602 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.280854 (+627252us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:34.644374 (+363520us) raft_consensus.cc:1685] finished
0709 13:06:34.644405 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.644683 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1695,"raft.queue_time_us":1837,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":15782,"spinlock_wait_cycles":8471296,"thread_start_us":1079297,"threads_started":1,"wal-append.queue_time_us":1263919}
I20260709 13:06:34.205246 24660 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:34.629462 22177 rpcz_store.cc:276] 0709 13:06:32.375299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.461320 (+ 86021us) service_pool.cc:224] Handling call
0709 13:06:32.461651 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.461973 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.462001 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.462443 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.458599 (+996156us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:33.458655 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.458746 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.262402 (+803656us) spinlock_profiling.cc:243] Waited 70.6 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:34.628196 (+365794us) raft_consensus.cc:1685] finished
0709 13:06:34.628234 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.628646 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6329,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3429,"spinlock_wait_cycles":162373888,"thread_start_us":964126,"threads_started":1,"wal-append.queue_time_us":1172537}
W20260709 13:06:34.260418 24661 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:06:34.648373 24429 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.431555 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:34.649215 22253 raft_consensus.cc:2376] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3. Re-sending same reply.
I20260709 13:06:34.249802 24664 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:34.650524 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:34.650806 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1634) took 2168 ms. Trace:
I20260709 13:06:34.651463 22253 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:34.651561 24603 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:34.652695 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:34.651382 22255 rpcz_store.cc:276] 0709 13:06:32.482424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.482546 (+   122us) service_pool.cc:224] Handling call
0709 13:06:32.482990 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.483306 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.483333 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.483742 (+   409us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.455446 (+971704us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:33.455503 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.455597 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.272557 (+816960us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:34.650257 (+377700us) raft_consensus.cc:1685] finished
0709 13:06:34.650302 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.650604 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7325,"raft.queue_time_us":4241,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":22774,"spinlock_wait_cycles":72797696,"thread_start_us":910402,"threads_started":1,"wal-append.queue_time_us":1143912}
W20260709 13:06:34.457618 22004 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40924 (request call id 274) took 19726 ms (client timeout 15000 ms). Trace:
I20260709 13:06:34.653483 24660 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.653872 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:34.651489 24664 raft_consensus.cc:697] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:34.654702 22255 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:34.655985 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:34.494094 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:34.251951 24411 raft_consensus.cc:697] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:34.078891 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:34.658063 22255 raft_consensus.cc:2393] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:34.658636 24411 consensus_queue.cc:237] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:34.660688 24446 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.661791 22100 raft_consensus.cc:1275] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:34.511622 24373 consensus_meta.cc:287] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 1.028s	user 0.010s	sys 0.002s
I20260709 13:06:34.510571 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:34.517400 22071 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:34.368407 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.532194 22101 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:34.536834 24599 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:34.553311 22254 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.547361 22251 rpcz_store.cc:276] 0709 13:06:32.482992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.483355 (+   363us) service_pool.cc:224] Handling call
0709 13:06:32.488454 (+  5099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.488860 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.488899 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.501545 (+ 12646us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.937272 (+1435727us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:33.982386 (+ 45114us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.278981 (+296595us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b24001f4bb8. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4ce79c4 00007f66a4ce5acb 00007f66a4ea0dc9 00007f66a4ea0a55 00007f66a4ea009d 00007f66a7ad210e 00007f66a7ae988c 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221
0709 13:06:34.412030 (+133049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.412210 (+   180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.412297 (+    87us) raft_consensus.cc:1685] finished
0709 13:06:34.412464 (+   167us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.412771 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22947,"prepare.queue_time_us":56071,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":3209,"raft.queue_time_us":164525,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":24931,"spinlock_wait_cycles":6836608,"thread_start_us":1806107,"threads_started":2,"wal-append.queue_time_us":1439036}
I20260709 13:06:34.541036 22247 rpcz_store.cc:276] 0709 13:06:32.482088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.482560 (+   472us) service_pool.cc:224] Handling call
0709 13:06:32.493792 (+ 11232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.494186 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.494220 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.494697 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.660512 (+1165815us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:33.660568 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.660659 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.183309 (+522650us) raft_consensus.cc:1685] finished
0709 13:06:34.183328 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.183455 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14021,"raft.queue_time_us":1991,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":13475,"spinlock_wait_cycles":50688,"thread_start_us":1110879,"threads_started":1,"wal-append.queue_time_us":1263237}
I20260709 13:06:34.546253 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:34.234216 24501 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:34.599720 24552 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.235122 24553 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.594014 24509 consensus_queue.cc:1059] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:06:34.590672 24506 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:34.602665 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.254663 24581 consensus_queue.cc:1059] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:06:34.241905 24640 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:34.612493 22781 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.015s	sys 0.020s
W20260709 13:06:34.613925 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 411255us
I20260709 13:06:34.648504 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1635) took 2164 ms. Trace:
I20260709 13:06:34.414721 22000 catalog_manager.cc:5697] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 3 to 5, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 5 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:34.459965 24395 consensus_queue.cc:237] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:34.655444 24664 consensus_queue.cc:237] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:34.657146 22103 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:34.257367 24384 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:34.672247 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:34.653744 22004 rpcz_store.cc:269] 0709 13:06:14.730976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.740337 (+  9361us) service_pool.cc:224] Handling call
0709 13:06:34.457303 (+19716966us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:25.652965 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:25.796132 (+143167us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:25.796184 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:06:25.796204 (+    20us) tablet.cc:662] Decoding operations
0709 13:06:25.874536 (+ 78332us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:25.898211 (+ 23675us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:25.900642 (+  2431us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:06:26.279315 (+378673us) tablet.cc:701] Row locks acquired
0709 13:06:26.279375 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:06:26.279649 (+   274us) write_op.cc:270] Start()
0709 13:06:26.279852 (+   203us) write_op.cc:276] Timestamp: P: 1783602386279563 usec, L: 0
0709 13:06:26.279880 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:06:26.280889 (+  1009us) log.cc:844] Serialized 6774 byte log entry
0709 13:06:26.973830 (+692941us) op_driver.cc:464] REPLICATION: finished
0709 13:06:27.263509 (+289679us) write_op.cc:301] APPLY: starting
0709 13:06:27.329472 (+ 65963us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:27.369672 (+ 40200us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:27.509639 (+139967us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:28.703074 (+1193435us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:28.826085 (+123011us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:06:28.840867 (+ 14782us) write_op.cc:312] APPLY: finished
0709 13:06:28.918391 (+ 77524us) log.cc:844] Serialized 119 byte log entry
0709 13:06:29.028555 (+110164us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:29.052360 (+ 23805us) write_op.cc:454] Released schema lock
0709 13:06:29.094011 (+ 41651us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:29.117078 (+ 23067us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:29.117111 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":138011,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":261469,"apply.run_cpu_time_us":45372,"apply.run_wall_time_us":1870580,"num_ops":17,"prepare.queue_time_us":98525,"prepare.run_cpu_time_us":47394,"prepare.run_wall_time_us":787307,"raft.queue_time_us":492792,"raft.run_cpu_time_us":56589,"raft.run_wall_time_us":190377,"replication_time_us":693761,"thread_start_us":822798,"threads_started":5,"wal-append.queue_time_us":359224,"wal-append.run_cpu_time_us":61726,"wal-append.run_wall_time_us":2451920}]]}
W20260709 13:06:34.667517 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 89704.7us
I20260709 13:06:34.689378 22104 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:34.681499 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:34.659161 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:34.512636 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:34.640658 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 850261us
W20260709 13:06:34.668186 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 151115us
I20260709 13:06:34.668273 22173 raft_consensus.cc:1217] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-5.3]   Dedup: 5.3->[]
W20260709 13:06:34.693285 22781 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.016s	sys 0.021s
I20260709 13:06:34.653472 22253 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:34.696449 22173 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 7. Ops: [3.2-5.3]
I20260709 13:06:34.696755 22246 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:34.674847 22147 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:34.700286 22248 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:34.703404 22250 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:34.707281 24501 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:34.708076 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:34.668558 24660 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.717782 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:34.718302 24373 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:34.718701 22172 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:34.719055 24429 raft_consensus.cc:3055] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:06:34.719606 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 44955.9us
I20260709 13:06:34.719184 22000 catalog_manager.cc:5697] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 5, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 5 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.720876 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:34.722028 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:34.722875 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:34.870729 22071 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:34.945044 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1877) took 2231 ms. Trace:
W20260709 13:06:34.984977 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 171785us
I20260709 13:06:34.985219 24553 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:34.985755 24553 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.986212 24553 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:34.985553 22000 catalog_manager.cc:5697] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 2 to 3, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 3 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:34.987154 22177 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:34.891008 24552 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:06:34.843245 22144 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:34.734756 24599 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.990185 22179 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:34.990553 24599 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:34.907403 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 324508us
I20260709 13:06:34.944211 24463 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:34.992921 24429 raft_consensus.cc:740] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:34.993397 24463 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.994242 24662 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.994514 24581 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.994035 24429 consensus_queue.cc:260] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:34.995030 24662 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:34.995213 24581 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:34.997503 24662 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:34.997888 24581 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:34.689905 22252 rpcz_store.cc:276] 0709 13:06:32.482695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.483847 (+  1152us) service_pool.cc:224] Handling call
0709 13:06:32.506602 (+ 22755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.507284 (+   682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.507331 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.507924 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.947309 (+1439385us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:33.993285 (+ 45976us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.393409 (+400124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.393613 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.631037 (+237424us) raft_consensus.cc:1685] finished
0709 13:06:34.631065 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.647319 (+ 16254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19741,"prepare.queue_time_us":70794,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":174867,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":25306,"thread_start_us":1818533,"threads_started":2,"wal-append.queue_time_us":1523790}
I20260709 13:06:34.999305 22099 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:34.999619 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:34.963958 24369 consensus_meta.cc:287] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 1.161s	user 0.011s	sys 0.008s
I20260709 13:06:35.000921 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:35.000834 24369 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:35.001515 24553 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:34.723985 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:34.816745 22105 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:35.003047 22178 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:34.844832 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1648) took 1392 ms. Trace:
I20260709 13:06:35.003823 22246 rpcz_store.cc:276] 0709 13:06:33.451987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.539377 (+1087390us) service_pool.cc:224] Handling call
0709 13:06:34.844598 (+305221us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b5400073ad4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:34.844749 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180465920}
I20260709 13:06:34.827754 22255 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:35.004832 22176 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:35.005137 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1863) took 1189 ms. Trace:
I20260709 13:06:34.924634 24640 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:35.006629 24373 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:34.809103 24501 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:35.004371 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.949540 24626 raft_consensus.cc:3055] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:35.007596 24501 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:35.007249 24373 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.724649 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:35.009303 22174 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.010646 24501 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:34.917114 22247 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:35.011622 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1853) took 1285 ms. Trace:
I20260709 13:06:35.011950 22247 rpcz_store.cc:276] 0709 13:06:33.725951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.704174 (+978223us) service_pool.cc:224] Handling call
0709 13:06:34.876929 (+172755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.011364 (+134435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.011548 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:35.012526 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:35.013695 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:35.013814 22811 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:35.013942 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:35.013306 22099 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:35.015620 22813 raft_consensus.cc:2393] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:35.016089 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:35.016489 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:35.017521 22105 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:35.008103 22147 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.030s (SENT) [suppressed 17 similar messages]
I20260709 13:06:34.986706 22071 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:35.021253 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:35.021908 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:35.022277 22250 raft_consensus.cc:1240] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:35.022866 22252 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:35.023168 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1854) took 1297 ms. Trace:
I20260709 13:06:34.886896 22251 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:06:35.023798 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:34.825003 24635 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.008224 24626 raft_consensus.cc:740] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:34.995855 24429 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:34.938176 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 960931us
I20260709 13:06:35.025997 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:35.024645 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1649) took 1572 ms. Trace:
I20260709 13:06:35.097021 22254 raft_consensus.cc:2410] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:35.024128 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:35.091756 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:35.060608 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 74008.5us
I20260709 13:06:35.023695 22250 rpcz_store.cc:276] 0709 13:06:33.726214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.704268 (+978054us) service_pool.cc:224] Handling call
0709 13:06:35.021933 (+317665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.022841 (+   908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.023099 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35584}
I20260709 13:06:35.097669 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1852) took 1372 ms. Trace:
W20260709 13:06:35.108506 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.097162 22251 rpcz_store.cc:276] 0709 13:06:33.452301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.805165 (+1352864us) service_pool.cc:224] Handling call
0709 13:06:34.863249 (+ 58084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.024328 (+161079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.024561 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:35.101194 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:35.098719 22071 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:35.113041 22000 catalog_manager.cc:5697] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 2 to 3, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 3 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.117760 22254 rpcz_store.cc:276] 0709 13:06:33.725708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.428083 (+702375us) service_pool.cc:224] Handling call
0709 13:06:35.097607 (+669524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:35.120582 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:35.121361 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:35.121675 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:35.035140 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 119968us
I20260709 13:06:35.100703 22177 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:06:35.025118 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:35.027931 24583 consensus_meta.cc:287] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.007s
W20260709 13:06:34.953100 24686 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.051s	user 0.003s	sys 0.000s
I20260709 13:06:35.022481 22810 raft_consensus.cc:2410] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:06:35.161100 22178 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:35.162744 22174 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:35.109468 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:35.164870 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.005533 22255 rpcz_store.cc:276] 0709 13:06:33.815345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.658753 (+843408us) service_pool.cc:224] Handling call
0709 13:06:35.005078 (+346325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:35.025645 22173 rpcz_store.cc:276] 0709 13:06:32.713585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.745977 (+1032392us) service_pool.cc:224] Handling call
0709 13:06:33.746330 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:34.778561 (+1032231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.944628 (+166067us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b540045f6d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:34.944941 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2118943616}
I20260709 13:06:35.136230 22000 catalog_manager.cc:5697] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 3, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 3 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.138099 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:35.138507 24369 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:35.036339 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:34.928020 24584 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:35.144358 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.144546 22172 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
W20260709 13:06:35.175855 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.180451 22254 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:35.183135 24660 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:35.184137 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.183336 22000 catalog_manager.cc:5697] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 3 to 5, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 5 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.185710 22072 leader_election.cc:400] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6.
I20260709 13:06:35.186066 22072 leader_election.cc:403] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.187505 22175 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 5: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:35.186520 22246 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:34.877367 24485 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.105708 24465 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:06:35.189229 24485 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:35.189643 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:35.190378 22246 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:35.190481 24465 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6.
I20260709 13:06:35.191285 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:35.191497 24485 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:35.192027 22782 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:35.192705 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:35.191912 22246 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:35.180816 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 46760us
I20260709 13:06:35.149268 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:35.151139 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 52584.8us
I20260709 13:06:35.025564 24055 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:35.029280 24456 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 13:06:34.870193 24446 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.152493 24583 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:35.153352 24454 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:35.153949 22105 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:06:34.888393 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 735) took 1900 ms. Trace:
I20260709 13:06:35.170595 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:35.188638 22807 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.151788 22247 raft_consensus.cc:2393] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:35.186054 22000 catalog_manager.cc:5697] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 2, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:35.027347 24463 consensus_queue.cc:1059] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 13:06:35.193269 22782 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:35.100703 24506 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:35.215900 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:35.217310 22179 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.224710 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:35.228154 22099 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:35.193182 24429 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.193397 24553 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:35.240875 22250 raft_consensus.cc:2393] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 8: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:35.237828 24465 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:06:35.243361 22251 raft_consensus.cc:2410] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:35.229364 24454 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.252631 24454 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.244867 24506 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:35.245404 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:35.245517 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 52365.5us
I20260709 13:06:35.245311 22000 catalog_manager.cc:5697] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 3 to 4, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 4 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:06:35.246259 22249 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.008s	sys 0.018s
I20260709 13:06:35.254323 22220 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:35.171700 24635 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:35.258167 22249 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.008s	sys 0.018s
I20260709 13:06:35.258344 22254 raft_consensus.cc:2393] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:35.258941 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:35.257186 22247 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:35.239615 24055 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.242125 24429 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:35.269739 24429 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.263861 22252 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:35.275242 22097 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.030s	sys 0.014s
I20260709 13:06:35.276374 22250 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:35.249476 24662 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:35.261737 24055 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.268796 24501 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:35.253008 24456 consensus_queue.cc:1059] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:06:35.230774 24446 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:35.279840 24635 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:35.280130 22220 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:35.290832 24660 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:35.267131 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:35.302743 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 114392us
I20260709 13:06:35.296334 22246 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:35.197134 24584 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:35.313814 22781 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:35.309295 22000 catalog_manager.cc:5697] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 3, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 3 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.307148 24501 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.303555 24662 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:35.323738 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 43719.3us
I20260709 13:06:35.324568 22179 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:35.324831 22246 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:35.322187 22000 catalog_manager.cc:5697] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 1 to 3, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 3 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.323202 24552 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:35.332183 22254 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:35.333428 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1859) took 1582 ms. Trace:
I20260709 13:06:35.334649 22220 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:35.333611 22251 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 3.
I20260709 13:06:35.296345 24373 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:35.339725 22246 rpcz_store.cc:276] 0709 13:06:33.784581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.315411 (+1530830us) service_pool.cc:224] Handling call
0709 13:06:35.324668 (+  9257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.327642 (+  2974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.327831 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:35.341624 22781 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:35.342741 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1856) took 1609 ms. Trace:
I20260709 13:06:35.343222 22254 rpcz_store.cc:276] 0709 13:06:33.726704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.266590 (+1539886us) service_pool.cc:224] Handling call
0709 13:06:35.319801 (+ 53211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.335545 (+ 15744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.335782 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:35.307592 24369 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:06:35.327988 24662 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.326262 24501 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.331197 24635 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:35.352813 22782 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:35.359386 22220 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:35.360535 22181 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.363328 24589 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:35.357434 24635 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.364028 24589 raft_consensus.cc:697] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:35.364082 22251 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:35.365161 24589 consensus_queue.cc:237] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:35.365581 22247 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 7. Ops: []
I20260709 13:06:35.364274 24635 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.365170 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1873) took 1380 ms. Trace:
I20260709 13:06:35.371403 22251 rpcz_store.cc:276] 0709 13:06:33.984865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.348846 (+1363981us) service_pool.cc:224] Handling call
0709 13:06:35.363875 (+ 15029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.364843 (+   968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.365080 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:35.307403 24626 consensus_queue.cc:260] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:35.375108 22220 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:35.376362 24506 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:35.376645 22251 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:35.376953 24506 raft_consensus.cc:697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:35.377974 22251 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.377887 24506 consensus_queue.cc:237] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:35.381234 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1858) took 1634 ms. Trace:
I20260709 13:06:35.381718 22247 rpcz_store.cc:276] 0709 13:06:33.737659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.314406 (+1576747us) service_pool.cc:224] Handling call
0709 13:06:35.340334 (+ 25928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.372091 (+ 31757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.372292 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:35.399549 22250 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:35.400369 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1857) took 1673 ms. Trace:
I20260709 13:06:35.400746 22250 rpcz_store.cc:276] 0709 13:06:33.731652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.308493 (+1576841us) service_pool.cc:224] Handling call
0709 13:06:35.340660 (+ 32167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.400052 (+ 59392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.400301 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:35.380875 24552 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:35.398564 22781 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:35.407121 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 82740.1us
I20260709 13:06:35.406589 24552 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.407656 24581 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.412954 24675 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:35.417044 24446 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:35.418629 24583 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:35.428889 24626 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.432672 24552 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.432401 24581 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.410984 24429 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:35.454275 22072 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:35.229640 22809 rpcz_store.cc:276] 0709 13:06:32.988297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.006579 (+ 18282us) service_pool.cc:224] Handling call
0709 13:06:34.064972 (+1058393us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29eee 0000000000375939 00007f66ace9d1e0 00007f66acf660c4 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:34.065134 (+   162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.065351 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:34.543113 (+477762us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.828611 (+285498us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.867581 (+ 38970us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:34.887742 (+ 20161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.887887 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.888142 (+   255us) inbound_call.cc:177] Queueing success response
0709 13:06:34.952289 (+ 64147us) spinlock_profiling.cc:243] Waited 9.93 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
Metrics: {"mutex_wait_us":48170,"prepare.queue_time_us":459228,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":119257,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":196,"spinlock_wait_cycles":53171840,"thread_start_us":592660,"threads_started":2,"wal-append.queue_time_us":268582}
I20260709 13:06:35.452189 24675 raft_consensus.cc:697] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:35.461194 24581 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:35.484395 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 105361us
W20260709 13:06:35.489394 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:35.489419 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 481310us
I20260709 13:06:35.478439 24369 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:35.511831 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 357661us
W20260709 13:06:35.523938 22144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.030s	sys 0.028s
W20260709 13:06:35.533761 22144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.031s	sys 0.029s
W20260709 13:06:35.534446 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:35.535709 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:35.542412 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.492654 24373 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:35.523706 24584 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:35.547955 22252 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:35.551131 22255 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:35.524842 24369 raft_consensus.cc:697] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:35.561789 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:35.562736 22103 raft_consensus.cc:2410] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:35.562886 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:35.563647 22104 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:35.567152 22251 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:35.567314 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:35.568161 22102 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.571308 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:35.572145 22106 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.575282 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:35.576313 22098 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:35.567348 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:35.580077 22181 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:35.580159 22105 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:35.600919 22218 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:35.593349 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 316815us
I20260709 13:06:35.594759 22807 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
W20260709 13:06:35.628856 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 821962us
I20260709 13:06:35.644915 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1855) took 1918 ms. Trace:
I20260709 13:06:35.647243 22255 rpcz_store.cc:276] 0709 13:06:33.726461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.262514 (+1536053us) service_pool.cc:224] Handling call
0709 13:06:35.550866 (+288352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.556194 (+  5328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.644631 (+ 88437us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54002cbad0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:35.644837 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532476800}
I20260709 13:06:35.618012 24584 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:35.608331 22105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:06:35.651171 22105 raft_consensus.cc:606] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:35.651572 22105 raft_consensus.cc:614] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:35.651428 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:35.617904 24456 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:06:35.642840 24429 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:35.652379 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 56551.4us
I20260709 13:06:35.656899 22102 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:35.630173 24463 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:06:35.591285 24675 consensus_queue.cc:237] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:35.674337 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 299314us
I20260709 13:06:35.645323 24583 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:35.672036 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 321597us
I20260709 13:06:35.677731 22782 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:35.694810 22069 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:35.701467 22220 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:35.704923 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 58421.4us
W20260709 13:06:35.711406 24695 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:06:35.711699 22220 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:35.656970 24584 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:35.670631 24660 consensus_queue.cc:1059] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:06:35.699478 24583 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:35.703725 24603 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:35.738700 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 305706us
I20260709 13:06:35.706504 24698 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.657799 24369 consensus_queue.cc:237] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:35.720155 24706 raft_consensus.cc:3055] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:35.710120 24501 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:35.749039 24697 log.cc:927] Time spent T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:06:35.751041 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet 16e48ec055f940c49e01d5a5d77581aa: Illegal state: Replica c0694f6572bf406a92d55f1f2ab46ef2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } }
I20260709 13:06:35.752992 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1647) took 2301 ms. Trace:
I20260709 13:06:35.753863 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1569) took 1027 ms. Trace:
I20260709 13:06:35.754480 24446 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:35.788645 24469 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:35.789170 24603 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:35.789899 24603 raft_consensus.cc:697] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:35.790975 24456 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:35.791510 24456 raft_consensus.cc:697] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:35.791239 24603 consensus_queue.cc:237] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:35.792505 24456 consensus_queue.cc:237] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:35.794790 22254 raft_consensus.cc:1240] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:35.798084 22072 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:35.798959 24469 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:35.800321 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.800926 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:35.802104 22072 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:35.803980 24693 log.cc:927] Time spent T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 13:06:35.805599 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 111368us
I20260709 13:06:35.806743 22218 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:35.808354 22218 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:35.808790 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:35.808290 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:35.790002 24501 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:35.808696 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:35.814903 22175 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:35.743615 24429 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:35.814102 22173 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:35.744601 24640 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:35.785619 22253 rpcz_store.cc:276] 0709 13:06:33.451677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.702530 (+1250853us) service_pool.cc:224] Handling call
0709 13:06:34.892652 (+190122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.109736 (+217084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.109774 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.110391 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 13:06:35.511188 (+400797us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:35.511245 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.511342 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:35.752727 (+241385us) raft_consensus.cc:1685] finished
0709 13:06:35.752751 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.752931 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":400292,"threads_started":1,"wal-append.queue_time_us":540336}
I20260709 13:06:35.786051 22176 rpcz_store.cc:276] 0709 13:06:34.725985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.006222 (+280237us) service_pool.cc:224] Handling call
0709 13:06:35.111957 (+105735us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b5800165698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:35.159981 (+ 48024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.180999 (+ 21018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.181031 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.192920 (+ 11889us) log.cc:844] Serialized 26 byte log entry
0709 13:06:35.649337 (+456417us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:35.649711 (+   374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.650090 (+   379us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:35.753465 (+103375us) raft_consensus.cc:1685] finished
0709 13:06:35.753493 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.753758 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32518016,"thread_start_us":453445,"threads_started":1,"wal-append.queue_time_us":558276}
I20260709 13:06:35.819897 22181 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 3.
W20260709 13:06:35.820086 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 266914us
I20260709 13:06:35.760346 24706 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:35.834538 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:35.827888 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:35.835992 22174 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.832818 22106 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:35.815189 24469 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:35.844229 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:35.845278 22181 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:35.847504 22172 raft_consensus.cc:2410] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:06:35.847024 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 45003.7us
I20260709 13:06:35.833750 24465 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:35.813926 24664 consensus_queue.cc:1059] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:06:35.853866 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:35.857928 24581 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:35.859529 24706 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:35.860057 24553 raft_consensus.cc:3055] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:35.860267 24581 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:35.860694 24553 raft_consensus.cc:740] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:35.860888 24706 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.862658 22072 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:35.869534 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:35.861955 24553 consensus_queue.cc:260] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:35.875583 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:35.886585 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1642) took 2436 ms. Trace:
W20260709 13:06:35.894308 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 182675us
I20260709 13:06:35.899780 22097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1445) took 1824 ms. Trace:
W20260709 13:06:35.899816 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 205110us
I20260709 13:06:35.848084 24469 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.847908 24501 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:35.928076 22174 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:35.929742 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:35.930348 22172 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:35.854367 24465 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:35.867449 24506 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:35.902117 22249 rpcz_store.cc:276] 0709 13:06:33.449852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.696560 (+1246708us) service_pool.cc:224] Handling call
0709 13:06:34.735444 (+ 38884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.735761 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:35.266006 (+530245us) log.cc:844] Serialized 14 byte log entry
0709 13:06:35.886100 (+620094us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:35.886181 (+    81us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:35.886244 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.886333 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.886503 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":789092,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":2122,"raft.queue_time_us":113246,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"thread_start_us":1052977,"threads_started":3,"wal-append.queue_time_us":576002}
I20260709 13:06:35.951871 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:35.837736 24640 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:35.952801 22174 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
W20260709 13:06:35.955525 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.900463 22097 rpcz_store.cc:276] 0709 13:06:34.120837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.532152 (+411315us) service_pool.cc:224] Handling call
0709 13:06:34.532713 (+   561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.533186 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:34.633074 (+ 99888us) log.cc:844] Serialized 14 byte log entry
0709 13:06:35.858585 (+1225511us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b18003a0f00. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a7af64bc 00007f66a4e4448b 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e5e455 00007f66a7f46060 00007f66a7f58716 00007f66a7f69287
0709 13:06:35.858707 (+   122us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:35.858771 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:35.858841 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.863264 (+  4423us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.873458 (+ 10194us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":301158,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":366323,"raft.run_wall_time_us":8389,"spinlock_wait_cycles":34325504,"thread_start_us":1043449,"threads_started":3,"wal-append.queue_time_us":631623}
W20260709 13:06:35.960600 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 98021.4us
I20260709 13:06:35.962262 24708 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:35.962772 24708 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:35.963173 24708 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.963459 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:35.965301 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:35.966107 22099 raft_consensus.cc:2393] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:35.967407 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:35.968370 22098 raft_consensus.cc:2393] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:06:35.970643 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.929076 24626 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.965596 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:35.918411 24469 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.979581 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:35.980494 22172 raft_consensus.cc:2376] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7. Re-sending same reply.
W20260709 13:06:35.983647 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 243388us
I20260709 13:06:35.933403 24704 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.936470 24465 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.993906 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:35.935837 24501 raft_consensus.cc:697] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:35.996564 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 243023us
W20260709 13:06:36.004585 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.011555 22105 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
I20260709 13:06:36.019156 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:36.019160 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet 8f5e08d4c24545e18b620e33800d39d3: Illegal state: Replica c0694f6572bf406a92d55f1f2ab46ef2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:36.024045 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:36.029402 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:36.030224 22179 raft_consensus.cc:2393] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:36.030340 22220 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:36.031497 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 49712.1us
W20260709 13:06:36.031543 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 223335us
I20260709 13:06:36.036002 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:36.036154 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:36.036787 22105 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.037298 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:36.042213 22106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:06:36.042850 22106 raft_consensus.cc:606] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:36.043215 22106 raft_consensus.cc:614] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:36.045034 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:36.040625 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1849) took 2315 ms. Trace:
I20260709 13:06:36.045913 22249 raft_consensus.cc:2410] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:36.052927 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:36.017510 24429 raft_consensus.cc:697] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:06:36.038847 24662 consensus_meta.cc:287] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.667s	user 0.006s	sys 0.006s
I20260709 13:06:36.063632 22172 raft_consensus.cc:2393] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:36.063817 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:36.073501 22247 raft_consensus.cc:2410] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:36.074286 24721 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:36.075202 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:36.075773 22181 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:36.041848 24553 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.994413 24626 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.070888 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:36.044070 24640 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:36.063136 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:36.092085 22102 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.092222 22255 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:36.045725 22248 rpcz_store.cc:276] 0709 13:06:33.725006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.702038 (+977032us) service_pool.cc:224] Handling call
0709 13:06:35.006210 (+304172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.006608 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:35.390447 (+383839us) log.cc:844] Serialized 14 byte log entry
0709 13:06:36.040225 (+649778us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18002deda0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a7af64bc 00007f66a4e4448b 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e5e455 00007f66a7f46060 00007f66a7f58716 00007f66a7f69287
0709 13:06:36.040307 (+    82us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:36.040355 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:36.040399 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.040460 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.040569 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":554724,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":36,"raft.queue_time_us":118709,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5209,"spinlock_wait_cycles":35305088,"thread_start_us":805828,"threads_started":3,"wal-append.queue_time_us":522915}
I20260709 13:06:36.074970 24721 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:36.088696 24055 consensus_meta.cc:287] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.765s	user 0.007s	sys 0.004s
I20260709 13:06:36.089656 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:36.091104 22176 raft_consensus.cc:1275] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:36.071552 22250 raft_consensus.cc:2368] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
W20260709 13:06:36.094734 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.044896 24584 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:36.072520 24454 consensus_meta.cc:287] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.811s	user 0.001s	sys 0.013s
I20260709 13:06:36.103140 22181 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:36.116487 22105 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:36.125093 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:36.125792 22172 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:36.131019 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:36.132917 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:36.136528 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:36.139019 22173 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:36.139487 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.140528 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:36.141088 22177 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.141394 22178 raft_consensus.cc:2410] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:06:36.129976 24695 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:06:36.143045 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.145085 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:36.137171 22101 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:36.144901 22098 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:36.124575 24506 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:36.153527 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:36.154443 22172 raft_consensus.cc:2410] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:36.135241 24369 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.155258 22102 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:36.079909 24662 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.161279 22220 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:36.111316 24055 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:36.163193 22220 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:36.165033 22102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:06:36.139878 24724 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.173826 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:36.166599 24729 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:36.159920 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:36.176637 22178 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:36.177197 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:36.175999 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:36.138024 24454 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.181401 22101 raft_consensus.cc:2376] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4. Re-sending same reply.
I20260709 13:06:36.192427 22172 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:36.195501 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:36.197342 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:36.203033 24733 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.203733 24733 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.206100 24733 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:36.206593 24728 log.cc:927] Time spent T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:36.195713 24718 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.174791 24730 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 13:06:36.166443 24429 consensus_queue.cc:237] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.207067 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:36.208436 24724 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:36.182083 24722 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 13:06:36.208905 24709 log.cc:927] Time spent T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:06:36.215360 22177 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
W20260709 13:06:36.187701 24696 log.cc:927] Time spent T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.538s	user 0.002s	sys 0.007s
I20260709 13:06:36.203075 22808 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:36.225099 22779 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:36.229391 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:36.252463 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 189995us
I20260709 13:06:36.145642 24501 consensus_queue.cc:237] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:36.276963 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 51966.2us
I20260709 13:06:36.265133 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:36.266170 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 241824us
I20260709 13:06:36.176402 24369 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.277791 22779 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:36.263700 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:36.277951 22172 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:36.275956 22175 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:36.279649 22812 raft_consensus.cc:2410] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:36.261462 24724 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.279837 22177 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:36.284037 22147 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:36.290544 24708 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:36.259224 24718 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.297644 24718 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:36.263077 24714 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:06:36.299969 24737 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:36.300508 24737 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:36.300724 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.300897 24737 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.303802 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:36.304554 22144 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:36.305266 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:36.305857 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:36.295409 24721 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:36.290611 22779 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:36.275036 24729 raft_consensus.cc:697] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:36.282387 24724 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.313961 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:36.285146 24664 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:36.313239 24465 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.320590 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:36.333885 22809 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.332240 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:36.287070 24732 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.333240 24708 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:36.335022 22813 raft_consensus.cc:2410] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:36.318517 24704 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.334964 22099 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:36.321902 24727 log.cc:927] Time spent T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:06:36.308775 24626 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:36.348840 24552 consensus_meta.cc:287] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.877s	user 0.006s	sys 0.006s
I20260709 13:06:36.349355 24552 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.353334 24583 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:36.353646 22810 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:06:36.345921 24698 consensus_meta.cc:287] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.532s	user 0.012s	sys 0.000s
I20260709 13:06:36.383920 22218 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:36.354982 24640 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:36.387192 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:36.388697 22812 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:36.339794 24664 raft_consensus.cc:697] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:36.410547 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:36.411832 22178 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:36.348874 24369 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:36.419456 22071 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:36.415755 22102 raft_consensus.cc:606] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:36.422544 22102 raft_consensus.cc:614] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:36.425273 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:36.426000 22247 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.389636 24640 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:36.417964 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:36.438478 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 57198.4us
I20260709 13:06:36.412744 24698 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:36.382022 24446 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:06:36.412529 24662 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:36.444005 22071 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:36.422061 24626 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:06:36.447448 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 107886us
I20260709 13:06:36.426388 24454 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:36.430464 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:36.430135 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:36.424453 24729 consensus_queue.cc:237] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:36.455639 22178 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
W20260709 13:06:36.578577 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.528278 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 365146us
W20260709 13:06:36.527560 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 100491us
W20260709 13:06:36.526695 24742 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:06:36.547694 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 48606.7us
I20260709 13:06:36.621312 22247 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:36.564821 22218 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:36.430954 24640 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.528003 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:36.437335 24506 raft_consensus.cc:697] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:36.663012 22782 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:36.579743 24635 consensus_meta.cc:287] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 1.183s	user 0.012s	sys 0.001s
I20260709 13:06:36.448557 24731 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:36.567174 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.662411 24759 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:06:36.587095 24717 log.cc:927] Time spent T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.666s	user 0.001s	sys 0.003s
I20260709 13:06:36.679083 24718 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:36.641510 22809 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:36.660092 24752 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:36.679644 24718 raft_consensus.cc:697] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:36.587440 22071 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:36.526942 24745 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:36.448783 24626 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.662575 22253 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.666321 22147 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:36.667845 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.669152 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:36.673388 22181 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:36.673141 24635 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:36.673691 22173 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:36.681910 22178 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:36.554785 24454 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.119s
W20260709 13:06:36.605612 24553 consensus_meta.cc:287] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.000s
I20260709 13:06:36.674094 22175 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:36.674377 24733 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:36.449641 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:36.676074 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:36.579183 24724 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:36.676709 24603 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:36.677502 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 112761us
I20260709 13:06:36.679675 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1568) took 1954 ms. Trace:
W20260709 13:06:36.617280 24469 consensus_meta.cc:287] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.001s
I20260709 13:06:36.449239 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:36.681783 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.737212 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.503326 24706 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:36.682628 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 95254.2us
I20260709 13:06:36.702724 22247 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:36.739403 22071 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:36.682053 24731 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.686086 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:36.686877 22147 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:36.674645 24506 consensus_queue.cc:237] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:36.688056 22100 raft_consensus.cc:2410] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:36.526613 24552 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:36.688611 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.699246 24698 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:36.744242 24698 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.744678 24698 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.701347 24733 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:36.702267 24711 raft_consensus.cc:3055] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:36.735512 22180 rpcz_store.cc:276] 0709 13:06:34.725608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.725821 (+   213us) service_pool.cc:224] Handling call
0709 13:06:35.025823 (+300002us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5800165698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:06:35.026118 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.026813 (+   695us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:35.388116 (+361303us) log.cc:844] Serialized 14 byte log entry
0709 13:06:35.713992 (+325876us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.738962 (+ 24970us) log.cc:844] Serialized 26 byte log entry
0709 13:06:35.739102 (+   140us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:35.739132 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.739193 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.381543 (+642350us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:36.679383 (+297840us) raft_consensus.cc:1685] finished
0709 13:06:36.679404 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.679511 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29545,"prepare.queue_time_us":599378,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":20721,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":5951,"spinlock_wait_cycles":349313280,"thread_start_us":568812,"threads_started":2,"wal-append.queue_time_us":374065}
I20260709 13:06:36.749092 24711 raft_consensus.cc:740] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:36.702282 22220 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:36.689532 24704 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:36.705479 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:36.705391 24718 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.753682 24704 raft_consensus.cc:697] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:36.755060 24501 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:36.754889 24704 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.755455 24501 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.755679 22218 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:36.755918 24501 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:36.682891 24745 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.756606 22218 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:36.756702 24745 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:36.553190 24664 consensus_queue.cc:237] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.759920 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 417) took 1761 ms. Trace:
I20260709 13:06:36.684648 24626 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:36.747961 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 61152.8us
I20260709 13:06:36.752243 22071 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:36.752487 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 50287.9us
I20260709 13:06:36.765357 22218 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:36.760380 22254 rpcz_store.cc:276] 0709 13:06:34.998856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.383169 (+384313us) service_pool.cc:224] Handling call
0709 13:06:35.404881 (+ 21712us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.795202 (+390321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.759640 (+964438us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54002283d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:36.759863 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896105728}
I20260709 13:06:36.741621 24706 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.742818 24731 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.747293 24553 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:36.765753 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 461267us
I20260709 13:06:36.600448 24737 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.759734 24635 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:36.776907 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:36.760305 24395 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:36.753041 24724 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:36.762365 24603 raft_consensus.cc:697] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:36.762681 24714 raft_consensus.cc:2764] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:06:36.784762 22218 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:36.786366 22071 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:36.764300 24675 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:36.742812 24469 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:36.775794 24553 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:36.790704 24589 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:36.778029 24711 consensus_queue.cc:260] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.791590 24737 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:36.792145 24552 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.771934 24706 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:36.806116 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.781551 24723 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:36.783457 24722 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.787624 24395 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.817727 22144 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:36.759768 24734 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:06:36.818703 22147 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:36.815325 24708 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.793735 24675 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:36.802819 24553 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.802804 24589 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:36.835793 24708 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:36.837972 24738 log.cc:927] Time spent T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.543s	user 0.005s	sys 0.000s
I20260709 13:06:36.815399 24456 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:36.839455 24456 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.839877 24456 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:36.805840 24454 consensus_queue.cc:1059] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:06:36.843809 24454 raft_consensus.cc:3055] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:36.844218 24454 raft_consensus.cc:740] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:36.844954 24731 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:36.845118 24454 consensus_queue.cc:260] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:36.846573 24454 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:36.847065 22247 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:36.827430 24395 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.855335 22253 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:36.806080 24635 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:36.822016 24711 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:36.863864 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 45270.9us
I20260709 13:06:36.857090 24589 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.857254 24675 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:36.821909 24552 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.861253 24583 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:36.875104 22812 raft_consensus.cc:1240] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:36.875113 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 90450.3us
W20260709 13:06:36.882522 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.858547 24635 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:06:36.876977 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 72759.1us
I20260709 13:06:36.878454 24737 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:36.893085 24465 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:36.894183 24469 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:36.897686 24736 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.628s	user 0.007s	sys 0.007s
I20260709 13:06:36.898901 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:36.899237 22175 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:36.899426 22815 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:06:36.899633 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:36.912456 22816 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:36.900682 22809 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:36.901219 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:36.903070 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:36.904512 22782 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:36.906085 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:36.924921 22247 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:36.881826 24583 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:36.886088 24635 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:36.912272 22815 pending_rounds.cc:85] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Aborting all ops after (but not including) 5
I20260709 13:06:36.927779 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:36.928982 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:36.955772 22097 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:36.950086 24706 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:36.951386 22147 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:36.952025 24583 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:36.935706 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:36.939083 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:36.960002 22144 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:36.960295 22178 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.889230 24723 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:06:36.938544 24762 log.cc:927] Time spent T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:36.925268 24501 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.954942 22815 pending_rounds.cc:107] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:06:36.970170 22815 raft_consensus.cc:2889] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:36.934574 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:36.935717 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:36.935025 22104 raft_consensus.cc:1240] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:36.874298 24603 consensus_queue.cc:237] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:36.934679 22814 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:36.944967 24734 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:36.902571 24552 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:36.973907 22813 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 6: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:36.980626 22105 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:36.981890 22178 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:36.984097 22147 leader_election.cc:400] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
I20260709 13:06:36.984472 22147 leader_election.cc:403] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:06:37.014334 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:37.014951 22103 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:36.967240 24722 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:06:37.025753 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 47831.4us
I20260709 13:06:36.919670 24429 consensus_queue.cc:1059] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:06:37.030781 22178 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:37.031878 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:37.034621 22175 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: [2.2-5.3]
W20260709 13:06:36.985513 22218 connection.cc:256] RPC call timeout handler was delayed by -1.4527888310000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:06:37.037559 22218 connection.cc:256] RPC call timeout handler was delayed by -1.4509888310000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 13:06:37.038020 22218 connection.cc:256] RPC call timeout handler was delayed by -1.2160888309999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 13:06:37.038373 22218 connection.cc:256] RPC call timeout handler was delayed by -1.1971888309999486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
I20260709 13:06:37.024442 24589 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:37.040007 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:37.040834 22104 raft_consensus.cc:2393] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:37.041203 24553 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:37.041684 24589 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:37.041990 22072 leader_election.cc:336] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.035s (SENT)
I20260709 13:06:37.042546 22072 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:37.043002 22781 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:37.043663 24553 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:36.982152 24584 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:37.052748 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:37.054389 22218 connection.cc:256] RPC call timeout handler was delayed by -1.1773888310000302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
I20260709 13:06:37.057766 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:37.058780 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:37.059507 22249 raft_consensus.cc:2376] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5. Re-sending same reply.
I20260709 13:06:37.063341 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:37.042008 22104 raft_consensus.cc:1275] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:37.014436 24714 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.015520 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 750) took 1340 ms. Trace:
I20260709 13:06:37.029095 24729 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.015722 24734 raft_consensus.cc:697] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:36.975651 24745 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:36.983702 24469 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:06:37.090229 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:37.092578 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:37.094398 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:37.101325 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:37.101478 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:37.102120 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:37.015843 24465 consensus_queue.cc:1059] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:06:37.062397 24584 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.061640 24581 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.105093 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:37.108260 22810 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:37.109665 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 66757.9us
I20260709 13:06:37.119381 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:37.132296 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1576) took 1061 ms. Trace:
I20260709 13:06:37.132555 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:37.131902 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:37.075766 24552 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:37.132645 22179 rpcz_store.cc:276] 0709 13:06:36.070640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.071008 (+   368us) service_pool.cc:224] Handling call
0709 13:06:36.071308 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.078660 (+  7352us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:37.087512 (+1008852us) spinlock_profiling.cc:243] Waited 914 us on lock 0x7b18003e9e60. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a7af64bc 00007f66a4e4448b 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e5e455 00007f66ab9463c7 00007f66a7f589a7 00007f66a7f680bf
0709 13:06:37.087689 (+   177us) log.cc:844] Serialized 14 byte log entry
0709 13:06:37.131948 (+ 44259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:37.131999 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:37.132050 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.132125 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:37.132241 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42902,"prepare.queue_time_us":29843,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"spinlock_wait_cycles":2102016,"thread_start_us":62064,"threads_started":2}
I20260709 13:06:37.137598 22781 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:37.077268 24737 raft_consensus.cc:697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:37.139690 22173 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
W20260709 13:06:37.142462 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 109612us
I20260709 13:06:37.107580 24589 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:37.151969 22175 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
W20260709 13:06:37.155112 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 113143us
I20260709 13:06:37.156426 22175 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:37.155045 22781 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:37.159695 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:37.161100 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.164896 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.130489 24584 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:37.136286 24373 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:37.103675 24729 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:37.205449 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 48160.6us
I20260709 13:06:37.143651 24759 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:37.130348 24724 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:06:37.149510 24465 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:37.208410 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:37.218396 22105 raft_consensus.cc:2368] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
I20260709 13:06:37.213898 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:37.154251 24718 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:37.216596 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:37.221207 24772 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:37.220523 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 65578.5us
I20260709 13:06:37.135673 24581 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:37.224120 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 66164.8us
I20260709 13:06:37.234591 22098 raft_consensus.cc:2368] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
I20260709 13:06:36.973325 24723 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:37.056330 24722 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:37.073856 24714 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:37.159195 24640 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:37.216266 24589 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:06:37.221894 24772 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:37.203336 24552 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:37.522399 22810 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
W20260709 13:06:37.657596 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 420901us
W20260709 13:06:37.716572 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.866039 22782 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.002s	sys 0.010s
I20260709 13:06:37.490700 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:37.962885 22782 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.008s	sys 0.011s
W20260709 13:06:37.567355 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 458405us
I20260709 13:06:37.947029 22178 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:37.224982 24718 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:37.397511 22815 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:06:37.939463 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 837370us
I20260709 13:06:37.393486 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43362 (request call id 14) took 1316 ms. Trace:
I20260709 13:06:37.282377 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:37.985366 22179 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:38.008703 22106 rpcz_store.cc:276] 0709 13:06:36.077267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.093025 (+ 15758us) service_pool.cc:224] Handling call
0709 13:06:37.393139 (+1300114us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b540001f254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f54735 00007f66acf14d29 00007f66a64931d4 00007f66a6493162 00007f66a6493091 00007f66a649300c 00007f66a64922c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:37.393386 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112643840}
I20260709 13:06:38.005647 22220 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:37.396203 24675 consensus_meta.cc:287] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.001s
W20260709 13:06:37.668005 24626 consensus_meta.cc:287] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.895s	user 0.009s	sys 0.002s
W20260709 13:06:37.938591 24584 consensus_meta.cc:287] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.723s	user 0.010s	sys 0.000s
W20260709 13:06:37.392237 24778 log.cc:927] Time spent T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:06:37.696979 24583 consensus_meta.cc:287] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.720s	user 0.005s	sys 0.005s
I20260709 13:06:37.256798 24748 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
I20260709 13:06:38.006594 24429 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:37.456993 24501 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:37.512427 24729 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:38.005678 24454 consensus_meta.cc:287] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.138s	user 0.008s	sys 0.003s
I20260709 13:06:37.393018 22809 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 13:06:37.385468 24773 log.cc:927] Time spent T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:06:38.063131 24552 raft_consensus.cc:697] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:06:37.505568 24777 log.cc:927] Time spent T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
W20260709 13:06:37.245504 24698 consensus_meta.cc:287] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.002s
I20260709 13:06:38.005796 24718 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:37.511029 24395 consensus_meta.cc:287] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.000s
I20260709 13:06:37.692814 24758 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:37.387667 24705 raft_consensus.cc:3055] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:37.508890 24706 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:37.361059 24787 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:38.023480 22174 raft_consensus.cc:1240] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:37.494866 24745 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:37.901026 24731 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:37.477905 24469 consensus_queue.cc:1059] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.598s
I20260709 13:06:38.224424 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:38.227054 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 167942us
I20260709 13:06:37.235585 24456 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:37.706854 24635 consensus_meta.cc:287] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.759s	user 0.004s	sys 0.005s
I20260709 13:06:38.005664 24724 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.166s
W20260709 13:06:38.248246 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet 6b965624a67d4adb87e9787782f1715c: Illegal state: Replica c0694f6572bf406a92d55f1f2ab46ef2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:37.688925 24791 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.561s
I20260709 13:06:38.232923 22809 pending_rounds.cc:85] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting all ops after (but not including) 6
I20260709 13:06:38.337110 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:37.224011 24759 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:37.397292 24737 consensus_queue.cc:237] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:38.344517 22100 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:06:38.077900 24584 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:38.078280 24626 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:37.279897 24734 consensus_queue.cc:237] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:38.076295 24675 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:38.364177 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:38.208024 24583 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:38.270160 24748 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:38.226488 24429 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:38.274204 24729 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:38.323734 24705 raft_consensus.cc:740] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:38.414974 22221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.007s	sys 0.023s
I20260709 13:06:37.071507 22807 rpcz_store.cc:276] 0709 13:06:35.675183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.691298 (+ 16115us) service_pool.cc:224] Handling call
0709 13:06:35.721199 (+ 29901us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.821622 (+100423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.835832 (+ 14210us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.918461 (+ 82629us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.070770 (+152309us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:36.078956 (+  8186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.102057 (+ 23101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.897118 (+795061us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:36.956821 (+ 59703us) raft_consensus.cc:1685] finished
0709 13:06:36.956846 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.983315 (+ 26469us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83678,"raft.queue_time_us":154194,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":23305,"spinlock_wait_cycles":13851520,"thread_start_us":75529,"threads_started":1,"wal-append.queue_time_us":214522,"wal-append.run_cpu_time_us":16914,"wal-append.run_wall_time_us":1768943}
I20260709 13:06:38.332163 24395 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:38.579922 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 184108us
I20260709 13:06:38.416463 24552 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:38.333340 24758 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:38.348265 24778 log.cc:927] Time spent T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:06:38.357430 24589 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.424823 24640 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:38.426002 22254 pending_rounds.cc:85] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 5
I20260709 13:06:38.616596 22254 pending_rounds.cc:107] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:38.616994 22254 raft_consensus.cc:2889] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:38.426281 24723 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:38.426384 24805 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.428154 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:38.637305 22814 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:06:38.428779 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.478813 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1471) took 1525 ms. Trace:
I20260709 13:06:38.395988 22809 pending_rounds.cc:107] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:06:38.491142 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:38.492856 24775 log.cc:927] Time spent T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 1.417s	user 0.012s	sys 0.014s
I20260709 13:06:38.493026 24553 raft_consensus.cc:3055] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:06:38.493351 24776 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.029s	sys 0.048s
W20260709 13:06:38.499104 24792 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.008s	sys 0.024s
W20260709 13:06:38.508632 22147 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.031s	sys 0.063s
I20260709 13:06:38.429371 22100 pending_rounds.cc:85] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 3
I20260709 13:06:38.328554 24732 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.427925 24581 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:38.408380 24731 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:38.550006 22812 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:38.557826 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 751) took 2632 ms. Trace:
I20260709 13:06:38.558844 24748 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:38.559702 22247 raft_consensus.cc:1240] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:38.504792 24784 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.402339 24635 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:38.567889 22221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.008s	sys 0.024s
I20260709 13:06:38.332968 24698 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:38.483019 24745 consensus_queue.cc:1059] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:06:38.548278 24804 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.436967 24785 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.547717 24469 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.632030 24813 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:38.955909 22145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.073s	sys 0.116s
W20260709 13:06:38.956629 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 287571us
W20260709 13:06:39.003840 22145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.079s	sys 0.119s
I20260709 13:06:38.637899 22099 rpcz_store.cc:276] 0709 13:06:36.953223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.953462 (+   239us) service_pool.cc:224] Handling call
0709 13:06:36.965268 (+ 11806us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.965567 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.965603 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.966282 (+   679us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.281142 (+314860us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:37.676868 (+395726us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.054382 (+377514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.054476 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.478500 (+424024us) raft_consensus.cc:1685] finished
0709 13:06:38.478531 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.478726 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1009539,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":562347,"raft.run_wall_time_us":42878,"spinlock_wait_cycles":85972224,"thread_start_us":742364,"threads_started":3,"wal-append.queue_time_us":1268059}
I20260709 13:06:39.006536 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:38.725844 22147 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.031s	sys 0.063s
W20260709 13:06:38.676460 22781 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.216s	user 0.006s	sys 0.004s
W20260709 13:06:39.010442 22781 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.550s	user 0.009s	sys 0.010s
W20260709 13:06:39.010869 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 1.55108e+06us
I20260709 13:06:38.658082 22809 raft_consensus.cc:2889] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:39.004616 22221 connection.cc:256] RPC call timeout handler was delayed by -1.4216137590000244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:06:38.956769 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 436620us
W20260709 13:06:39.014839 22781 connection.cc:256] RPC call timeout handler was delayed by -1.4038810409999769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
W20260709 13:06:39.072963 22781 connection.cc:256] RPC call timeout handler was delayed by -1.3095585160000383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 13:06:39.074090 22072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.417s	user 0.005s	sys 0.019s
I20260709 13:06:39.076398 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:39.078505 22072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.422s	user 0.005s	sys 0.019s
I20260709 13:06:39.078974 22812 raft_consensus.cc:2410] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:39.079974 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:39.080711 22179 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:39.081835 22072 leader_election.cc:336] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.376s (SENT)
I20260709 13:06:39.082216 22072 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:38.674741 24776 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.278s	user 0.030s	sys 0.048s
I20260709 13:06:39.084252 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:38.958546 24775 log.cc:927] Time spent T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 13:06:38.668717 24553 raft_consensus.cc:740] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:39.085158 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:39.085216 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:39.090394 22181 raft_consensus.cc:2393] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 6: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:39.085990 22251 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:39.087203 22814 raft_consensus.cc:2410] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:06:38.725183 24792 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.009s	sys 0.024s
I20260709 13:06:38.788340 22100 pending_rounds.cc:107] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 6.4
W20260709 13:06:38.725399 24802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.024s	sys 0.022s
I20260709 13:06:38.911147 24584 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:39.016134 24714 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:39.183255 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:38.852675 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:39.091997 22178 raft_consensus.cc:2393] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:06:39.096683 22246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.005s	sys 0.009s
W20260709 13:06:39.185452 22246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.005s	sys 0.009s
W20260709 13:06:39.097767 22781 connection.cc:256] RPC call timeout handler was delayed by -1.2994810410000355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 13:06:39.098855 22179 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
W20260709 13:06:39.186301 22781 connection.cc:256] RPC call timeout handler was delayed by -1.1959810409999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
I20260709 13:06:39.177719 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:38.989226 24729 raft_consensus.cc:697] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:38.852147 24758 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:39.180011 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.668882 24589 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:39.177122 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:39.187770 22810 raft_consensus.cc:2368] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7.
W20260709 13:06:39.109570 24802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.024s	sys 0.030s
W20260709 13:06:39.177500 24811 log.cc:927] Time spent T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.649s	user 0.000s	sys 0.001s
I20260709 13:06:39.193076 22813 raft_consensus.cc:1240] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:39.194235 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:39.277668 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 273497us
I20260709 13:06:39.084472 24806 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.662667 24805 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:39.191787 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 103051us
I20260709 13:06:39.279008 22069 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:39.075354 24731 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:39.279986 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:39.291352 22814 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:39.099069 22100 raft_consensus.cc:2889] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:39.184826 24581 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.288488 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:39.075155 24469 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:39.293283 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:39.298183 22106 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:39.193169 22807 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.299841 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:39.306514 22099 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.309542 22097 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:06:38.914191 24705 consensus_queue.cc:260] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:39.316035 22781 connection.cc:256] RPC call timeout handler was delayed by -1.1025585160000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
I20260709 13:06:39.084534 24785 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:39.321666 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:39.015192 22808 rpcz_store.cc:276] 0709 13:06:35.924878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.934887 (+ 10009us) service_pool.cc:224] Handling call
0709 13:06:36.011515 (+ 76628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.277296 (+265781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.557510 (+2280214us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54006f0254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:38.557732 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371914496}
I20260709 13:06:39.289335 24429 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:39.333045 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:39.339500 22106 raft_consensus.cc:2393] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:39.278147 24815 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:39.087081 24784 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:39.340710 22781 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:39.075232 24813 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:39.075352 24804 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:39.349257 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 51953.5us
W20260709 13:06:39.365746 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 283908us
W20260709 13:06:39.373127 22072 connection.cc:256] RPC call timeout handler was delayed by -1.641348852999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2836s for a response
W20260709 13:06:39.373714 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 94805.2us
W20260709 13:06:39.373989 22072 connection.cc:256] RPC call timeout handler was delayed by -1.1909929960000909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
W20260709 13:06:39.374727 22072 connection.cc:256] RPC call timeout handler was delayed by -1.0337550980000287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 13:06:39.366009 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:39.317574 24456 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:39.377583 22781 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:39.179126 24732 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:39.397626 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:39.336292 24783 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.327088 24723 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:39.396571 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.353812 24705 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.304816 24581 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:39.379182 24791 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.442317 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:39.297421 24806 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:39.312462 24553 consensus_queue.cc:260] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:39.482067 22104 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:39.505465 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:39.439273 24811 log.cc:927] Time spent T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:06:39.512171 22105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a4e641637cf41118865c96aec55b340"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:33706
W20260709 13:06:39.512624 22072 leader_election.cc:336] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.540s (SENT)
I20260709 13:06:39.555130 22105 raft_consensus.cc:606] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Received request to transfer leadership to TS a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:39.555190 22072 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:39.556344 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 43757.3us
W20260709 13:06:39.556955 22072 leader_election.cc:336] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.601s (SENT)
W20260709 13:06:39.557765 22072 leader_election.cc:336] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.634s (SENT)
W20260709 13:06:39.403520 21990 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 252049d2bcdd4f329ca5015bf10c1b19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 79683575881f4334bd4dc6d9bdbb45c3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:39.514881 24834 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:39.558885 21990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 484047us
I20260709 13:06:39.515314 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:39.558189 22072 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:39.560387 22104 raft_consensus.cc:2410] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:06:39.560398 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:39.561789 22178 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:39.527077 24788 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.054s	sys 0.086s
I20260709 13:06:39.188129 24759 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:39.534322 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 95434.1us
I20260709 13:06:39.520970 24825 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.527523 24827 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:39.520457 24793 log.cc:927] Time spent T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.727s	user 0.000s	sys 0.001s
I20260709 13:06:39.449684 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:39.637194 22249 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:39.435949 24723 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:39.644148 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:39.649366 22250 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.553711 24730 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:39.645117 24833 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.646519 22248 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:39.647441 24818 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:39.647256 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:39.366452 24815 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:39.654204 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:39.565769 24745 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:39.427205 24729 consensus_queue.cc:237] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:39.668030 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:39.662753 22104 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
W20260709 13:06:39.567551 24788 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.054s	sys 0.087s
I20260709 13:06:39.533289 24635 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:39.577708 24838 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:39.679960 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 302440us
I20260709 13:06:39.647208 22807 raft_consensus.cc:2410] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:06:39.569976 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:39.649202 24698 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:39.688320 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:39.688088 24833 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:39.688583 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:39.688974 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:39.689915 22098 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:39.691337 24820 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:39.691728 24821 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:39.692646 22102 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:39.708750 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 155152us
I20260709 13:06:39.683631 24589 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:39.438377 24783 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:39.693794 22781 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:39.655085 24733 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.492681 24791 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:39.703359 22104 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:39.620111 24834 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:39.637115 24714 consensus_queue.cc:1059] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:06:39.566839 24819 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.717839 22178 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
W20260709 13:06:39.702239 24552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.016s	sys 0.063s
W20260709 13:06:39.745585 24552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.017s	sys 0.063s
I20260709 13:06:39.710059 24731 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:39.746030 24832 log.cc:927] Time spent T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:06:39.746654 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:39.747606 22810 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:39.747812 24784 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:39.749140 22810 raft_consensus.cc:1240] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:39.749881 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 523) took 1329 ms. Trace:
I20260709 13:06:39.559068 24456 consensus_queue.cc:1059] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.178s
W20260709 13:06:39.710326 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:39.721354 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.728349 22102 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:39.572414 24802 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:39.740711 22172 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:06:39.753517 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.708916 24845 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.639926 24825 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:39.739647 24820 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:39.744484 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 50765.7us
I20260709 13:06:39.750252 22810 rpcz_store.cc:276] 0709 13:06:38.420363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.748421 (+1328058us) service_pool.cc:224] Handling call
0709 13:06:39.748850 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.749580 (+   730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.749817 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:39.760179 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:39.763063 22781 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:39.764768 22781 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:39.729403 22807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35214 (request call id 520) took 1292 ms (client timeout 1634 ms). Trace:
I20260709 13:06:39.768981 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:39.774832 22178 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:39.769045 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:39.775909 22104 raft_consensus.cc:2393] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:39.685089 24818 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:39.775298 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 88999.5us
I20260709 13:06:39.759567 24840 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:39.737969 24821 raft_consensus.cc:697] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:39.751250 24469 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:39.821024 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1470) took 2864 ms. Trace:
I20260709 13:06:39.818845 22105 raft_consensus.cc:2393] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 8: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:39.705910 24838 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:39.822829 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 265070us
I20260709 13:06:39.734126 24733 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:39.834553 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:39.783854 22781 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:39.837395 22072 leader_election.cc:336] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.729s (SENT)
W20260709 13:06:39.842020 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 58275.5us
I20260709 13:06:39.842788 22178 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:06:39.843015 22072 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:39.843982 22220 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:39.849145 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:39.850353 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:39.767057 24843 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:39.836181 22101 rpcz_store.cc:276] 0709 13:06:36.952918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.953399 (+   481us) service_pool.cc:224] Handling call
0709 13:06:36.979291 (+ 25892us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.025181 (+ 45890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:37.025211 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:37.065482 (+ 40271us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.304848 (+239366us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:38.393305 (+1088457us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.401723 (+  8418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.401808 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.816812 (+1415004us) raft_consensus.cc:1685] finished
0709 13:06:39.816840 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.817003 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":299622,"prepare.queue_time_us":1112488,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":148143,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":18224,"thread_start_us":516614,"threads_started":2,"wal-append.queue_time_us":1325661}
W20260709 13:06:39.859714 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 208635us
I20260709 13:06:39.860589 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:39.845546 24830 log.cc:927] Time spent T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.130s	user 0.002s	sys 0.000s
W20260709 13:06:39.844977 24781 log.cc:927] Time spent T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 2.617s	user 0.012s	sys 0.001s
I20260709 13:06:39.874506 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:39.862063 22072 leader_election.cc:336] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.733s (SENT)
I20260709 13:06:39.839193 24581 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:39.774624 22807 rpcz_store.cc:269] 0709 13:06:38.419503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.669775 (+250272us) service_pool.cc:224] Handling call
0709 13:06:39.711925 (+1042150us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:39.838815 24829 log.cc:927] Time spent T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:06:39.817173 24456 raft_consensus.cc:3055] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:06:39.848685 24797 log.cc:927] Time spent T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.454s	user 0.001s	sys 0.002s
W20260709 13:06:39.885393 22072 leader_election.cc:336] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.033s (SENT)
I20260709 13:06:39.812114 24730 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:06:39.886587 22178 raft_consensus.cc:2410] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:06:39.849756 24795 log.cc:927] Time spent T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.470s	user 0.001s	sys 0.002s
I20260709 13:06:39.780190 24552 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:39.887629 22218 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:39.819731 24840 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:39.913280 24840 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:39.913851 22807 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:39.914278 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:39.891660 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:39.891381 22808 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:39.849947 24802 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:39.860348 24589 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:39.897389 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:39.765492 24819 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:39.898062 22144 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:39.901924 22147 leader_election.cc:336] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.037s (SENT)
W20260709 13:06:39.908007 22099 consensus_meta.cc:287] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.000s
I20260709 13:06:39.912485 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:39.850660 24804 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:39.963290 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:39.915288 22104 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:39.964457 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:39.965124 22104 raft_consensus.cc:2368] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
I20260709 13:06:39.965816 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:39.922061 22248 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:06:39.962615 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 60713.3us
I20260709 13:06:39.966881 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:39.894565 24806 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:39.895401 24456 raft_consensus.cc:740] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:39.929034 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 43684us
I20260709 13:06:39.930747 22218 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:39.971896 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:39.972929 22104 raft_consensus.cc:2393] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:39.984050 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:39.985283 22104 raft_consensus.cc:2410] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:39.990259 22252 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:39.771899 24845 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:40.006474 24813 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:39.932297 24850 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:39.933539 24844 log.cc:927] Time spent T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:06:39.913872 24798 consensus_queue.cc:1059] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.163s
I20260709 13:06:40.036423 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:39.943084 24733 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:39.944080 22812 raft_consensus.cc:2410] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:06:39.944737 24836 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:39.946125 24589 raft_consensus.cc:697] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:39.947768 24786 log.cc:927] Time spent T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 2.736s	user 0.009s	sys 0.022s
I20260709 13:06:39.950515 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:39.927982 24759 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:39.892463 24792 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:06:39.952358 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1678) took 1595 ms. Trace:
I20260709 13:06:39.952867 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:40.058550 22254 rpcz_store.cc:276] 0709 13:06:38.356795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.393166 (+ 36371us) service_pool.cc:224] Handling call
0709 13:06:38.425751 (+ 32585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:38.636922 (+211171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.636968 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:38.637509 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:06:39.085468 (+447959us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:39.085508 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.085573 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.952140 (+866567us) raft_consensus.cc:1685] finished
0709 13:06:39.952159 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.952298 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":145749,"threads_started":1,"wal-append.queue_time_us":584645}
I20260709 13:06:39.953657 24791 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:39.958263 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:39.959128 22814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 522) took 1539 ms. Trace:
I20260709 13:06:39.954768 24821 consensus_queue.cc:237] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:40.009008 24723 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:39.895210 24843 consensus_queue.cc:1059] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
W20260709 13:06:40.010241 22072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.212s (SENT) [suppressed 24 similar messages]
W20260709 13:06:40.064973 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 54772.9us
W20260709 13:06:40.009640 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 79016.1us
W20260709 13:06:40.010345 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 112358us
I20260709 13:06:40.066905 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:40.067116 22218 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:39.934700 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 524) took 1514 ms. Trace:
W20260709 13:06:39.995597 24718 consensus_meta.cc:287] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 1.642s	user 0.009s	sys 0.004s
I20260709 13:06:39.989611 24635 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:40.037358 22104 raft_consensus.cc:2393] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:06:40.047367 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 186298us
I20260709 13:06:40.040468 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1591) took 3143 ms. Trace:
I20260709 13:06:40.037089 24853 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:40.076658 22180 rpcz_store.cc:276] 0709 13:06:36.897196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.901412 (+  4216us) service_pool.cc:224] Handling call
0709 13:06:36.901699 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.902081 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.902112 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.902525 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.092139 (+189614us) spinlock_profiling.cc:243] Waited 9.45 ms on lock 0x7b4800271a58. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66ace77aa1 00007f66ace6eb37 00007f66ace6e9ca 00007f66acf6626f 00007f66acf65f37 00007f66acf7a55c 00007f66acf7a508 00007f66acf7a488 00007f66acf7a443 00007f66acf796ec 00007f66abea3a96
0709 13:06:37.283534 (+191395us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:37.283593 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.283699 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.017216 (+2733517us) raft_consensus.cc:1685] finished
0709 13:06:40.017245 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.040403 (+ 23158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58266,"raft.queue_time_us":8414,"raft.run_cpu_time_us":1934,"raft.run_wall_time_us":177425,"spinlock_wait_cycles":21739392,"thread_start_us":380574,"threads_started":1,"wal-append.queue_time_us":2083858}
I20260709 13:06:40.071105 22808 rpcz_store.cc:276] 0709 13:06:38.420663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.771119 (+1350456us) service_pool.cc:224] Handling call
0709 13:06:39.856720 (+ 85601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.927225 (+ 70505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.934620 (+  7395us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:40.078711 24635 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:40.079231 24635 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:40.079679 22782 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:40.054214 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:40.081030 22248 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.082993 24733 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:40.083755 24733 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:40.085028 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:40.085625 24831 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:40.086220 24831 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:40.055102 22812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35214 (request call id 519) took 1635 ms (client timeout 2156 ms). Trace:
I20260709 13:06:40.050690 24813 raft_consensus.cc:3055] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:06:40.087198 22812 rpcz_store.cc:269] 0709 13:06:38.419212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.177451 (+758239us) service_pool.cc:224] Handling call
0709 13:06:39.943431 (+765980us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b54005c09a8. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add2b924 00007f66acf14227 00007f66acf13ab8 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6
0709 13:06:40.055010 (+111579us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4912384}
W20260709 13:06:40.056404 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 94392.4us
I20260709 13:06:39.963111 22099 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
W20260709 13:06:40.052270 24781 log.cc:927] Time spent T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:06:40.099896 22099 raft_consensus.cc:1240] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:40.070564 22072 leader_election.cc:336] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.969s (SENT)
I20260709 13:06:40.100924 22072 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:40.102128 24850 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:40.102042 24635 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:40.103552 24782 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 2.396s	user 0.002s	sys 0.004s
I20260709 13:06:40.072856 22255 raft_consensus.cc:2393] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:40.060703 22814 rpcz_store.cc:276] 0709 13:06:38.420063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.299500 (+879437us) service_pool.cc:224] Handling call
0709 13:06:39.626035 (+326535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.649412 (+ 23377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.649442 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.683331 (+ 33889us) log.cc:844] Serialized 26 byte log entry
0709 13:06:39.891047 (+207716us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:39.925806 (+ 34759us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.926116 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.926229 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.958838 (+ 32609us) raft_consensus.cc:1685] finished
0709 13:06:39.958865 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.959056 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5275,"prepare.queue_time_us":32941,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":68,"raft.queue_time_us":47665,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"spinlock_wait_cycles":8682752,"thread_start_us":166355,"threads_started":1,"wal-append.queue_time_us":239058}
I20260709 13:06:40.075912 22250 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:40.047955 24583 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:40.097244 22144 leader_election.cc:400] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7.
I20260709 13:06:40.109365 22144 leader_election.cc:403] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:06:40.110489 22144 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:40.111238 22248 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 4.
I20260709 13:06:40.092247 24813 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:40.100344 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 431) took 3197 ms. Trace:
I20260709 13:06:40.086656 24831 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:40.106838 24581 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:40.121685 22254 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:40.107450 22099 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:40.108421 24395 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:40.104857 24801 log.cc:927] Time spent T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.477s	user 0.002s	sys 0.002s
I20260709 13:06:40.121016 24708 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:40.115300 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:40.117548 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1592) took 3220 ms. Trace:
W20260709 13:06:40.131327 24857 log.cc:927] Time spent T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:40.132602 24838 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:40.131505 22177 rpcz_store.cc:276] 0709 13:06:36.897554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.913425 (+ 15871us) service_pool.cc:224] Handling call
0709 13:06:36.913850 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.914241 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.914279 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.967712 (+ 53433us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.224647 (+256935us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:37.224704 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.224807 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.102788 (+2877981us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:40.105050 (+  2262us) raft_consensus.cc:1685] finished
0709 13:06:40.105068 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.117473 (+ 12405us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9347,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":19086,"spinlock_wait_cycles":282530560,"thread_start_us":196923,"threads_started":1,"wal-append.queue_time_us":647524}
I20260709 13:06:40.133571 22779 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:40.115978 22253 rpcz_store.cc:276] 0709 13:06:36.903068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.903179 (+   111us) service_pool.cc:224] Handling call
0709 13:06:36.903490 (+   311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:36.931188 (+ 27698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.931233 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:36.952829 (+ 21596us) log.cc:844] Serialized 52 byte log entry
0709 13:06:37.071987 (+119158us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:37.151219 (+ 79232us) log.cc:844] Serialized 14 byte log entry
0709 13:06:37.180611 (+ 29392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.180762 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.691889 (+2511127us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:40.100031 (+408142us) raft_consensus.cc:1685] finished
0709 13:06:40.100139 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.100277 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77319,"prepare.queue_time_us":94473,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":3589,"raft.queue_time_us":392740,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":86563,"spinlock_wait_cycles":7000448,"thread_start_us":118766,"threads_started":1,"wal-append.queue_time_us":246645}
I20260709 13:06:40.134594 24818 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:40.134783 22779 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:40.129467 24725 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7.
I20260709 13:06:40.129200 24552 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:40.135730 24815 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:40.135965 24798 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:40.136509 24851 raft_consensus.cc:2764] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:40.137248 24851 consensus_queue.cc:1059] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:40.131330 22103 raft_consensus.cc:2368] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7.
I20260709 13:06:40.105206 24827 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:40.138401 24552 raft_consensus.cc:3055] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:40.060166 24456 consensus_queue.cc:260] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:40.150517 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 182379us
I20260709 13:06:40.152143 22144 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:40.139526 24583 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:40.087649 24718 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:40.164119 22103 raft_consensus.cc:3055] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:40.160533 22147 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:40.165592 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 85074.8us
I20260709 13:06:40.169783 22099 raft_consensus.cc:1240] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:40.164677 22103 raft_consensus.cc:740] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:40.173913 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 333) took 1121 ms. Trace:
I20260709 13:06:40.150382 24552 raft_consensus.cc:740] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:40.160212 24815 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:40.174360 22178 rpcz_store.cc:276] 0709 13:06:39.045137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.964262 (+919125us) service_pool.cc:224] Handling call
0709 13:06:39.964555 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.964767 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:39.966796 (+  2029us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.166255 (+199459us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:40.166304 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:40.166348 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.166409 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.166516 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3042,"prepare.queue_time_us":150,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":3171,"thread_start_us":195735,"threads_started":1}
W20260709 13:06:40.181493 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 109091us
I20260709 13:06:40.178733 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1926) took 1100 ms. Trace:
I20260709 13:06:40.175882 22103 consensus_queue.cc:260] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:40.186152 22816 raft_consensus.cc:2393] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:40.185400 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:40.189925 22218 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:40.191196 22103 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.188797 24853 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:40.183723 24456 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:40.198729 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:40.184201 24815 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:40.171684 24725 consensus_queue.cc:1059] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:06:40.141752 24589 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:40.192765 24705 consensus_meta.cc:287] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.756s	user 0.003s	sys 0.009s
I20260709 13:06:40.216724 22144 leader_election.cc:400] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
I20260709 13:06:40.217110 22144 leader_election.cc:403] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:40.201773 22781 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:40.191526 24825 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:40.208151 24815 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:40.182235 24395 consensus_queue.cc:1059] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:06:40.212119 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:40.213995 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:40.213430 24864 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:40.196120 24833 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:40.199460 24635 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:40.255198 22099 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:40.255249 22178 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:40.325544 22097 raft_consensus.cc:2410] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:06:40.178728 24813 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:40.218757 24657 raft_consensus.cc:3055] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:40.484675 22781 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:40.217773 24853 raft_consensus.cc:697] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:40.479166 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 262549us
I20260709 13:06:40.555150 22144 leader_election.cc:400] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
I20260709 13:06:40.323908 24806 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:40.321435 24581 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.562041 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:40.606482 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 51552.7us
I20260709 13:06:40.621718 22178 raft_consensus.cc:2393] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 7: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:40.424988 24506 raft_consensus.cc:3055] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:40.554073 24657 raft_consensus.cc:740] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:40.518618 24838 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
W20260709 13:06:40.691565 24862 log.cc:927] Time spent T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:06:40.710281 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1928) took 1631 ms. Trace:
I20260709 13:06:40.710767 22180 rpcz_store.cc:276] 0709 13:06:39.079141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.078768 (+999627us) service_pool.cc:224] Handling call
0709 13:06:40.088360 (+  9592us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:40.089735 (+  1375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.089784 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:40.108070 (+ 18286us) log.cc:844] Serialized 52 byte log entry
0709 13:06:40.184593 (+ 76523us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:40.185245 (+   652us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.188577 (+  3332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.188649 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.710035 (+521386us) raft_consensus.cc:1685] finished
0709 13:06:40.710058 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.710213 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3091,"prepare.queue_time_us":198,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":4782,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":3207,"thread_start_us":76104,"threads_started":1,"wal-append.queue_time_us":212346}
I20260709 13:06:40.713092 22180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:06:40.713732 22180 raft_consensus.cc:606] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
W20260709 13:06:40.716322 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 104672us
W20260709 13:06:40.683168 24867 log.cc:927] Time spent T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.485s	user 0.000s	sys 0.001s
I20260709 13:06:40.739550 22099 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
W20260709 13:06:40.739545 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 255014us
I20260709 13:06:40.641641 24506 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:40.747045 22144 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:40.748307 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:40.682289 24806 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:40.749361 22144 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:40.753532 22218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.002s	sys 0.011s
W20260709 13:06:40.738294 24583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.049s	sys 0.081s
W20260709 13:06:40.754148 22218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.002s	sys 0.011s
W20260709 13:06:40.759056 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 534415us
I20260709 13:06:40.714170 24864 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:40.563701 24729 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.200s
I20260709 13:06:40.635890 24581 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:40.762578 22144 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:40.608929 24552 consensus_queue.cc:260] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:40.752717 24806 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.765594 22253 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:40.756963 24583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.049s	sys 0.081s
I20260709 13:06:40.656255 24865 consensus_queue.cc:1059] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.143s
I20260709 13:06:40.752393 24718 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:40.768126 22178 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:40.753476 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:40.756203 24395 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:40.774302 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:40.771692 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:40.775049 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:40.775610 24870 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:06:40.758093 24373 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:40.777406 24626 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:40.783810 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:40.771341 24657 consensus_queue.cc:260] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:40.775113 24833 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:40.786868 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1473) took 3823 ms. Trace:
I20260709 13:06:40.788112 22813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 758) took 3718 ms. Trace:
I20260709 13:06:40.790341 24722 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:06:40.791136 24805 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:40.794148 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:40.834251 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:40.800200 24814 raft_consensus.cc:3055] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:40.753983 24788 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
W20260709 13:06:40.804263 24840 consensus_meta.cc:287] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.890s	user 0.008s	sys 0.003s
I20260709 13:06:40.805713 24789 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.763290 24737 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:40.830426 24373 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:40.808840 24552 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:40.812110 24820 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:40.814260 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1559) took 1370 ms. Trace:
W20260709 13:06:40.818087 24456 consensus_meta.cc:287] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.612s	user 0.006s	sys 0.001s
W20260709 13:06:40.819630 22103 consensus_meta.cc:287] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.628s	user 0.007s	sys 0.001s
I20260709 13:06:40.824277 22099 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:40.840029 22105 rpcz_store.cc:276] 0709 13:06:39.443609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.678440 (+234831us) service_pool.cc:224] Handling call
0709 13:06:40.813984 (+1135544us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54002ab2d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:40.814179 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276771584}
I20260709 13:06:40.825446 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:40.840669 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:40.826242 24854 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:40.844376 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:40.824157 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:40.845319 22103 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:06:40.845643 22253 raft_consensus.cc:2368] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7.
I20260709 13:06:40.845646 22103 pending_rounds.cc:85] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 4
I20260709 13:06:40.846216 22103 pending_rounds.cc:107] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:06:40.846657 22103 raft_consensus.cc:2889] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:40.847805 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 388) took 1342 ms. Trace:
I20260709 13:06:40.827239 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1930) took 1743 ms. Trace:
I20260709 13:06:40.832751 22813 rpcz_store.cc:276] 0709 13:06:37.069526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.099157 (+ 29631us) service_pool.cc:224] Handling call
0709 13:06:37.099519 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.283577 (+2184058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.787796 (+1504219us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b5400690fd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:40.788037 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4807533312}
I20260709 13:06:40.848456 22178 rpcz_store.cc:276] 0709 13:06:39.083569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.757946 (+1674377us) service_pool.cc:224] Handling call
0709 13:06:40.767542 (+  9596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.823757 (+ 56215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.827174 (+  3417us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:40.834560 22179 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:40.822995 24806 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:40.798354 24785 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:40.831501 22177 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.003s	sys 0.035s
I20260709 13:06:40.836370 24814 raft_consensus.cc:740] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:06:40.867063 22177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.004s	sys 0.035s
I20260709 13:06:40.836967 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:40.867611 22176 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:40.842571 22248 raft_consensus.cc:2393] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:40.825811 24865 consensus_queue.cc:1243] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer a07ca3d1b5b84f4bbcb907f709a69275 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:40.761400 24838 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:40.863889 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:40.871658 22105 raft_consensus.cc:2393] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 4: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:40.832506 22100 rpcz_store.cc:276] 0709 13:06:36.963744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.040666 (+ 76922us) service_pool.cc:224] Handling call
0709 13:06:37.040987 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.320068 (+2279081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.786513 (+1466445us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540001ed54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:40.786777 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2742190976}
I20260709 13:06:40.848287 22103 rpcz_store.cc:276] 0709 13:06:39.505409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.149105 (+643696us) service_pool.cc:224] Handling call
0709 13:06:40.163983 (+ 14878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.847554 (+683571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.847734 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:40.872563 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:40.849428 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1584) took 4180 ms. Trace:
W20260709 13:06:40.835798 22220 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.031s	sys 0.061s
W20260709 13:06:40.825114 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 50897.9us
I20260709 13:06:40.842352 24657 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:40.856890 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:40.874014 22220 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.031s	sys 0.061s
I20260709 13:06:40.874405 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:40.828327 24506 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:40.877100 22144 leader_election.cc:400] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5.
I20260709 13:06:40.873126 22174 rpcz_store.cc:276] 0709 13:06:36.669109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.669246 (+   137us) service_pool.cc:224] Handling call
0709 13:06:36.674027 (+  4781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.336354 (+1662327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.849211 (+2512857us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540031b0d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:40.849374 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3102923008}
W20260709 13:06:40.877486 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 710951us
I20260709 13:06:40.878883 22144 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:40.879966 22144 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:40.881959 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:40.884238 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:40.885512 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:40.886128 22099 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:40.887526 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:40.889679 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:40.892164 24814 consensus_queue.cc:260] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:40.893301 24814 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:40.878227 24854 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:40.897783 24823 log.cc:927] Time spent T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 1.386s	user 0.012s	sys 0.000s
I20260709 13:06:40.898147 24373 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:40.899893 24845 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:40.902086 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:40.902562 24373 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:40.903298 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:40.903864 22174 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:40.909406 22253 raft_consensus.cc:1240] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:40.841491 24840 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:40.905097 24506 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:40.839035 24853 consensus_queue.cc:237] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:40.918581 22144 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:40.941051 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:40.919754 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.942281 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1929) took 1859 ms. Trace:
I20260709 13:06:40.931861 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:40.936650 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:40.918175 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:40.934790 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:40.842823 24789 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:40.951359 24454 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:06:40.955394 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:40.956480 24785 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:40.956678 24373 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:40.951508 24737 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:40.951421 24733 consensus_queue.cc:1059] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:06:40.958557 24733 raft_consensus.cc:3055] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:40.958801 24789 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:40.959740 22249 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:40.958878 24733 raft_consensus.cc:740] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:40.930187 24831 consensus_meta.cc:287] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.786s	user 0.006s	sys 0.003s
I20260709 13:06:40.963779 24733 consensus_queue.cc:260] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:40.965106 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:40.980155 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:40.980454 22814 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:40.968173 22808 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:40.968855 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:40.969048 24698 raft_consensus.cc:3055] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:40.991396 24698 raft_consensus.cc:740] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:40.991878 22811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 527) took 2570 ms. Trace:
I20260709 13:06:40.992654 24833 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:40.992372 24698 consensus_queue.cc:260] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:40.979866 24831 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:40.993963 24698 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:40.994200 24842 log.cc:927] Time spent T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 1.420s	user 0.011s	sys 0.000s
I20260709 13:06:40.995352 24831 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:40.996423 24772 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:40.969485 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:40.997124 22812 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:40.919606 24849 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.970631 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:40.927424 24840 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:40.971414 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:40.973153 22144 leader_election.cc:400] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7.
I20260709 13:06:40.974014 24581 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:40.917615 24854 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:40.981016 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.925513 24815 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:40.919983 24626 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.983393 22180 raft_consensus.cc:1275] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:40.981835 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:40.942664 22177 rpcz_store.cc:276] 0709 13:06:39.083236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.133893 (+1050657us) service_pool.cc:224] Handling call
0709 13:06:40.134275 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.134523 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:40.138102 (+  3579us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.913421 (+775319us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.941100 (+ 27679us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:40.941149 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:40.941192 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.941808 (+   616us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.942219 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27423,"prepare.queue_time_us":48489,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":13425,"raft.queue_time_us":29196,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":7912,"spinlock_wait_cycles":10681216,"thread_start_us":774637,"threads_started":2,"wal-append.queue_time_us":739829}
I20260709 13:06:41.005477 22144 leader_election.cc:403] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:41.013271 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1597) took 1645 ms. Trace:
I20260709 13:06:41.009394 22069 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:41.013813 22180 rpcz_store.cc:276] 0709 13:06:39.367614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.970776 (+1603162us) service_pool.cc:224] Handling call
0709 13:06:40.975014 (+  4238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.010399 (+ 35385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.013196 (+  2797us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.003604 24733 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.016842 22144 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:41.020569 22144 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:41.021770 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.023165 22177 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:41.024111 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1598) took 1656 ms. Trace:
I20260709 13:06:41.024883 22177 rpcz_store.cc:276] 0709 13:06:39.367880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.012619 (+1644739us) service_pool.cc:224] Handling call
0709 13:06:41.020476 (+  7857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.023762 (+  3286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.024036 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.021709 22069 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:41.016172 24818 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7.
W20260709 13:06:41.026335 24817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.328s	user 0.030s	sys 0.021s
I20260709 13:06:41.027894 24454 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:41.030474 24469 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:41.019124 24725 consensus_queue.cc:1059] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:06:41.042733 24469 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.043246 24469 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.043619 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 376) took 4110 ms. Trace:
I20260709 13:06:41.044075 22809 rpcz_store.cc:276] 0709 13:06:36.933431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.937002 (+  3571us) service_pool.cc:224] Handling call
0709 13:06:36.937321 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.091800 (+2154479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.043345 (+1951545us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54006225d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:41.043554 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046738176}
I20260709 13:06:41.030200 24772 consensus_queue.cc:1048] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:06:41.046761 24725 raft_consensus.cc:3055] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:41.047377 24725 raft_consensus.cc:740] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:41.047801 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1674) took 3998 ms. Trace:
I20260709 13:06:41.048233 22251 rpcz_store.cc:276] 0709 13:06:37.049795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.065736 (+ 15941us) service_pool.cc:224] Handling call
0709 13:06:37.066024 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.091032 (+2025008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.047572 (+1956540us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b540014afd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:41.047740 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4645045632}
I20260709 13:06:41.048264 24725 consensus_queue.cc:260] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:40.992301 22811 rpcz_store.cc:276] 0709 13:06:38.421646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.818377 (+1396731us) service_pool.cc:224] Handling call
0709 13:06:39.892095 (+ 73718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.941018 (+ 48923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.941075 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:39.941160 (+    85us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:39.941255 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.991596 (+1050341us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b5400720e54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:40.991650 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.991818 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4741,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"spinlock_wait_cycles":107605888}
I20260709 13:06:41.015990 24626 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.051007 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1596) took 1683 ms. Trace:
I20260709 13:06:41.052029 24626 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:41.052592 22181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1595) took 4154 ms (client timeout 3198 ms). Trace:
W20260709 13:06:41.053089 22181 rpcz_store.cc:269] 0709 13:06:36.898454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.898564 (+   110us) service_pool.cc:224] Handling call
0709 13:06:41.052339 (+4153775us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b540031bfd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:41.052480 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5009614976}
I20260709 13:06:41.053848 24469 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:41.039384 24817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.341s	user 0.030s	sys 0.022s
I20260709 13:06:41.055876 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.056643 22250 raft_consensus.cc:2393] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:41.026172 24853 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:41.046841 22106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 381) took 1643 ms (client timeout 2101 ms). Trace:
I20260709 13:06:41.049574 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.008936 24849 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.030153 24789 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:06:41.054654 22181 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:41.123766 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 88470.4us
I20260709 13:06:41.125290 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1603) took 1677 ms. Trace:
I20260709 13:06:41.029623 24854 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:41.051434 22178 rpcz_store.cc:276] 0709 13:06:39.367327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.905921 (+1538594us) service_pool.cc:224] Handling call
0709 13:06:40.906346 (+   425us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:40.911965 (+  5619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.912009 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:40.943778 (+ 31769us) log.cc:844] Serialized 52 byte log entry
0709 13:06:41.006821 (+ 63043us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:41.028033 (+ 21212us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.029008 (+   975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.029079 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.050744 (+ 21665us) raft_consensus.cc:1685] finished
0709 13:06:41.050763 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.050947 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5546,"prepare.queue_time_us":19423,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":6233,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":91,"spinlock_wait_cycles":2319616,"thread_start_us":36432,"threads_started":1,"wal-append.queue_time_us":73223}
W20260709 13:06:41.125643 22106 rpcz_store.cc:269] 0709 13:06:39.403876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.435997 (+ 32121us) service_pool.cc:224] Handling call
0709 13:06:41.046590 (+1610593us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b5400215554. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:41.046770 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1620666624}
I20260709 13:06:41.126824 22181 rpcz_store.cc:276] 0709 13:06:39.491821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.054113 (+1562292us) service_pool.cc:224] Handling call
0709 13:06:41.054429 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.123898 (+ 69469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.125237 (+  1339us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.041615 24454 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.132408 24454 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.122329 24725 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:41.134969 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.135926 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.037433 24824 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:06:41.123195 24834 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:41.136925 24831 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.135627 24853 raft_consensus.cc:697] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:41.147967 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.148010 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.148670 22251 raft_consensus.cc:2393] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:41.123389 24806 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.156644 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:41.157375 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:41.158531 24828 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 1.676s	user 0.002s	sys 0.010s
I20260709 13:06:41.159263 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:41.160053 22813 raft_consensus.cc:2393] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:41.160725 22254 raft_consensus.cc:2410] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:41.161518 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:41.162956 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.163276 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.163938 22250 raft_consensus.cc:2393] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:41.165428 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.165545 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:41.166141 22101 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:41.167197 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:41.167827 22101 raft_consensus.cc:2393] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:41.169847 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:41.170583 22106 raft_consensus.cc:2393] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:41.146634 24831 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:41.171705 22815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 754) took 4123 ms. Trace:
I20260709 13:06:41.172086 22815 rpcz_store.cc:276] 0709 13:06:37.048588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.048859 (+   271us) service_pool.cc:224] Handling call
0709 13:06:37.070567 (+ 21708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.004836 (+934269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.171478 (+3166642us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b5400691c54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:41.171651 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750758144}
I20260709 13:06:41.173122 24831 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:41.173489 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:41.174331 22807 raft_consensus.cc:2393] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:41.175256 24752 raft_consensus.cc:3055] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:41.175657 24752 raft_consensus.cc:740] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:41.176491 22808 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:41.176581 24752 consensus_queue.cc:260] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.177170 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:41.173677 24813 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:41.177996 24752 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.179402 24783 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:41.182600 22100 raft_consensus.cc:1275] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:41.187000 22103 raft_consensus.cc:1275] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:41.187351 24675 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:41.188198 24853 consensus_queue.cc:237] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:41.190801 24839 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 1.608s	user 0.000s	sys 0.013s
I20260709 13:06:41.191016 24454 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.193552 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.193706 22248 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:41.201138 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.202000 22103 raft_consensus.cc:2393] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:41.203730 24454 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:41.204231 24841 raft_consensus.cc:3055] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:41.204636 24841 raft_consensus.cc:740] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:41.205865 24732 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:41.207849 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.208071 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:41.209681 22809 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
W20260709 13:06:41.211210 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.219852 22071 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:41.225461 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:41.228626 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.229596 22103 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:41.232043 22071 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:41.233453 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.234541 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:41.242268 22071 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:41.238747 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.243196 22101 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:41.248018 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.240613 24824 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:41.255180 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.256091 22103 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:41.239715 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.249797 22101 raft_consensus.cc:2410] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:41.241861 24783 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:41.260823 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.261196 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.261471 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.262149 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.246511 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:41.264981 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:41.266732 22813 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.249274 24469 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:41.265807 24805 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:06:41.267014 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.272423 22103 raft_consensus.cc:2410] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:41.248554 24882 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:41.248373 24465 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:06:41.286726 22147 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:41.286849 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:41.287930 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.288345 22251 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:41.291651 22253 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:41.296494 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:41.297144 22807 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.300025 22103 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:41.301208 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.302289 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.304286 24553 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:41.305802 22253 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
W20260709 13:06:41.307787 24886 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:06:41.275796 24882 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.308501 24882 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.308902 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:41.309394 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.310474 24640 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:41.310842 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.311007 24640 raft_consensus.cc:697] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:41.311968 24640 consensus_queue.cc:237] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:41.313112 22097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1556) took 1979 ms (client timeout 2626 ms). Trace:
W20260709 13:06:41.313493 22097 rpcz_store.cc:269] 0709 13:06:39.334281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.334506 (+   225us) service_pool.cc:224] Handling call
0709 13:06:41.312944 (+1978438us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54000235d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:41.313060 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956528512}
I20260709 13:06:41.262226 24824 raft_consensus.cc:697] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:41.317608 24806 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:41.324209 22072 leader_election.cc:336] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 3.285s (SENT)
I20260709 13:06:41.325736 24584 consensus_queue.cc:1059] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:41.326699 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.327899 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.329097 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.330084 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.325016 22072 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:41.330295 24584 consensus_queue.cc:1059] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:41.319671 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.326727 24698 raft_consensus.cc:3055] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:41.318903 24824 consensus_queue.cc:237] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:41.334640 22813 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:41.332850 22097 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:41.330782 22255 raft_consensus.cc:2393] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:41.343355 22101 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:41.346293 22069 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:41.366791 22072 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:41.368081 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.386842 22255 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:41.369576 22100 raft_consensus.cc:2393] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:41.344622 24698 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:41.375010 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.376713 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.378014 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:41.392371 22179 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.378830 24819 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:41.379577 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1677) took 4328 ms. Trace:
I20260709 13:06:41.393613 22247 rpcz_store.cc:276] 0709 13:06:37.050716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.070909 (+ 20193us) service_pool.cc:224] Handling call
0709 13:06:37.071232 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.005432 (+1934200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.379159 (+2373727us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540023a854. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:41.379460 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3422728576}
I20260709 13:06:41.381093 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 440) took 1736 ms. Trace:
I20260709 13:06:41.395077 22252 rpcz_store.cc:276] 0709 13:06:39.644574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.661230 (+ 16656us) service_pool.cc:224] Handling call
0709 13:06:39.678199 (+ 16969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.990956 (+312757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.380866 (+1389910us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54002dc654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:41.381033 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716627200}
I20260709 13:06:41.396495 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.397531 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.398137 22252 raft_consensus.cc:2393] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:41.381301 22104 raft_consensus.cc:2410] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:41.377657 22807 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:41.382189 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:41.398865 22176 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.383955 24055 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:41.384924 22071 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:41.399885 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.400578 22247 raft_consensus.cc:2393] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:41.404500 22251 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:41.405229 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.405779 22251 raft_consensus.cc:2376] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7. Re-sending same reply.
I20260709 13:06:41.408603 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.402951 22069 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:41.410795 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:41.411481 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.412106 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.413451 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.415374 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.420842 22179 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:41.423586 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.426569 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.416257 22247 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 3.
W20260709 13:06:41.431682 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.392297 24553 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.427529 22255 raft_consensus.cc:2376] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7. Re-sending same reply.
I20260709 13:06:41.428161 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.438970 22247 raft_consensus.cc:2393] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:41.435110 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.437387 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.405861 24705 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.405165 24454 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:41.441428 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.442700 22252 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:41.438234 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.443830 22255 raft_consensus.cc:2410] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:41.428558 24805 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:41.425727 24465 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:41.446712 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:41.449324 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.459219 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.451450 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.442111 24429 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.464391 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1918) took 4428 ms. Trace:
I20260709 13:06:41.463726 22255 raft_consensus.cc:2410] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:41.464808 22172 rpcz_store.cc:276] 0709 13:06:37.030336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.036636 (+  6300us) service_pool.cc:224] Handling call
0709 13:06:37.065571 (+ 28935us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.758796 (+2693225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.458884 (+1700088us) spinlock_profiling.cc:243] Waited 2.67 s on lock 0x7b540003c354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:41.459162 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6151647488}
I20260709 13:06:41.463510 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.467093 22249 raft_consensus.cc:2393] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:41.467729 22251 raft_consensus.cc:1240] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:41.450080 24758 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:41.449424 24454 raft_consensus.cc:697] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:41.446557 24465 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.472221 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.458374 24456 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:41.456326 24805 raft_consensus.cc:697] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:41.476619 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:41.480631 22172 raft_consensus.cc:2368] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9.
I20260709 13:06:41.468933 24429 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.481904 24805 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.484505 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:41.485354 22781 leader_election.cc:400] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9.
I20260709 13:06:41.485349 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:41.485901 22781 leader_election.cc:403] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:06:41.485661 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:41.447988 24705 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:41.488952 24783 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.494292 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:40.184901 22175 rpcz_store.cc:276] 0709 13:06:39.078599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.059233 (+980634us) service_pool.cc:224] Handling call
0709 13:06:40.059532 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.059743 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:40.074733 (+ 14990us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.178037 (+103304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:40.178287 (+   250us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:40.178351 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.178503 (+   152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.178653 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16231,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":4853,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":8086,"thread_start_us":96637,"threads_started":1}
I20260709 13:06:41.491559 22249 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:41.495642 22255 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:41.495927 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:41.489459 22179 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:41.495007 22173 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:41.498978 22252 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:41.499403 22071 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:41.500342 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:41.480695 24465 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:41.503377 22072 leader_election.cc:336] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.043s (SENT)
I20260709 13:06:41.501128 22173 raft_consensus.cc:2376] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6. Re-sending same reply.
I20260709 13:06:41.504273 22072 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:41.504640 22252 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:41.503862 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:41.476441 24758 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.506016 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.506589 22249 raft_consensus.cc:2376] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7. Re-sending same reply.
I20260709 13:06:41.507619 24758 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:41.507814 22249 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:06:41.507032 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:41.508205 24725 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:41.510385 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1605) took 1885 ms. Trace:
I20260709 13:06:41.511056 24752 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:41.502316 24783 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.510782 22178 rpcz_store.cc:276] 0709 13:06:39.625441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.142573 (+1517132us) service_pool.cc:224] Handling call
0709 13:06:41.153246 (+ 10673us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.161381 (+  8135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.161412 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.193251 (+ 31839us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.332025 (+138774us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:41.332083 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.332163 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.510171 (+178008us) raft_consensus.cc:1685] finished
0709 13:06:41.510194 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.510329 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3688,"raft.queue_time_us":2003,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":123725,"threads_started":1,"wal-append.queue_time_us":223432}
I20260709 13:06:41.516458 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:41.516672 22254 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:41.517030 22178 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:41.517868 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:41.518002 22254 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:41.518371 22781 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:41.519754 22071 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:41.511795 24752 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.520522 24817 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:41.520972 24758 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:41.521261 24817 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:41.521384 24758 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:41.521799 24817 raft_consensus.cc:697] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:41.464094 24698 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:41.514801 24783 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:41.521814 24758 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.508175 22249 pending_rounds.cc:85] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 5
I20260709 13:06:41.527169 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:41.535518 22249 pending_rounds.cc:107] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:06:41.535795 22249 raft_consensus.cc:2889] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:41.527549 22252 raft_consensus.cc:1240] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:41.530025 22248 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:41.534106 22147 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:41.535879 22178 raft_consensus.cc:2393] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:06:41.527004 22816 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35214 (request call id 514) took 3190 ms (client timeout 1696 ms). Trace:
I20260709 13:06:41.493510 24814 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:41.522629 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 379) took 2144 ms. Trace:
I20260709 13:06:41.527853 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:41.539788 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:41.545540 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:41.549180 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:41.542284 22098 rpcz_store.cc:276] 0709 13:06:39.378577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.402811 (+ 24234us) service_pool.cc:224] Handling call
0709 13:06:39.428262 (+ 25451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.703258 (+274996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.522414 (+1819156us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54003e0654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:41.522576 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":574186752}
W20260709 13:06:41.539143 22816 rpcz_store.cc:269] 0709 13:06:38.336725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.336855 (+   130us) service_pool.cc:224] Handling call
0709 13:06:41.526691 (+3189836us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b5400736c54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:41.526874 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4084581760}
I20260709 13:06:41.554247 22178 raft_consensus.cc:2393] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 6: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:06:41.534811 22072 leader_election.cc:336] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.111s (SENT)
I20260709 13:06:41.555253 22072 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:41.557044 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:41.558182 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.523412 24827 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:41.504642 24640 consensus_queue.cc:1059] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:06:41.531628 24897 log.cc:927] Time spent T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:41.559854 24640 raft_consensus.cc:3055] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:41.560230 24640 raft_consensus.cc:740] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:41.561038 24640 consensus_queue.cc:260] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.562124 24640 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:41.563285 24885 log.cc:927] Time spent T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.376s	user 0.002s	sys 0.000s
I20260709 13:06:41.563529 22782 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:41.564764 22174 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:41.532372 24758 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.566257 24732 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:41.567103 24834 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.567510 24834 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:41.567804 24758 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:41.489475 24882 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:41.569867 24849 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:41.570298 24469 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:41.523356 24698 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:41.571702 22072 leader_election.cc:336] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.118s (SENT)
W20260709 13:06:41.572588 24894 log.cc:927] Time spent T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.331s	user 0.002s	sys 0.000s
I20260709 13:06:41.531528 22808 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:41.547760 24831 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:41.575490 24831 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:41.576026 24831 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.559154 24827 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.567874 24834 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.583242 22252 raft_consensus.cc:2410] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:41.489178 24429 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:41.591882 22174 raft_consensus.cc:1275] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:41.572613 22072 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:41.592604 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1610) took 1823 ms. Trace:
W20260709 13:06:41.533017 24888 log.cc:927] Time spent T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.329s	user 0.000s	sys 0.004s
I20260709 13:06:41.596737 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.597543 22252 raft_consensus.cc:2393] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:41.522248 24752 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:41.564935 22176 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:41.598470 22252 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:41.579998 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.590816 22178 raft_consensus.cc:1275] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:41.565382 22782 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:41.599555 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1608) took 1895 ms. Trace:
I20260709 13:06:41.594162 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:41.600402 22178 rpcz_store.cc:276] 0709 13:06:39.704100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.589891 (+1885791us) service_pool.cc:224] Handling call
0709 13:06:41.590304 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.599238 (+  8934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.599477 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.602427 22781 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:41.593050 22174 rpcz_store.cc:276] 0709 13:06:39.769127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.566708 (+1797581us) service_pool.cc:224] Handling call
0709 13:06:41.582448 (+ 15740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.592299 (+  9851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.592543 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:41.608778 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.601197 22175 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:41.522748 24817 consensus_queue.cc:237] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:41.615938 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 50608.2us
I20260709 13:06:41.525336 24815 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:41.620865 24429 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:41.621524 24837 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:41.622282 24837 raft_consensus.cc:697] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:41.623207 24837 consensus_queue.cc:237] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:41.623699 22102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 382) took 2197 ms (client timeout 2034 ms). Trace:
W20260709 13:06:41.624066 22102 rpcz_store.cc:269] 0709 13:06:39.426313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.426431 (+   118us) service_pool.cc:224] Handling call
0709 13:06:41.623507 (+2197076us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b540042a254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:41.623609 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":573855616}
I20260709 13:06:41.627803 24783 raft_consensus.cc:993] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:06:41.628295 24783 raft_consensus.cc:1081] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Signalling peer a07ca3d1b5b84f4bbcb907f709a69275 to start an election
I20260709 13:06:41.630546 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1572) took 1660 ms. Trace:
I20260709 13:06:41.630663 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:41.631506 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1611) took 1821 ms. Trace:
I20260709 13:06:41.632076 22106 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:41.631924 22178 rpcz_store.cc:276] 0709 13:06:39.782986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.602691 (+1819705us) service_pool.cc:224] Handling call
0709 13:06:41.603132 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.603357 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.603395 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.603450 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:41.603495 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.603557 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.603963 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.634613 22174 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:41.635443 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1613) took 1815 ms. Trace:
I20260709 13:06:41.635878 22174 rpcz_store.cc:276] 0709 13:06:39.820038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.603453 (+1783415us) service_pool.cc:224] Handling call
0709 13:06:41.634381 (+ 30928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.635116 (+   735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.635368 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.631023 22104 rpcz_store.cc:276] 0709 13:06:39.969856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.084761 (+114905us) service_pool.cc:224] Handling call
0709 13:06:41.630353 (+1545592us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540040f6d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:41.630491 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2979067264}
I20260709 13:06:41.557076 24733 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:41.592528 24827 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:41.640048 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 68394.6us
I20260709 13:06:41.641790 22814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a4e641637cf41118865c96aec55b340"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
 from {username='slave'} at 127.0.0.1:35198
I20260709 13:06:41.642134 22815 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:41.643935 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:41.647333 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1675) took 4597 ms. Trace:
I20260709 13:06:41.649607 22178 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:41.649899 22814 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:41.650681 22814 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:41.653052 22072 leader_election.cc:336] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.135s (SENT)
W20260709 13:06:41.654673 22072 leader_election.cc:336] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.224s (SENT)
I20260709 13:06:41.655282 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:41.657068 22176 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.656107 22072 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:41.649451 22246 rpcz_store.cc:276] 0709 13:06:37.050082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.065683 (+ 15601us) service_pool.cc:224] Handling call
0709 13:06:37.076612 (+ 10929us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:38.502354 (+1425742us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b1800339400. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a7af64bc 00007f66a4e4448b 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e5e455 00007f66a7f46060 00007f66a7f46bfb 00007f66a7f5164b
0709 13:06:38.502569 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.502609 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:38.503262 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 13:06:39.185947 (+682685us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:39.186005 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.646913 (+2460908us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54002db754. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:41.647001 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.647054 (+    53us) raft_consensus.cc:1685] finished
0709 13:06:41.647072 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.647250 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":406432,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":103339,"spinlock_wait_cycles":1056866944,"thread_start_us":1088847,"threads_started":2,"wal-append.queue_time_us":837611,"wal-append.run_cpu_time_us":12803,"wal-append.run_wall_time_us":1659455}
W20260709 13:06:41.665311 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.677884 22175 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:41.678831 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 341) took 1525 ms. Trace:
I20260709 13:06:41.679399 22175 rpcz_store.cc:276] 0709 13:06:40.152891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.640883 (+1487992us) service_pool.cc:224] Handling call
0709 13:06:41.677640 (+ 36757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.678487 (+   847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.678734 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:41.681838 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.693692 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:41.643535 24853 raft_consensus.cc:3055] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:41.638002 24704 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:41.531109 24454 consensus_queue.cc:237] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.694561 22102 raft_consensus.cc:2393] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:06:41.719308 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.615161 24737 consensus_queue.cc:1059] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:06:41.722566 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:41.721076 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1600) took 2325 ms. Trace:
W20260709 13:06:41.724632 22218 connection.cc:256] RPC call timeout handler was delayed by -2.8800575370000843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 13:06:41.725111 22218 connection.cc:256] RPC call timeout handler was delayed by -2.8044575370000757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
W20260709 13:06:41.725425 22218 connection.cc:256] RPC call timeout handler was delayed by -2.3454575370000157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 13:06:41.725729 22218 connection.cc:256] RPC call timeout handler was delayed by -1.9494575370000575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25670000000000004s for a response
W20260709 13:06:41.726012 22218 connection.cc:256] RPC call timeout handler was delayed by -1.3815575370000488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31980000000000003s for a response
I20260709 13:06:41.727890 22218 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:41.723512 22180 rpcz_store.cc:276] 0709 13:06:39.395414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.026972 (+1631558us) service_pool.cc:224] Handling call
0709 13:06:41.035366 (+  8394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.035737 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.035764 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.039269 (+  3505us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.143307 (+104038us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:41.143349 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.143412 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.497170 (+353758us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:41.720704 (+223534us) raft_consensus.cc:1685] finished
0709 13:06:41.720735 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.720994 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":284,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":2552,"spinlock_wait_cycles":11701504,"thread_start_us":34630,"threads_started":1,"wal-append.queue_time_us":137430}
I20260709 13:06:41.666222 24783 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:41.737531 22175 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:41.647221 24758 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
W20260709 13:06:41.748600 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.705657 24853 raft_consensus.cc:740] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:41.659631 24836 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:06:41.763042 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.785833 22180 raft_consensus.cc:1240] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:41.731743 22176 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
W20260709 13:06:41.788305 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.665536 24733 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.734835 24752 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.732240 24759 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:41.807226 24759 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:41.809307 24759 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:41.733538 24732 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.810077 24732 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:41.811398 24904 log.cc:927] Time spent T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:06:41.812295 24732 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:41.815163 24758 consensus_queue.cc:1243] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:41.704468 24805 consensus_queue.cc:1059] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:06:41.820129 22781 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:41.822063 22781 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:41.823871 24758 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:41.824275 24758 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:41.824180 24806 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:41.824898 24758 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:41.798578 22175 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:41.806274 24752 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:41.828855 22104 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:06:41.828985 22147 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:41.832369 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.832866 22104 pending_rounds.cc:85] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 4
I20260709 13:06:41.833159 22104 pending_rounds.cc:107] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:06:41.833371 22104 raft_consensus.cc:2889] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:41.834659 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:41.833885 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.835676 22102 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:41.839963 22253 raft_consensus.cc:1275] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:41.837695 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.842025 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:41.842715 22102 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:41.849613 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:41.850193 22099 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:41.761997 24714 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:06:41.854771 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.849409 24838 consensus_queue.cc:1048] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:06:41.850160 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.853111 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:41.853006 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:41.860529 22098 raft_consensus.cc:2393] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:41.861308 22104 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:41.840154 24815 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:41.872750 24898 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.491s	user 0.008s	sys 0.002s
I20260709 13:06:41.799307 24849 consensus_queue.cc:1048] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:06:41.876008 24843 raft_consensus.cc:3055] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:41.876622 24843 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:41.877722 24843 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.844262 24783 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:41.886004 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 253515us
I20260709 13:06:41.887442 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:41.865530 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:41.894456 22782 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:41.882403 24429 raft_consensus.cc:697] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:41.886161 24815 raft_consensus.cc:697] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:41.909310 22782 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:41.901482 24732 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:06:41.915243 22782 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:41.884721 24783 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:41.906466 24843 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.921505 24429 consensus_queue.cc:237] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.933314 22102 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:06:41.923344 24837 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:41.923650 24705 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:41.925076 24748 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:41.927109 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.926601 24815 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:41.929447 22251 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:06:41.866129 24853 consensus_queue.cc:260] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:41.936542 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:41.912793 24745 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:41.905396 22100 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:41.917559 24824 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.955017 22247 raft_consensus.cc:2410] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:41.960585 22099 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
W20260709 13:06:41.954825 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 207127us
I20260709 13:06:41.964902 24714 consensus_queue.cc:1059] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:41.965945 24749 raft_consensus.cc:3055] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:41.966355 24749 raft_consensus.cc:740] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:41.999394 22218 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:41.955359 24553 consensus_meta.cc:287] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.006s
I20260709 13:06:42.000928 24553 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:42.001935 22101 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:06:42.003587 24853 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:42.003983 22782 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:42.005604 24813 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:42.006508 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.011201 24733 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:42.011858 24733 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:41.959635 24837 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:41.998958 24745 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.030198 22814 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.040351 22814 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:42.050618 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 51291.9us
I20260709 13:06:41.954876 24465 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.052786 22218 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:42.081682 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1908) took 1081 ms. Trace:
I20260709 13:06:42.082266 22255 rpcz_store.cc:276] 0709 13:06:41.000104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.496554 (+496450us) service_pool.cc:224] Handling call
0709 13:06:41.538226 (+ 41672us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.576337 (+ 38111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.576366 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.578058 (+  1692us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.751723 (+173665us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:42.080923 (+329200us) log.cc:844] Serialized 14 byte log entry
0709 13:06:42.081191 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.081374 (+   183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.081426 (+    52us) raft_consensus.cc:1685] finished
0709 13:06:42.081443 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.081607 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13117,"prepare.queue_time_us":280158,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":13515,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":120,"thread_start_us":456575,"threads_started":2,"wal-append.queue_time_us":261300}
I20260709 13:06:42.029503 24752 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:41.996692 24824 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:42.087078 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 301186us
I20260709 13:06:42.087777 22103 raft_consensus.cc:2393] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:42.051544 24806 raft_consensus.cc:2764] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:06:42.100773 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:42.109998 22178 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:42.111191 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:42.111912 22178 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:42.117349 22144 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:42.077145 24916 consensus_queue.cc:1048] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 13:06:42.130977 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.138645 22144 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:42.085225 24865 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:42.151072 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 98343.4us
I20260709 13:06:42.153154 22218 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:42.155125 22218 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:42.061949 24745 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.132344 24752 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:42.138867 24908 log.cc:927] Time spent T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:42.160822 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:42.084918 24759 consensus_queue.cc:1048] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:06:42.140873 24815 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:42.174115 24824 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:42.175005 24912 log.cc:927] Time spent T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:06:42.169430 24932 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:06:42.175974 24915 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:42.166096 24819 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:42.193084 24698 consensus_meta.cc:287] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.000s
I20260709 13:06:42.152042 24737 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:42.151711 24838 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:06:42.201748 24841 consensus_queue.cc:260] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.206585 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:42.223834 24834 consensus_meta.cc:287] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.586s	user 0.005s	sys 0.005s
I20260709 13:06:42.211994 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:42.190181 24831 consensus_meta.cc:287] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.002s
W20260709 13:06:42.222389 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 81976.6us
I20260709 13:06:42.188985 22178 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
W20260709 13:06:42.210621 24640 consensus_meta.cc:287] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.647s	user 0.013s	sys 0.000s
I20260709 13:06:42.143592 24725 consensus_queue.cc:1059] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
W20260709 13:06:42.208724 24814 consensus_meta.cc:287] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.000s
W20260709 13:06:42.211027 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 50318.1us
I20260709 13:06:42.233960 22172 raft_consensus.cc:2410] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:42.255810 22218 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:42.256942 22218 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:42.203343 24758 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.231974 24819 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:42.251861 22175 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:42.253677 22180 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:42.252828 22144 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:42.225044 24940 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:42.250298 22179 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 9. Ops: [7.8-7.8]
I20260709 13:06:42.251834 22781 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:42.232875 24733 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:42.261215 22178 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:42.271684 24758 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:42.276376 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:42.278589 24882 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:42.261395 24938 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:42.279332 24938 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:42.279697 24938 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:42.280354 24745 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:42.281252 24465 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:42.260243 24814 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9.
I20260709 13:06:42.262892 24932 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:42.288318 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:42.289743 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:42.290395 22072 leader_election.cc:336] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.940s (SENT)
I20260709 13:06:42.291317 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:42.291584 22072 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:42.292526 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:42.293438 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:42.294615 22253 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:42.299526 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:42.294592 22252 raft_consensus.cc:2376] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7. Re-sending same reply.
I20260709 13:06:42.252140 24831 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.249226 24834 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.307929 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:42.263887 24819 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.268959 24940 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.303573 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:42.307246 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:42.308050 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:42.308928 22175 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:42.304894 22072 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:42.269572 24841 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:42.310132 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:42.306583 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 53840.3us
I20260709 13:06:42.317823 22250 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:42.318478 22144 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:42.318691 22173 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:42.319594 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:42.311086 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:42.311334 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:42.310124 24640 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:42.316154 22253 raft_consensus.cc:2393] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:42.309722 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:42.298740 24732 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:42.317642 24940 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.322036 24732 raft_consensus.cc:697] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:42.323506 22180 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:42.323884 24732 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.320510 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:42.309144 24824 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:42.320894 24820 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.328874 24698 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.330466 22180 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:42.307297 24827 consensus_meta.cc:287] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.649s	user 0.012s	sys 0.000s
I20260709 13:06:42.331277 24827 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:42.332062 22144 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:06:42.332774 24893 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 1.088s	user 0.002s	sys 0.006s
I20260709 13:06:42.332872 24838 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:42.333472 24838 raft_consensus.cc:697] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:42.334499 24838 consensus_queue.cc:237] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.307475 24465 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:06:42.321211 22246 raft_consensus.cc:3055] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:42.340085 22246 raft_consensus.cc:740] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:42.319099 22072 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:42.333505 24827 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:42.335600 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 387) took 1121 ms. Trace:
I20260709 13:06:42.331286 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 1947) took 1032 ms. Trace:
I20260709 13:06:42.340561 22144 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:42.341010 22179 rpcz_store.cc:276] 0709 13:06:41.299282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.243619 (+944337us) service_pool.cc:224] Handling call
0709 13:06:42.250080 (+  6461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.264626 (+ 14546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.331108 (+ 66482us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b54001766d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:42.331229 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13985536}
I20260709 13:06:42.340850 22809 rpcz_store.cc:276] 0709 13:06:41.214593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.214747 (+   154us) service_pool.cc:224] Handling call
0709 13:06:41.215199 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.215666 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.215706 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.216207 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.244228 (+ 28021us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:41.244290 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.244380 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.332209 (+1087829us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:42.335315 (+  3106us) raft_consensus.cc:1685] finished
0709 13:06:42.335333 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.335544 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3731,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4038,"spinlock_wait_cycles":3998976,"thread_start_us":27544,"threads_started":1,"wal-append.queue_time_us":27933}
I20260709 13:06:42.345408 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:42.346763 22072 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:42.348794 22099 raft_consensus.cc:1275] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:42.348800 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:42.349280 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:42.350468 22220 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:42.338616 24640 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.351538 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:42.352013 22220 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:42.352190 22097 raft_consensus.cc:2376] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8. Re-sending same reply.
I20260709 13:06:42.353910 22220 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:42.352753 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:42.354692 22179 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.353219 24820 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.355564 24945 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.335052 24584 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:42.359218 22782 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:42.361951 22815 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:42.362993 24584 raft_consensus.cc:697] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:42.356614 24749 consensus_queue.cc:260] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:42.363045 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:57840 (request call id 12) took 1536 ms. Trace:
I20260709 13:06:42.364034 24584 consensus_queue.cc:237] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:42.364914 22181 rpcz_store.cc:276] 0709 13:06:40.826883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.344360 (+1517477us) service_pool.cc:224] Handling call
0709 13:06:42.362955 (+ 18595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.364104 24749 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.366331 24947 consensus_queue.cc:1048] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:06:42.368124 24916 consensus_queue.cc:1048] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:42.368691 24759 consensus_queue.cc:1048] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:42.360850 24714 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.360553 24820 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:42.369697 24865 consensus_queue.cc:1059] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:42.370385 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:42.400473 22100 raft_consensus.cc:2410] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:42.354622 22246 consensus_queue.cc:260] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.401679 22246 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.403373 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:42.403960 22255 raft_consensus.cc:2376] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7. Re-sending same reply.
I20260709 13:06:42.404153 24469 raft_consensus.cc:3055] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:42.404587 24469 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:42.404680 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1602) took 2963 ms. Trace:
I20260709 13:06:42.405424 24469 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.406565 24469 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:42.391475 24456 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:42.407802 24752 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.395887 24429 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:06:42.408411 24941 log.cc:927] Time spent T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260709 13:06:42.408598 24429 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.353696 24944 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:42.411336 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1917) took 1357 ms. Trace:
I20260709 13:06:42.411605 24944 raft_consensus.cc:697] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:42.411706 22251 rpcz_store.cc:276] 0709 13:06:41.053574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.498090 (+444516us) service_pool.cc:224] Handling call
0709 13:06:41.929128 (+431038us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.952691 (+ 23563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.411141 (+458450us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54002cbad0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:42.411280 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891723520}
I20260709 13:06:42.412587 24944 consensus_queue.cc:237] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:42.405925 24940 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.417613 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:42.397926 22144 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:42.353066 24640 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:42.352246 24815 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:42.425431 22246 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:42.425837 22248 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:42.421521 22179 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:42.421674 22144 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:42.419051 24837 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.428352 24783 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:42.429687 24834 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:42.405086 22177 rpcz_store.cc:276] 0709 13:06:39.440908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.027341 (+1586433us) service_pool.cc:224] Handling call
0709 13:06:41.031508 (+  4167us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:41.146145 (+114637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.146177 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:41.149757 (+  3580us) log.cc:844] Serialized 52 byte log entry
0709 13:06:41.249052 (+ 99295us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:41.249183 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.388317 (+1139134us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400302854. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:42.388387 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.388447 (+    60us) raft_consensus.cc:1685] finished
0709 13:06:42.388466 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.404625 (+ 16159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4049,"raft.queue_time_us":2483,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":3032,"spinlock_wait_cycles":257240320,"thread_start_us":57397,"threads_started":1,"wal-append.queue_time_us":97628,"wal-append.run_cpu_time_us":1640,"wal-append.run_wall_time_us":1001825}
W20260709 13:06:42.432976 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 73672.9us
I20260709 13:06:42.433863 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:42.410715 24429 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:42.436307 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:42.334882 24938 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.353259 24932 consensus_queue.cc:1059] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:06:42.398612 24732 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:42.402848 24749 raft_consensus.cc:3055] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:42.444708 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:42.435631 24748 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:42.447500 22220 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:42.424124 24815 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:42.452355 22253 raft_consensus.cc:1240] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:42.437769 24947 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.459314 22248 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:42.439153 24465 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:42.441964 24732 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.438230 24745 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:06:42.446272 24749 raft_consensus.cc:740] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:42.469532 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:42.472311 22248 raft_consensus.cc:2410] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:42.457885 24815 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:42.456687 24752 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:42.473053 24752 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.473425 24752 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.480224 24752 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:42.482671 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.482820 22101 raft_consensus.cc:1275] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:42.483520 24752 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:42.483045 24815 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:42.484889 24584 consensus_queue.cc:1048] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:42.485487 24815 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:42.487313 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:42.488085 22101 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:42.460707 24940 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:42.460845 24748 raft_consensus.cc:697] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:42.468544 24732 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:42.451682 24916 consensus_queue.cc:1059] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:06:42.456528 24714 consensus_queue.cc:1059] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:06:42.519591 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.519928 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1492) took 1282 ms. Trace:
I20260709 13:06:42.521032 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:42.521697 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:42.520279 22106 rpcz_store.cc:276] 0709 13:06:41.237759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.258003 (+ 20244us) service_pool.cc:224] Handling call
0709 13:06:41.631638 (+373635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.632764 (+  1126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.519736 (+886972us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b540040f6d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:42.519876 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":828849920}
I20260709 13:06:42.525173 22099 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:42.526113 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:42.526949 22099 raft_consensus.cc:2393] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:42.526618 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:42.527820 22248 raft_consensus.cc:2410] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:42.532495 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:42.533355 22104 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:42.467782 24465 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:42.559412 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:42.569049 22098 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:42.571877 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:42.575107 22104 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:06:42.577929 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:42.578950 22809 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:42.525663 24820 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.488539 24819 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.530725 24940 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.648061 24833 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:42.648912 24833 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:42.652262 24938 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:42.653128 24938 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:42.655638 24942 log.cc:927] Time spent T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.328s	user 0.002s	sys 0.000s
I20260709 13:06:42.660529 24916 consensus_queue.cc:1243] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:42.661314 24916 raft_consensus.cc:3055] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:42.661738 24916 raft_consensus.cc:740] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:42.668982 24865 raft_consensus.cc:3055] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:42.669575 24865 raft_consensus.cc:740] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:42.576830 24834 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:06:42.672326 22106 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:42.673329 24749 consensus_queue.cc:260] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:42.674067 24834 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.676337 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:42.645176 22248 raft_consensus.cc:2393] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 4: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:42.535091 24837 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.681740 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:42.690516 22253 raft_consensus.cc:2393] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:06:42.644502 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 61903.9us
W20260709 13:06:42.704159 22172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1616) took 1411 ms (client timeout 1795 ms). Trace:
W20260709 13:06:42.704751 22172 rpcz_store.cc:269] 0709 13:06:41.284643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.485101 (+200458us) service_pool.cc:224] Handling call
0709 13:06:42.677837 (+1192736us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b5400328cd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:42.695526 (+ 17689us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718917888}
I20260709 13:06:42.710328 22254 raft_consensus.cc:1240] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:42.710565 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:42.711393 22246 raft_consensus.cc:2393] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:42.712443 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:42.713462 22253 raft_consensus.cc:2393] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:42.714179 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:42.675259 24831 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:42.688382 24882 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:06:42.754908 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 43548us
I20260709 13:06:42.757705 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:42.763404 22218 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:42.763592 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:42.599152 24843 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 13:06:42.703341 24749 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:42.764971 22218 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:42.775760 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1607) took 3089 ms. Trace:
I20260709 13:06:42.776206 22173 rpcz_store.cc:276] 0709 13:06:39.686687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.588192 (+1901505us) service_pool.cc:224] Handling call
0709 13:06:41.588631 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.319199 (+730568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.775483 (+456284us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b540028d054. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:42.775691 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1678524288}
W20260709 13:06:42.755779 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.703737 24725 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.674790 24834 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:42.770574 24958 log.cc:927] Time spent T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
I20260709 13:06:42.694931 24940 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.640029 24913 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.177s
W20260709 13:06:42.815615 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 122767us
I20260709 13:06:42.676429 24820 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:42.778968 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.662797 24916 consensus_queue.cc:260] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:42.827067 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 62159.9us
I20260709 13:06:42.706568 24837 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.747450 24745 consensus_queue.cc:1059] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
W20260709 13:06:42.849915 22180 consensus_meta.cc:287] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
I20260709 13:06:42.858341 22180 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:42.863128 22815 raft_consensus.cc:1240] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:42.864651 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:42.767160 24882 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:42.874747 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 221532us
I20260709 13:06:42.829679 24725 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.880570 24827 consensus_queue.cc:1059] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:42.881713 24827 raft_consensus.cc:3055] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.882026 24833 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:42.882121 24827 raft_consensus.cc:740] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:42.883385 24827 consensus_queue.cc:260] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.884907 24827 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.711616 24748 consensus_queue.cc:237] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:42.894095 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.824929 24454 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:06:42.866758 24465 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:42.831135 24752 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:06:42.876466 24916 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:42.757603 24865 consensus_queue.cc:260] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:42.928398 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 45703.6us
I20260709 13:06:42.933483 22101 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:42.934638 22099 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:06:42.908463 24945 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:42.939594 24944 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:42.940380 24944 raft_consensus.cc:697] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:42.940821 24820 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:42.941521 24944 consensus_queue.cc:237] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:42.943362 24819 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:42.943529 24955 log.cc:927] Time spent T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:06:42.945938 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 340) took 2793 ms. Trace:
I20260709 13:06:42.947121 22174 rpcz_store.cc:276] 0709 13:06:40.152666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.636808 (+1484142us) service_pool.cc:224] Handling call
0709 13:06:41.686500 (+ 49692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.706952 (+ 20452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.707002 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.372726 (+665724us) spinlock_profiling.cc:243] Waited 43.9 ms on lock 0x7b2c00040298. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6857372 00007f66a7f89a01 00007f66a7f4e43a 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2
0709 13:06:42.373161 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:06:42.458720 (+ 85559us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:42.458753 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.458813 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.945570 (+486757us) raft_consensus.cc:1685] finished
0709 13:06:42.945590 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.945848 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19357,"raft.queue_time_us":32876,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8189,"spinlock_wait_cycles":100943616,"thread_start_us":85117,"threads_started":1,"wal-append.queue_time_us":204265}
I20260709 13:06:42.946290 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 454) took 1389 ms. Trace:
I20260709 13:06:42.908659 24714 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.949404 22249 rpcz_store.cc:276] 0709 13:06:41.557405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.568522 (+ 11117us) service_pool.cc:224] Handling call
0709 13:06:41.568989 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.844872 (+275883us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:42.048419 (+203547us) log.cc:844] Serialized 14 byte log entry
0709 13:06:42.113064 (+ 64645us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.113111 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:42.113160 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.946048 (+832888us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54002dcb54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:42.946100 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.946229 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10095,"prepare.queue_time_us":187458,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":26,"raft.queue_time_us":13893,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":50,"spinlock_wait_cycles":633939200,"thread_start_us":257287,"threads_started":2,"wal-append.queue_time_us":54556}
I20260709 13:06:42.954473 24910 raft_consensus.cc:3055] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:42.945431 24962 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:42.965118 24841 consensus_meta.cc:287] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.626s	user 0.005s	sys 0.005s
I20260709 13:06:42.962342 24865 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:42.978601 22815 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:06:42.982527 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 467974us
W20260709 13:06:42.993292 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 456798us
I20260709 13:06:42.975641 24910 raft_consensus.cc:740] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:43.006986 22174 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:42.998485 22779 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:43.003319 24940 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:43.011173 24957 log.cc:927] Time spent T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 13:06:43.013510 24963 log.cc:927] Time spent T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:06:43.011483 24837 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:43.014585 24966 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:43.039894 24882 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:43.016670 24818 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.034890 22779 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:43.045970 22781 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:43.049613 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.050218 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.010536 24962 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 13:06:43.053159 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 188625us
I20260709 13:06:43.054459 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:43.048921 24951 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.056809 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:43.064821 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:43.051635 24814 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.070677 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:43.073952 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet ee2b1eeb3bb341638b56bf74c37e2045: Illegal state: Replica 79683575881f4334bd4dc6d9bdbb45c3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:43.055460 24966 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:43.069231 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:43.049863 24837 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 13:06:43.083729 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 68574.4us
I20260709 13:06:43.077152 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:43.033885 24910 consensus_queue.cc:260] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:43.092538 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.100515 22250 raft_consensus.cc:1275] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:43.051832 24818 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:43.062436 24951 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.085196 24814 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.089179 22247 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:43.130589 24814 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:43.118976 22072 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:43.119311 24972 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:06:43.131470 24972 consensus_queue.cc:1243] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer a07ca3d1b5b84f4bbcb907f709a69275 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:06:43.093962 24469 consensus_meta.cc:287] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.669s	user 0.012s	sys 0.000s
I20260709 13:06:43.119410 24910 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.129925 24837 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
W20260709 13:06:43.134321 24640 consensus_meta.cc:287] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.697s	user 0.007s	sys 0.001s
I20260709 13:06:43.077636 24940 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:43.135700 24983 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.136248 24983 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:43.138306 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:43.138513 24983 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:43.140446 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:43.140568 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:43.141158 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:43.141625 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:43.142519 24967 log.cc:927] Time spent T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:06:43.142861 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.145291 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:43.150681 22180 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:06:43.150017 22181 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:43.153841 22255 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:43.157877 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:43.159999 22179 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:43.160653 22220 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:43.164149 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 129358us
I20260709 13:06:43.166260 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:43.167490 22812 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:43.098248 24732 consensus_meta.cc:287] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.574s	user 0.006s	sys 0.001s
I20260709 13:06:43.161092 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:43.173483 22175 raft_consensus.cc:2393] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:43.173842 22179 raft_consensus.cc:2410] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:43.147423 24977 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:43.183871 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.176061 22779 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:43.185300 22175 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:43.183293 22144 leader_election.cc:336] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Timed out: RequestConsensusVote RPC to 127.20.130.68:35973 timed out after 1.696s (SENT)
I20260709 13:06:43.189065 22144 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:43.077163 24975 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.194281 22179 raft_consensus.cc:1275] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:43.192343 22814 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:43.198740 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:43.134759 24640 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:43.202684 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:43.175287 24983 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:43.189505 24940 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.200752 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:43.191273 24732 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:43.212852 24903 log.cc:927] Time spent T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 1.494s	user 0.004s	sys 0.002s
I20260709 13:06:43.192781 24834 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:43.199123 24961 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.202891 24921 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:43.221333 22177 raft_consensus.cc:1240] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:06:43.185722 24837 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:06:43.205049 24945 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:43.224232 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 48264.4us
I20260709 13:06:43.230697 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:43.232681 22809 raft_consensus.cc:1240] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:43.233886 22249 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:43.247037 22812 raft_consensus.cc:2393] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:43.230237 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:43.217469 24975 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:43.250021 22814 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:43.204389 24749 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:06:43.218940 24964 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:43.249814 22808 raft_consensus.cc:2410] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:43.254323 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:43.205651 24759 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:06:43.201265 24977 consensus_queue.cc:1059] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:06:43.259948 22810 raft_consensus.cc:2410] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:43.251051 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:43.211118 24916 consensus_queue.cc:1059] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:06:43.228143 24939 raft_consensus.cc:3055] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:43.265285 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1591) took 1427 ms. Trace:
I20260709 13:06:43.265275 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:43.268846 22103 rpcz_store.cc:276] 0709 13:06:41.838345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.838475 (+   130us) service_pool.cc:224] Handling call
0709 13:06:43.265096 (+1426621us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54003e0654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:43.265228 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529346816}
I20260709 13:06:43.217093 24983 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:43.272117 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:43.271371 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:43.275058 22814 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
W20260709 13:06:43.274041 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 85341.4us
I20260709 13:06:43.220216 24940 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:43.258266 24749 consensus_queue.cc:1243] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer c0694f6572bf406a92d55f1f2ab46ef2 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:06:43.280138 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 77546.5us
I20260709 13:06:43.258953 24964 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:43.281049 24969 log.cc:927] Time spent T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:06:43.288838 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:43.272708 24939 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:43.293592 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 396) took 1996 ms. Trace:
I20260709 13:06:43.294001 22816 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:43.294778 22105 rpcz_store.cc:276] 0709 13:06:41.297300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.333637 (+ 36337us) service_pool.cc:224] Handling call
0709 13:06:41.333974 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.334326 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.334370 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.340249 (+  5879us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.497433 (+157184us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:41.497470 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.497532 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.197747 (+1700215us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:43.289358 (+ 91611us) raft_consensus.cc:1685] finished
0709 13:06:43.289381 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.293520 (+  4139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5669,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3397,"spinlock_wait_cycles":52917120,"thread_start_us":124808,"threads_started":1,"wal-append.queue_time_us":228537}
I20260709 13:06:43.296831 24714 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:43.331382 22816 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:43.289481 24964 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:43.332480 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 53545.7us
I20260709 13:06:43.333793 22253 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:43.285594 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:43.342309 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:43.336172 24737 raft_consensus.cc:3055] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:43.349357 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:43.352377 22816 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:43.344899 24698 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.359467 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:43.360037 22249 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
W20260709 13:06:43.361163 24991 log.cc:927] Time spent T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:06:43.358351 24939 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:43.362061 24939 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:43.363652 24987 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:43.351286 24737 raft_consensus.cc:740] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:43.365842 24990 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:06:43.366266 24819 consensus_queue.cc:1059] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:43.366314 24737 consensus_queue.cc:260] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:43.365415 24983 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:43.367422 24819 raft_consensus.cc:3055] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:43.367843 24819 raft_consensus.cc:740] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:43.369306 24998 consensus_queue.cc:1059] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:06:43.370297 24998 raft_consensus.cc:3055] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:43.370627 24998 raft_consensus.cc:740] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:43.371841 24988 log.cc:927] Time spent T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:06:43.371649 24998 consensus_queue.cc:260] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.373034 24998 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.375768 24732 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:43.374358 24759 consensus_queue.cc:1175] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "79683575881f4334bd4dc6d9bdbb45c3" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 5 index: 7 } }
I20260709 13:06:43.362334 24640 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:43.345177 24945 consensus_queue.cc:1059] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:06:43.340773 24977 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:06:43.382619 22815 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:43.382627 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:43.385260 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:43.381516 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:43.387581 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:43.388613 22144 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:43.391412 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:43.392835 22144 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:43.392361 24974 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.391124 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:43.394050 24841 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:43.394511 24841 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:43.394641 22808 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 5: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:43.394961 24841 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.377506 24698 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:43.398044 24698 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:43.398660 24983 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:43.390314 24584 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.394186 24974 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:43.401218 24974 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:43.402875 22144 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:43.405256 24584 consensus_queue.cc:1059] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:43.406190 24584 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:43.406548 24584 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.406869 24584 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.408068 24733 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:43.408567 24733 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:43.409171 24983 raft_consensus.cc:3055] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:43.409554 24983 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:43.410324 24983 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.411487 24983 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:43.403559 24640 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:43.417415 24725 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:43.420885 22811 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:06:43.421980 22816 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:43.368734 24819 consensus_queue.cc:260] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.423920 24819 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:43.429457 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 460) took 1175 ms. Trace:
I20260709 13:06:43.429883 22254 rpcz_store.cc:276] 0709 13:06:42.253974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.254123 (+   149us) service_pool.cc:224] Handling call
0709 13:06:42.260191 (+  6068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.710883 (+450692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.429222 (+718339us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b540023b754. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:43.429393 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034745088}
I20260709 13:06:43.432578 24841 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:43.433336 24949 log.cc:927] Time spent T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 1.097s	user 0.006s	sys 0.000s
I20260709 13:06:43.435860 24964 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.438683 24951 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:43.443493 24759 consensus_queue.cc:1059] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:43.444361 24759 raft_consensus.cc:3055] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:43.444708 24759 raft_consensus.cc:740] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:43.445552 24759 consensus_queue.cc:260] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:43.446290 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.446684 24759 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.447530 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:43.448174 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:43.449802 22177 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:43.455967 24940 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:43.461449 24584 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.464005 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:43.464450 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.465274 24584 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:43.462908 24841 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:43.466230 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:43.466825 22807 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.466900 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:43.467408 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:43.467828 22254 raft_consensus.cc:2410] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:43.467995 22248 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:43.468616 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:43.468860 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:43.468662 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:43.469259 22254 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.470316 22250 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:43.470391 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:43.469586 22248 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:43.438766 24964 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:43.477566 22254 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:43.479342 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:43.480283 22174 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:43.485839 24815 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.489107 24758 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.489805 24758 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:43.492228 22000 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40410 (request call id 194) took 17661 ms (client timeout 15000 ms). Trace:
I20260709 13:06:43.498463 24758 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:43.500360 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:43.501066 24981 log.cc:927] Time spent T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:06:43.501170 22249 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:43.502295 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:43.504549 22782 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:43.506880 22781 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:43.510391 22807 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:43.510232 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:43.511585 22218 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:43.512751 24972 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:43.513453 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 531802us
I20260709 13:06:43.513904 24983 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.514375 24983 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.515398 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:43.516083 24454 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:43.516521 22172 raft_consensus.cc:2410] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:06:43.520052 24983 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:43.520174 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:43.520773 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 401875us
I20260709 13:06:43.523149 24469 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:43.523819 24469 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:43.524348 24469 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:43.527169 24818 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:43.526757 24469 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:43.527592 22147 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:43.527729 24818 consensus_queue.cc:1059] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:43.523808 24584 consensus_queue.cc:1048] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:06:43.536841 24837 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:43.537326 24837 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.537464 22248 raft_consensus.cc:1240] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:06:43.537758 24837 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:43.538759 24737 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.541952 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:43.542526 22144 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:43.544184 22175 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:43.486645 24815 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.495246 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:43.544521 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:43.545110 22254 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:43.494544 22255 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:43.546406 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:43.496345 24843 consensus_queue.cc:1059] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:43.520850 22811 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:43.544170 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:43.549538 22810 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:43.492974 24916 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:43.515683 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.493413 22002 catalog_manager.cc:5697] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:43.552701 22815 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:43.551198 24838 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:43.555562 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:43.555855 24429 consensus_queue.cc:1059] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:06:43.556270 22180 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:43.556915 24843 raft_consensus.cc:3055] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:43.557289 24843 raft_consensus.cc:740] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:43.558457 24815 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:43.558149 24843 consensus_queue.cc:260] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.548157 24640 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:06:43.559569 24838 raft_consensus.cc:697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:43.559991 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.544157 24758 consensus_queue.cc:1059] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:06:43.560813 22177 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
W20260709 13:06:43.576414 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.618537 22100 raft_consensus.cc:1275] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:43.580021 24758 raft_consensus.cc:3055] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:43.586597 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:43.609567 22002 catalog_manager.cc:5697] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:43.644093 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:43.592659 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:43.643321 24758 raft_consensus.cc:740] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:43.564204 24916 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:43.605598 24731 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:43.562986 24975 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.647703 24731 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.648057 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:43.648618 24916 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:43.647049 24758 consensus_queue.cc:260] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.563527 24820 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:43.585325 22101 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:43.649606 24758 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.650120 24731 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:43.563438 24429 raft_consensus.cc:3055] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:43.650681 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:43.648906 22100 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:43.650903 24429 raft_consensus.cc:740] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:43.651458 22101 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:43.652819 22101 pending_rounds.cc:85] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 2
I20260709 13:06:43.700623 22101 pending_rounds.cc:107] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:06:43.712385 22101 raft_consensus.cc:2889] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:43.653831 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 126329us
I20260709 13:06:43.580924 24995 raft_consensus.cc:3055] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:43.563313 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:43.655158 24820 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:43.656098 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.660056 24819 consensus_queue.cc:1059] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:43.665576 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 115595us
W20260709 13:06:43.498291 22000 rpcz_store.cc:269] 0709 13:06:25.840566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.855914 (+ 15348us) service_pool.cc:224] Handling call
0709 13:06:43.492144 (+17636230us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:35.749366 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:35.750036 (+   670us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:35.750091 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:06:35.750114 (+    23us) tablet.cc:662] Decoding operations
0709 13:06:35.846452 (+ 96338us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:35.854517 (+  8065us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:35.867254 (+ 12737us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:06:36.282484 (+415230us) tablet.cc:701] Row locks acquired
0709 13:06:36.294986 (+ 12502us) write_op.cc:260] PREPARE: finished
0709 13:06:36.295300 (+   314us) write_op.cc:270] Start()
0709 13:06:36.295455 (+   155us) write_op.cc:276] Timestamp: P: 1783602396295216 usec, L: 0
0709 13:06:36.295472 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:06:36.296209 (+   737us) log.cc:844] Serialized 4367 byte log entry
0709 13:06:36.666408 (+370199us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a4e440ac 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b
0709 13:06:37.206687 (+540279us) op_driver.cc:464] REPLICATION: finished
0709 13:06:38.569170 (+1362483us) write_op.cc:301] APPLY: starting
0709 13:06:38.612922 (+ 43752us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:38.940806 (+327884us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:38.985990 (+ 45184us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:39.678438 (+692448us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:39.818599 (+140161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:06:39.834552 (+ 15953us) write_op.cc:312] APPLY: finished
0709 13:06:39.913393 (+ 78841us) log.cc:844] Serialized 83 byte log entry
0709 13:06:40.003918 (+ 90525us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:40.037000 (+ 33082us) write_op.cc:454] Released schema lock
0709 13:06:40.057147 (+ 20147us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:40.139996 (+ 82849us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:40.141644 (+  1648us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2537754,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":1205226,"apply.run_cpu_time_us":41073,"apply.run_wall_time_us":1561693,"num_ops":11,"prepare.queue_time_us":352841,"prepare.run_cpu_time_us":32125,"prepare.run_wall_time_us":1053423,"raft.queue_time_us":220987,"raft.run_cpu_time_us":88251,"raft.run_wall_time_us":1953951,"replication_time_us":853875,"spinlock_wait_cycles":23230720,"thread_start_us":2542268,"threads_started":5,"wal-append.queue_time_us":732052,"wal-append.run_cpu_time_us":44977,"wal-append.run_wall_time_us":2256650}]]}
I20260709 13:06:43.556190 24921 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.676501 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:43.654651 22106 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.751364 22180 raft_consensus.cc:2393] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:43.760948 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:43.689244 22254 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:43.671728 24783 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:43.664443 22220 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:43.648169 24975 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.652341 24429 consensus_queue.cc:260] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.645889 22002 catalog_manager.cc:5697] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 4, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 4 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.694710 22218 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:43.708019 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:43.709941 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:43.497370 24733 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:43.670096 22814 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:43.573725 24824 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.716737 22147 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:43.687631 24983 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:43.796537 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 79872.9us
I20260709 13:06:43.732919 24995 raft_consensus.cc:740] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:43.791987 22105 raft_consensus.cc:2393] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 5: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:43.750347 22144 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:43.792585 24913 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:43.800580 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 137435us
W20260709 13:06:43.800541 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 105952us
W20260709 13:06:43.802273 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 52010.2us
I20260709 13:06:43.828171 22144 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:43.711700 24731 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:06:43.801460 22218 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:43.839949 22106 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:43.846131 22218 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:43.854945 22100 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
W20260709 13:06:43.841042 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 265870us
I20260709 13:06:43.856686 22071 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:43.733933 24838 consensus_queue.cc:237] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:43.802861 24947 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:43.876758 22071 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:43.836465 24944 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:43.845685 25003 log.cc:927] Time spent T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:43.839536 24916 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:43.839414 24833 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:43.785924 24783 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.871210 24961 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:43.898887 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:43.841972 24983 raft_consensus.cc:697] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:43.884140 22218 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:43.802815 24824 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:43.884048 24947 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.899752 22105 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:43.858302 24815 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:06:43.891513 24882 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:43.883248 24640 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:43.875690 24749 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:43.882558 24972 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:43.890282 24916 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.843731 24429 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:43.928416 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 90104.6us
I20260709 13:06:43.944703 22097 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:43.931612 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 49340.2us
W20260709 13:06:43.931236 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 47171.2us
I20260709 13:06:43.895669 24944 raft_consensus.cc:697] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:43.899474 24961 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.878609 24938 consensus_queue.cc:1059] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 13:06:43.941287 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.901183 24833 raft_consensus.cc:697] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:43.893013 24759 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:06:43.948035 22218 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:43.933316 24947 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:43.900898 24454 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:06:43.960515 22002 catalog_manager.cc:5697] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 3, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 3 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:43.940317 24940 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:43.973330 25005 log.cc:927] Time spent T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:06:43.939507 24640 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.979733 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:43.939594 24749 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:43.952486 24916 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.942230 24731 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:43.890841 24995 consensus_queue.cc:260] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:43.954370 24961 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:43.994331 22002 catalog_manager.cc:5697] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 3, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 3 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:43.961019 24733 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:43.974578 24940 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.985563 24964 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:43.950963 24972 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:44.003942 25011 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:06:44.015951 22002 catalog_manager.cc:5697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 3 to 5, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 5 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:43.987174 24749 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.988565 24938 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:43.981213 24640 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:44.046980 22002 catalog_manager.cc:5697] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 4 to 5, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 5 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.015288 24940 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:44.059518 25016 log.cc:927] Time spent T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:06:44.063860 24938 raft_consensus.cc:697] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:44.064136 25012 log.cc:927] Time spent T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.134s	user 0.002s	sys 0.000s
I20260709 13:06:44.064845 24938 consensus_queue.cc:237] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.067171 25013 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:44.069487 25013 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:06:44.071153 25014 log.cc:927] Time spent T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:06:44.073093 25015 log.cc:927] Time spent T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:06:44.060577 24972 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:44.076082 24783 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:44.076856 25010 log.cc:927] Time spent T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:06:44.014679 24820 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:44.081988 24940 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.056823 24833 consensus_queue.cc:237] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.089278 24640 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.093012 22097 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:44.121953 24983 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:44.095453 25004 log.cc:927] Time spent T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
W20260709 13:06:44.095553 24737 consensus_meta.cc:287] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.000s
I20260709 13:06:44.097048 24843 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:44.137244 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.114122 24640 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:44.139338 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:44.139712 22808 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:44.094605 24944 consensus_queue.cc:237] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:44.100921 24837 consensus_meta.cc:287] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 13:06:44.143419 24837 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:44.123903 25008 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:06:44.024689 24995 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:44.125404 25007 log.cc:927] Time spent T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
W20260709 13:06:44.136782 22070 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.010s	sys 0.011s
W20260709 13:06:44.146639 22070 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.010s	sys 0.011s
W20260709 13:06:44.147249 24748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.001s	sys 0.000s
I20260709 13:06:44.106856 24940 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:44.147738 24748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.001s	sys 0.001s
I20260709 13:06:44.149600 22816 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:06:44.102425 24824 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:44.143868 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:44.150466 22172 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
W20260709 13:06:44.144382 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 255399us
I20260709 13:06:44.152683 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:44.152876 24837 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:44.153322 22105 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:44.155303 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:44.156494 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:44.156975 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:44.137221 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 173769us
I20260709 13:06:44.158123 22071 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:44.158135 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:44.160085 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:44.160667 22104 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:44.161854 24882 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:44.164446 24640 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:44.164809 24882 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:44.165107 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:44.166002 22103 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 4.
I20260709 13:06:44.166121 24853 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:44.165385 24882 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:44.166731 24815 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.165171 24640 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.167562 24815 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.166816 24853 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.170055 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:44.162729 22100 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:44.172017 22781 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:44.173136 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:44.173883 22103 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.181887 24640 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:44.166889 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:44.185567 22099 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:44.163888 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:44.186805 24815 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:44.187247 22102 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:44.187250 22099 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:06:44.190220 24758 consensus_meta.cc:287] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260709 13:06:44.186472 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:44.191157 22812 raft_consensus.cc:2410] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:44.185591 22104 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:44.196956 24853 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:44.162773 24932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.449s	user 0.004s	sys 0.023s
W20260709 13:06:44.198674 22072 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.030s	sys 0.083s
W20260709 13:06:44.201149 22072 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.031s	sys 0.084s
I20260709 13:06:44.161679 22218 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:44.205988 24940 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:44.208910 24737 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.209432 24737 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.164228 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:44.210740 25023 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:44.211730 22105 raft_consensus.cc:2393] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:44.212838 22815 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:44.213621 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:44.218271 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 390161us
I20260709 13:06:44.193820 24731 raft_consensus.cc:697] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:44.269436 22102 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:44.270498 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:44.199473 24932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.492s	user 0.005s	sys 0.023s
W20260709 13:06:44.203367 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 680704us
I20260709 13:06:44.276925 22103 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:44.278362 22099 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:44.229261 24749 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:44.213886 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 52172.7us
I20260709 13:06:44.111959 22002 catalog_manager.cc:5697] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 3, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 3 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:44.245009 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.222119 24947 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.261747 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:44.283912 22810 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:44.284818 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:44.219496 24921 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:44.286795 22173 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:44.265985 22104 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:44.271502 22071 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:44.206537 24940 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.205931 24961 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.273305 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:44.275133 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:44.279102 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:44.323308 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:44.325331 22813 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:44.278911 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.111482 24975 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:44.263163 24640 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.297821 24731 consensus_queue.cc:237] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.288868 24732 consensus_queue.cc:1059] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 13:06:44.350469 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.327032 24759 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:44.347095 25027 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:44.347147 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 75863.6us
I20260709 13:06:44.362181 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:44.362879 22097 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:44.363058 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:44.348030 24947 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:44.327308 24940 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:44.345530 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 63085.7us
I20260709 13:06:44.347862 24737 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:44.281045 24944 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:44.379850 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:44.388262 22104 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:44.384222 22097 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:06:44.369907 22813 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
W20260709 13:06:44.395107 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 113979us
I20260709 13:06:44.389067 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:44.396863 22097 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:44.397083 22105 raft_consensus.cc:1240] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:06:44.374752 24824 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.341977 24882 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.373847 24815 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:44.387766 25030 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.407881 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:44.388144 25025 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.412412 22072 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:44.407119 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:44.414372 22072 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:44.408949 22097 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:44.415750 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:44.416244 24827 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:44.385622 24759 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.390386 24944 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.421036 24944 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:44.407817 24824 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.425436 24913 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.425908 24913 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:44.363940 24640 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.428434 22100 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:44.429967 24640 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:44.433668 22103 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:44.415256 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:44.435601 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:44.440064 22218 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:44.441164 22218 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:44.444820 22098 raft_consensus.cc:1240] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:44.448509 25027 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:44.449494 22105 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:06:44.449700 22072 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:44.452498 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:44.453975 24820 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:44.454272 25027 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.454517 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:44.455734 22072 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:44.472090 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.488188 22072 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:44.490489 24827 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:06:44.552222 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 59714.1us
I20260709 13:06:44.447978 24944 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:44.446991 24932 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:44.480230 24964 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:44.479362 24972 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:44.561128 22072 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:44.410897 24815 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.417034 25030 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:44.431438 25025 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:44.603192 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet 00e5bf29367f432285b4e873ecccea9e: Illegal state: Replica c0694f6572bf406a92d55f1f2ab46ef2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:44.560349 24932 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:44.584705 24806 raft_consensus.cc:3055] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:44.567374 24824 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:44.595422 25031 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:06:44.624358 25028 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.628015 24882 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:44.627784 24806 raft_consensus.cc:740] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:06:44.650045 25033 log.cc:927] Time spent T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:06:44.629783 24932 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.645259 24749 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:44.650128 24882 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:44.655175 24961 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:44.664361 24938 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.670986 25051 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 13:06:44.673358 25050 log.cc:927] Time spent T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.226s	user 0.001s	sys 0.001s
I20260709 13:06:44.669384 24749 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.697896 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1513) took 1106 ms. Trace:
I20260709 13:06:44.698450 22106 rpcz_store.cc:276] 0709 13:06:43.591421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.592326 (+   905us) service_pool.cc:224] Handling call
0709 13:06:44.697711 (+1105385us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b54003ffcd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:44.697834 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20246912}
W20260709 13:06:44.684633 24995 consensus_meta.cc:287] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
I20260709 13:06:44.683055 24820 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:44.707093 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.657688 25028 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.701386 24964 raft_consensus.cc:697] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:44.697813 24972 raft_consensus.cc:697] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:44.717563 25032 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.666599 24806 consensus_queue.cc:260] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.730945 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:44.732172 25049 log.cc:927] Time spent T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:44.732288 22813 raft_consensus.cc:2393] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 4: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:44.732700 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:44.733278 22814 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:44.731756 25032 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:44.709686 24759 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:44.717196 24995 raft_consensus.cc:3055] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:44.695061 24938 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.716295 24961 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.747699 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:44.749029 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:44.752312 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:44.704523 24749 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.756410 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:44.761143 22813 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 4.
I20260709 13:06:44.760097 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:44.760134 22814 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:44.742069 24995 raft_consensus.cc:740] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:44.742995 25020 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:44.743712 24983 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:44.751801 24815 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:44.753229 25036 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.753973 25068 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.766868 25030 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:44.755391 24806 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:44.756120 24944 raft_consensus.cc:697] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:44.754369 24961 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.799598 24938 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:44.781384 25053 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:06:44.801055 25032 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
W20260709 13:06:44.801411 25047 log.cc:927] Time spent T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:06:44.774572 24983 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.798075 25068 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.780098 25071 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:44.781435 24972 consensus_queue.cc:237] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.804136 25028 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:44.804682 25029 log.cc:927] Time spent T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.189s	user 0.002s	sys 0.000s
I20260709 13:06:44.807019 24940 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.816020 25071 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.818516 25023 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:44.818713 25068 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:44.807576 25052 log.cc:927] Time spent T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:06:44.819685 25071 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:44.808540 24916 consensus_meta.cc:287] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.804s	user 0.008s	sys 0.004s
I20260709 13:06:44.814191 24944 consensus_queue.cc:237] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.820402 24916 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:44.821165 25043 log.cc:927] Time spent T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:06:44.814339 24961 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:44.822427 24916 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:44.810563 24913 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.819101 25023 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:44.819769 25009 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.754s	user 0.003s	sys 0.000s
I20260709 13:06:44.808044 24749 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:44.821107 24983 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:44.773844 24964 consensus_queue.cc:237] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.781383 24995 consensus_queue.cc:260] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.780068 25025 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:44.824141 24932 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:44.834901 25019 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.883s	user 0.000s	sys 0.003s
I20260709 13:06:44.836426 24932 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:44.780479 25036 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.772217 25020 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.824088 24940 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:44.842093 25036 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:44.877928 22069 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:44.890959 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1516) took 1267 ms. Trace:
W20260709 13:06:44.893530 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 123835us
I20260709 13:06:44.893996 24940 consensus_queue.cc:1059] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:44.896087 22218 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:44.897570 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.900627 25024 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.898043 24913 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:44.888975 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 327743us
I20260709 13:06:44.901268 24820 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:44.917045 25031 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:44.917374 25023 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.917409 22072 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:44.906179 25073 log.cc:927] Time spent T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:06:44.891837 22101 rpcz_store.cc:276] 0709 13:06:43.622910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.652141 (+ 29231us) service_pool.cc:224] Handling call
0709 13:06:43.652565 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:43.751103 (+ 98538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.751154 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:43.751740 (+   586us) log.cc:844] Serialized 52 byte log entry
0709 13:06:43.878524 (+126784us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:43.878567 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.878636 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.834295 (+955659us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:44.889960 (+ 55665us) raft_consensus.cc:1685] finished
0709 13:06:44.890013 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.890603 (+   590us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17181,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":18107,"spinlock_wait_cycles":8626944,"thread_start_us":85284,"threads_started":1,"wal-append.queue_time_us":157098}
I20260709 13:06:44.913887 25024 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.917699 24820 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.900833 25020 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:44.934010 24964 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:44.926450 22072 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:44.925102 24820 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.934806 24964 raft_consensus.cc:697] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:44.925662 25031 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:44.965847 22072 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:44.967046 24932 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.968091 24932 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:44.968516 22072 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:44.969501 22815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35198 (request call id 794) took 1209 ms. Trace:
I20260709 13:06:44.970023 22815 rpcz_store.cc:276] 0709 13:06:43.760175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.760696 (+   521us) service_pool.cc:224] Handling call
0709 13:06:44.969029 (+1208333us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54002008d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:44.969240 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037598080}
I20260709 13:06:44.971393 25077 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.972158 22811 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:44.972476 25077 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:44.971447 25027 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:44.972994 22816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 400) took 1433 ms. Trace:
W20260709 13:06:44.980350 25006 log.cc:927] Time spent T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.917s	user 0.000s	sys 0.002s
I20260709 13:06:44.988793 25024 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:44.990551 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 788) took 1471 ms. Trace:
I20260709 13:06:44.990406 24964 consensus_queue.cc:237] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:44.991098 22807 rpcz_store.cc:276] 0709 13:06:43.519333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.637205 (+117872us) service_pool.cc:224] Handling call
0709 13:06:43.637645 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.892103 (+254458us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:43.892150 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.893373 (+  1223us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.208514 (+315141us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:44.208724 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.989751 (+781027us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54005c0b54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:44.989849 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.989951 (+   102us) raft_consensus.cc:1685] finished
0709 13:06:44.989970 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.990351 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4800,"raft.queue_time_us":76053,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":6537,"spinlock_wait_cycles":428488064,"thread_start_us":376962,"threads_started":2,"wal-append.queue_time_us":494523}
I20260709 13:06:44.962211 25023 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:44.977281 22816 rpcz_store.cc:276] 0709 13:06:43.539804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.549742 (+  9938us) service_pool.cc:224] Handling call
0709 13:06:43.550066 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:44.150074 (+600008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.972357 (+822283us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b5400625a54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:44.972800 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1377862912}
I20260709 13:06:44.996610 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:44.998029 22811 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:44.999991 24932 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:44.982689 24995 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:45.003003 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.004290 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:45.005061 22104 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:45.006565 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:45.008128 22254 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:45.009207 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:45.010134 22180 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:45.011603 22105 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:45.011677 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:45.027220 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:45.040500 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 69956.9us
I20260709 13:06:45.041711 22072 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:45.040627 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:45.045553 24944 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.045886 22071 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:45.046787 22072 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:45.046511 24944 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.051389 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:45.054076 22811 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:45.060250 24827 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:45.061043 22254 raft_consensus.cc:1240] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:45.061285 25069 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:45.061749 25069 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.062089 25069 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.063329 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1948) took 2352 ms. Trace:
W20260709 13:06:45.064756 22779 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.65:33421 timed out after 1.659s (SENT) [suppressed 23 similar messages]
I20260709 13:06:45.068717 25053 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.069542 25053 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:45.070387 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:45.071645 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:45.072198 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:45.045570 22218 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:45.073894 24962 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.074465 22218 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:45.076431 24932 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:45.077040 24932 raft_consensus.cc:697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:45.073134 22105 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.077421 24752 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:45.079206 24972 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:45.080076 24972 consensus_queue.cc:1243] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer a07ca3d1b5b84f4bbcb907f709a69275 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:45.080703 24916 raft_consensus.cc:3055] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:45.081138 24916 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:45.081259 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:45.081444 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.081861 22218 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:45.082437 24916 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.083321 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:45.084101 22248 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.084035 24916 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:45.086077 22144 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:06:45.083109 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.087636 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.088565 22253 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:45.089015 22782 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:45.089741 25020 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.097164 24913 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:45.097898 24913 raft_consensus.cc:697] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:45.097500 25020 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.082605 22255 raft_consensus.cc:2410] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:45.099274 24913 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.063854 22251 rpcz_store.cc:276] 0709 13:06:42.710473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.715111 (+  4638us) service_pool.cc:224] Handling call
0709 13:06:42.757024 (+ 41913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.757344 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:42.824303 (+ 66959us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.402672 (+578369us) spinlock_profiling.cc:243] Waited 998 us on lock 0x7b18003bbae0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee23a 00007f66a7f58a2a
0709 13:06:43.825955 (+423283us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.826221 (+   266us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.972438 (+146217us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b18003bbae0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:06:44.069270 (+ 96832us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b2c000ad588. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6857372 00007f66a7f89a01 00007f66a7f4e43a 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2
0709 13:06:44.069654 (+   384us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.069794 (+   140us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:44.070013 (+   219us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.260783 (+190770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.260923 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.978973 (+718050us) spinlock_profiling.cc:243] Waited 74.1 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:45.002978 (+ 24005us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b18003bbae0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:06:45.062792 (+ 59814us) raft_consensus.cc:1685] finished
0709 13:06:45.062823 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.063096 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21871,"prepare.queue_time_us":70083,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":167,"raft.queue_time_us":153560,"raft.run_cpu_time_us":525,"raft.run_wall_time_us":30878,"spinlock_wait_cycles":219152640,"thread_start_us":599600,"threads_started":2,"wal-append.queue_time_us":1224929}
W20260709 13:06:45.094902 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 48312.2us
W20260709 13:06:45.111986 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.116227 22069 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:45.118214 25065 raft_consensus.cc:2764] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:45.118839 25020 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:45.120265 24725 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:45.120827 24725 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:45.121299 24725 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.121829 24819 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:45.123373 24748 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:45.124169 24748 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:45.130427 22218 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:45.135699 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.136373 24944 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:45.136726 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 50966us
I20260709 13:06:45.078337 24932 consensus_queue.cc:237] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.054427 25027 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:45.135345 24853 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:45.087662 24429 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.094413 25053 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:45.090762 24966 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:45.155846 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 91250.1us
I20260709 13:06:45.157917 22072 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:45.157774 24429 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.163030 24853 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:45.163887 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 75105.3us
I20260709 13:06:45.164599 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:45.165386 22101 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:45.165575 22782 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:45.167693 25020 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:45.176090 22105 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:45.165783 24853 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:45.178853 22098 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.181317 24962 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.168664 25036 consensus_queue.cc:1059] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:06:45.182313 25036 raft_consensus.cc:3055] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:45.182655 25036 raft_consensus.cc:740] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:45.183004 22072 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:45.185393 22248 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:45.190114 22811 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:45.168936 24944 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:45.135416 24640 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:45.192659 22782 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:45.203329 22072 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:45.203651 25020 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:45.201720 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:45.212934 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:45.194068 24944 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.193113 24964 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:45.183760 25036 consensus_queue.cc:260] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.219563 22144 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:45.216274 25020 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:45.222792 24944 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.219342 24748 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:45.215011 25027 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:45.249729 22098 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:45.195292 24966 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.253095 24806 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:45.253806 24454 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:45.254264 24454 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:45.254704 24454 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.254844 24966 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:45.255764 24853 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:45.241783 24962 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:45.257083 24962 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.253046 25030 consensus_queue.cc:1059] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:06:45.259670 24962 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:45.259816 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 56725.3us
I20260709 13:06:45.256551 24964 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:45.215821 25069 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:45.243144 25020 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.264694 22815 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:45.265170 22782 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:45.250957 22102 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:45.256536 24853 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.241467 24820 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.227897 24640 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.242969 24973 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:45.252640 25077 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:45.252168 25053 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.275521 24966 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:45.287952 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 109812us
I20260709 13:06:45.288899 22144 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:45.291800 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 1.4671e+06us
I20260709 13:06:45.292618 24429 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:45.292906 25039 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:45.253032 24783 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:45.276762 25036 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.299081 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.313515 24818 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:45.315522 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.316399 22255 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
W20260709 13:06:45.316939 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 51707.8us
I20260709 13:06:45.321719 22218 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:45.323257 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.296070 24964 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:45.330253 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.301038 24966 raft_consensus.cc:697] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:45.342911 22248 raft_consensus.cc:2410] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:06:45.340317 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 46992.5us
I20260709 13:06:45.343829 22782 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:45.337378 24836 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.300678 24853 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.293609 25039 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.300105 25053 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.300133 24973 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:45.365291 22180 raft_consensus.cc:1275] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:06:45.375492 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 86762.3us
I20260709 13:06:45.365903 24836 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.349900 25023 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:45.372956 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:45.383769 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:45.384454 22175 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:45.369462 25088 log.cc:927] Time spent T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:06:45.367708 25048 log.cc:927] Time spent T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.762s	user 0.005s	sys 0.000s
I20260709 13:06:45.373102 24752 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:06:45.346669 24962 consensus_queue.cc:1059] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:06:45.375573 25069 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:45.369740 24819 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.374306 24916 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:45.395115 24916 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.379786 25023 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.395289 25077 consensus_queue.cc:1048] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:45.395785 25023 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.396251 24640 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:45.394937 22779 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:45.397912 24429 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:45.387343 24748 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:45.395591 24916 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.371841 25039 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:45.399260 24995 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:45.379948 24725 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:45.395565 24962 raft_consensus.cc:3055] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:45.400219 24819 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.394901 24983 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.426331 24983 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.428282 22144 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:45.429100 24983 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:45.423602 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 553) took 1158 ms. Trace:
I20260709 13:06:45.429765 24640 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:45.430105 22809 rpcz_store.cc:276] 0709 13:06:44.265308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.265413 (+   105us) service_pool.cc:224] Handling call
0709 13:06:44.265735 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.266104 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.266131 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.273121 (+  6990us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.363722 (+ 90601us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:44.363942 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.364053 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.324987 (+960934us) spinlock_profiling.cc:243] Waited 6.47 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:45.423014 (+ 98027us) raft_consensus.cc:1685] finished
0709 13:06:45.423036 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.423419 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3247,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":15597184,"thread_start_us":89168,"threads_started":1,"wal-append.queue_time_us":239519}
I20260709 13:06:45.419796 24962 raft_consensus.cc:740] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:45.433642 24962 consensus_queue.cc:260] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:45.424472 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:45.399180 24748 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:45.436910 24748 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:45.438138 24853 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:45.436061 24962 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.443835 25039 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:45.444327 24725 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:45.423875 24836 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:45.447685 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.448371 22248 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:45.452828 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.453879 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:45.454991 22173 raft_consensus.cc:2393] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 7: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:45.455466 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:45.453992 24966 consensus_queue.cc:237] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.456141 22181 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.456795 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:45.439616 24820 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:45.457778 24820 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:45.458338 24820 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:45.458698 22178 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:45.438665 24429 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:45.459899 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.462278 22253 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:45.460520 25053 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:45.472074 22254 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:45.455838 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:45.474800 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:45.475545 22807 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.476362 22177 raft_consensus.cc:2410] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:45.477114 24820 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:45.480089 25013 raft_consensus.cc:3055] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:45.480168 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:45.480509 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.480860 22254 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.481238 22253 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:45.480547 25013 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:45.486070 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:45.459542 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 86650us
I20260709 13:06:45.487514 22218 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:45.490756 24995 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:45.491070 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.495926 22181 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
W20260709 13:06:45.502974 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.491276 24995 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.510020 22175 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:45.511729 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:45.510977 22255 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:45.510413 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:45.511273 22247 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:45.510291 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:45.429811 24983 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:45.524251 22218 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:45.525840 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:45.526717 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:45.531091 22807 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:45.463653 24806 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:06:45.443328 24454 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:45.510241 24995 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.531138 22779 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:45.533295 22069 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:45.508164 24944 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.536813 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:45.537169 22247 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:45.537573 22106 raft_consensus.cc:2376] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9. Re-sending same reply.
W20260709 13:06:45.538157 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 47949.8us
I20260709 13:06:45.538412 22101 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:45.539090 22218 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:45.542752 22103 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:45.543941 22071 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:45.549880 22254 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:45.543437 25077 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:45.552626 22781 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:45.537962 25061 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:45.540809 25036 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:45.560497 22781 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:45.562777 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.563637 22254 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:45.550906 24752 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:45.564491 22177 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:45.554062 24783 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:45.559401 25077 raft_consensus.cc:697] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:45.576272 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 57579.5us
W20260709 13:06:45.573736 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 145617us
I20260709 13:06:45.566977 24752 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.574177 24783 raft_consensus.cc:697] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:45.587955 22779 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:45.590524 25036 raft_consensus.cc:2764] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:06:45.594705 24783 consensus_queue.cc:237] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:45.596742 25077 consensus_queue.cc:237] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.599049 24843 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:45.569109 24913 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:45.599100 25036 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:06:45.602754 24819 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.604198 25023 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.593298 25020 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.567555 25061 raft_consensus.cc:697] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:45.589376 22779 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:45.617455 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:45.618275 22254 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:45.619024 22144 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:45.540990 25013 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.623755 25013 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:45.629376 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.629678 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.630231 22250 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:45.630892 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.631181 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.631600 22246 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:45.631978 22250 raft_consensus.cc:2368] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8.
I20260709 13:06:45.632103 22253 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:45.632601 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.632771 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.633020 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.633392 22250 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:06:45.633615 22253 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:45.635414 22249 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:45.399433 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:45.574594 24944 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:45.606351 24752 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.605116 24819 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:45.651116 25069 consensus_queue.cc:1175] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "79683575881f4334bd4dc6d9bdbb45c3" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 8 } }
I20260709 13:06:45.654034 25020 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:45.660008 22250 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:45.660662 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:45.661557 22249 raft_consensus.cc:2368] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8.
I20260709 13:06:45.662256 24836 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:45.659565 25061 consensus_queue.cc:237] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:45.671669 22782 leader_election.cc:400] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8.
I20260709 13:06:45.672441 22782 leader_election.cc:403] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.631242 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.674628 25036 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.613380 24973 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:45.681617 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:45.682413 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 60943.7us
I20260709 13:06:45.704519 22254 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
W20260709 13:06:45.700634 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 158478us
I20260709 13:06:45.707368 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.709647 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:45.710186 25101 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.710541 22175 raft_consensus.cc:2393] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 7: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:45.711323 24818 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:45.707151 24983 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:06:45.712531 24454 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:45.708047 22246 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:45.715952 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:45.714193 24806 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:45.715691 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.736063 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:45.742846 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 153541us
I20260709 13:06:45.743312 22102 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:45.744114 22101 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:45.745796 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:45.748750 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:45.751917 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:45.722416 24916 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:45.759892 22807 raft_consensus.cc:2393] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:45.733731 24944 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:06:45.767284 22104 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:45.771227 22811 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:45.774212 22247 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:45.774350 22099 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:45.776806 22779 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:45.777932 22779 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:45.780223 22218 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:45.781675 24966 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:45.779994 25053 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.782742 25020 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:45.799783 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.804263 22255 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:45.787356 25067 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:45.794566 25077 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.806630 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.808683 22144 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:45.803800 25020 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.820578 25077 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:45.821239 25020 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.822295 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:45.822868 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 74651.6us
I20260709 13:06:45.823057 25077 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:45.824033 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.824136 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.798763 24966 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.797269 24806 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.831523 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:45.806766 25067 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.832687 25067 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.837438 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:45.838666 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:45.839133 22808 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.839371 24983 raft_consensus.cc:2764] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 13:06:45.843712 25102 log.cc:927] Time spent T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:06:45.844046 24916 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:45.847213 25106 log.cc:927] Time spent T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:06:45.848592 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.849185 22174 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:06:45.849558 22174 pending_rounds.cc:85] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 6
I20260709 13:06:45.849826 22174 pending_rounds.cc:107] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:06:45.850126 22174 raft_consensus.cc:2889] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:45.790001 24818 consensus_queue.cc:1059] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:06:45.852391 24818 raft_consensus.cc:3055] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:45.852751 24818 raft_consensus.cc:740] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:45.853627 24818 consensus_queue.cc:260] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:45.854809 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 52913.9us
I20260709 13:06:45.865844 22251 raft_consensus.cc:2393] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:45.866766 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:45.867590 22175 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.869618 24752 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:45.870517 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.871358 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.871693 22254 raft_consensus.cc:1240] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:06:45.871977 22253 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:45.872740 22072 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:45.874442 24806 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.866854 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:45.876279 24882 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:45.876673 24882 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:45.877077 24882 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.876799 24806 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:45.829736 24966 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.877586 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:45.878427 22180 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:45.871868 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:45.880108 22250 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.883728 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:45.889295 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.886598 22218 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:45.899760 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:45.900755 22102 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.892647 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:45.922571 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.883234 24818 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.926312 22178 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:45.927373 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:45.928103 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:45.932734 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:45.932987 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:45.903070 24995 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:45.937052 24995 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:45.911021 25104 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:06:45.939302 22072 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:45.858629 25020 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.902599 24944 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:45.939477 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:45.824261 25053 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:45.953090 22252 raft_consensus.cc:2393] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:45.951581 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:45.903995 24962 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:06:45.924547 25101 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:45.940564 24640 raft_consensus.cc:3055] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:45.971817 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:45.992650 22811 raft_consensus.cc:1240] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:45.967655 22173 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:45.997852 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 85502.9us
I20260709 13:06:45.998898 22072 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:46.011204 22248 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:45.953758 24944 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:46.016316 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:45.961055 24819 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.015363 22251 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:45.960443 25024 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:45.948717 24843 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:06:45.926569 24932 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 13:06:46.026012 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:46.004031 24972 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:45.999431 24640 raft_consensus.cc:740] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:46.053551 22174 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:46.040026 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:46.023859 25104 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.044267 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:46.021361 25089 log.cc:927] Time spent T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:46.069394 22177 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:06:46.055492 25065 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:46.072331 25104 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:46.073206 22147 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:46.075560 22248 raft_consensus.cc:1275] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:46.068578 22178 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:46.080660 25023 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:46.081809 25065 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:46.082275 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:46.082441 25065 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:46.082978 22101 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.078055 25101 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:46.087683 25101 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.088030 25101 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.087170 24752 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:46.089285 24640 consensus_queue.cc:260] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:46.090716 24640 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.074417 24983 consensus_queue.cc:1059] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:06:46.093912 24983 raft_consensus.cc:3055] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:46.094318 24983 raft_consensus.cc:740] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:46.095415 24983 consensus_queue.cc:260] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:46.097100 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:46.022241 24944 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:46.098460 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:46.054769 24819 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:46.019097 24995 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:06:45.997051 22175 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
W20260709 13:06:46.132804 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 134037us
I20260709 13:06:46.136464 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:46.143867 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 70753.4us
W20260709 13:06:46.145391 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 203188us
W20260709 13:06:46.155817 25112 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:06:46.156934 25053 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:46.157749 22072 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:46.157953 25020 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:46.221807 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:46.149233 24983 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:46.227807 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 70137.4us
W20260709 13:06:46.228562 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 224462us
I20260709 13:06:46.228071 22144 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:46.259120 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:46.259779 22175 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.269827 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:46.270602 22815 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:46.275218 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:46.253991 24916 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.279325 25013 consensus_meta.cc:287] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.655s	user 0.018s	sys 0.007s
I20260709 13:06:46.282729 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:46.285301 22072 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:46.289132 22253 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.292166 22173 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:46.239667 24820 consensus_queue.cc:1059] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:06:46.300311 22180 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:46.303844 22811 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:46.298609 22175 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
W20260709 13:06:46.309679 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 83121.1us
I20260709 13:06:46.280330 25065 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:46.312587 22147 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:46.319235 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:46.293057 25039 raft_consensus.cc:2764] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:46.320115 22178 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:46.321592 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:46.322744 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:46.296854 24973 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 13:06:46.324765 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet 5d3869ae617b42c89768d68043d44be2: Illegal state: Replica 765d912bde9e48959e50d9efec3c26b6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:46.324914 24836 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.325562 24836 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:46.327190 25120 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:46.337738 22180 raft_consensus.cc:1240] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:46.338001 22250 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:46.339100 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:46.339365 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:46.340070 25062 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:46.294309 25121 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:46.331262 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 57890.5us
W20260709 13:06:46.331668 25117 log.cc:927] Time spent T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:06:46.332036 25116 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.354287 25116 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:46.332605 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:46.324821 24973 consensus_queue.cc:1243] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:46.333282 22808 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:06:46.294456 24916 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:46.340612 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:46.345471 22098 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:06:46.345268 22218 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:46.339100 22147 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:46.348994 22101 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:46.349965 22175 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:46.283830 24995 consensus_queue.cc:1059] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 13:06:46.358150 25036 consensus_meta.cc:287] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.680s	user 0.016s	sys 0.000s
I20260709 13:06:46.358992 22072 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:46.323119 22815 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:46.361881 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:46.368561 22253 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:46.352903 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:46.394870 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 49716.6us
I20260709 13:06:46.399982 22178 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:46.404207 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 65256.4us
I20260709 13:06:46.405727 24836 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:46.406430 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:46.406636 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:46.407310 22097 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:06:46.408593 25067 consensus_meta.cc:287] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.575s	user 0.013s	sys 0.000s
I20260709 13:06:46.409281 22104 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:46.409132 25067 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:46.409822 25123 raft_consensus.cc:3055] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:46.410223 25123 raft_consensus.cc:740] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:46.412016 24818 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:46.411878 24944 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:46.412870 24818 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.413064 22173 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:46.413394 24818 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:46.414300 22173 raft_consensus.cc:1275] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:46.414630 24819 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:46.415252 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:46.415840 22181 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.403324 25134 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:46.417227 25134 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.417546 25134 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.419418 22176 raft_consensus.cc:2410] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:46.420148 24973 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:46.407065 22180 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:46.422706 22147 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:46.425457 22181 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:46.420583 24973 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:46.428288 22102 consensus_meta.cc:287] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.518s	user 0.013s	sys 0.000s
I20260709 13:06:46.430770 22102 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:46.359655 24820 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:46.429312 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:46.432683 22175 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:46.404842 25036 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8.
W20260709 13:06:46.438901 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 89434us
I20260709 13:06:46.423602 24995 consensus_queue.cc:1243] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer a07ca3d1b5b84f4bbcb907f709a69275 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:46.420456 25101 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:46.443313 22147 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:46.427695 25120 raft_consensus.cc:697] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:46.444329 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 131864us
I20260709 13:06:46.433712 25069 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:46.433478 24454 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:06:46.460179 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 99776.7us
I20260709 13:06:46.432550 24973 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.464360 22147 leader_election.cc:400] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8.
I20260709 13:06:46.438300 25116 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:46.367817 24966 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:46.465987 22147 leader_election.cc:403] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:46.459430 25067 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:46.471519 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:46.429982 25123 consensus_queue.cc:260] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:46.464031 22808 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:46.482858 22175 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:06:46.481958 22097 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:46.477996 22815 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:46.480728 22809 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:06:46.472052 24916 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:46.484653 22220 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:46.462144 24818 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:46.442559 24820 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:46.484316 25123 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:46.467078 25121 raft_consensus.cc:2764] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:46.493592 22147 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:46.474717 24454 raft_consensus.cc:697] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:46.497288 22218 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:46.499451 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 166943us
I20260709 13:06:46.508355 22220 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:46.509610 25125 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:46.511171 25121 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:46.496659 24818 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8.
I20260709 13:06:46.508349 22147 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:46.511662 25121 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:46.512076 25121 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.512388 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 417) took 1062 ms. Trace:
I20260709 13:06:46.508882 25104 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:46.512781 22098 rpcz_store.cc:276] 0709 13:06:45.483037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.485743 (+  2706us) service_pool.cc:224] Handling call
0709 13:06:46.512208 (+1026465us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b540042bb54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:46.512332 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861548416}
I20260709 13:06:46.509991 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:46.513581 22147 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:46.514099 22106 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:06:46.520217 24454 consensus_queue.cc:237] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:46.523172 25062 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.524014 25062 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:46.527240 22779 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:46.528479 25023 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:46.528986 25023 raft_consensus.cc:697] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:46.529693 24966 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:46.530112 24640 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:46.529872 25023 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:46.527447 25140 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:06:46.526511 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:46.532773 25101 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:46.540311 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:46.530576 24640 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.543396 24640 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:46.545812 22172 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:46.532696 25140 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:06:46.553894 25140 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:06:46.557895 25131 log.cc:927] Time spent T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:46.559365 25120 consensus_queue.cc:237] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:46.574689 22177 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:06:46.575487 22177 pending_rounds.cc:85] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 2
I20260709 13:06:46.575929 22177 pending_rounds.cc:107] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:46.576587 24820 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:46.576686 22177 raft_consensus.cc:2889] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:46.524475 24932 raft_consensus.cc:3055] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:46.581022 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:46.584309 22098 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:46.507759 25138 raft_consensus.cc:2764] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:46.495810 24972 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:46.584555 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 78399.8us
I20260709 13:06:46.554646 25140 raft_consensus.cc:697] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:46.586649 22178 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:46.586216 22779 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:46.608196 22180 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:06:46.526823 25062 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:46.490765 24827 consensus_queue.cc:1048] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:06:46.584065 24932 raft_consensus.cc:740] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:46.623613 25104 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:46.631407 24882 consensus_meta.cc:287] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.754s	user 0.010s	sys 0.014s
I20260709 13:06:46.631916 24882 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:46.632562 25134 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:46.635267 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 126972us
I20260709 13:06:46.636749 22220 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:46.635248 25134 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:46.639400 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 53862.5us
I20260709 13:06:46.640254 22218 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:46.634673 24882 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:46.643424 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:46.644814 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:46.645073 25140 consensus_queue.cc:237] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:46.645525 22072 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:46.646215 22248 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:46.646301 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:46.647185 25123 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:46.650171 25123 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:46.645761 22251 raft_consensus.cc:2410] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:46.652801 22072 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:46.654238 25123 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:46.606199 24966 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:46.656836 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:46.656697 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:46.657759 22178 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:46.659698 22249 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:46.660466 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:46.661170 22098 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:46.660475 22069 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:46.661365 22072 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:46.662995 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 149541us
W20260709 13:06:46.663453 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 155465us
I20260709 13:06:46.663959 22147 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:46.670333 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:46.683472 22252 raft_consensus.cc:2393] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:46.684746 22220 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:46.682869 22098 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:06:46.675596 22218 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:46.689690 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:46.612522 24964 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:06:46.661182 24966 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.695439 22807 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:46.667863 24882 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:46.697932 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:46.699457 22815 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.670650 24820 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:46.674274 25134 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:46.699205 24882 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:46.710556 24882 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.711818 25142 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:46.712307 25122 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.702030 22220 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:46.716100 22218 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:46.715060 24820 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:46.721697 24820 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:46.724110 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet 0232d828f8664f348df823432990379b: Illegal state: Replica c0694f6572bf406a92d55f1f2ab46ef2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:46.724931 25127 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:46.737566 22781 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:46.736179 22218 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:46.745146 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:46.747170 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:46.694674 24966 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.747790 22175 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
W20260709 13:06:46.749938 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 48030.2us
I20260709 13:06:46.754304 22177 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:46.693233 25125 raft_consensus.cc:697] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:46.716838 25142 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:46.726020 24962 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:46.726243 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:46.726372 25134 raft_consensus.cc:697] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:46.735313 24964 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:46.758237 25067 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:46.696554 25121 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:46.788821 24640 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:46.749189 25023 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:46.790135 22176 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:06:46.793749 25023 raft_consensus.cc:697] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:46.797312 25134 consensus_queue.cc:237] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:46.797380 25023 consensus_queue.cc:237] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:46.805996 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:46.776157 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:46.808094 22097 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
W20260709 13:06:46.815421 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 53053.2us
I20260709 13:06:46.750000 25039 consensus_queue.cc:1059] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:06:46.746951 25122 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:46.829809 25122 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:46.830402 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:46.831996 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:46.832706 22105 raft_consensus.cc:2393] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:46.764442 25142 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:46.834309 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 416) took 1097 ms. Trace:
I20260709 13:06:46.834823 22809 rpcz_store.cc:276] 0709 13:06:45.737214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.737401 (+   187us) service_pool.cc:224] Handling call
0709 13:06:46.834141 (+1096740us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54004f5954. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:46.834251 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583580928}
I20260709 13:06:46.834829 22105 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:46.763983 24752 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:46.815442 24973 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:46.837450 22101 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.847196 22815 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:46.773924 24964 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.849435 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:46.854650 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:46.859210 22807 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:46.862507 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:46.863489 22105 raft_consensus.cc:2393] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:46.864595 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:46.790261 25125 consensus_queue.cc:237] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:46.819103 22808 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:46.816493 25036 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:06:46.881072 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:46.882457 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.816303 25116 consensus_queue.cc:1059] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:06:46.848881 24962 raft_consensus.cc:697] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:46.860852 25072 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:46.890676 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:46.897056 22816 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:46.897411 22097 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:46.860925 24964 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.898895 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:46.899993 22175 raft_consensus.cc:2368] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9.
I20260709 13:06:46.901677 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:46.864566 24752 raft_consensus.cc:697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:46.907931 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:46.915911 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1969) took 1046 ms. Trace:
I20260709 13:06:46.909840 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:46.919555 22174 raft_consensus.cc:2410] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:46.860667 24972 consensus_queue.cc:1059] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:06:46.916321 22254 rpcz_store.cc:276] 0709 13:06:45.869844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.872498 (+  2654us) service_pool.cc:224] Handling call
0709 13:06:46.044144 (+171646us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800111698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29e9c 00007f66a4e29a5b 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:46.907802 (+863658us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b5800111698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29eee 0000000000375939 00007f66ace9d1e0 00007f66acf660c4 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:46.915817 (+  8015us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76002816}
I20260709 13:06:46.927259 22809 raft_consensus.cc:2393] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:46.896978 25072 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.893222 25140 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:46.895504 24640 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:46.929739 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:46.942826 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.943343 22815 raft_consensus.cc:2368] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8.
I20260709 13:06:46.819886 24932 consensus_queue.cc:260] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:46.943437 24962 consensus_queue.cc:237] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:46.944722 24932 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:46.946496 25136 log.cc:927] Time spent T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.500s	user 0.003s	sys 0.000s
I20260709 13:06:46.939600 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:46.940989 25121 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:46.984251 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:46.933693 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:46.947189 24752 consensus_queue.cc:237] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:46.957902 25146 log.cc:927] Time spent T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:06:46.959738 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1964) took 1091 ms. Trace:
I20260709 13:06:46.960412 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:47.010993 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:46.961166 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:46.962195 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:46.936587 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:46.936105 25072 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.878549 25134 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 13:06:47.003509 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 166152us
W20260709 13:06:47.004294 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.005133 22101 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:06:47.007612 22176 raft_consensus.cc:2410] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:46.941387 25140 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.009027 22782 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:47.013195 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:47.017149 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:47.014842 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:47.019939 22101 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:47.021150 22249 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:06:47.007417 25131 log.cc:927] Time spent T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.082s	user 0.001s	sys 0.001s
I20260709 13:06:47.022871 22220 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:47.025199 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:47.003259 25039 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:47.039775 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:47.048089 22254 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:47.009960 22246 rpcz_store.cc:276] 0709 13:06:45.868372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.868489 (+   117us) service_pool.cc:224] Handling call
0709 13:06:45.868787 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.869214 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.869247 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.869716 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:06:45.994332 (+124616us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:46.020862 (+ 26530us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.084230 (+ 63368us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b18001ce700. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4ddbc0a 00007f66ae51b219 00007f66a4e63a40 00007f66a4e5e4e4 00007f66a4e5e455 00007f66a7f46060 00007f66a7f58716 00007f66a7f69287 00007f66a7f69208
0709 13:06:46.084387 (+   157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.084451 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.522008 (+437557us) spinlock_profiling.cc:243] Waited 7.84 ms on lock 0x7b18001ce700. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e2f2a6 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e61522 00007f66a4e637c1
0709 13:06:46.522637 (+   629us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b18001ce700. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e61522 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:06:46.830141 (+307504us) spinlock_profiling.cc:243] Waited 8.35 ms on lock 0x7b18001ce700. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:06:46.835199 (+  5058us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b18001ce700. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:06:46.959449 (+124250us) raft_consensus.cc:1685] finished
0709 13:06:46.959470 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.959650 (+   180us) inbound_call.cc:177] Queueing success response
0709 13:06:46.977227 (+ 17577us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b4800240258. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66ace77aa1 00007f66ace6eb37 00007f66ace6e9ca 00007f66acf6626f 00007f66acf65f37 00007f66acf7a55c 00007f66acf7a508 00007f66acf7a488 00007f66acf7a443 00007f66acf796ec 00007f66abea3a96
Metrics: {"mutex_wait_us":1874,"prepare.queue_time_us":26723,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":76409,"raft.run_cpu_time_us":3245,"raft.run_wall_time_us":151464,"spinlock_wait_cycles":69852160,"thread_start_us":124210,"threads_started":1,"wal-append.queue_time_us":175185}
I20260709 13:06:47.047451 22144 leader_election.cc:400] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8.
I20260709 13:06:47.061280 22097 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:06:47.023308 25116 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:47.059217 25148 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:47.020967 24932 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:06:47.080004 22144 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:47.071609 25116 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:47.090471 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 70952.7us
I20260709 13:06:47.099676 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:47.064505 25138 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:06:47.100632 22246 raft_consensus.cc:2410] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:06:47.065949 25039 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:47.107610 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 61311.8us
I20260709 13:06:47.092126 25148 raft_consensus.cc:697] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:47.097724 25116 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.112742 22220 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:47.115221 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:47.121613 22144 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:47.121995 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:47.122525 25134 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:47.123099 25134 raft_consensus.cc:697] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:47.123198 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:47.129920 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:47.130883 22246 raft_consensus.cc:2410] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:47.126518 24640 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:06:47.135725 25140 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:47.138473 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:47.140300 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:47.141471 22814 raft_consensus.cc:2393] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
W20260709 13:06:47.141996 25155 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:06:47.143327 25143 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.146206 25039 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:47.147107 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 225549us
I20260709 13:06:47.147922 22071 leader_election.cc:400] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9.
I20260709 13:06:47.148859 25160 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:47.149621 25160 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:47.152832 22172 raft_consensus.cc:1240] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:47.155493 24973 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:47.157572 22098 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:47.162146 24966 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.165030 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:47.165745 25144 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.165922 24964 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:47.107345 25161 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:06:47.193761 22782 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:47.198297 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:47.201246 22812 raft_consensus.cc:2393] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:47.121179 24962 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:06:47.223580 22255 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:47.219650 22782 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:47.225318 22782 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:47.172705 25036 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
W20260709 13:06:47.237581 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 72615.1us
I20260709 13:06:47.220454 25144 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.193758 24882 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.244493 22144 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:47.226521 24913 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:47.168244 25134 consensus_queue.cc:237] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.227805 25165 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.250947 22144 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:47.224200 25142 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:47.253806 24973 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:47.255704 22144 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:47.259771 25158 log.cc:927] Time spent T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.321s	user 0.002s	sys 0.002s
I20260709 13:06:47.251474 25140 consensus_queue.cc:1059] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:06:47.250146 24640 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.246440 25148 consensus_queue.cc:237] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.247671 24806 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:47.292850 24882 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:47.294123 25135 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:06:47.295876 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.295961 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 70738.8us
I20260709 13:06:47.298314 25160 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:47.304056 25116 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:47.308226 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 52616.8us
I20260709 13:06:47.316475 22178 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:47.319288 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:47.320513 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:47.312915 25077 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:47.321264 25039 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.321563 25077 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:47.313223 24973 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.323714 24973 consensus_queue.cc:1059] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:47.324862 25077 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:47.328154 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:47.327572 24806 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.316511 25135 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.329540 24806 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.331434 25135 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:47.332343 24806 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:47.331455 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:47.333231 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:47.333513 22099 raft_consensus.cc:2393] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:47.328572 25160 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.335726 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:47.336370 22100 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:47.336292 25160 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:47.341710 22814 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:47.344727 22100 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:06:47.336339 22816 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:06:47.335742 25116 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:47.328210 25138 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:47.347411 25138 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.347846 22144 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:47.348153 25138 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.350968 22144 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:47.347935 25140 consensus_queue.cc:1059] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:06:47.351723 25143 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.352064 25140 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:47.352361 25143 raft_consensus.cc:3055] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:47.352609 25140 raft_consensus.cc:697] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:47.353641 25140 consensus_queue.cc:237] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:47.356953 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:47.320086 24964 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:47.363221 24966 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:47.363425 25127 raft_consensus.cc:3055] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:47.363883 25127 raft_consensus.cc:740] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:47.364583 22098 raft_consensus.cc:1240] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:47.364738 22105 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:47.365417 24944 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:47.352720 25143 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:47.366731 25143 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.368132 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:47.368687 22105 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:47.371776 22218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.012s	sys 0.020s
W20260709 13:06:47.372154 22218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.012s	sys 0.020s
W20260709 13:06:47.375074 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 602175us
I20260709 13:06:47.375209 25120 raft_consensus.cc:3055] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:47.375908 25121 raft_consensus.cc:3055] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:47.377270 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:47.379055 25143 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.380123 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:47.361941 25142 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:47.407327 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:47.390861 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:47.388761 22105 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:47.408588 22250 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.407384 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:47.403805 22252 raft_consensus.cc:2376] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7. Re-sending same reply.
I20260709 13:06:47.412689 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:47.415349 22253 raft_consensus.cc:2410] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:06:47.380781 22247 consensus_queue.cc:237] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:06:47.415949 22218 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:47.416596 22779 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:47.422104 22179 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:47.420035 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:47.423832 22172 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:47.422216 22218 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:47.403578 25121 raft_consensus.cc:740] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:47.427222 22251 raft_consensus.cc:1217] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-8.5]   Dedup: 5.3->[6.4-8.5]
I20260709 13:06:47.346625 25072 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:47.436483 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 59003.1us
I20260709 13:06:47.436941 22249 raft_consensus.cc:2393] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:47.398883 25160 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:47.437462 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 1963) took 1554 ms. Trace:
I20260709 13:06:47.437544 22072 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:47.401451 25120 raft_consensus.cc:740] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:47.431562 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:47.432331 22250 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:47.439464 22251 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: [3.2-8.5]
I20260709 13:06:47.428462 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:47.435791 25161 consensus_queue.cc:1059] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:47.415975 24640 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:47.442065 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:47.413194 24964 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.444505 22254 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:06:47.437958 22255 rpcz_store.cc:276] 0709 13:06:45.868074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.873283 (+  5209us) service_pool.cc:224] Handling call
0709 13:06:46.849236 (+975953us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5800111698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:47.421886 (+572650us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b540023bc54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:47.422029 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818722944}
I20260709 13:06:47.445674 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:47.445986 22782 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:47.446780 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:47.447788 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:47.448275 24962 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:47.469228 22106 raft_consensus.cc:1275] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:47.428714 24752 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.420008 24983 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:06:47.452250 24973 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:47.419462 25125 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:06:47.364750 25127 consensus_queue.cc:260] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:47.453773 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:47.419373 25142 consensus_queue.cc:1059] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:47.449462 25135 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:47.469962 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:47.427963 25036 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.460631 22250 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:47.476428 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:47.480402 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 54148.3us
I20260709 13:06:47.480880 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:47.453274 25013 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.481165 22072 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:47.412425 24454 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:06:47.484539 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:47.444767 25104 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:47.473554 24966 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:47.494400 22181 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:47.513134 24882 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:47.516074 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:47.508129 25036 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.487428 24640 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:47.519266 24640 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.521194 25036 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:47.521379 24640 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:47.504617 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:47.522619 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:47.505601 25127 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:47.523273 22255 raft_consensus.cc:2393] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 5: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:06:47.516137 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 64350.3us
I20260709 13:06:47.524098 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:47.524827 22255 raft_consensus.cc:2393] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:47.525674 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:47.526367 22255 raft_consensus.cc:2393] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:47.496985 25121 consensus_queue.cc:260] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:47.527379 25020 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:47.527704 24640 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:47.528461 25121 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:47.528340 25020 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.516536 24966 raft_consensus.cc:697] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:47.531193 24966 consensus_queue.cc:237] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.533061 25020 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:47.429016 24913 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:47.534389 24913 raft_consensus.cc:697] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:47.535789 24913 consensus_queue.cc:237] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.494776 22105 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:06:47.543663 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.543673 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:47.563382 24882 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:47.565718 22176 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:06:47.566900 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:47.567854 22103 raft_consensus.cc:1275] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:47.572074 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:47.469511 25024 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:06:47.481978 25039 consensus_queue.cc:1059] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
W20260709 13:06:47.615549 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.616190 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 135094us
I20260709 13:06:47.480466 24962 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:47.617070 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.481221 24964 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:47.620503 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:47.616024 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 112204us
I20260709 13:06:47.619882 25104 raft_consensus.cc:697] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:47.633144 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:47.634269 22250 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:06:47.635164 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:47.637193 22253 raft_consensus.cc:2410] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:47.637979 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:47.570086 25161 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:06:47.639454 22782 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:47.647060 22779 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:47.657078 25072 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:47.658404 25178 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:06:47.655125 25127 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.655196 25020 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.654837 25053 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:47.690744 25127 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.693605 25104 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.698567 22813 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:47.664520 25164 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.707701 22247 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:47.710429 22247 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:06:47.712137 25180 log.cc:927] Time spent T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:06:47.712745 22247 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:06:47.714476 22247 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:47.715641 25177 log.cc:927] Time spent T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:06:47.716289 22247 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:47.705600 25053 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.762990 25197 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.765465 25200 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.744431 24836 raft_consensus.cc:3055] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:47.782209 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.789412 25053 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:47.777891 24836 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:47.757737 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:47.822162 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.825729 22250 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:47.763890 25197 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:47.805393 24964 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:47.766077 25200 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:47.849766 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:47.849893 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:47.852342 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:47.853621 22178 raft_consensus.cc:2410] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:06:47.839398 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:47.845330 25166 raft_consensus.cc:3055] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:47.848596 22174 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:06:47.848721 24836 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.858435 22177 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:47.869230 22247 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:47.870322 24843 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:47.870745 25197 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:47.871773 24973 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:47.814888 25138 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.873041 24843 consensus_queue.cc:1059] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:47.874521 25138 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:47.875077 22781 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:47.876138 25020 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:47.858253 25166 raft_consensus.cc:740] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:47.879223 22175 raft_consensus.cc:2393] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 7: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:47.878849 25166 consensus_queue.cc:260] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.880148 25166 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:47.883322 22181 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:47.894243 25200 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:47.917573 22816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:47484
I20260709 13:06:47.918377 22816 raft_consensus.cc:606] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:47.918735 22816 raft_consensus.cc:614] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:47.923300 22816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47484
I20260709 13:06:47.923717 25189 raft_consensus.cc:3055] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:47.924319 25189 raft_consensus.cc:740] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:47.925550 25189 consensus_queue.cc:260] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:47.933660 25189 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.938388 22255 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:47.943439 25121 raft_consensus.cc:3055] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:47.943908 25121 raft_consensus.cc:740] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:47.944844 25121 consensus_queue.cc:260] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:47.945999 25121 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.959177 25144 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:47.959856 25144 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:47.960625 24836 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:47.962726 25144 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:47.980141 25120 consensus_queue.cc:260] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:47.981314 25120 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:47.988168 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.991541 22071 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:47.992126 25013 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:47.992849 25013 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:47.988440 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 87836.2us
W20260709 13:06:47.995030 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.996284 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:06:48.001484 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 574881us
I20260709 13:06:48.002635 22220 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:48.005044 22220 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:48.009030 22220 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:48.019342 22069 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:48.020879 22147 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:48.007735 24882 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:48.023307 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:48.027601 22175 raft_consensus.cc:2393] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 9: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:48.023928 22147 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:47.999955 24827 consensus_queue.cc:1059] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:06:48.026840 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:48.010165 25061 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:48.044246 22174 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:06:48.051987 22220 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:48.045888 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 228521us
I20260709 13:06:48.048292 25186 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:48.049053 22147 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:48.010416 24752 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.031335 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:48.017012 25200 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:48.058019 22172 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:48.058223 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:48.069196 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:48.025754 25189 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:48.044828 25143 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:48.043805 24806 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:48.027348 24882 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:48.071787 25101 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:06:48.109983 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 82765.4us
I20260709 13:06:48.080890 25024 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.113402 22069 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:48.058537 25142 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:06:48.108222 24882 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.120548 22218 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:48.120927 22069 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:48.126667 22069 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:48.138808 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.107147 24806 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:48.121001 25209 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.123592 25024 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:48.143385 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:48.174026 22809 raft_consensus.cc:2393] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:48.144953 25185 consensus_queue.cc:1059] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:06:48.136040 25122 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:48.162629 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.164250 24932 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:48.168180 22179 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:06:48.122249 25166 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:48.121681 25065 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.183990 22179 pending_rounds.cc:85] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 5
I20260709 13:06:48.184680 22179 pending_rounds.cc:107] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:06:48.185135 22179 raft_consensus.cc:2889] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:48.191906 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 71504.8us
I20260709 13:06:48.142805 25013 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:48.203800 24932 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:48.205713 25181 log.cc:927] Time spent T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.695s	user 0.001s	sys 0.001s
I20260709 13:06:48.191449 25166 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.208045 25166 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:48.199069 25065 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:48.181432 25209 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:48.214550 25065 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:48.215754 25209 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:48.184633 25185 consensus_queue.cc:1243] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:48.216123 25220 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:48.217885 22218 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:48.219640 22218 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:48.216795 25220 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:48.201139 25197 raft_consensus.cc:2764] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:48.221740 25197 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.222687 25220 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:48.135789 24827 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:48.202455 25122 raft_consensus.cc:697] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:48.232718 24806 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:48.206756 24932 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:48.230614 25122 consensus_queue.cc:237] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:48.248909 22218 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:48.249379 22105 raft_consensus.cc:1240] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:48.253013 22097 raft_consensus.cc:1275] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:06:48.276443 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.285451 22816 raft_consensus.cc:606] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:48.291293 22816 raft_consensus.cc:614] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:48.250101 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:48.292363 22099 raft_consensus.cc:2393] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
W20260709 13:06:48.292727 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 240800us
W20260709 13:06:48.292387 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 43563.9us
W20260709 13:06:48.296475 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 302743us
I20260709 13:06:48.296761 22098 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:06:48.297632 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:48.303798 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:48.306998 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:48.307592 22178 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:06:48.313429 22178 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:48.313956 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:48.322700 22180 raft_consensus.cc:1275] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:48.327466 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:48.330770 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:48.339116 22250 raft_consensus.cc:1275] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:48.340647 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:48.343562 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:48.287225 24932 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:48.339818 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:48.346526 22098 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:48.353665 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:48.354815 22248 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:48.318389 25148 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:06:48.353595 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 145473us
I20260709 13:06:48.367648 22144 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:48.426589 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:48.346482 25189 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:48.409678 25174 log.cc:927] Time spent T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:06:48.293370 25160 consensus_queue.cc:1048] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:06:48.349227 24827 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.347849 25140 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:48.427562 22180 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:48.355077 25065 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.355365 25024 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.409574 25144 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.423844 25215 log.cc:927] Time spent T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:06:48.443632 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1697) took 1012 ms. Trace:
I20260709 13:06:48.443957 22175 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:48.342329 24836 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:06:48.347148 25101 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:06:48.360980 24806 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:06:48.453918 22176 rpcz_store.cc:276] 0709 13:06:47.430894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.431086 (+   192us) service_pool.cc:224] Handling call
0709 13:06:48.443462 (+1012376us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540003c354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:48.443576 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268578688}
I20260709 13:06:48.436932 25227 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:06:48.490204 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 73815.9us
I20260709 13:06:48.439749 22003 catalog_manager.cc:5697] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.452575 25143 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:48.446430 25148 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:06:48.440285 24882 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:48.504367 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 136862us
W20260709 13:06:48.490675 25120 consensus_meta.cc:287] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.003s
I20260709 13:06:48.507205 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:48.449805 24827 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:48.517411 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 66695.1us
W20260709 13:06:48.518059 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 176792us
I20260709 13:06:48.522755 22173 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:06:48.524438 22173 pending_rounds.cc:85] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 4
I20260709 13:06:48.524757 22173 pending_rounds.cc:107] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:06:48.525055 22173 raft_consensus.cc:2889] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:48.532878 22809 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:48.454149 25065 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:48.537550 22002 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40946 (request call id 276) took 24357 ms (client timeout 15000 ms). Trace:
I20260709 13:06:48.459091 25144 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:48.503645 25219 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.459218 25024 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:48.514876 22003 catalog_manager.cc:5697] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 3 to 6, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 6 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:48.551856 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 47028us
I20260709 13:06:48.495935 25227 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:48.551203 22220 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:48.563249 22003 catalog_manager.cc:5697] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 5 to 8, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 8 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:48.572347 25235 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:06:48.573462 25234 log.cc:927] Time spent T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:48.573798 25227 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:48.574482 25229 log.cc:927] Time spent T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:48.550565 25143 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:48.549480 25120 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:48.590591 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:48.597841 25228 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
W20260709 13:06:48.537998 22002 rpcz_store.cc:269] 0709 13:06:24.103084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.103420 (+   336us) service_pool.cc:224] Handling call
0709 13:06:48.451478 (+24348058us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:44.678462 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:44.764009 (+ 85547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:44.766208 (+  2199us) write_op.cc:435] Acquired schema lock
0709 13:06:44.768928 (+  2720us) tablet.cc:662] Decoding operations
0709 13:06:44.802411 (+ 33483us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:44.802480 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:44.802514 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:06:44.811354 (+  8840us) tablet.cc:701] Row locks acquired
0709 13:06:44.811380 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:06:44.811544 (+   164us) write_op.cc:270] Start()
0709 13:06:44.811666 (+   122us) write_op.cc:276] Timestamp: P: 1783602404811494 usec, L: 0
0709 13:06:44.811688 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:44.822061 (+ 10373us) log.cc:844] Serialized 3248 byte log entry
0709 13:06:45.033576 (+211515us) op_driver.cc:464] REPLICATION: finished
0709 13:06:45.202889 (+169313us) write_op.cc:301] APPLY: starting
0709 13:06:45.203078 (+   189us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:45.203502 (+   424us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:45.203685 (+   183us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:45.313852 (+110167us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:45.314237 (+   385us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:06:45.314299 (+    62us) write_op.cc:312] APPLY: finished
0709 13:06:45.314784 (+   485us) log.cc:844] Serialized 65 byte log entry
0709 13:06:45.315030 (+   246us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:45.315367 (+   337us) write_op.cc:454] Released schema lock
0709 13:06:45.315443 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:45.315941 (+   498us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:45.315967 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34362,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":163641,"apply.run_cpu_time_us":5761,"apply.run_wall_time_us":113094,"num_ops":8,"prepare.queue_time_us":253089,"prepare.run_cpu_time_us":16593,"prepare.run_wall_time_us":178893,"raft.queue_time_us":102643,"raft.run_cpu_time_us":32187,"raft.run_wall_time_us":122363,"replication_time_us":221627,"spinlock_wait_cycles":13056,"thread_start_us":250794,"threads_started":4,"wal-append.queue_time_us":21956,"wal-append.run_cpu_time_us":17032,"wal-append.run_wall_time_us":1482880}]]}
I20260709 13:06:48.595165 22003 catalog_manager.cc:5697] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:48.575505 25143 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:48.579766 24962 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:48.608042 22003 catalog_manager.cc:5697] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 5 to 7, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 7 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:48.612653 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:48.589408 25160 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:48.619819 22813 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:06:48.575213 25243 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:48.623404 22003 catalog_manager.cc:5697] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:48.562088 25219 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:48.628154 22003 catalog_manager.cc:5697] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:48.592953 25120 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:48.602237 24752 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:48.603791 24806 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:48.639036 24983 raft_consensus.cc:3055] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:48.648339 22003 catalog_manager.cc:5697] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
W20260709 13:06:48.654361 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 101328us
I20260709 13:06:48.623661 25160 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.601858 25166 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:48.626334 25209 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:48.670629 22003 catalog_manager.cc:5697] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 6 to 7, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 7 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:48.683936 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:48.631313 25053 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:48.689663 22003 catalog_manager.cc:5697] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 5, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 5 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:48.646903 24983 raft_consensus.cc:740] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:48.701390 25065 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:48.673262 25160 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:48.709307 22254 raft_consensus.cc:1217] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-8.5]   Dedup: 5.3->[6.4-8.5]
I20260709 13:06:48.712108 22254 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: [3.2-8.5]
I20260709 13:06:48.712149 22808 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:48.717435 22003 catalog_manager.cc:5697] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 3 to 8, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 8 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:48.669358 24806 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:48.725307 25225 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:06:48.726024 25144 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:48.727701 25238 consensus_queue.cc:1059] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:06:48.728514 25238 consensus_queue.cc:1243] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:48.721379 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:48.668828 24752 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:48.701390 25219 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:48.693984 25209 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:48.742120 25237 consensus_queue.cc:1048] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.147s
I20260709 13:06:48.738400 25239 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.157s
I20260709 13:06:48.699235 25053 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:48.749302 22147 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:48.760632 22812 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:48.764778 22003 catalog_manager.cc:5697] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:48.742902 25166 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:48.745494 25024 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:48.763550 25101 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:48.837905 25120 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:48.930902 22003 catalog_manager.cc:5697] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:48.932636 22003 catalog_manager.cc:5697] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 4 to 8, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 8 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:48.933701 25197 consensus_meta.cc:287] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.712s	user 0.004s	sys 0.005s
I20260709 13:06:48.934139 25197 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.862278 25143 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:48.974278 25253 log.cc:927] Time spent T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:06:48.934373 22003 catalog_manager.cc:5697] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 4 to 7, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 7 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:48.970896 25245 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:06:48.935433 25219 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.980589 25199 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:06:49.009680 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 341795us
I20260709 13:06:49.010591 22072 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:49.004613 22003 catalog_manager.cc:5697] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 1 to 4, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 4 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:49.036511 25237 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.037655 25231 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.038028 25237 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.038231 25231 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.040643 25231 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:49.041957 25175 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:49.042552 25175 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.043370 25123 raft_consensus.cc:3055] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:49.043902 25123 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:49.044713 25175 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:48.982285 25164 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:49.047353 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 401252us
I20260709 13:06:49.071308 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:49.071491 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:49.072340 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 61877.7us
I20260709 13:06:49.007730 24836 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:49.074913 22812 raft_consensus.cc:2393] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:49.076131 22071 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:49.076570 22072 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:49.079579 22003 catalog_manager.cc:5697] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 4 to 6, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 6 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:49.086339 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.086690 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.087355 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.090803 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.008565 25219 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.089718 22003 catalog_manager.cc:5697] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 1 to 3, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 3 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:06:49.102758 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.103513 22101 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:49.044780 25123 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.077229 25175 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:49.042577 25160 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.120239 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.114679 22003 catalog_manager.cc:5697] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 5 to 6, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 6 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.088189 25239 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.127432 24752 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.127990 25053 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.130106 25219 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:49.130729 25240 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:49.082952 24836 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.134334 24836 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:49.115922 25249 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:49.134472 25259 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:49.135298 25249 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:49.135777 25249 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:49.136261 25249 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:49.137519 22816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47484 (request call id 1) took 1214 ms. Trace:
I20260709 13:06:49.137930 22816 rpcz_store.cc:276] 0709 13:06:47.923010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.923163 (+   153us) service_pool.cc:224] Handling call
0709 13:06:49.137324 (+1214161us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b540004fe54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f48853 00007f66acf1660a 00007f66a649c7d4 00007f66a649c762 00007f66a649c691 00007f66a649c60c 00007f66a649b8c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:49.137432 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":831342336}
I20260709 13:06:49.139952 25243 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:49.140902 22102 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
W20260709 13:06:49.173076 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 96996.9us
I20260709 13:06:49.257761 22003 catalog_manager.cc:5697] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 2 to 3, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 3 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.262640 22072 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:49.197794 22252 raft_consensus.cc:2368] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10.
I20260709 13:06:49.140398 25243 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:49.243678 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.122624 25101 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.131407 25240 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.123363 25175 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:49.266415 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 175175us
I20260709 13:06:49.272580 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:49.264099 22003 catalog_manager.cc:5697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:49.269840 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.244343 24806 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:49.277711 25160 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.280511 25175 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:49.270651 25101 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.268254 25072 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:49.283135 25072 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.283499 25101 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:49.283936 25127 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.285197 25072 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:49.285772 22003 catalog_manager.cc:5697] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.246126 25228 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.293018 25228 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:49.294087 24882 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:49.295212 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.296084 22098 raft_consensus.cc:2410] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:49.128401 25239 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.243638 25231 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.076608 25164 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.135389 25259 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:49.262593 24973 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.277s	user 0.000s	sys 0.026s
I20260709 13:06:49.265663 25243 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.243376 25166 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:49.321316 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:49.270761 25185 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:49.323016 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.332928 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:49.303081 25120 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.402890 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:49.322433 22179 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:49.400478 22106 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:49.402282 22180 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
W20260709 13:06:49.313252 24973 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.327s	user 0.000s	sys 0.027s
I20260709 13:06:49.408800 22176 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
W20260709 13:06:49.396106 25262 log.cc:927] Time spent T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.227s	user 0.004s	sys 0.003s
I20260709 13:06:49.367739 25240 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:49.328717 25263 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.394044 25266 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:49.394550 25259 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:49.331316 25072 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.429421 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:49.434321 22071 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:49.435200 22071 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:49.413251 25127 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:49.321424 25231 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.444389 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.406123 25185 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.415165 25120 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.426506 25261 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:49.430938 25077 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:49.416914 25166 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.456352 25239 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.429301 25142 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:49.432130 25228 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:06:49.456557 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.444588 25267 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:49.457147 25268 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:49.464370 25268 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.444103 25127 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.467012 25077 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.468811 25127 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.469028 25077 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.445663 25259 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:49.436391 25072 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.460175 25166 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.466852 25268 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.431651 25263 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:49.535573 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 64420.9us
W20260709 13:06:49.537286 25269 log.cc:927] Time spent T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:06:49.527099 25264 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:06:49.471271 25271 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:49.538812 25271 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.539178 25271 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:49.540414 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.471572 25024 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:49.570838 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:49.571944 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1707) took 1506 ms. Trace:
I20260709 13:06:49.572561 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:49.572468 22175 rpcz_store.cc:276] 0709 13:06:48.030141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.030290 (+   149us) service_pool.cc:224] Handling call
0709 13:06:48.443640 (+413350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.453996 (+ 10356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.536039 (+1082043us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b540003c350. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:49.536179 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949950720}
I20260709 13:06:49.584000 22101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:06:49.584640 22101 raft_consensus.cc:606] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:49.584980 22101 raft_consensus.cc:614] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:49.460475 25142 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:49.587925 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 152781us
I20260709 13:06:49.438535 25266 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.539944 25164 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:49.591815 25273 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.569357 25024 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.456939 25261 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.474138 25259 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.599783 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1983) took 2149 ms. Trace:
I20260709 13:06:49.600350 22255 rpcz_store.cc:276] 0709 13:06:47.450531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.732598 (+282067us) service_pool.cc:224] Handling call
0709 13:06:47.938152 (+205554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.938893 (+   741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.599594 (+1660701us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54001b03d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:49.599727 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471761280}
I20260709 13:06:49.570573 25263 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:49.463404 25267 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.603929 25259 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:49.604580 25143 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:49.605142 25143 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.598690 22101 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:49.607380 22101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:06:49.592353 25273 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.597460 25024 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:49.605227 25267 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:49.632282 22178 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:06:49.632859 22178 pending_rounds.cc:85] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 6
I20260709 13:06:49.613564 25121 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.634560 22178 pending_rounds.cc:107] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:06:49.613128 25239 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.637238 22178 raft_consensus.cc:2889] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:49.611618 25039 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:49.643625 25039 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.646031 22174 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:49.613343 24973 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:49.639868 25254 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:49.642635 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:49.608837 25249 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.908905 22101 raft_consensus.cc:606] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:49.881924 25120 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:49.703886 25231 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:49.729390 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:49.926416 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1703) took 2484 ms. Trace:
I20260709 13:06:49.905480 25072 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.927489 25273 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:49.927237 22173 rpcz_store.cc:276] 0709 13:06:47.441894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.442144 (+   250us) service_pool.cc:224] Handling call
0709 13:06:47.449078 (+  6934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.525644 (+1076566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.926119 (+1400475us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400176bd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:49.926326 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2468047232}
I20260709 13:06:49.650209 25121 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.928959 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:49.926368 22101 raft_consensus.cc:614] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:49.930248 25121 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.711774 25185 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.930429 22173 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:49.638391 25266 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:49.933431 25165 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:49.933743 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:49.933965 25165 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.650010 25239 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.680884 25254 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:49.678551 24973 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.724478 25261 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.727715 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.703867 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:49.934569 22174 raft_consensus.cc:2410] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:49.936081 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.942260 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:49.948315 22808 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:49.896634 25277 log.cc:927] Time spent T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:06:49.959800 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.953668 22218 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:49.942590 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:49.945744 22172 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:49.941291 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:49.945374 22099 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:49.942277 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:49.962801 22811 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:49.966355 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.967746 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:49.669986 25238 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:49.972389 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.968279 22218 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:49.941304 22173 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:06:49.707137 25278 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:49.974028 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.943607 25209 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.936203 25232 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.978384 22097 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:49.980490 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:49.936698 25239 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:49.942766 24973 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.958331 25067 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.974476 25196 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.987104 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:49.964373 24827 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:49.973481 25072 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:49.997829 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:49.971827 25122 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:49.976382 25143 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.000504 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:49.979213 25104 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:49.994639 22808 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
W20260709 13:06:49.995986 25243 consensus_meta.cc:287] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.000s
I20260709 13:06:49.972043 24916 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:06:49.981998 25263 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:49.984187 25142 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:49.983999 25273 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:50.014741 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:50.014648 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:50.017148 22808 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:06:50.003288 24454 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.978503 25238 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.982534 25278 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.002003 25067 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.023617 25260 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:50.045284 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.046902 22103 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:50.047921 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:50.048399 25217 log.cc:927] Time spent T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 1.837s	user 0.007s	sys 0.023s
I20260709 13:06:50.048549 22103 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:50.023841 25273 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:49.996392 25232 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.061147 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.061439 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.054841 22172 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
W20260709 13:06:50.063155 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 85817.3us
I20260709 13:06:50.064500 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:50.004576 25196 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.062242 22103 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:50.060392 25278 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.019042 25122 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.016885 25243 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.020498 25263 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.073594 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.075037 22253 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:50.056473 25067 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:50.076779 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:50.059441 25165 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.073287 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.082849 22255 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:50.032552 24454 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.078665 22247 raft_consensus.cc:2393] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:50.085358 25285 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.085994 25138 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:50.070387 25242 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:50.086472 25143 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:50.099515 24983 consensus_queue.cc:260] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.100561 24983 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:50.100327 25143 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.102489 25143 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.098683 25138 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.097616 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.093163 22099 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:50.109005 22098 raft_consensus.cc:2410] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:06:50.109464 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.110245 22253 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:50.111837 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.112704 22253 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:50.112723 22172 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:50.114825 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.108002 25285 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.119446 25285 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:50.120098 25138 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.121555 25273 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:50.121896 24454 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.117614 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:50.124706 25122 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.124611 22172 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:50.126029 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:50.126420 22100 raft_consensus.cc:1275] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:50.127772 22100 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:50.128026 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1593) took 1041 ms. Trace:
I20260709 13:06:50.128373 22102 rpcz_store.cc:276] 0709 13:06:49.086352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.086477 (+   125us) service_pool.cc:224] Handling call
0709 13:06:50.127878 (+1041401us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b540001ed54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:50.127973 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122796928}
I20260709 13:06:50.128940 22100 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:50.107385 25196 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:50.129751 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.130056 22144 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:50.130402 22105 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:50.131680 25238 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:50.134091 25242 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:50.135092 22248 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:50.134611 25242 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.136611 22250 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:50.137015 25242 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:50.137544 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.139950 25039 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.142331 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.143263 22144 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:50.144658 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:50.104622 25271 consensus_meta.cc:287] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.001s
I20260709 13:06:50.148581 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.148138 22144 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:50.151079 22253 raft_consensus.cc:2410] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:06:50.158991 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.160490 22248 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:50.164456 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.166628 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.167064 25284 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:50.167501 22102 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:50.167577 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.167727 25284 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.168296 22101 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:50.168866 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.169265 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.169464 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.176455 22105 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:50.170639 22144 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:50.171006 25240 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:50.168381 25284 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:50.184713 22782 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:50.173022 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.208209 22097 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
I20260709 13:06:50.189087 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:50.210839 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:50.215746 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.216012 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.216467 22255 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:50.220255 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:50.222671 22248 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:50.225456 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.225899 22144 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:50.164008 25239 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:50.156419 24843 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:06:50.233107 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.236974 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.238111 22248 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:50.190480 25240 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.220702 25120 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.164281 25165 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:06:50.220283 25196 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:50.158597 25271 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.235041 25239 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:50.242357 25143 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:50.256805 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:50.245357 25240 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.285993 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:50.291594 22807 raft_consensus.cc:2393] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:50.293533 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:50.282886 25239 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:50.254446 25120 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.253077 25232 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.251716 25196 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:50.251717 25243 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:50.256222 25020 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:50.325855 22807 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:50.256343 25164 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:50.377699 25164 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.380501 25164 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:50.294730 25125 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.382786 25125 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.385689 25125 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:50.387306 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.390450 25065 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:50.390880 25227 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:50.391002 25065 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.391564 25227 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:50.323609 25024 consensus_meta.cc:287] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.690s	user 0.007s	sys 0.004s
I20260709 13:06:50.393093 25024 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.393714 25227 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:50.394876 22252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1770) took 2994 ms (client timeout 1507 ms). Trace:
I20260709 13:06:50.395361 22103 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:50.396875 25276 log.cc:927] Time spent T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:06:50.395406 22252 rpcz_store.cc:269] 0709 13:06:47.400113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.667756 (+1267643us) service_pool.cc:224] Handling call
0709 13:06:50.394616 (+1726860us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54002cb0d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:50.394795 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084389632}
I20260709 13:06:50.286999 25143 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.275941 25249 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.326645 25020 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.398499 22101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:06:50.428089 22101 raft_consensus.cc:606] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:50.428593 22101 raft_consensus.cc:614] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:50.324720 25196 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:50.391582 25298 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:06:50.430029 25143 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:50.429880 25020 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.438628 25271 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.455482 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.455727 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:50.456247 22101 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:50.457518 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:50.433748 25120 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:50.479830 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 294906us
I20260709 13:06:50.484350 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:50.485399 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 287253us
I20260709 13:06:50.487774 22781 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:50.487661 25232 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:50.496557 25239 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.492772 22071 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:50.502529 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:50.493247 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.503991 25024 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:50.506677 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:50.502655 25143 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.508184 22100 raft_consensus.cc:2368] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9.
I20260709 13:06:50.504441 22144 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:50.509021 22144 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:50.510365 22144 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:50.512594 25120 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.513178 25020 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.513152 25120 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.515995 25239 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:50.491778 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.520884 25121 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:50.521387 25121 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:50.521770 25121 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:50.524597 25143 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.525209 25143 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:50.525626 25143 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:50.526000 25143 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.527027 25238 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:50.527458 25238 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.527802 25238 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:50.504884 25284 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.531543 25020 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.550784 22072 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:50.567857 22218 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.65:33421 timed out after 1.515s (SENT) [suppressed 4 similar messages]
I20260709 13:06:50.537868 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:50.541980 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 49243.4us
I20260709 13:06:50.581211 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.581501 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:50.566412 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:50.582374 22247 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.583741 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:50.584980 25300 log.cc:927] Time spent T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:06:50.588441 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 100744us
I20260709 13:06:50.591652 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:50.592661 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:50.593582 22173 raft_consensus.cc:2393] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:50.597324 22178 raft_consensus.cc:2368] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9.
I20260709 13:06:50.580053 25227 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:50.577623 24973 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:50.601220 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 50536.7us
I20260709 13:06:50.577281 24983 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:50.607411 22072 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:50.609572 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 448) took 1166 ms. Trace:
I20260709 13:06:50.610095 22098 rpcz_store.cc:276] 0709 13:06:49.438698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.456209 (+ 17511us) service_pool.cc:224] Handling call
0709 13:06:50.604449 (+1148240us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b5400215a54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:50.604599 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1488909696}
I20260709 13:06:50.616923 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:50.617758 22173 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:50.611303 24973 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.627427 25227 raft_consensus.cc:697] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:50.627924 22072 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:50.628788 25227 consensus_queue.cc:237] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.629472 22072 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:50.631124 25243 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:50.632185 25243 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:50.632617 25243 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:50.633085 25243 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:50.635134 25122 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:50.635644 25122 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:50.636111 25122 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.636181 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.635885 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:50.636922 22101 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:50.600119 25302 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:50.636945 22098 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:50.580847 25196 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.640322 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:50.641635 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 49597us
I20260709 13:06:50.605751 25249 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:50.654345 22144 leader_election.cc:400] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9.
I20260709 13:06:50.586717 25121 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.658054 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.662271 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:50.663506 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:50.707487 22144 leader_election.cc:403] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:06:50.696581 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:50.665377 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:50.700146 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:50.641597 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 51895.5us
I20260709 13:06:50.610641 24983 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.711202 22177 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:50.720474 22779 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:50.726085 22101 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:50.717860 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:50.725471 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:50.740820 22172 raft_consensus.cc:2393] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:06:50.712091 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 48649us
I20260709 13:06:50.547833 25120 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.742275 22072 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:50.749449 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 95256.5us
I20260709 13:06:50.749500 22247 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:50.751796 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.751991 22781 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:50.753372 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.753638 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:50.754073 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.754889 22250 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 8: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:50.755409 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.755980 22247 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:50.754722 22782 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:50.766727 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:50.766817 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.701804 25268 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:50.707504 25249 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:50.710124 24913 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:50.756927 25303 log.cc:927] Time spent T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:06:50.741979 25222 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:50.787424 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:50.720602 25301 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:50.780462 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.720471 25232 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.651223 25302 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:50.783594 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:50.760130 25020 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:50.810305 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.772226 24973 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.716653 25240 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.786437 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.701853 24454 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
W20260709 13:06:50.759019 25185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.033s	sys 0.042s
I20260709 13:06:50.756927 25221 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.790551 22253 raft_consensus.cc:1217] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-8.5]   Dedup: 5.3->[6.4-8.5]
I20260709 13:06:50.775741 25148 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:50.790637 25305 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:50.773070 25220 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:50.740726 25165 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:06:50.804322 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 236493us
W20260709 13:06:50.791002 22254 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.013s	sys 0.060s
W20260709 13:06:50.786685 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 66278.5us
W20260709 13:06:50.831128 22254 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.017s	sys 0.063s
I20260709 13:06:50.781085 25268 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:50.784081 25249 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:50.816437 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.784324 24843 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:50.818084 22253 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: [3.2-8.5]
I20260709 13:06:50.817945 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.839912 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.841274 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.765636 25197 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:50.763782 22144 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:50.845063 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 81380.4us
I20260709 13:06:50.846767 22144 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:50.822090 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:50.767510 25186 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:50.828516 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:50.807981 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:50.822103 25185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.034s	sys 0.042s
I20260709 13:06:50.808557 25302 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.836081 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:50.809954 25232 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.791393 24913 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.850723 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.828023 25220 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.869068 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.808045 25301 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.827929 25148 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.849377 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.870970 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:50.835352 25268 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:50.874004 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:50.878123 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.881436 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:50.827865 25221 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:50.834568 25165 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:50.850991 25305 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:06:50.847739 22809 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:50.879410 22247 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:51.513010 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:51.513886 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:51.100507 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:51.506366 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 147853us
W20260709 13:06:51.276067 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 442628us
I20260709 13:06:51.515671 22811 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
W20260709 13:06:51.506103 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 218904us
I20260709 13:06:50.882938 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:50.850018 24843 raft_consensus.cc:697] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:51.530319 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:51.359083 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:50.875164 25279 log.cc:927] Time spent T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 1.284s	user 0.006s	sys 0.009s
I20260709 13:06:51.549607 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:51.557446 22810 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:51.558372 22251 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:50.868057 25144 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:51.531723 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:51.559549 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:51.532495 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.880110 25125 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:06:51.473735 25243 consensus_meta.cc:287] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.840s	user 0.008s	sys 0.004s
I20260709 13:06:50.871851 24932 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.689s
I20260709 13:06:51.561129 25125 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:51.363185 25316 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:51.561779 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:51.562093 24913 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:51.562371 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:51.562225 25316 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:06:51.562964 22098 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:51.563002 22218 consensus_peers.cc:597] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 79d645cd970b4b2789be5374cc2005aa. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:51.563541 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 47726.8us
I20260709 13:06:51.564271 25301 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:51.564437 25316 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:06:51.565048 22808 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
W20260709 13:06:51.375244 25307 log.cc:927] Time spent T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9: Append to log took a long time: real 0.655s	user 0.003s	sys 0.000s
I20260709 13:06:51.000756 24454 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:51.566861 24454 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:51.302523 25164 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:51.255537 25306 log.cc:927] Time spent T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
W20260709 13:06:50.900192 25304 log.cc:927] Time spent T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:06:51.561211 25243 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:51.438608 25314 log.cc:927] Time spent T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:06:51.453179 25122 consensus_meta.cc:287] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.816s	user 0.010s	sys 0.001s
W20260709 13:06:51.489650 25249 consensus_meta.cc:287] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.000s
I20260709 13:06:50.950789 25120 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:51.300684 25240 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:50.867945 25197 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:50.901253 25310 log.cc:927] Time spent T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:06:51.449275 25143 consensus_meta.cc:287] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.923s	user 0.011s	sys 0.001s
I20260709 13:06:51.360539 25318 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:51.572037 25164 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:51.572471 22098 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:51.573272 25232 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:51.227557 25238 consensus_meta.cc:287] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.699s	user 0.005s	sys 0.007s
W20260709 13:06:50.901245 25308 log.cc:927] Time spent T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:06:51.580091 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:50.874502 25239 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:06:51.546720 22102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.006s	sys 0.010s
I20260709 13:06:51.581224 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:50.917405 25311 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:06:51.585242 25337 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:50.914281 25196 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:51.254700 24983 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:51.074255 25231 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:51.268880 25271 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:06:51.968783 22102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.012s	sys 0.013s
W20260709 13:06:51.851358 25328 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:06:51.848387 24843 consensus_queue.cc:237] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:51.970125 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:51.525580 25220 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.904408 25285 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.970702 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1738) took 1306 ms. Trace:
I20260709 13:06:51.701764 22814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 849) took 1762 ms. Trace:
W20260709 13:06:51.877178 22173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.002s	sys 0.016s
W20260709 13:06:51.932268 25315 log.cc:927] Time spent T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:06:51.526438 25319 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.978907 22098 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:51.748833 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 554817us
W20260709 13:06:51.702643 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 110533us
W20260709 13:06:51.979522 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.970219 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 451) took 1211 ms. Trace:
I20260709 13:06:51.996567 22101 rpcz_store.cc:276] 0709 13:06:50.758523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.512436 (+753913us) service_pool.cc:224] Handling call
0709 13:06:51.970154 (+457718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:51.992770 22812 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:51.585985 25243 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:51.976693 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:51.980049 22144 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:51.752547 25020 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.036s	sys 0.046s
I20260709 13:06:51.985973 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:51.586776 25186 consensus_meta.cc:287] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.002s
I20260709 13:06:51.988618 22247 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 5.
W20260709 13:06:51.983822 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 457899us
W20260709 13:06:51.992182 22173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.003s	sys 0.016s
I20260709 13:06:51.569993 25144 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:51.858299 25326 log.cc:927] Time spent T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
W20260709 13:06:51.779376 25304 log.cc:927] Time spent T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:06:51.994975 22071 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:51.628837 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:51.579511 25329 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:52.001844 22779 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:52.046710 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 44956.3us
I20260709 13:06:51.974133 25231 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:51.982699 25249 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:51.989952 22177 rpcz_store.cc:276] 0709 13:06:50.664027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.779521 (+115494us) service_pool.cc:224] Handling call
0709 13:06:50.779830 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.784524 (+  4694us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:50.917911 (+133387us) log.cc:844] Serialized 14 byte log entry
0709 13:06:51.685255 (+767344us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.685814 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:06:51.686078 (+   264us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:51.686127 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.686243 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:51.970483 (+284240us) raft_consensus.cc:1685] finished
0709 13:06:51.970501 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.970639 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4289,"prepare.queue_time_us":572536,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":50195,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":14953,"spinlock_wait_cycles":1225984,"thread_start_us":532843,"threads_started":3,"wal-append.queue_time_us":217152}
W20260709 13:06:52.013867 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 45454.8us
I20260709 13:06:51.977568 25239 raft_consensus.cc:697] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:51.587604 25254 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:51.964097 25185 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:51.931325 25221 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:51.612511 25316 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:52.043301 25144 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.930450 25165 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:51.985551 25232 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:52.024730 22811 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:52.051610 25305 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:51.586577 24932 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.418s
I20260709 13:06:51.982071 25238 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:52.047240 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 52408.3us
I20260709 13:06:52.087641 22071 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:52.047529 22779 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:51.591392 25259 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:52.028167 25020 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.043s	sys 0.055s
I20260709 13:06:52.003547 22250 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.987071 25143 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:51.984570 25122 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.051146 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1619) took 1505 ms. Trace:
I20260709 13:06:52.052480 22101 raft_consensus.cc:1240] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:52.101179 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 455) took 1321 ms. Trace:
I20260709 13:06:52.101490 22101 rpcz_store.cc:276] 0709 13:06:50.779838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.027887 (+1248049us) service_pool.cc:224] Handling call
0709 13:06:52.052321 (+ 24434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.100937 (+ 48616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.101134 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.052492 22098 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:52.052824 22144 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:52.024035 25240 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:52.055492 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 531) took 1573 ms. Trace:
I20260709 13:06:52.001879 25319 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.054745 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1697) took 1184 ms. Trace:
I20260709 13:06:52.056043 25337 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:52.043402 25186 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9.
I20260709 13:06:52.056821 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:52.106375 22099 rpcz_store.cc:276] 0709 13:06:50.870283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.046455 (+1176172us) service_pool.cc:224] Handling call
0709 13:06:52.054074 (+  7619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.054293 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.054334 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.054395 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.054448 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.054523 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.054671 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.102632 22255 rpcz_store.cc:276] 0709 13:06:50.481753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.481958 (+   205us) service_pool.cc:224] Handling call
0709 13:06:50.493830 (+ 11872us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.494128 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.494157 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.500074 (+  5917us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.754690 (+254616us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:50.754748 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.754831 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.055232 (+1300401us) raft_consensus.cc:1685] finished
0709 13:06:52.055263 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.055419 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":254232,"threads_started":1,"wal-append.queue_time_us":329513}
I20260709 13:06:51.992547 25271 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.040431 24454 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:52.039810 24983 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.995362 25285 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:51.586135 24973 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:51.991809 25318 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.124611 22813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 438) took 3480 ms. Trace:
W20260709 13:06:52.062628 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 498465us
I20260709 13:06:51.991830 25120 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.068511 22811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35214 (request call id 590) took 1157 ms. Trace:
I20260709 13:06:51.992087 22814 rpcz_store.cc:276] 0709 13:06:49.939060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.939198 (+   138us) service_pool.cc:224] Handling call
0709 13:06:49.939512 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.086634 (+147122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.086680 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.087272 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.206850 (+119578us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:50.206902 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.592250 (+1385348us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540064f354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:51.592306 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:51.592365 (+    59us) raft_consensus.cc:1685] finished
0709 13:06:51.592379 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.701657 (+109278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9062,"spinlock_wait_cycles":317892480,"thread_start_us":83002,"threads_started":1,"wal-append.queue_time_us":157998,"wal-append.run_cpu_time_us":1825,"wal-append.run_wall_time_us":1001869}
I20260709 13:06:52.053411 25329 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:52.195375 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 57184.3us
I20260709 13:06:52.125144 22813 rpcz_store.cc:276] 0709 13:06:48.634556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.639260 (+  4704us) service_pool.cc:224] Handling call
0709 13:06:48.639556 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.746447 (+106891us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:48.750163 (+  3716us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.119695 (+369532us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:49.119743 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:49.119787 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.059951 (+940164us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b18002c3c80. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e2f2a6 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419
0709 13:06:52.114474 (+2054523us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54002008d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:52.114543 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.114705 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1582,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":122,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":13683,"spinlock_wait_cycles":252361856,"thread_start_us":369188,"threads_started":1,"wal-append.queue_time_us":541012,"wal-append.run_cpu_time_us":1085,"wal-append.run_wall_time_us":1001111}
I20260709 13:06:52.198458 22250 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:52.071795 25339 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:52.071476 25232 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.072746 25069 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:52.071789 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:52.076524 25221 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:52.221161 25069 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:52.077527 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 530) took 1596 ms. Trace:
I20260709 13:06:52.221763 25069 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.079350 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:52.223829 25122 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:52.224004 25069 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:52.053934 25334 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:52.224670 25339 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.224794 25334 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.044735 25268 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.203601 25186 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:52.227555 25186 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.228541 22100 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:52.102485 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1698) took 1231 ms. Trace:
I20260709 13:06:52.119805 25350 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:52.110746 25259 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.121829 25239 consensus_queue.cc:237] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.042073 25302 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.063663 25148 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:52.099583 22105 rpcz_store.cc:276] 0709 13:06:50.545954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.546141 (+   187us) service_pool.cc:224] Handling call
0709 13:06:50.578418 (+ 32277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.612862 (+ 34444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.612905 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.618978 (+  6073us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.833221 (+214243us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:50.833260 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.833326 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.050908 (+1217582us) raft_consensus.cc:1685] finished
0709 13:06:52.050946 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.051090 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33976,"raft.queue_time_us":35729,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":17722,"thread_start_us":74315,"threads_started":1,"wal-append.queue_time_us":291282}
I20260709 13:06:52.109577 22174 raft_consensus.cc:2393] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:52.108990 25196 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:52.065037 25185 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.070713 25197 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:52.326310 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 235656us
I20260709 13:06:52.153499 22811 rpcz_store.cc:276] 0709 13:06:50.910950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.570871 (+659921us) service_pool.cc:224] Handling call
0709 13:06:52.068428 (+497557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.222422 22248 rpcz_store.cc:276] 0709 13:06:50.481485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.482022 (+   537us) service_pool.cc:224] Handling call
0709 13:06:50.482419 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.486224 (+  3805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.486257 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.486731 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.742006 (+255275us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:50.770741 (+ 28735us) log.cc:844] Serialized 14 byte log entry
0709 13:06:50.776663 (+  5922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.776730 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.077252 (+1300522us) raft_consensus.cc:1685] finished
0709 13:06:52.077281 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.077449 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5699,"prepare.queue_time_us":29052,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":2887,"raft.queue_time_us":12474,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":15115,"thread_start_us":240831,"threads_started":1,"wal-append.queue_time_us":337336}
I20260709 13:06:52.193413 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.327320 22071 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:52.106176 25240 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.066304 25316 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.200132 25164 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:52.124291 24983 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.202344 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:52.202982 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:52.108058 25165 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:52.222000 25348 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:52.089020 22779 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:52.283028 25231 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:52.242491 22100 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
W20260709 13:06:52.291821 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.335116 22814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35214 (request call id 591) took 1416 ms. Trace:
I20260709 13:06:52.269200 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:52.259603 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 409) took 1497 ms. Trace:
I20260709 13:06:52.378131 22814 rpcz_store.cc:276] 0709 13:06:50.918330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.202085 (+1283755us) service_pool.cc:224] Handling call
0709 13:06:52.335065 (+132980us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.378955 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1806) took 1510 ms. Trace:
I20260709 13:06:52.255898 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:52.221083 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 189586us
W20260709 13:06:52.317080 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 120730us
W20260709 13:06:52.381506 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 292503us
I20260709 13:06:52.382310 22813 raft_consensus.cc:2410] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:06:52.383001 22813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35214 (request call id 589) took 1474 ms. Trace:
I20260709 13:06:52.383155 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:52.383167 22779 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:52.383507 22813 rpcz_store.cc:276] 0709 13:06:50.908462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.255500 (+1347038us) service_pool.cc:224] Handling call
0709 13:06:52.382889 (+127389us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.384091 25331 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:52.384828 25331 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:52.384816 22218 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:52.231070 22098 rpcz_store.cc:276] 0709 13:06:50.871214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.969859 (+1098645us) service_pool.cc:224] Handling call
0709 13:06:52.102427 (+132568us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:52.193156 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 67211.6us
I20260709 13:06:52.330883 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1620) took 1781 ms. Trace:
I20260709 13:06:52.332612 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:52.386353 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1804) took 1551 ms. Trace:
I20260709 13:06:52.386672 22248 rpcz_store.cc:276] 0709 13:06:50.835084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.332356 (+1497272us) service_pool.cc:224] Handling call
0709 13:06:52.386299 (+ 53943us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.335559 22255 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:52.387452 22220 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:52.243160 25249 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:52.320679 25268 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:52.102595 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 49858.6us
I20260709 13:06:52.250593 25329 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:52.237166 25339 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:52.284435 25319 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:52.327734 25123 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:52.388808 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:52.379653 22250 rpcz_store.cc:276] 0709 13:06:50.868261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.268849 (+1400588us) service_pool.cc:224] Handling call
0709 13:06:52.378873 (+110024us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.269201 25144 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.278687 25221 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:52.282456 25271 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:52.332185 25069 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:52.392069 22782 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:52.393214 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:52.417049 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1995) took 2342 ms. Trace:
I20260709 13:06:52.418560 22218 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:52.393764 22814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 593) took 1043 ms. Trace:
I20260709 13:06:52.390298 22779 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:52.420713 25237 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:52.420900 22779 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:52.421782 22172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 2049) took 1884 ms (client timeout 1823 ms). Trace:
W20260709 13:06:52.422209 22172 rpcz_store.cc:269] 0709 13:06:50.537238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.537356 (+   118us) service_pool.cc:224] Handling call
0709 13:06:52.421529 (+1884173us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54003282d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:52.421680 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295438208}
I20260709 13:06:52.193778 24973 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.423849 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:52.406720 25344 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:52.425028 24973 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:52.425897 22178 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 2050) took 1888 ms (client timeout 1584 ms). Trace:
I20260709 13:06:52.426062 22176 raft_consensus.cc:1240] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:52.413257 25185 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:52.426373 22178 rpcz_store.cc:269] 0709 13:06:50.537502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.537609 (+   107us) service_pool.cc:224] Handling call
0709 13:06:52.425695 (+1888086us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b54000db1d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:52.425826 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42424064}
I20260709 13:06:52.427987 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:52.428445 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1734) took 1765 ms. Trace:
I20260709 13:06:52.428635 22178 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:06:52.428978 22176 rpcz_store.cc:276] 0709 13:06:50.662938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.748027 (+ 85089us) service_pool.cc:224] Handling call
0709 13:06:52.425804 (+1677777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.426631 (+   827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.428175 (+  1544us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54003282d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:52.428362 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3857603840}
I20260709 13:06:52.429831 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:52.430507 22178 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:06:52.430860 25231 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:52.431517 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:52.431878 25231 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.394629 25186 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:52.432657 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:52.408082 25302 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:52.410064 25316 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:52.395752 25346 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:52.396507 25148 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:52.411369 25259 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:52.392839 25348 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.397104 25340 raft_consensus.cc:2764] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:52.397228 24932 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:52.394622 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:52.449388 22255 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:52.398240 25220 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.398731 25342 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:52.398871 22220 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:52.252455 25343 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:52.388057 22102 rpcz_store.cc:276] 0709 13:06:50.549527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.609464 (+ 59937us) service_pool.cc:224] Handling call
0709 13:06:50.623754 (+ 14290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.624021 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:50.980216 (+356195us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.060399 (+1080183us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.060725 (+   326us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.330437 (+269712us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.330496 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:52.330559 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.330646 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.330811 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":267917,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":3387,"raft.queue_time_us":167709,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":15662,"spinlock_wait_cycles":13224192,"thread_start_us":1634620,"threads_started":4,"wal-append.queue_time_us":819455}
I20260709 13:06:52.153564 25337 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.331372 25240 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.447304 24843 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:52.282987 25334 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:52.332432 25350 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:52.341506 25196 raft_consensus.cc:697] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:52.406150 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:52.378711 22173 rpcz_store.cc:276] 0709 13:06:50.762421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.770704 (+  8283us) service_pool.cc:224] Handling call
0709 13:06:50.791944 (+ 21240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.950104 (+158160us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:51.309366 (+359262us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.051022 (+741656us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:52.056740 (+  5718us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.056868 (+   128us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:52.056900 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.056967 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.259336 (+202369us) raft_consensus.cc:1685] finished
0709 13:06:52.259363 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.259527 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18061,"prepare.queue_time_us":407188,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":36729,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":9400,"thread_start_us":999970,"threads_started":3,"wal-append.queue_time_us":947474}
I20260709 13:06:52.399967 25333 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:52.447599 25221 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.485805 25333 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.404951 25232 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:52.408388 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.487461 22099 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:06:52.487562 25221 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:52.488618 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.489962 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.425203 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:52.440145 22178 raft_consensus.cc:2410] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:06:52.449672 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:52.422551 22779 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:52.440584 22177 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:52.448722 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:52.498095 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 49445.2us
W20260709 13:06:52.498267 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 75788us
I20260709 13:06:52.498977 22218 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:52.500516 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:52.500941 22100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1696) took 1747 ms (client timeout 1554 ms). Trace:
W20260709 13:06:52.501344 22100 rpcz_store.cc:269] 0709 13:06:50.753258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.753420 (+   162us) service_pool.cc:224] Handling call
0709 13:06:52.500779 (+1747359us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000b8954. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:52.500881 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3390694784}
I20260709 13:06:52.502188 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1816) took 1144 ms. Trace:
I20260709 13:06:52.417537 22254 rpcz_store.cc:276] 0709 13:06:50.075182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.075292 (+   110us) service_pool.cc:224] Handling call
0709 13:06:50.075624 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.076311 (+   687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.076337 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.080020 (+  3683us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.231730 (+151710us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:50.833294 (+601564us) log.cc:844] Serialized 14 byte log entry
0709 13:06:50.833577 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.833675 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.412167 (+1578492us) spinlock_profiling.cc:243] Waited 885 us on lock 0x7b54001ec6a0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7ec3dbe 00007f66a7ece930 00007f66a7ece8d8 00007f66a7ece858 00007f66a7ece813 00007f66a7ecda9c 00007f66addb9626 00007f66addb3dd8 00007f66a7f0a7cb 00007f66a7f0d2c0
0709 13:06:52.414153 (+  1986us) raft_consensus.cc:1685] finished
0709 13:06:52.416679 (+  2526us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.416978 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18785,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":32,"raft.queue_time_us":2503,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":10204,"spinlock_wait_cycles":2036608,"thread_start_us":727696,"threads_started":2,"wal-append.queue_time_us":148685}
I20260709 13:06:52.502388 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.402216 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:52.506165 22105 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:52.457589 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:52.460474 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.412045 25120 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:52.461419 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 62644.4us
I20260709 13:06:52.459810 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 446) took 3024 ms. Trace:
I20260709 13:06:52.412034 24983 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:52.473408 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:52.459772 24973 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:52.461130 24843 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.478403 25337 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:52.459766 25343 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.480779 25220 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:52.481176 25339 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:52.481599 25350 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.471978 24932 raft_consensus.cc:697] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:52.455142 25319 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:52.455598 25230 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:52.484758 25196 consensus_queue.cc:237] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.502589 22248 rpcz_store.cc:276] 0709 13:06:51.357314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.449306 (+1091992us) service_pool.cc:224] Handling call
0709 13:06:52.502124 (+ 52818us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.503018 25148 raft_consensus.cc:2764] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:52.503870 25348 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:52.504621 25323 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:52.453287 22814 rpcz_store.cc:276] 0709 13:06:51.350688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.392977 (+1042289us) service_pool.cc:224] Handling call
0709 13:06:52.393262 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.393451 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.393477 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.393518 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.393549 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.393604 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.393711 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.662885 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2057) took 1860 ms. Trace:
I20260709 13:06:52.545810 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 411) took 1782 ms. Trace:
I20260709 13:06:52.664971 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:52.656423 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.671639 22172 rpcz_store.cc:276] 0709 13:06:50.763037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.544916 (+1781879us) service_pool.cc:224] Handling call
0709 13:06:52.545320 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.545489 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.545514 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.545554 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:52.545585 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.545642 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.545758 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.674400 22097 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:06:52.675714 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.550360 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:52.614651 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 114184us
I20260709 13:06:52.550616 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:52.677054 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:52.677532 22099 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:52.607931 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.640403 25065 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:52.504568 25144 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:52.636737 25333 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:52.679721 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1782) took 4331 ms. Trace:
I20260709 13:06:52.679925 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2060) took 1793 ms. Trace:
I20260709 13:06:52.680593 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2058) took 1852 ms. Trace:
I20260709 13:06:52.557068 25221 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:52.680189 22249 rpcz_store.cc:276] 0709 13:06:48.334822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.337027 (+  2205us) service_pool.cc:224] Handling call
0709 13:06:48.353291 (+ 16264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.297266 (+943975us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:49.452962 (+155696us) log.cc:844] Serialized 14 byte log entry
0709 13:06:50.772491 (+1319529us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:06:50.849532 (+ 77041us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b180045ef80. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a7af64bc 00007f66a4e4448b 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee23a
0709 13:06:50.872068 (+ 22536us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:50.872127 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:50.872170 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.665620 (+1793450us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b54001cc5d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:52.665679 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.665831 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":166163,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":18054,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4816,"spinlock_wait_cycles":2179105024,"thread_start_us":218763,"threads_started":2,"wal-append.queue_time_us":74534,"wal-append.run_cpu_time_us":43124,"wal-append.run_wall_time_us":3059174}
I20260709 13:06:52.681143 22172 rpcz_store.cc:276] 0709 13:06:50.828149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.675647 (+1847498us) service_pool.cc:224] Handling call
0709 13:06:52.680150 (+  4503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.680310 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.680336 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.680373 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:52.680407 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.680455 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.680544 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.682083 25221 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:52.493964 25338 log.cc:927] Time spent T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.635s	user 0.004s	sys 0.006s
I20260709 13:06:52.704028 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:52.704435 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2061) took 1787 ms. Trace:
I20260709 13:06:52.580881 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2056) took 1810 ms. Trace:
I20260709 13:06:52.704962 22172 rpcz_store.cc:276] 0709 13:06:50.917441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.683167 (+1765726us) service_pool.cc:224] Handling call
0709 13:06:52.703933 (+ 20766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.704121 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.704145 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.704186 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:52.704219 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.704273 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.704380 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.704913 22814 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:52.683789 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 410) took 1921 ms. Trace:
I20260709 13:06:52.671511 22181 rpcz_store.cc:276] 0709 13:06:50.802674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.661814 (+1859140us) service_pool.cc:224] Handling call
0709 13:06:52.662248 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.662467 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.662505 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.662560 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:52.662604 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.662672 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.662814 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.705919 22180 rpcz_store.cc:276] 0709 13:06:50.770935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.568187 (+1797252us) service_pool.cc:224] Handling call
0709 13:06:52.580213 (+ 12026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.580464 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.580503 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.580562 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:52.580605 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.580669 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.580819 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.684154 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.707139 22173 rpcz_store.cc:276] 0709 13:06:50.762716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.484514 (+1721798us) service_pool.cc:224] Handling call
0709 13:06:52.484841 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.485063 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:52.620964 (+135901us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.683425 (+ 62461us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.683477 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:52.683525 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.683588 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.683706 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":115058,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":71,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":197485,"threads_started":2}
I20260709 13:06:52.709290 22102 raft_consensus.cc:2393] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:52.707923 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.710352 22097 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
W20260709 13:06:52.607235 25227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.256s	user 0.000s	sys 0.021s
I20260709 13:06:52.670625 25319 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.673867 22220 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:52.660912 22105 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:06:52.712607 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.718173 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.683408 22104 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:52.713183 22176 raft_consensus.cc:2410] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:52.637848 25020 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.681617 25350 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:52.715695 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:52.550766 25346 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:52.717917 22102 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:52.721953 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.680330 22178 rpcz_store.cc:276] 0709 13:06:50.886281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.679155 (+1792874us) service_pool.cc:224] Handling call
0709 13:06:52.679451 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.679623 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.679646 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.679690 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.679721 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.679777 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.679874 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.720391 22809 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:52.682533 25221 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.675027 24843 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:52.674309 22103 rpcz_store.cc:276] 0709 13:06:49.435672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.066242 (+630570us) service_pool.cc:224] Handling call
0709 13:06:50.075181 (+  8939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.395870 (+320689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.459556 (+2063686us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b540042bb54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:52.459746 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735817600}
I20260709 13:06:52.637596 25143 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:52.713140 25227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.451s	user 0.000s	sys 0.027s
I20260709 13:06:52.722440 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.707238 25342 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:52.722213 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:52.728050 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:52.740499 22816 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:52.546361 25232 consensus_queue.cc:1059] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.175s
I20260709 13:06:52.721354 25339 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 13:06:52.733649 25287 log.cc:927] Time spent T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 2.690s	user 0.015s	sys 0.008s
I20260709 13:06:52.716300 25148 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:06:52.721412 25344 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:52.707257 25230 consensus_queue.cc:1048] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:06:52.723812 25346 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:52.720885 25319 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:52.629097 25240 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.744542 22105 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:52.749455 22099 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:52.728921 22102 raft_consensus.cc:2410] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:06:52.682693 24973 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.742478 25342 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:52.747665 25152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.600s	user 0.011s	sys 0.047s
I20260709 13:06:52.754592 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 413) took 1031 ms. Trace:
I20260709 13:06:52.756604 22176 rpcz_store.cc:276] 0709 13:06:51.722950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.719789 (+996839us) service_pool.cc:224] Handling call
0709 13:06:52.720226 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.720524 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:52.720753 (+   229us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.753444 (+ 32691us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.753510 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:52.753568 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.753654 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.753874 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13446,"prepare.queue_time_us":843,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":1551,"thread_start_us":32296,"threads_started":1}
I20260709 13:06:52.758215 25342 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.758554 25343 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:52.759166 25344 raft_consensus.cc:697] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:52.760239 25344 consensus_queue.cc:237] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.752140 25346 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:52.763089 25152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.631s	user 0.011s	sys 0.047s
I20260709 13:06:52.726150 25020 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.750335 25143 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.790532 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:52.792804 22102 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:52.792043 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.794911 24973 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:52.797465 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:52.802333 22808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 450) took 2018 ms (client timeout 1727 ms). Trace:
I20260709 13:06:52.802573 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:06:52.802714 22808 rpcz_store.cc:269] 0709 13:06:50.783441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.787176 (+  3735us) service_pool.cc:224] Handling call
0709 13:06:52.802167 (+2014991us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b5400720e54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:52.802268 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786908416}
I20260709 13:06:52.803750 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:52.804373 22808 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:52.805050 22811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 592) took 1615 ms. Trace:
I20260709 13:06:52.805452 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:52.805433 22811 rpcz_store.cc:276] 0709 13:06:51.189895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.332057 (+1142162us) service_pool.cc:224] Handling call
0709 13:06:52.803051 (+470994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.803227 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.803251 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.803291 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:52.803319 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.803367 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.804913 (+  1546us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400720e50. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:52.805002 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979847424}
I20260709 13:06:52.808411 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:52.809144 25219 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.809689 25219 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:52.811818 25219 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:52.750684 24932 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.815480 25284 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:52.817180 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1817) took 1459 ms. Trace:
I20260709 13:06:52.817595 22247 rpcz_store.cc:276] 0709 13:06:51.357601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.579779 (+222178us) service_pool.cc:224] Handling call
0709 13:06:52.817002 (+1237223us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b54001ccad4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:52.817116 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95137536}
W20260709 13:06:52.819041 22174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 2051) took 2281 ms (client timeout 1624 ms). Trace:
W20260709 13:06:52.819424 22174 rpcz_store.cc:269] 0709 13:06:50.537758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.537891 (+   133us) service_pool.cc:224] Handling call
0709 13:06:52.818806 (+2280915us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54000db6d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:52.818954 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3507101568}
I20260709 13:06:52.774729 25143 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:52.800221 22218 connection.cc:256] RPC call timeout handler was delayed by -1.2854922870000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 13:06:52.864579 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:52.867621 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 412) took 1145 ms. Trace:
I20260709 13:06:52.981702 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:52.981014 22173 rpcz_store.cc:276] 0709 13:06:51.722610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.717794 (+995184us) service_pool.cc:224] Handling call
0709 13:06:52.730979 (+ 13185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.731238 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:52.755972 (+ 24734us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.863803 (+107831us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.867253 (+  3450us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.867311 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.867394 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.867548 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19095,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":6410,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":23043,"thread_start_us":117306,"threads_started":2}
I20260709 13:06:52.843024 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:52.906385 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 142073us
I20260709 13:06:52.982326 22248 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:06:52.949174 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:52.984045 22220 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:52.985483 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:52.985562 22220 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:52.923502 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 854) took 2627 ms. Trace:
I20260709 13:06:52.864200 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:52.980305 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:52.949766 22812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35214 (request call id 583) took 2105 ms (client timeout 1580 ms). Trace:
I20260709 13:06:52.849915 22808 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:52.986461 22807 rpcz_store.cc:276] 0709 13:06:50.296270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.296461 (+   191us) service_pool.cc:224] Handling call
0709 13:06:50.296726 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.326203 (+ 29477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.923248 (+2597045us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b5400690354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:52.923443 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66185600}
I20260709 13:06:52.987459 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:52.988209 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:52.988794 22250 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:52.988794 22254 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:06:52.992468 22220 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:52.991684 22098 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
W20260709 13:06:52.987076 22812 rpcz_store.cc:269] 0709 13:06:50.835262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.835762 (+   500us) service_pool.cc:224] Handling call
0709 13:06:52.940152 (+2104390us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54006225d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:52.940313 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105486720}
I20260709 13:06:52.995985 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:52.997843 22254 raft_consensus.cc:1240] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:53.007359 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.010102 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:53.010610 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.011606 22174 raft_consensus.cc:2368] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9.
I20260709 13:06:53.012058 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.008203 22255 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:52.823590 25263 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:53.014350 22176 raft_consensus.cc:2393] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:53.014657 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:52.822878 25125 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:53.017786 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:52.825310 25020 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:53.018774 22811 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:52.824002 25240 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:52.936161 25121 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:53.019163 22250 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:06:52.827486 25143 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:53.021416 22220 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:53.022162 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.022491 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.025779 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:53.023940 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:53.026371 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:52.990746 25344 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.027451 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:53.034417 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:52.997203 24932 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.013474 25013 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:52.901198 25346 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:53.099985 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.105373 22176 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:06:53.106273 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:53.106999 22176 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:53.101816 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.101997 22255 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:53.102029 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:52.935657 25342 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:53.108489 22173 raft_consensus.cc:2393] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:52.935042 24843 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:53.113636 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:53.113890 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.125313 22255 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.027324 25230 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.114879 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:53.127720 22173 raft_consensus.cc:2368] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9.
I20260709 13:06:53.115417 25346 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:53.106063 25013 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:52.914788 25319 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:53.114328 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.127110 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.134841 22072 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:53.136353 22072 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:53.138058 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.139940 22072 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:53.133984 22176 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:53.138756 22174 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:53.145383 22808 raft_consensus.cc:2368] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9.
I20260709 13:06:53.153635 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.118603 25342 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:53.154327 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.155316 22072 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:53.160140 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:53.160420 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 139190us
I20260709 13:06:53.155464 22176 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:06:53.171077 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.152580 25263 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:53.176002 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.152938 25266 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:53.182039 22254 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:53.159849 24827 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.183238 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:53.183512 25370 log.cc:927] Time spent T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:06:53.183609 24827 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:53.184144 24827 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.187222 22254 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:53.187883 22173 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:53.188611 22250 raft_consensus.cc:2368] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9.
I20260709 13:06:53.176573 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:53.198268 22247 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:53.198846 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:53.199859 22176 raft_consensus.cc:2368] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9.
I20260709 13:06:53.200846 22255 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:53.170821 25125 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:53.201764 25125 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:53.202189 25125 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:53.202440 24932 consensus_queue.cc:1059] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:53.203518 24932 raft_consensus.cc:3055] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:53.203868 24932 raft_consensus.cc:740] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:53.181217 25138 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.207670 25138 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:53.209087 24827 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:53.210762 22147 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:53.211458 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:53.211812 25121 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:53.212075 22100 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:53.212152 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.212323 25121 raft_consensus.cc:697] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:53.212563 24827 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:53.212975 22173 raft_consensus.cc:2393] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 8: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:53.213260 25121 consensus_queue.cc:237] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:53.213981 25013 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:53.213891 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:53.215554 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.210757 25138 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:53.217192 25238 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:53.169763 25350 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:53.223453 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.226698 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.229025 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.232146 22176 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:53.161576 25077 consensus_queue.cc:1059] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:06:53.171528 25260 consensus_queue.cc:1059] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:06:53.234644 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.235636 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:53.187750 25263 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.236830 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.246173 25238 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:06:53.246585 25221 consensus_meta.cc:287] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 13:06:53.192677 25266 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:53.248325 25013 raft_consensus.cc:3055] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:53.248394 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:53.260190 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.260414 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.251626 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.261703 22174 raft_consensus.cc:2410] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:06:53.253707 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.258890 22147 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:53.233512 25350 raft_consensus.cc:697] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:53.260970 22176 raft_consensus.cc:2393] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 9: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:53.266485 22147 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:53.269140 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.254367 25263 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:53.277364 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1678) took 3533 ms. Trace:
I20260709 13:06:53.277741 22106 rpcz_store.cc:276] 0709 13:06:49.743824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.123775 (+379951us) service_pool.cc:224] Handling call
0709 13:06:50.846662 (+722887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.846901 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.846947 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:50.847005 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:50.847056 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.847129 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.277190 (+2430061us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b540001f750. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:53.277308 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1661708160}
I20260709 13:06:53.266182 25238 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:53.282390 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:53.282975 24827 raft_consensus.cc:3055] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:53.283360 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:53.283447 24827 raft_consensus.cc:740] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:53.284219 25143 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:53.284619 25143 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:53.284479 24827 consensus_queue.cc:260] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:53.285194 25143 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:53.285722 24827 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.286315 25238 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:53.272143 25240 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.268728 25284 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:53.275760 25350 consensus_queue.cc:237] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:53.204747 24932 consensus_queue.cc:260] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:06:53.264922 25013 raft_consensus.cc:740] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:53.265568 25266 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:53.284682 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 1994) took 3211 ms. Trace:
I20260709 13:06:53.287211 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:53.287606 25240 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:53.290148 24932 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.284219 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:53.272905 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.295892 22255 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:53.291325 22246 rpcz_store.cc:276] 0709 13:06:50.073580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.073704 (+   124us) service_pool.cc:224] Handling call
0709 13:06:50.074099 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.099693 (+ 25594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.099735 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:50.099775 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:50.099823 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.284470 (+3184647us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b540005dcd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:53.284514 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.284629 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58373888}
I20260709 13:06:53.293605 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.290498 25013 consensus_queue.cc:260] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:53.297852 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.298511 25013 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.299254 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:53.299969 25240 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.301749 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.302464 22255 raft_consensus.cc:2376] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7. Re-sending same reply.
I20260709 13:06:53.303388 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:53.304219 22101 raft_consensus.cc:2410] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:53.300700 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:53.305838 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.306879 22246 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:06:53.312100 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:53.283596 25138 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:53.296604 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:54.794297 22174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1758) took 1549 ms (client timeout 1669 ms). Trace:
I20260709 13:06:53.287300 25319 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:54.794719 22174 rpcz_store.cc:269] 0709 13:06:53.245345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.296301 (+ 50956us) service_pool.cc:224] Handling call
0709 13:06:54.794210 (+1497909us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:53.339746 25138 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:53.269109 25221 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:54.639427 25374 ts_tablet_manager.cc:933] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:54.645538 22035 debug-util.cc:398] Leaking SignalData structure 0x7b0800370020 after lost signal to thread 21004
W20260709 13:06:54.644548 25375 log.cc:927] Time spent T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.728s	user 0.000s	sys 0.001s
W20260709 13:06:54.655081 25350 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.365s	user 0.018s	sys 0.039s
W20260709 13:06:54.808768 25350 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.519s	user 0.018s	sys 0.039s
W20260709 13:06:54.733047 25143 consensus_meta.cc:287] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 1.447s	user 0.007s	sys 0.005s
I20260709 13:06:54.811203 25143 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:54.760165 22251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1814) took 3403 ms (client timeout 2239 ms). Trace:
W20260709 13:06:54.815721 22251 rpcz_store.cc:269] 0709 13:06:51.356658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.759905 (+3403247us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:54.760067 (+   162us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:54.774828 25266 consensus_meta.cc:287] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.484s	user 0.012s	sys 0.000s
I20260709 13:06:54.776930 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:54.817682 22181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1753) took 1573 ms (client timeout 1822 ms). Trace:
I20260709 13:06:54.817585 25266 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:54.818125 22181 rpcz_store.cc:269] 0709 13:06:53.243875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.776570 (+1532695us) service_pool.cc:224] Handling call
0709 13:06:54.817617 (+ 41047us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.819480 22181 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:54.820120 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1745) took 1609 ms. Trace:
I20260709 13:06:54.820469 22181 rpcz_store.cc:276] 0709 13:06:53.210285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.818904 (+1608619us) service_pool.cc:224] Handling call
0709 13:06:54.819298 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.819878 (+   580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.820064 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.822170 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2092) took 1601 ms. Trace:
W20260709 13:06:54.779321 22250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 2025) took 1757 ms (client timeout 2011 ms). Trace:
I20260709 13:06:54.822986 25319 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:06:54.823074 22250 rpcz_store.cc:269] 0709 13:06:53.021953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.025541 (+  3588us) service_pool.cc:224] Handling call
0709 13:06:54.779052 (+1753511us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54002dcb54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:54.779234 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372649856}
I20260709 13:06:54.795888 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:54.823791 25319 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:54.824476 22174 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
W20260709 13:06:54.825011 22174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1757) took 1580 ms (client timeout 2067 ms). Trace:
W20260709 13:06:54.825364 22174 rpcz_store.cc:269] 0709 13:06:53.245090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.795603 (+1550513us) service_pool.cc:224] Handling call
0709 13:06:54.824955 (+ 29352us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.825965 25319 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:54.826762 22174 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:54.797924 25138 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:54.800592 25221 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:54.812666 25230 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.607s	user 0.038s	sys 0.108s
W20260709 13:06:54.828166 25230 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.623s	user 0.038s	sys 0.108s
W20260709 13:06:54.814332 22172 consensus_meta.cc:287] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 1.554s	user 0.010s	sys 0.015s
I20260709 13:06:54.831049 22172 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
W20260709 13:06:54.832849 22172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 2068) took 2005 ms (client timeout 1665 ms). Trace:
W20260709 13:06:54.834936 22172 rpcz_store.cc:269] 0709 13:06:52.827877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.829087 (+  1210us) service_pool.cc:224] Handling call
0709 13:06:53.248246 (+419159us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800165698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:54.832773 (+1584527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2699136}
I20260709 13:06:54.838236 22172 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:06:54.841300 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1751) took 1603 ms. Trace:
W20260709 13:06:54.743642 25013 consensus_meta.cc:287] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.445s	user 0.006s	sys 0.005s
I20260709 13:06:54.837006 22248 raft_consensus.cc:2368] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7.
I20260709 13:06:54.827461 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1747) took 1605 ms. Trace:
I20260709 13:06:54.822518 22181 rpcz_store.cc:276] 0709 13:06:53.220664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.821360 (+1600696us) service_pool.cc:224] Handling call
0709 13:06:54.821668 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.821841 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.821871 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:54.821919 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:54.821952 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.822007 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.822117 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.843168 25143 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:54.847250 25318 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:54.843647 25273 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.879388 22172 rpcz_store.cc:276] 0709 13:06:53.237849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.837593 (+1599744us) service_pool.cc:224] Handling call
0709 13:06:54.837963 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.841009 (+  3046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.841244 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.843438 24454 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:54.883534 24454 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:54.884255 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1756) took 1639 ms. Trace:
I20260709 13:06:54.884876 22172 rpcz_store.cc:276] 0709 13:06:53.244637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.883401 (+1638764us) service_pool.cc:224] Handling call
0709 13:06:54.883742 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.883926 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.883953 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:54.883996 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:54.884032 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.884086 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.884202 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:54.867220 25232 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.617s	user 0.013s	sys 0.061s
I20260709 13:06:54.886183 25374 tablet_copy_client.cc:323] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.67:42273
I20260709 13:06:54.880190 22174 rpcz_store.cc:276] 0709 13:06:53.222228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.826012 (+1603784us) service_pool.cc:224] Handling call
0709 13:06:54.826524 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.827207 (+   683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.827409 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:54.886790 25232 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.637s	user 0.014s	sys 0.063s
W20260709 13:06:54.868799 22779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.588s	user 0.021s	sys 0.026s
W20260709 13:06:54.888370 22779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.607s	user 0.021s	sys 0.028s
I20260709 13:06:54.880200 25273 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:54.889788 22779 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:54.890564 25273 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:54.890679 25318 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:54.892174 25380 consensus_queue.cc:1059] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:54.893337 25318 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:54.893662 25380 raft_consensus.cc:3055] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:54.893839 25318 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.894147 25380 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:54.895227 25380 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:54.896781 25380 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:54.902136 25384 consensus_queue.cc:1059] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:54.902874 25318 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:54.905268 25318 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:54.905938 25318 raft_consensus.cc:3055] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:54.906363 25318 raft_consensus.cc:740] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:54.908149 25318 consensus_queue.cc:260] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:54.911795 25138 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:54.862226 22249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.599s	user 0.022s	sys 0.023s
W20260709 13:06:54.933988 22249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.679s	user 0.025s	sys 0.024s
I20260709 13:06:54.936697 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2013) took 1955 ms. Trace:
I20260709 13:06:54.937145 22249 rpcz_store.cc:276] 0709 13:06:52.980923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.981051 (+   128us) service_pool.cc:224] Handling call
0709 13:06:52.994083 (+ 13032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.019624 (+ 25541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.019656 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.027975 (+  8319us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.934474 (+1906499us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:54.935143 (+   669us) log.cc:844] Serialized 14 byte log entry
0709 13:06:54.936305 (+  1162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.936429 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.936484 (+    55us) raft_consensus.cc:1685] finished
0709 13:06:54.936505 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.936640 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69594,"prepare.queue_time_us":155,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":43,"raft.queue_time_us":28973,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":80655,"thread_start_us":1679391,"threads_started":1,"wal-append.queue_time_us":1463046}
I20260709 13:06:54.927062 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:54.939802 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:54.940379 22809 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:06:54.928174 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:54.942339 22814 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:54.929201 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:54.930194 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:54.933244 25384 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:54.885993 24454 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:54.926231 25318 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:54.942747 22253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1813) took 3590 ms (client timeout 2234 ms). Trace:
I20260709 13:06:54.944757 25384 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:54.945989 22253 rpcz_store.cc:269] 0709 13:06:51.352024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.942559 (+3590535us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:54.942672 (+   113us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:54.951359 25380 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:54.953500 25380 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:54.955698 25380 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:54.952546 25384 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:54.958765 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1754) took 1714 ms. Trace:
I20260709 13:06:54.959263 22180 rpcz_store.cc:276] 0709 13:06:53.244155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.839366 (+1595211us) service_pool.cc:224] Handling call
0709 13:06:54.839648 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.839817 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:54.949547 (+109730us) log.cc:844] Serialized 14 byte log entry
0709 13:06:54.958187 (+  8640us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:54.958237 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:54.958281 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.958438 (+   157us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.958563 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":118909,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":422,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":117487,"threads_started":2}
I20260709 13:06:54.962798 25138 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:54.962749 25323 raft_consensus.cc:3055] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:54.964296 25323 raft_consensus.cc:740] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:54.965186 25323 consensus_queue.cc:260] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:54.966374 25323 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:54.967744 22781 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.727s	user 0.023s	sys 0.031s
W20260709 13:06:54.968096 22781 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.727s	user 0.023s	sys 0.031s
W20260709 13:06:54.968364 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 1.72736e+06us
I20260709 13:06:54.976713 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1746) took 1755 ms. Trace:
I20260709 13:06:54.977183 22176 rpcz_store.cc:276] 0709 13:06:53.221291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.825102 (+1603811us) service_pool.cc:224] Handling call
0709 13:06:54.825440 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.825748 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.825774 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.826270 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.957230 (+130960us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:54.957270 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.957354 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.976502 (+ 19148us) raft_consensus.cc:1685] finished
0709 13:06:54.976523 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.976653 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17490,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":130488,"threads_started":1,"wal-append.queue_time_us":148344}
W20260709 13:06:54.992069 22808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 455) took 2225 ms (client timeout 1674 ms). Trace:
W20260709 13:06:54.992588 22808 rpcz_store.cc:269] 0709 13:06:52.766547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.995740 (+229193us) service_pool.cc:224] Handling call
0709 13:06:54.991794 (+1996054us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540004fe54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:54.991977 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341560576}
W20260709 13:06:55.006217 25240 consensus_meta.cc:287] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 1.706s	user 0.010s	sys 0.000s
I20260709 13:06:55.006865 25240 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:55.009305 25240 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:55.009335 25121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.789s	user 0.027s	sys 0.064s
W20260709 13:06:55.009959 25121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.790s	user 0.029s	sys 0.066s
I20260709 13:06:55.014262 25285 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:55.057740 22813 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.767s	user 0.014s	sys 0.003s
W20260709 13:06:55.058172 22813 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.768s	user 0.014s	sys 0.003s
I20260709 13:06:55.060611 22813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 459) took 2291 ms. Trace:
W20260709 13:06:55.061249 22807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.887s	user 0.061s	sys 0.089s
W20260709 13:06:55.061755 22807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.887s	user 0.061s	sys 0.089s
I20260709 13:06:55.061314 22813 rpcz_store.cc:276] 0709 13:06:52.769428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.249543 (+480115us) service_pool.cc:224] Handling call
0709 13:06:53.249897 (+   354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:53.250207 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.250232 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:53.271122 (+ 20890us) log.cc:844] Serialized 52 byte log entry
0709 13:06:53.290112 (+ 18990us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b1800434d40. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee0d1 00007f66a7f09a0f
0709 13:06:55.058540 (+1768428us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:55.059328 (+   788us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.060207 (+   879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.060288 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.060326 (+    38us) raft_consensus.cc:1685] finished
0709 13:06:55.060405 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.060547 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":303,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":19596,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":2808,"spinlock_wait_cycles":29443328,"thread_start_us":1768222,"threads_started":1,"wal-append.queue_time_us":1382129}
I20260709 13:06:55.067505 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 454) took 2301 ms. Trace:
W20260709 13:06:55.068627 25379 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.421s	user 0.003s	sys 0.000s
I20260709 13:06:55.067927 22807 rpcz_store.cc:276] 0709 13:06:52.766248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.991040 (+224792us) service_pool.cc:224] Handling call
0709 13:06:52.992422 (+  1382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.995931 (+  3509us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:53.147451 (+151520us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.062388 (+1914937us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.062858 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.067103 (+  4245us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:55.067148 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.067241 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.067308 (+    67us) raft_consensus.cc:1685] finished
0709 13:06:55.067321 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.067449 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":279210,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":4101,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":6253,"spinlock_wait_cycles":1043840,"thread_start_us":2012841,"threads_started":2,"wal-append.queue_time_us":1493326}
W20260709 13:06:55.072423 24827 consensus_meta.cc:287] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.786s	user 0.013s	sys 0.000s
W20260709 13:06:55.072683 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 1.78838e+06us
I20260709 13:06:55.073989 25121 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:55.074419 25121 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:55.074816 25121 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:55.081292 25263 consensus_meta.cc:287] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.804s	user 0.007s	sys 0.002s
I20260709 13:06:55.081837 25263 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:55.084048 22144 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:55.085325 25138 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:55.085368 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:55.085983 25138 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.086422 25138 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:55.087195 25185 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:55.087622 25185 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:55.088029 25185 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.093767 25138 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.098089 25138 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:55.099328 25263 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:55.096853 25121 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.103783 25185 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.104668 25121 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:55.105674 22815 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.834s	user 0.020s	sys 0.014s
W20260709 13:06:55.106024 22815 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.834s	user 0.020s	sys 0.014s
I20260709 13:06:55.106957 22815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 458) took 2337 ms. Trace:
I20260709 13:06:55.107069 25232 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:55.107635 25232 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.107321 22815 rpcz_store.cc:276] 0709 13:06:52.769227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.084765 (+315538us) service_pool.cc:224] Handling call
0709 13:06:53.106066 (+ 21301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:53.106423 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.106460 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:53.109172 (+  2712us) log.cc:844] Serialized 52 byte log entry
0709 13:06:53.251652 (+142480us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:55.106311 (+1854659us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.106555 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.106642 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.106688 (+    46us) raft_consensus.cc:1685] finished
0709 13:06:55.106700 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.106836 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23880,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":2633,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":794,"thread_start_us":1969646,"threads_started":2,"wal-append.queue_time_us":676948}
I20260709 13:06:55.112303 25185 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:55.114039 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:55.114902 22253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1833) took 1839 ms (client timeout 2134 ms). Trace:
W20260709 13:06:55.115301 22253 rpcz_store.cc:269] 0709 13:06:55.113603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.113782 (+   179us) service_pool.cc:224] Handling call
0709 13:06:55.114831 (+  1049us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.116355 25266 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:55.117084 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.118510 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.120488 24843 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:55.121240 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.122421 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.123692 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.125162 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.125731 22251 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
W20260709 13:06:55.126011 22248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 2016) took 2140 ms (client timeout 1875 ms). Trace:
I20260709 13:06:55.127213 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.127830 22251 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:55.128762 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.129338 22250 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:06:55.132077 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.131290 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.136475 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.137737 22253 raft_consensus.cc:2368] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9.
W20260709 13:06:55.126401 22248 rpcz_store.cc:269] 0709 13:06:52.985118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.985249 (+   131us) service_pool.cc:224] Handling call
0709 13:06:55.125771 (+2140522us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b5400145d54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:55.125903 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4255633792}
W20260709 13:06:55.139700 25125 consensus_meta.cc:287] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 1.937s	user 0.012s	sys 0.000s
I20260709 13:06:55.140030 25125 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.141559 25125 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:55.184074 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:55.188380 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:55.189271 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:55.189648 22807 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.190471 22808 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
W20260709 13:06:55.192951 22144 connection.cc:256] RPC call timeout handler was delayed by -1.5074232719999827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
W20260709 13:06:55.193516 22144 connection.cc:256] RPC call timeout handler was delayed by -1.5030311520000623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31190000000000007s for a response
W20260709 13:06:55.193881 22144 connection.cc:256] RPC call timeout handler was delayed by -1.417313652999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 13:06:55.194257 22144 connection.cc:256] RPC call timeout handler was delayed by -1.3840136530000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 13:06:55.194608 22144 connection.cc:256] RPC call timeout handler was delayed by -1.350713652999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
I20260709 13:06:55.218348 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:55.219067 22144 connection.cc:256] RPC call timeout handler was delayed by -1.3480136529999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 13:06:55.219599 22144 connection.cc:256] RPC call timeout handler was delayed by -1.299460358000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 13:06:55.219959 22144 connection.cc:256] RPC call timeout handler was delayed by -1.2161030030000575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 13:06:55.220340 22144 connection.cc:256] RPC call timeout handler was delayed by -1.1887603580000814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
I20260709 13:06:55.221743 22144 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:55.221829 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.223390 25185 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:55.224253 25185 raft_consensus.cc:697] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:55.226325 22104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1676) took 5844 ms (client timeout 2136 ms). Trace:
I20260709 13:06:55.197149 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:55.233115 22816 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:55.197768 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:55.235631 22815 raft_consensus.cc:2393] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:55.198647 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:55.198909 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:55.237462 22809 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.199822 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:55.200711 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:55.241043 22249 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:55.242275 22807 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:55.201073 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:55.243566 22814 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.245565 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.202200 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.247684 22248 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 8: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:55.204340 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.206390 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:55.208684 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:55.249946 22251 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:55.253072 22147 connection.cc:256] RPC call timeout handler was delayed by -1.6924246469999389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
I20260709 13:06:55.211627 22246 raft_consensus.cc:3055] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:55.255103 22246 raft_consensus.cc:740] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:06:55.232609 22104 rpcz_store.cc:269] 0709 13:06:49.381430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.381582 (+   152us) service_pool.cc:224] Handling call
0709 13:06:52.607735 (+3226153us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b5800003398. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:06:55.225795 (+2618060us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b5400215f54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:55.226059 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18097408}
I20260709 13:06:55.256597 22246 consensus_queue.cc:260] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:55.258366 22246 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:55.259896 22812 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.965s	user 0.020s	sys 0.036s
W20260709 13:06:55.260325 22812 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.966s	user 0.020s	sys 0.036s
I20260709 13:06:55.261718 22812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 462) took 2135 ms. Trace:
I20260709 13:06:55.211934 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:55.212158 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.211683 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:55.215981 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.216101 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:55.266572 22147 connection.cc:256] RPC call timeout handler was delayed by -1.6285246469999493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260709 13:06:55.229056 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:55.195130 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:55.225971 25185 consensus_queue.cc:237] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:55.267957 22147 connection.cc:256] RPC call timeout handler was delayed by -1.5524592529999381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260709 13:06:55.268417 22147 connection.cc:256] RPC call timeout handler was delayed by -1.5234839259999262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
I20260709 13:06:55.269134 22808 raft_consensus.cc:2410] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:06:55.270772 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.272114 25125 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:55.272279 22097 raft_consensus.cc:2376] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9. Re-sending same reply.
I20260709 13:06:55.272600 22220 leader_election.cc:400] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9.
I20260709 13:06:55.273671 25125 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.276896 25125 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:55.278007 22147 connection.cc:256] RPC call timeout handler was delayed by -1.4815752109999494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 13:06:55.278502 22147 connection.cc:256] RPC call timeout handler was delayed by -1.2573231420000184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 13:06:55.279834 22251 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
W20260709 13:06:55.281368 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:55.282150 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.284461 22147 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:55.287051 22255 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:55.287863 25121 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.290037 22147 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:55.291247 25121 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:55.291996 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.291249 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:55.293026 22255 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:55.295295 22220 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:55.296880 25197 consensus_queue.cc:1059] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:55.298745 22264 tablet_copy_service.cc:140] P 765d912bde9e48959e50d9efec3c26b6: Received BeginTabletCopySession request for tablet 79d645cd970b4b2789be5374cc2005aa from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:45738)
I20260709 13:06:55.262141 22812 rpcz_store.cc:276] 0709 13:06:53.126537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.266792 (+140255us) service_pool.cc:224] Handling call
0709 13:06:53.267438 (+   646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.267959 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:53.294270 (+ 26311us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.261064 (+1966794us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.261187 (+   123us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:55.261323 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.261449 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.261625 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25955,"prepare.queue_time_us":26075,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":59,"raft.queue_time_us":227,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":275,"thread_start_us":1966163,"threads_started":1,"wal-append.queue_time_us":1361709}
W20260709 13:06:55.301450 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.303891 22809 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:55.305037 25320 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.306358 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:55.307323 22813 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:55.307433 22811 raft_consensus.cc:1240] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:55.309180 22218 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.171s	user 0.021s	sys 0.090s
I20260709 13:06:55.309418 25243 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:55.293028 22249 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:55.314899 22104 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:55.316045 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.317504 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.318765 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.319885 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.335565 22255 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:06:55.326186 22814 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:06:55.330102 22816 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:06:55.318789 22147 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:55.340052 22807 raft_consensus.cc:1240] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:55.340374 22782 connection.cc:256] RPC call timeout handler was delayed by -1.6589700179999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
I20260709 13:06:55.340493 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:55.341787 22809 raft_consensus.cc:2393] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:55.342316 25020 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:55.343111 24843 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:55.343297 22101 raft_consensus.cc:2410] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:06:55.344030 22105 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:06:55.336076 22264 tablet_copy_service.cc:161] P 765d912bde9e48959e50d9efec3c26b6: Beginning new tablet copy session on tablet 79d645cd970b4b2789be5374cc2005aa from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:45738: session id = a07ca3d1b5b84f4bbcb907f709a69275-79d645cd970b4b2789be5374cc2005aa
I20260709 13:06:55.345046 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:55.340835 22782 connection.cc:256] RPC call timeout handler was delayed by -1.5545700180000495s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
I20260709 13:06:55.339505 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.347703 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1788) took 4595 ms. Trace:
W20260709 13:06:55.346625 22218 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.209s	user 0.023s	sys 0.091s
I20260709 13:06:55.349776 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:55.350692 25197 raft_consensus.cc:3055] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:55.351176 25197 raft_consensus.cc:740] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:55.352490 25197 consensus_queue.cc:260] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:55.355818 22246 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:06:55.356451 22246 pending_rounds.cc:85] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 4
I20260709 13:06:55.360396 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:55.361821 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:55.363832 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.363718 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:55.336635 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 72194.7us
I20260709 13:06:55.363682 22782 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:55.365612 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.366272 25121 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.366390 22249 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:55.359175 25320 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.367658 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:55.368306 25350 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.369058 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:55.368961 25350 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:55.369951 22249 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:55.370296 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.363850 25351 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:55.343173 25020 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.371268 25316 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:55.371421 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:55.371822 25316 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:55.372254 25316 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:55.372495 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:55.373764 25020 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:55.374569 22812 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:55.375272 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 2.23732e+06us
I20260709 13:06:55.376050 25020 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.376521 25020 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:55.376950 25020 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.376760 22782 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:55.377588 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:55.377791 25232 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:55.377882 25323 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:55.365171 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.379619 22247 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:55.369271 25320 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:55.381321 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:55.359182 22246 pending_rounds.cc:107] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:06:55.383057 22251 raft_consensus.cc:2393] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:55.349370 22252 rpcz_store.cc:276] 0709 13:06:50.750831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.753491 (+  2660us) service_pool.cc:224] Handling call
0709 13:06:50.776711 (+ 23220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.950868 (+1174157us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:52.063668 (+112800us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.336196 (+272528us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:52.336555 (+   359us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.336650 (+    95us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:52.336669 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.345768 (+3009099us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b540014afd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:55.345851 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.345918 (+    67us) raft_consensus.cc:1685] finished
0709 13:06:55.346024 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.346287 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17714,"prepare.queue_time_us":301125,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":470038,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":37413,"spinlock_wait_cycles":1855610240,"thread_start_us":664410,"threads_started":3,"wal-append.queue_time_us":330687,"wal-append.run_cpu_time_us":2461,"wal-append.run_wall_time_us":1037047}
I20260709 13:06:55.384733 22246 raft_consensus.cc:2889] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:55.344060 24843 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.386550 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:55.387742 22814 raft_consensus.cc:2393] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:55.355324 25243 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:55.389675 22816 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:55.388028 22815 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:55.388572 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.393034 22250 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:55.393307 22248 raft_consensus.cc:2368] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9.
I20260709 13:06:55.399209 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.399969 22102 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:55.399046 25197 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:55.411947 22098 raft_consensus.cc:2393] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:06:55.412978 22177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 2059) took 4562 ms (client timeout 1594 ms). Trace:
W20260709 13:06:55.413407 22177 rpcz_store.cc:269] 0709 13:06:50.850105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.056583 (+1206478us) service_pool.cc:224] Handling call
0709 13:06:55.412606 (+3356023us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b5400069354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:55.412760 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":758622592}
I20260709 13:06:55.394217 25350 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:55.394093 24843 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:55.401769 25243 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:55.436968 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 208272us
I20260709 13:06:53.312824 22254 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
W20260709 13:06:55.439190 22254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1830) took 2204 ms (client timeout 1908 ms). Trace:
W20260709 13:06:55.439741 22254 rpcz_store.cc:269] 0709 13:06:53.234634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.271922 (+ 37288us) service_pool.cc:224] Handling call
0709 13:06:55.438841 (+2166919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.441731 22144 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:55.443663 25121 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:55.444231 25121 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.444770 25121 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:55.445672 22102 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:55.444267 22098 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:06:55.401367 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 82695us
I20260709 13:06:55.448374 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.448621 22147 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:55.450127 25185 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.450585 25185 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:55.451269 25185 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.449581 22102 raft_consensus.cc:2410] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:06:55.453709 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.454002 22178 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:55.454818 22035 debug-util.cc:398] Leaking SignalData structure 0x7b0800039060 after lost signal to thread 22038
I20260709 13:06:55.454617 22098 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
W20260709 13:06:55.455370 22035 debug-util.cc:398] Leaking SignalData structure 0x7b0800039120 after lost signal to thread 22052
W20260709 13:06:55.455837 22035 debug-util.cc:398] Leaking SignalData structure 0x7b080022aea0 after lost signal to thread 22058
W20260709 13:06:55.455863 24932 consensus_meta.cc:287] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 2.150s	user 0.006s	sys 0.012s
I20260709 13:06:55.462241 22097 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:55.463198 22071 connection.cc:256] RPC call timeout handler was delayed by -1.2169898239999384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 13:06:55.463079 22782 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:55.463707 22071 connection.cc:256] RPC call timeout handler was delayed by -1.2115898239999296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
W20260709 13:06:55.464074 22071 connection.cc:256] RPC call timeout handler was delayed by -1.2025898239999151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260709 13:06:55.464352 22071 connection.cc:256] RPC call timeout handler was delayed by -1.1998898239999107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
I20260709 13:06:55.464268 25320 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:55.464864 22071 connection.cc:256] RPC call timeout handler was delayed by -1.1755898239999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
W20260709 13:06:55.465191 22071 connection.cc:256] RPC call timeout handler was delayed by -1.1386898239999255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 13:06:55.392037 22072 connection.cc:256] RPC call timeout handler was delayed by -1.3110990420000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
W20260709 13:06:55.465795 22072 connection.cc:256] RPC call timeout handler was delayed by -1.1069582229999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 13:06:55.465987 25345 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:55.466203 22072 connection.cc:256] RPC call timeout handler was delayed by -1.0919426959999328s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
W20260709 13:06:55.466586 22072 connection.cc:256] RPC call timeout handler was delayed by -1.0918261439999242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 13:06:55.467147 22072 connection.cc:256] RPC call timeout handler was delayed by -1.0511582230000158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
I20260709 13:06:55.467065 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:55.467635 22072 connection.cc:256] RPC call timeout handler was delayed by -1.0380288790000805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
I20260709 13:06:55.467964 25263 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:55.469012 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:55.468763 25263 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.469733 22179 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:55.465466 22071 connection.cc:256] RPC call timeout handler was delayed by -1.1170898240000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 13:06:55.471464 25266 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:55.472047 25266 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.472366 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:55.466609 25345 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:55.484790 25243 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.485621 25243 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:55.467971 22178 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
W20260709 13:06:55.496786 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 120608us
W20260709 13:06:55.491333 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 48504us
W20260709 13:06:55.500489 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 91788us
W20260709 13:06:55.515149 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 66640.5us
I20260709 13:06:55.519913 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:55.534569 22249 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:06:55.535416 25164 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:06:55.535962 22178 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:06:55.513908 25345 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:55.562662 22101 raft_consensus.cc:1240] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:06:55.530772 22144 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:55.565640 22808 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:55.528561 22264 tablet_copy_source_session.cc:215] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:55.577577 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:55.580660 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 72713.7us
W20260709 13:06:55.575151 22072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.519s (SENT) [suppressed 46 similar messages]
I20260709 13:06:55.584805 25138 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:55.583498 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:55.580204 25263 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:55.599078 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:55.599738 22249 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.599786 22179 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:06:55.591207 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.601460 22782 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:55.601055 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:55.605171 22101 raft_consensus.cc:2393] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:55.607262 22250 raft_consensus.cc:1240] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:55.610332 22144 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:55.611181 22106 raft_consensus.cc:2393] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:06:55.611729 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 80230.5us
I20260709 13:06:55.598462 25138 raft_consensus.cc:697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:55.614086 25232 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:55.618786 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:55.624547 25345 consensus_queue.cc:1059] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:06:55.627995 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.628450 25345 raft_consensus.cc:3055] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:55.628935 25345 raft_consensus.cc:740] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:55.629040 22248 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:06:55.630106 25345 consensus_queue.cc:260] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.631685 22782 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:55.635202 22144 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:55.636257 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.637027 25240 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:55.637153 22250 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:55.638322 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.631968 25345 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.599583 25316 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.645582 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.647965 22782 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:55.649605 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.649942 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:55.647172 25164 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:55.651428 25261 consensus_queue.cc:1059] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:55.653066 25350 raft_consensus.cc:3055] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:55.653463 25350 raft_consensus.cc:740] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:55.626538 25266 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:55.654512 25350 consensus_queue.cc:260] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:55.655575 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 83677.1us
I20260709 13:06:55.655961 25350 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.656355 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:55.656847 22071 leader_election.cc:400] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9.
I20260709 13:06:55.657368 25143 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.613432 25243 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:55.662307 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:55.658411 22071 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:55.665813 25138 consensus_queue.cc:237] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:55.667833 25263 consensus_queue.cc:1059] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:55.669827 25263 raft_consensus.cc:3055] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:55.670307 25263 raft_consensus.cc:740] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:55.671355 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:55.672091 22250 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:55.671854 25263 consensus_queue.cc:260] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.673136 25263 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.674993 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1755) took 2430 ms. Trace:
I20260709 13:06:55.675182 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:55.646639 25232 raft_consensus.cc:697] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:55.676340 22069 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:55.676501 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.677314 25243 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:55.677716 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:55.677731 25243 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:55.678498 25243 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.660274 22144 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:55.678742 22253 raft_consensus.cc:2368] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7.
I20260709 13:06:55.691293 22069 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:06:55.687672 22035 debug-util.cc:398] Leaking SignalData structure 0x7b08003d19a0 after lost signal to thread 22130
I20260709 13:06:55.679867 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:55.708194 22255 raft_consensus.cc:2410] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:06:55.706861 22035 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1a00 after lost signal to thread 22131
W20260709 13:06:55.698143 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 51923.1us
I20260709 13:06:55.720665 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:55.722733 22035 debug-util.cc:398] Leaking SignalData structure 0x7b080023efa0 after lost signal to thread 22205
I20260709 13:06:55.722640 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:55.699929 22144 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:55.684877 25316 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:55.699275 25143 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:55.712020 25164 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:55.675415 22181 rpcz_store.cc:276] 0709 13:06:53.244408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.881018 (+1636610us) service_pool.cc:224] Handling call
0709 13:06:55.415135 (+534117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.415741 (+   606us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:55.416400 (+   659us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.560334 (+143934us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.568645 (+  8311us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.568965 (+   320us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.569033 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:55.569092 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.576298 (+  7206us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.617060 (+ 40762us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b1800463a80. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:06:55.674660 (+ 57600us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b5400069350. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:55.674778 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":123867,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":140,"raft.queue_time_us":40168,"raft.run_cpu_time_us":527,"raft.run_wall_time_us":8737,"spinlock_wait_cycles":1240840192,"thread_start_us":105225,"threads_started":1,"wal-append.queue_time_us":194405}
W20260709 13:06:55.742965 22035 debug-util.cc:398] Leaking SignalData structure 0x7b08003f75e0 after lost signal to thread 22279
I20260709 13:06:55.711022 25240 raft_consensus.cc:697] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:55.685062 25121 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:55.747941 25350 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:55.748121 22069 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:06:55.748984 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 90757.3us
I20260709 13:06:55.748816 25263 consensus_queue.cc:1059] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:55.736112 25266 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:55.750967 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:55.751814 22178 raft_consensus.cc:1240] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:55.676535 25232 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:55.748200 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.747255 22248 raft_consensus.cc:2393] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:55.687690 25243 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.743914 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:52.719594 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:55.768225 22179 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:55.742020 25143 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:55.769166 25263 raft_consensus.cc:3055] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:55.769497 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:55.770215 25350 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:55.773020 22035 debug-util.cc:398] Leaking SignalData structure 0x7b08002d5140 after lost signal to thread 22840
W20260709 13:06:55.775404 22035 debug-util.cc:398] Leaking SignalData structure 0x7b0800278080 after lost signal to thread 22841
I20260709 13:06:55.781103 22105 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:06:55.776630 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:55.781585 22180 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 10: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:55.785254 22808 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:55.780264 22071 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:55.788313 22105 pending_rounds.cc:85] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 6
I20260709 13:06:55.788676 22105 pending_rounds.cc:107] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:06:55.789463 22105 raft_consensus.cc:2889] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:55.790107 25350 raft_consensus.cc:697] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:55.796006 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:55.796861 22811 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.796917 25350 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.801800 22106 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.805886 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:55.807817 22147 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:55.807962 22071 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:55.809432 22071 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:55.790812 22250 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:06:55.810556 22147 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:55.811447 25240 consensus_queue.cc:237] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:55.781386 25243 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:55.816736 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:55.817031 25243 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:55.817474 22104 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.817504 25243 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:55.818169 25243 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:55.816264 22807 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:06:55.773553 25143 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:55.816766 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:55.819653 22035 debug-util.cc:398] Leaking SignalData structure 0x7b08002d5280 after lost signal to thread 24964
W20260709 13:06:55.820196 22035 debug-util.cc:398] Leaking SignalData structure 0x7b08002d5100 after lost signal to thread 24983
W20260709 13:06:55.820490 22035 debug-util.cc:398] Leaking SignalData structure 0x7b080037b560 after lost signal to thread 25065
I20260709 13:06:55.774271 25263 raft_consensus.cc:740] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:55.831619 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.836937 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.837615 22069 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:55.839478 22035 debug-util.cc:398] Leaking SignalData structure 0x7b08002d5180 after lost signal to thread 25144
I20260709 13:06:55.788829 25285 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.847103 22071 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:55.825713 24843 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:55.848001 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.852725 22807 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:55.853888 25404 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:55.854526 25404 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.855074 25404 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:55.854584 22000 catalog_manager.cc:5697] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 2 to 9, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 9 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:55.853838 25196 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:55.857152 22000 catalog_manager.cc:5697] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 3 to 5, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 5 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.860688 25374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d645cd970b4b2789be5374cc2005aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:55.864004 22102 raft_consensus.cc:2393] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 6: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:55.867817 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:55.870913 22811 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:55.840027 25261 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:06:55.867219 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 56707.8us
I20260709 13:06:55.862763 22106 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:55.853804 22098 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:55.851220 25316 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:55.844367 25285 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:55.872406 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.872635 22809 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.867753 22249 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:55.874657 22097 raft_consensus.cc:1240] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:55.882009 22104 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:55.875252 25197 consensus_queue.cc:1059] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:06:55.883246 25285 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.883937 25197 raft_consensus.cc:3055] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:55.875440 25316 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.884364 25197 raft_consensus.cc:740] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:55.884780 25316 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:55.885366 25197 consensus_queue.cc:260] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:55.887200 25261 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:55.887668 25261 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:55.886775 25197 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.888160 25261 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.871686 25410 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.888974 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.889420 25410 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:55.872189 25185 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.890874 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:55.892539 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.895429 22104 raft_consensus.cc:2393] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:55.896121 22252 raft_consensus.cc:1240] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:55.849977 25266 raft_consensus.cc:697] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:55.901456 25020 consensus_meta.cc:287] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.516s	user 0.019s	sys 0.005s
I20260709 13:06:55.901561 22147 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:55.932068 22098 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:06:55.908413 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:55.909196 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:55.909943 22176 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:55.909859 22175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 2062) took 4340 ms (client timeout 1914 ms). Trace:
I20260709 13:06:55.912206 22100 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:06:55.917753 24843 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:55.871286 25263 consensus_queue.cc:260] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.892221 25185 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:55.920702 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:55.926046 22251 raft_consensus.cc:1240] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:55.933193 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 233327us
I20260709 13:06:55.928574 24932 consensus_queue.cc:1059] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:06:55.931460 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.901949 22105 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 4.
I20260709 13:06:55.933706 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:55.934952 22809 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
W20260709 13:06:55.934973 22175 rpcz_store.cc:269] 0709 13:06:51.569843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.071533 (+501690us) service_pool.cc:224] Handling call
0709 13:06:55.909479 (+3837946us) spinlock_profiling.cc:243] Waited 3.6 s on lock 0x7b54003287d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:06:55.909683 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8288027904}
W20260709 13:06:55.947023 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 109489us
W20260709 13:06:55.973845 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.940121 24843 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.977088 22069 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:55.979892 22000 catalog_manager.cc:5697] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.968752 25266 consensus_queue.cc:237] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:55.948827 25196 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:56.011565 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 62196.6us
W20260709 13:06:56.016714 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 115226us
I20260709 13:06:55.969283 25121 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:55.937922 25020 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.024610 25285 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:56.040516 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 109282us
W20260709 13:06:56.042210 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 47040.2us
I20260709 13:06:56.046950 22808 raft_consensus.cc:2393] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 8: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:06:56.048921 22000 catalog_manager.cc:5697] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:56.054171 22779 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:56.055969 22106 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:56.056321 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 240139us
I20260709 13:06:56.057397 22144 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:56.018718 25320 consensus_queue.cc:1059] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:06:56.047739 25263 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.069152 25411 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:56.071709 25411 raft_consensus.cc:697] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:56.075712 25020 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:56.075595 25411 consensus_queue.cc:237] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.079164 22071 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:56.084993 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:56.085914 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 57908us
I20260709 13:06:56.091946 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:56.092420 22101 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:56.053813 25325 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:06:56.058369 25143 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.104935 22105 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:06:56.105352 22105 pending_rounds.cc:85] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 3
I20260709 13:06:56.105571 22105 pending_rounds.cc:107] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:06:56.105806 22105 raft_consensus.cc:2889] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:56.105973 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:56.094949 25164 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:56.111104 22104 raft_consensus.cc:1275] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:06:56.115423 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 68100.5us
I20260709 13:06:56.088771 25185 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:06:56.118193 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 64096.3us
I20260709 13:06:56.119423 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:56.120210 22100 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:56.105122 25323 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:56.121417 22249 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.123118 22779 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:56.119065 25164 raft_consensus.cc:697] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:56.127132 22779 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:56.122371 25240 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:56.141618 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 71581.4us
I20260709 13:06:56.121719 25185 raft_consensus.cc:697] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:56.128553 25323 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.142130 25240 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:56.164106 25143 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:56.164245 25240 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:56.167737 25261 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.169214 25431 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.170270 25261 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:56.172866 25285 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:56.173290 25185 consensus_queue.cc:237] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.172719 22000 catalog_manager.cc:5697] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 3 to 6, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 6 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:56.175588 25164 consensus_queue.cc:237] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.111711 25404 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.156229 25323 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:56.179046 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:56.184022 22071 leader_election.cc:400] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9.
I20260709 13:06:56.187552 22071 leader_election.cc:403] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:06:56.159324 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 60397.4us
I20260709 13:06:56.157827 25411 consensus_queue.cc:1059] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:06:56.191047 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:56.160094 22072 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:56.160506 22147 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:56.189090 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.194622 22071 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:56.189612 22249 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:06:56.196266 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:56.192787 22000 catalog_manager.cc:5697] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:56.199263 25411 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9.
I20260709 13:06:56.199928 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:56.200115 25411 raft_consensus.cc:3055] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:56.200505 25411 raft_consensus.cc:740] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:56.153928 25421 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:06:56.201483 25432 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:56.201401 25411 consensus_queue.cc:260] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.201881 25419 raft_consensus.cc:3055] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:56.213222 24843 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.154551 25325 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.213160 25419 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:56.202446 25285 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.207787 22144 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:56.204293 22147 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:56.205987 22782 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:56.219741 25419 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.220387 25325 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:56.180750 25404 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:56.220922 25325 raft_consensus.cc:697] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:56.208452 25143 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.221907 25325 consensus_queue.cc:237] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.222502 25420 raft_consensus.cc:3055] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:56.210382 25261 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:56.223520 22808 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.225201 22000 catalog_manager.cc:5697] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 4 to 7, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 7 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:56.218649 22003 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40924 (request call id 275) took 13750 ms (client timeout 15000 ms). Trace:
W20260709 13:06:56.227262 22003 rpcz_store.cc:269] 0709 13:06:42.470672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.512259 (+ 41587us) service_pool.cc:224] Handling call
0709 13:06:56.218413 (+13706154us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:50.001088 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:50.123275 (+122187us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:50.123328 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:06:50.123349 (+    21us) tablet.cc:662] Decoding operations
0709 13:06:50.231666 (+108317us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:50.246397 (+ 14731us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:50.248996 (+  2599us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:06:50.447019 (+198023us) tablet.cc:701] Row locks acquired
0709 13:06:50.447088 (+    69us) write_op.cc:260] PREPARE: finished
0709 13:06:50.447298 (+   210us) write_op.cc:270] Start()
0709 13:06:50.447483 (+   185us) write_op.cc:276] Timestamp: P: 1783602410447220 usec, L: 0
0709 13:06:50.447513 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:06:50.453662 (+  6149us) log.cc:844] Serialized 8703 byte log entry
0709 13:06:52.077449 (+1623787us) op_driver.cc:464] REPLICATION: finished
0709 13:06:52.413094 (+335645us) write_op.cc:301] APPLY: starting
0709 13:06:52.413245 (+   151us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:52.413872 (+   627us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:52.414056 (+   184us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:52.491922 (+ 77866us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:52.492239 (+   317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:06:52.492289 (+    50us) write_op.cc:312] APPLY: finished
0709 13:06:52.493126 (+   837us) log.cc:844] Serialized 152 byte log entry
0709 13:06:52.493324 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:52.493524 (+   200us) write_op.cc:454] Released schema lock
0709 13:06:52.493617 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:52.550526 (+ 56909us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:52.555553 (+  5027us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":598880,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":324737,"apply.run_cpu_time_us":6280,"apply.run_wall_time_us":90792,"num_ops":22,"prepare.queue_time_us":393424,"prepare.run_cpu_time_us":27581,"prepare.run_wall_time_us":603435,"raft.queue_time_us":510801,"raft.run_cpu_time_us":23480,"raft.run_wall_time_us":143671,"replication_time_us":1629782,"thread_start_us":737643,"threads_started":4,"wal-append.queue_time_us":266621,"wal-append.run_cpu_time_us":28014,"wal-append.run_wall_time_us":2865467}]]}
I20260709 13:06:56.215560 22098 consensus_queue.cc:237] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.201999 25432 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:56.231760 25121 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:56.231923 25432 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:56.232535 25121 raft_consensus.cc:697] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:56.233532 25121 consensus_queue.cc:237] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.159003 25416 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.222970 25420 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:56.210978 22071 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:56.211474 25411 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.230666 22000 catalog_manager.cc:5697] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:56.240115 22808 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:56.183327 25316 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.238294 22000 catalog_manager.cc:5697] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:56.245285 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 201892us
I20260709 13:06:56.253355 22000 catalog_manager.cc:5697] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 3 to 4, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 4 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:56.254714 25404 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:56.255229 25404 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:56.255684 25404 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:56.259651 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 51928.5us
I20260709 13:06:56.260687 22144 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:56.263237 22220 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:56.158412 25243 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.246546 25138 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:56.266263 22071 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:06:56.238965 25416 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:56.267800 22071 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:56.268270 22147 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:56.268970 25350 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:56.269987 25420 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.276291 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:56.285604 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 158536us
I20260709 13:06:56.285737 22069 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:56.258307 25432 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.285737 22220 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:06:56.291236 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.291810 22097 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:56.295166 22218 connection.cc:256] RPC call timeout handler was delayed by -1.5419862740000099s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260709 13:06:56.295621 22218 connection.cc:256] RPC call timeout handler was delayed by -1.4942862740000464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 13:06:56.295918 22218 connection.cc:256] RPC call timeout handler was delayed by -1.4825862740000275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 13:06:56.296269 22218 connection.cc:256] RPC call timeout handler was delayed by -1.4033862740000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
W20260709 13:06:56.296556 22218 connection.cc:256] RPC call timeout handler was delayed by -1.4033862740000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
W20260709 13:06:56.296826 22218 connection.cc:256] RPC call timeout handler was delayed by -1.3988862740000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260709 13:06:56.297080 22218 connection.cc:256] RPC call timeout handler was delayed by -1.2656862740000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260709 13:06:56.297322 22218 connection.cc:256] RPC call timeout handler was delayed by -1.2521862740001097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 13:06:56.297569 22218 connection.cc:256] RPC call timeout handler was delayed by -1.2017862740000282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260709 13:06:56.297813 22218 connection.cc:256] RPC call timeout handler was delayed by -1.0427108159999534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 13:06:56.283668 25263 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:56.275334 25416 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:56.286135 25138 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:56.284454 25350 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:56.291013 25421 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:56.315116 25421 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:56.315614 25421 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.317301 22809 raft_consensus.cc:1240] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:56.318727 22147 leader_election.cc:400] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9.
I20260709 13:06:56.319118 25415 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:56.319805 22147 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:56.321637 22147 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:56.322438 25196 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.323130 25196 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:56.323215 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 47053.4us
I20260709 13:06:56.323962 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:56.324759 25196 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:56.325253 25196 raft_consensus.cc:697] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:56.325455 25419 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:56.326397 25196 consensus_queue.cc:237] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.291167 25261 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:56.328025 25261 raft_consensus.cc:697] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:56.329137 22105 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:56.328946 25261 consensus_queue.cc:237] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.329517 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:56.330134 22106 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.330461 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:56.330974 25420 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.330156 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:56.331012 22101 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:56.333340 25425 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:56.333886 25425 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.335084 25345 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.335484 22097 raft_consensus.cc:1240] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:56.335589 25345 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.315147 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:56.306366 25435 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:56.307425 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:56.309226 25143 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.311172 25020 raft_consensus.cc:3055] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:56.312512 25138 raft_consensus.cc:697] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:56.304433 25350 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:56.313591 25185 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:56.337066 25432 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:56.346288 22106 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:56.305526 25416 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.355180 24843 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:56.353140 25138 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:56.394304 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.394673 22811 raft_consensus.cc:1240] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:56.395215 25185 raft_consensus.cc:697] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:56.396292 25185 consensus_queue.cc:237] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.401381 22147 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:56.402079 22071 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:56.347111 25020 raft_consensus.cc:740] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:56.403878 25020 consensus_queue.cc:260] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.404186 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:56.404910 25020 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.405009 22251 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.347049 25435 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:56.407965 25435 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.408140 25425 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:56.411460 25345 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:56.394309 25240 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.414008 25240 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:56.414419 25243 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:56.399364 22220 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:06:56.420344 22101 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:06:56.415614 25316 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:56.361801 25285 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.422652 25285 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:56.423205 25285 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.425278 25285 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:56.419209 25197 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.426158 25197 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.428149 25197 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:56.428248 22779 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:56.430367 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35230 (request call id 456) took 3663 ms. Trace:
I20260709 13:06:56.431114 25323 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:56.431656 25323 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:56.431685 22779 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:56.432804 22251 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:06:56.432129 25323 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.439913 22782 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:56.437228 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 87550.4us
W20260709 13:06:56.449628 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 100974us
I20260709 13:06:56.455137 25433 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:56.455672 22810 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:56.455783 25433 raft_consensus.cc:697] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:56.439145 25164 raft_consensus.cc:2764] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:06:56.459570 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 57572.9us
I20260709 13:06:56.461256 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:56.392634 25415 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:06:56.469424 22218 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:56.470424 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:56.452325 25240 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.471292 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.439009 25345 consensus_queue.cc:1059] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:06:56.457628 25425 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:56.457974 25197 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:56.478070 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.488781 22177 raft_consensus.cc:1240] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:56.488826 22811 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:06:56.490247 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.490471 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:56.489800 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.478578 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.496326 22175 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:56.485060 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.503882 22176 raft_consensus.cc:2393] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 10: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:56.452078 25325 consensus_queue.cc:1059] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:06:56.448462 25404 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.494119 22181 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:56.456728 25433 consensus_queue.cc:237] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.430975 25374 rpcz_store.cc:276] 0709 13:06:52.768658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.995929 (+227271us) service_pool.cc:224] Handling call
0709 13:06:54.801811 (+1805882us) ts_tablet_manager.cc:934] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
0709 13:06:55.849377 (+1047566us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:56.326042 (+476665us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:56.326170 (+   128us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:56.429275 (+103105us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:56.429726 (+   451us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:56.430107 (+   381us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:56.430230 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":293,"tablet-copy.queue_time_us":809325,"thread_start_us":252582,"threads_started":2}
I20260709 13:06:56.514735 25374 tablet_copy_client.cc:806] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:56.516851 25374 tablet_copy_client.cc:670] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:56.519340 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:56.520202 22174 raft_consensus.cc:2393] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 10: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:56.471509 25432 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:06:56.493328 24932 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:56.533129 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 60371.8us
I20260709 13:06:56.534135 22173 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:56.538581 25197 raft_consensus.cc:697] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:56.539781 25197 consensus_queue.cc:237] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.540324 22218 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:56.542219 22218 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:56.543866 25449 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:56.544711 25449 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:56.545904 22218 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:56.539037 25448 consensus_queue.cc:1059] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:06:56.548446 22147 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:56.550577 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.552017 25449 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:56.553718 25449 raft_consensus.cc:3055] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:56.554121 25449 raft_consensus.cc:740] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:56.555078 25449 consensus_queue.cc:260] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.556315 25449 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:56.561219 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 67133.3us
I20260709 13:06:56.563572 25240 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:56.567251 25240 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:56.567708 25240 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:56.569099 22147 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:56.570269 25121 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:56.571048 25434 consensus_queue.cc:1059] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 13:06:56.575052 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.575057 25429 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:56.576200 25429 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:56.576622 25429 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:56.581928 25435 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.559161 25323 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.585080 25323 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:56.585681 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:56.589573 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.589016 25416 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.589967 25429 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.592322 25429 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:56.593847 25121 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:56.596280 25121 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:56.597906 22147 leader_election.cc:400] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9.
I20260709 13:06:56.598934 22147 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:56.599215 25439 log.cc:927] Time spent T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:06:56.603391 25285 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:56.603847 25285 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:56.604373 25285 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:56.606448 25404 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:56.527913 25425 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:06:56.558542 25374 tablet_copy_client.cc:538] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:06:56.612121 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 47789.9us
W20260709 13:06:56.618111 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 54206.1us
I20260709 13:06:56.513147 25350 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.626456 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.628726 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:56.629235 22180 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.635270 22181 raft_consensus.cc:1240] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:56.629261 25350 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:56.637596 24843 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.625075 25448 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.646363 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 47500.9us
I20260709 13:06:56.647447 22147 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:56.671531 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:56.672986 22810 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:56.673177 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.675379 25451 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:56.675993 25451 raft_consensus.cc:697] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:56.676934 25451 consensus_queue.cc:237] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.679898 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:06:56.681018 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 351924us
I20260709 13:06:56.674748 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.682597 22180 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:56.692848 22178 raft_consensus.cc:2393] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:56.668356 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.695194 22181 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 8: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:56.696038 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.697424 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.702219 22177 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:56.707690 22251 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:56.708240 22178 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:56.708889 22071 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:56.709987 22251 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:56.710510 22177 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:56.716261 22071 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:56.689391 25416 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:56.755262 22179 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:56.758628 22176 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:56.765391 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 49208.3us
I20260709 13:06:56.766543 22071 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:56.665470 24843 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:56.753825 25423 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.774786 22179 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:56.665637 25448 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.697250 25404 consensus_queue.cc:1048] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:06:56.799347 22071 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:56.697504 25143 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:06:56.756054 25263 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:56.800799 22220 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:56.718068 25266 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.158s
I20260709 13:06:56.774456 25323 consensus_queue.cc:1059] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
W20260709 13:06:56.908797 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 135983us
I20260709 13:06:56.881342 25448 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:56.708678 25350 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
W20260709 13:06:56.887153 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 196992us
I20260709 13:06:56.767820 25351 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.878479 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 186154us
I20260709 13:06:56.934996 25351 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.755889 25320 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.121s
W20260709 13:06:56.927332 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.939649 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.908567 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.940418 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.941929 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:56.925935 25421 consensus_meta.cc:287] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.610s	user 0.011s	sys 0.000s
I20260709 13:06:56.948772 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:56.950187 25164 raft_consensus.cc:3055] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:56.963039 25415 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:56.968555 22144 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:56.969631 25429 raft_consensus.cc:3055] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:56.973387 22180 raft_consensus.cc:1240] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:56.976917 22175 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:56.799005 25185 consensus_queue.cc:1059] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.161s
I20260709 13:06:56.981087 22144 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:56.986949 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.988574 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.929145 25263 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:56.948081 25435 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:56.996976 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:56.995671 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:56.999238 22809 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:06:56.979302 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:57.000185 22178 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:56.991644 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.992110 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.992544 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:57.003454 22181 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 8: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:56.980195 25419 raft_consensus.cc:3055] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:56.982033 25429 raft_consensus.cc:740] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:56.926839 25345 consensus_queue.cc:1059] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:06:56.979614 25164 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:57.027853 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:56.992463 25420 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:56.998643 25263 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.039002 25446 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:57.060909 24843 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:57.039449 25285 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:56.801843 25423 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:06:57.039959 22179 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 7: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:57.059304 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:57.070688 22178 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:06:56.984623 25421 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:57.074568 22177 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:06:57.038838 25447 log.cc:927] Time spent T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:06:57.115145 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:57.119450 22105 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:57.025794 25419 raft_consensus.cc:740] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:57.121229 25419 consensus_queue.cc:260] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:57.118419 22180 raft_consensus.cc:1240] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:57.076339 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:57.109817 22176 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:57.123735 22100 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:57.116588 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:57.125034 22175 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 8: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:57.126096 25419 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:57.056103 25452 log.cc:927] Time spent T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:06:57.026858 25410 raft_consensus.cc:3055] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:57.128609 25410 raft_consensus.cc:740] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:57.129974 25410 consensus_queue.cc:260] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:57.077731 25121 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:06:57.135432 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 334638us
I20260709 13:06:57.136525 22220 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:57.137394 25434 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:57.137748 22220 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:57.138710 22220 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:57.145223 22808 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:06:57.155157 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:57.155987 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:57.157008 22098 raft_consensus.cc:2393] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:57.161051 22249 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:57.163805 25456 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:57.164664 25456 raft_consensus.cc:697] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:57.165875 25456 consensus_queue.cc:237] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:57.171962 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:57.101668 25414 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:57.097208 25446 raft_consensus.cc:697] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:06:57.179900 25453 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.409s	user 0.000s	sys 0.002s
I20260709 13:06:57.180163 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:57.181454 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:57.184764 25454 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:06:57.190284 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:57.075742 25444 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:57.194221 25444 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:57.194708 25444 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.195060 25463 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:06:57.199249 25197 consensus_queue.cc:1059] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:57.200132 25421 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:57.200425 25197 consensus_queue.cc:1059] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:57.200762 25421 consensus_queue.cc:1059] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:57.201749 25421 raft_consensus.cc:3055] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:57.201869 25197 raft_consensus.cc:3055] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:57.202126 25421 raft_consensus.cc:740] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:57.202306 25197 raft_consensus.cc:740] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:57.063062 25196 consensus_queue.cc:1059] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.120s
I20260709 13:06:57.182758 22179 raft_consensus.cc:3055] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:57.150096 25411 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.213470 22179 raft_consensus.cc:740] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:57.147132 25121 raft_consensus.cc:697] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:06:57.267518 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.167979 25433 raft_consensus.cc:3055] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:57.173568 25448 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.270646 22251 raft_consensus.cc:1240] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:57.266186 22179 consensus_queue.cc:260] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:57.203197 25458 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:57.280165 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:57.288573 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:57.288674 22179 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.288793 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:57.290241 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:57.293053 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.293512 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.288590 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:57.318056 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:57.325825 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:57.329782 22252 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:57.274282 25433 raft_consensus.cc:740] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:57.160851 25429 consensus_queue.cc:260] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:57.355803 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 423331us
I20260709 13:06:57.359400 22218 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:57.358886 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:57.270152 25411 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:57.372547 25460 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.373142 25460 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:57.380343 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.283802 25421 consensus_queue.cc:260] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:57.390084 25471 raft_consensus.cc:3055] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:57.394260 25471 raft_consensus.cc:740] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:57.394549 25419 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:57.396179 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:57.386421 25449 consensus_meta.cc:287] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.830s	user 0.007s	sys 0.006s
I20260709 13:06:57.306102 25197 consensus_queue.cc:260] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:57.423413 22100 raft_consensus.cc:2410] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:06:57.424607 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 98891.3us
W20260709 13:06:57.412869 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 387459us
W20260709 13:06:57.436035 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.446607 22179 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:57.449409 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:57.453605 22807 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:57.453460 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:57.455821 22144 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:57.494995 22251 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:57.418143 25434 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:57.415688 25285 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:57.516887 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.488596 25451 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:57.563778 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:57.572809 25483 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:57.573485 25483 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:57.576233 25483 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:57.577078 25419 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.577699 25419 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:57.488327 25423 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:57.496445 25240 consensus_meta.cc:287] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.928s	user 0.008s	sys 0.004s
I20260709 13:06:57.574505 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:57.511941 25449 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:57.491613 25421 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.416739 25433 consensus_queue.cc:260] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:57.410802 25121 consensus_queue.cc:237] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:57.570227 25197 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:57.631733 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.632098 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:57.668551 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.571836 25451 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:57.633160 22102 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:57.580029 25460 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:57.613092 25285 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:57.672257 25350 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.630263 25457 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:06:57.631088 25476 log.cc:927] Time spent T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:06:57.698174 25492 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:06:57.698822 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 124630us
I20260709 13:06:57.699307 25461 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:57.693998 25449 raft_consensus.cc:697] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:57.737973 25350 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:57.743876 25461 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:57.744742 25449 consensus_queue.cc:237] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:57.746063 25350 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:57.700106 25475 consensus_queue.cc:1059] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 13:06:57.747761 25475 raft_consensus.cc:3055] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:57.748158 25475 raft_consensus.cc:740] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:57.749163 25475 consensus_queue.cc:260] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:57.750495 25475 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:57.701627 25482 log.cc:927] Time spent T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:57.399685 25446 consensus_queue.cc:237] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:57.626792 25425 raft_consensus.cc:3055] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:57.698184 22099 raft_consensus.cc:1275] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:57.694792 25451 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:57.710387 25419 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:57.711711 25478 log.cc:927] Time spent T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:06:57.711812 25374 tablet_bootstrap.cc:492] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:06:57.589113 25240 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:57.685153 25266 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.629777 25434 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.558265 25263 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:57.630053 25423 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:57.727221 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 238407us
I20260709 13:06:57.808701 22174 raft_consensus.cc:1240] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:57.737159 22255 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:06:57.694501 24843 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:57.721616 25320 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.754885 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:57.809963 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:57.413944 25471 consensus_queue.cc:260] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:57.622602 25404 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
W20260709 13:06:57.769608 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 132511us
W20260709 13:06:57.770195 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.721865 25433 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.746704 25461 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:57.786896 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.759123 25425 raft_consensus.cc:740] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:06:57.741384 25448 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:57.755152 25492 raft_consensus.cc:697] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:57.803889 25411 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:57.824110 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:57.824821 22106 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
W20260709 13:06:57.827534 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 72725.1us
I20260709 13:06:57.835289 22779 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:06:57.837291 22072 leader_election.cc:336] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.519s (SENT)
I20260709 13:06:57.820564 25320 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:57.808244 25434 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:57.844221 25434 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:57.819895 24843 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:57.845130 22097 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:57.846403 24843 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:57.846629 22097 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:57.848645 22247 raft_consensus.cc:1275] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:06:57.849756 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.854779 22072 leader_election.cc:336] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.597s (SENT)
I20260709 13:06:57.805692 25266 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:57.832801 25419 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:57.860219 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:57.861510 22072 leader_election.cc:336] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.689s (SENT)
I20260709 13:06:57.862124 22072 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:57.842859 25320 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:06:57.864324 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.869736 22097 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:57.873982 25448 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:57.880264 25489 log.cc:927] Time spent T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:57.881052 25240 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:57.887223 22253 raft_consensus.cc:2410] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:06:57.887326 25420 consensus_meta.cc:287] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.799s	user 0.011s	sys 0.001s
I20260709 13:06:57.888185 25420 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:57.880343 25263 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:57.891152 25492 consensus_queue.cc:237] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:57.896088 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.898955 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 48323.7us
I20260709 13:06:57.900524 22250 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:06:57.902140 22100 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:57.902637 22808 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:57.872295 25446 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:57.857857 25316 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:57.907073 22246 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:57.874497 25425 consensus_queue.cc:260] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:57.908390 25444 consensus_meta.cc:287] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.713s	user 0.010s	sys 0.000s
W20260709 13:06:57.909366 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 52618.5us
W20260709 13:06:57.905763 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 44234us
I20260709 13:06:57.911276 22808 raft_consensus.cc:1240] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:57.918823 22809 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:57.918805 22254 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:06:57.919605 22254 pending_rounds.cc:85] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 8
I20260709 13:06:57.919893 22254 pending_rounds.cc:107] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:06:57.920197 22254 raft_consensus.cc:2889] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:57.919134 25444 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:57.927826 25425 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:57.928498 25444 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:57.930220 22218 leader_election.cc:400] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9.
I20260709 13:06:57.930562 22218 leader_election.cc:403] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:57.931007 25462 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:57.931469 25462 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.931814 25462 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:57.935220 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:06:57.920179 22072 leader_election.cc:336] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.820s (SENT)
I20260709 13:06:57.937690 22072 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:57.946513 22072 leader_election.cc:336] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.820s (SENT)
I20260709 13:06:57.947201 22072 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:57.947362 22246 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:57.948807 22218 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:06:57.966480 22072 leader_election.cc:336] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.850s (SENT)
I20260709 13:06:57.968215 22072 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:57.971709 25263 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:57.972041 22072 leader_election.cc:336] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.853s (SENT)
I20260709 13:06:57.972504 22072 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:57.973448 25263 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:57.973795 22072 leader_election.cc:336] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.875s (SENT)
I20260709 13:06:57.974251 22072 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:57.951484 25446 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:57.978699 22246 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:57.975225 25263 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:57.968555 25495 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:06:57.980516 25495 consensus_queue.cc:1243] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer a07ca3d1b5b84f4bbcb907f709a69275 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:57.982178 24843 consensus_queue.cc:1059] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:57.968837 25457 consensus_queue.cc:1059] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:06:57.986903 25495 raft_consensus.cc:3055] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:57.980015 25266 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:57.987332 25495 raft_consensus.cc:740] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:57.988263 25495 consensus_queue.cc:260] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:57.988684 22781 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:57.989676 25320 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.990111 22781 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:06:57.993522 25481 log.cc:927] Time spent T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.500s	user 0.001s	sys 0.000s
I20260709 13:06:57.977617 25503 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:06:57.975142 25444 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:57.967026 25492 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:57.998936 25480 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.999079 24843 consensus_queue.cc:1059] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:58.003139 25460 raft_consensus.cc:3055] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:58.003600 25460 raft_consensus.cc:740] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:58.005292 25460 consensus_queue.cc:260] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.006316 25460 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.012043 22176 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:58.013238 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:58.009833 22781 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:58.015208 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.015837 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.002696 25410 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.029564 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:58.019860 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:58.031463 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 74406.6us
W20260709 13:06:58.031657 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 57899.2us
I20260709 13:06:58.034987 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:58.043792 22072 leader_election.cc:336] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.011s (SENT)
I20260709 13:06:58.044212 22072 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:58.045693 22254 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:58.019588 25492 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.048004 25492 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.050393 25492 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:58.051035 25464 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.051368 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:58.051595 25464 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:58.053072 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:58.054201 25464 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:58.047336 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:58.055302 25428 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.054455 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:58.063333 22246 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:58.059610 25320 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:58.064292 22072 leader_election.cc:336] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.073s (SENT)
I20260709 13:06:58.065869 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:58.068048 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:58.068368 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:58.009500 25451 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.066529 22104 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
W20260709 13:06:58.072983 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 58414.4us
I20260709 13:06:58.076114 22809 pending_rounds.cc:85] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting all ops after (but not including) 6
I20260709 13:06:58.076673 22809 pending_rounds.cc:107] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:06:58.076022 25320 consensus_queue.cc:1059] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:58.076947 22809 raft_consensus.cc:2889] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:58.079780 22097 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:58.082991 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:58.067332 25464 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:58.094198 22147 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:58.095958 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:58.106107 22179 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:06:58.104995 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:58.108014 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:58.109547 22246 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:06:58.111637 22147 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:58.115535 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:58.090032 25320 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:06:58.104842 25435 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.132292 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:58.133172 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:58.071615 25466 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:06:58.082137 25428 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:06:58.138453 25506 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 13:06:58.139552 25500 log.cc:927] Time spent T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:06:58.141010 25511 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:58.136492 25456 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:06:58.147415 25433 consensus_queue.cc:1059] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:06:58.148938 25509 log.cc:927] Time spent T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:58.149878 25351 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:58.150200 25433 raft_consensus.cc:3055] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:58.138878 25517 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:58.155714 22172 raft_consensus.cc:1240] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:58.138475 25468 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:06:58.157644 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:58.158090 22106 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:58.166848 22246 raft_consensus.cc:2376] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6. Re-sending same reply.
I20260709 13:06:58.167909 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1774) took 1488 ms. Trace:
I20260709 13:06:58.150727 25433 raft_consensus.cc:740] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:58.177453 25480 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:58.138496 25515 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.179258 22072 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:58.188380 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:58.188691 22072 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:58.186216 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:58.168258 22173 rpcz_store.cc:276] 0709 13:06:56.674080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.688794 (+ 14714us) service_pool.cc:224] Handling call
0709 13:06:56.707281 (+ 18487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.714578 (+  7297us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:56.938895 (+224317us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.162040 (+1223145us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b18000e3200. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a7af64bc 00007f66a4e4448b 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e5e455 00007f66a7f46060 00007f66a7f58716 00007f66a7f69287
0709 13:06:58.162132 (+    92us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.162165 (+    33us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:58.162197 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.162272 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.162388 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":360850,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":70868,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":68521,"spinlock_wait_cycles":5361920,"thread_start_us":542963,"threads_started":3,"wal-append.queue_time_us":382210}
I20260709 13:06:58.186668 25351 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.164507 25462 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.154336 25435 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:58.199301 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 120289us
I20260709 13:06:58.201972 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:58.202718 22779 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:58.195652 25444 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:58.206365 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:58.206408 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:58.208570 22106 raft_consensus.cc:2393] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:06:58.208709 22179 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 8: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:58.196555 25464 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:58.209764 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:58.207319 25480 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:58.215541 25480 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.215919 25480 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.222087 25415 raft_consensus.cc:3055] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:58.222548 25415 raft_consensus.cc:740] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:58.223440 25415 consensus_queue.cc:260] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:58.232834 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:58.190781 25515 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.235687 25451 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:58.231181 25415 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.236738 22809 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:58.204191 25351 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:58.244717 25351 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:58.245342 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:58.246522 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:58.252032 22103 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:58.250883 22255 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
W20260709 13:06:58.252400 22072 leader_election.cc:336] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.193s (SENT)
I20260709 13:06:58.250139 22246 raft_consensus.cc:2376] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7. Re-sending same reply.
I20260709 13:06:58.252877 22072 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:58.253005 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:58.253626 22179 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:06:58.242339 25433 consensus_queue.cc:260] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.254968 25410 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:58.255204 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:58.256285 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.257470 25480 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.257668 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:58.259624 25480 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:58.259654 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2112) took 1655 ms. Trace:
I20260709 13:06:58.262439 22147 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:58.263312 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:58.263594 22147 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:58.264163 22106 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.231254 25435 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:58.262585 22174 rpcz_store.cc:276] 0709 13:06:56.604388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.605147 (+   759us) service_pool.cc:224] Handling call
0709 13:06:56.605460 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.810133 (+1204673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.259375 (+449242us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540045f1d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:58.259581 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2766812032}
I20260709 13:06:58.268635 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:58.268726 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:58.283493 22255 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:06:58.268952 22072 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:58.271121 22815 raft_consensus.cc:1240] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:58.271231 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:58.271551 22218 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:06:58.273391 25428 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:58.274003 22781 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:58.277725 22810 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:06:58.287629 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:58.288286 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:58.288777 25351 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:58.289114 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:58.288800 25410 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:58.289499 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:58.288817 25240 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:58.290161 25435 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:06:58.356818 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.294799 22174 raft_consensus.cc:2376] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9. Re-sending same reply.
I20260709 13:06:58.360709 22105 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:58.367714 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:58.368116 22106 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:06:58.371318 22779 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:58.284085 25503 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:58.375602 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:58.377851 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.379004 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 105044us
I20260709 13:06:58.379825 22781 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:58.380541 25522 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:58.381320 22781 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:06:58.382107 25515 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:58.383072 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:58.387202 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:06:58.390950 25470 log.cc:927] Time spent T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 1.394s	user 0.000s	sys 0.012s
I20260709 13:06:58.381098 25522 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.290351 25164 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.394392 22218 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:58.367085 25410 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.360634 25266 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:58.394411 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:58.404799 25164 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:58.415861 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1872) took 1135 ms. Trace:
I20260709 13:06:58.416399 22251 rpcz_store.cc:276] 0709 13:06:57.280956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.281195 (+   239us) service_pool.cc:224] Handling call
0709 13:06:57.281451 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.496700 (+215249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.409553 (+912853us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54002db754. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:58.415772 (+  6219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324081536}
I20260709 13:06:58.376405 25480 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:58.376891 25020 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:58.420001 22105 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:06:58.423298 22779 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:58.410986 25410 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.395720 25503 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:58.431531 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:58.442634 22251 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:58.425096 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:58.431680 25261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.363s	user 0.024s	sys 0.032s
I20260709 13:06:58.434298 22253 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:58.424647 25521 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.419283 25435 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:58.439139 25020 raft_consensus.cc:697] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:06:58.441591 25523 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:06:58.447162 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.396348 25421 consensus_queue.cc:1059] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:06:58.463356 25421 raft_consensus.cc:3055] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:58.463877 25421 raft_consensus.cc:740] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:58.465075 25421 consensus_queue.cc:260] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.466820 25421 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.456988 22174 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:58.459390 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:58.470072 22253 raft_consensus.cc:2368] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9.
I20260709 13:06:58.471280 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:58.480576 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:58.492424 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:58.450747 25261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.382s	user 0.024s	sys 0.032s
I20260709 13:06:58.433566 25461 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:58.493992 22174 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:58.456991 22251 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:06:58.495826 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:58.495748 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:58.497327 22251 raft_consensus.cc:2376] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10. Re-sending same reply.
I20260709 13:06:58.499353 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:58.501226 22253 raft_consensus.cc:2410] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:06:58.420854 25266 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.512845 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:58.513844 22253 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:58.514039 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:58.493932 25435 raft_consensus.cc:697] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:58.514595 22178 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:58.516578 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.514051 25460 consensus_meta.cc:287] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.004s
I20260709 13:06:58.518586 25515 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:58.522228 25266 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:58.523335 22178 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:58.523845 25522 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:58.528947 25020 consensus_queue.cc:237] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.502465 25461 raft_consensus.cc:697] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:58.530499 25461 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.531169 25503 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:58.529433 25515 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:06:58.532655 25515 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:58.533771 25450 log.cc:927] Time spent T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 1.585s	user 0.000s	sys 0.002s
I20260709 13:06:58.526139 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:58.554613 22178 raft_consensus.cc:1240] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:58.554798 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.559772 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:58.562471 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:58.577242 25435 consensus_queue.cc:237] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.591723 22250 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:06:58.605388 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:58.606330 22250 raft_consensus.cc:2376] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7. Re-sending same reply.
I20260709 13:06:58.597092 25507 consensus_queue.cc:1059] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:06:58.556228 25479 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:06:58.586026 25491 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:06:58.610951 25138 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:58.578621 25515 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.625799 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:58.633626 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:58.618445 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:58.638965 22246 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:58.638810 22253 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:06:58.640769 22253 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:58.609549 25410 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:58.607657 25512 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:06:58.641011 22250 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:58.638041 25285 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.646415 22246 raft_consensus.cc:1240] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:58.647087 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.652801 22253 raft_consensus.cc:3055] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:58.656901 25515 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:58.655398 22246 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:58.653275 22253 raft_consensus.cc:740] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:58.660326 22250 raft_consensus.cc:1240] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:58.668090 22251 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:58.669862 22250 raft_consensus.cc:1240] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:58.672537 22250 raft_consensus.cc:1240] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:58.673309 25521 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:58.672729 25495 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.668244 22253 consensus_queue.cc:260] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:58.681187 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.681463 22781 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:58.684223 22246 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:58.689869 22246 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:58.691318 25433 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.693912 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:58.694193 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.694671 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:06:58.696273 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:58.698575 22807 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
W20260709 13:06:58.710884 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.713563 22809 raft_consensus.cc:1240] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:58.708668 25266 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.717342 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:58.717231 25266 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.718415 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:58.719447 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 568) took 2383 ms. Trace:
I20260709 13:06:58.720067 22253 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.719465 22105 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:58.721696 22812 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:06:58.658944 25285 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.719837 22249 rpcz_store.cc:276] 0709 13:06:56.336178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.348749 (+ 12571us) service_pool.cc:224] Handling call
0709 13:06:56.349049 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.161655 (+812606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.719223 (+1557568us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b54002cc4d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:58.719368 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866800384}
W20260709 13:06:58.723430 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.792831 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.013716 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:59.021723 22101 raft_consensus.cc:2410] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:58.767019 22102 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:58.947966 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.762189 22147 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:58.723721 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:58.762087 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:06:59.024650 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 262534us
I20260709 13:06:58.776196 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:06:59.025904 22147 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:58.788033 22099 raft_consensus.cc:1240] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:59.029122 22104 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:58.902534 22253 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:06:58.788235 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 65394us
I20260709 13:06:58.713009 25435 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.812865 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2116) took 1834 ms. Trace:
I20260709 13:06:59.044993 22180 rpcz_store.cc:276] 0709 13:06:56.978013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.983154 (+  5141us) service_pool.cc:224] Handling call
0709 13:06:56.983504 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.123517 (+140013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.791182 (+1667665us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540031a6d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:58.812764 (+ 21582us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306208640}
W20260709 13:06:58.762782 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 81379.8us
I20260709 13:06:59.047705 22781 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:06:59.047932 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.857723 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:59.049644 22098 raft_consensus.cc:2410] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:06:58.767954 25020 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:58.720762 25515 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.073553 22104 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:58.791363 25466 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.039330 25473 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:58.714776 25514 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:59.040632 25374 log.cc:927] Time spent T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:06:58.720113 25512 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:58.761307 25164 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:58.813584 25445 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.722815 25243 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.855811 25261 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.841678 25266 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:59.093524 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:59.074470 25240 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:06:58.791244 25491 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.293s
I20260709 13:06:59.074597 25456 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:59.104702 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:59.108978 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.100826 25466 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:59.108296 25410 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:59.122392 22180 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:59.111271 25473 raft_consensus.cc:697] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:59.073235 25435 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:59.097790 25515 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:59.133929 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.101305 22098 raft_consensus.cc:1240] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:59.088594 25020 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:59.140843 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.143303 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:59.148600 22174 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:59.149096 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.112865 25164 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:59.146292 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:59.141446 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:59.118593 22104 raft_consensus.cc:1240] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:59.125408 25514 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:59.157752 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:59.159246 22099 raft_consensus.cc:2410] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:59.163610 25473 consensus_queue.cc:237] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:59.164518 25164 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:59.167517 25543 log.cc:927] Time spent T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:06:59.168785 25020 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:59.170553 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:59.172559 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:59.175983 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:59.176647 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:59.175632 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:06:59.177416 22106 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:59.142592 24932 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:59.178433 24932 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:59.127393 25266 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.105162 25544 consensus_queue.cc:1059] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:06:59.111838 25512 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:59.180891 24932 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:59.116827 25428 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:06:59.192083 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 630) took 1121 ms. Trace:
I20260709 13:06:59.116670 25445 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:59.121742 25243 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:59.215735 25456 raft_consensus.cc:697] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:06:59.216986 25456 consensus_queue.cc:237] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:59.218086 25243 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:06:59.195401 25537 log.cc:927] Time spent T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.425s	user 0.001s	sys 0.001s
I20260709 13:06:59.220288 25466 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:59.221335 22104 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:06:59.194078 25514 raft_consensus.cc:697] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:59.223917 25514 consensus_queue.cc:237] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:59.225713 25433 consensus_meta.cc:287] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.003s
I20260709 13:06:59.228410 25435 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:59.229131 25435 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:59.229604 25435 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:59.231379 25505 log.cc:927] Time spent T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 1.301s	user 0.002s	sys 0.002s
W20260709 13:06:59.233007 25549 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:06:59.233254 25445 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:59.233922 25538 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.389s	user 0.000s	sys 0.001s
I20260709 13:06:59.210989 25285 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:59.199528 22180 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
W20260709 13:06:59.159112 25540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.011s	sys 0.025s
I20260709 13:06:59.193605 22808 rpcz_store.cc:276] 0709 13:06:58.070990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.071798 (+   808us) service_pool.cc:224] Handling call
0709 13:06:58.095435 (+ 23637us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.181446 (+ 86011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.181470 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.194309 (+ 12839us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.227754 (+ 33445us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:58.227790 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.227849 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.178953 (+951104us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b24002e66e8. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4ce79c4 00007f66a4ce5acb 00007f66a4ea0dc9 00007f66a4ea0a55 00007f66a4e9ffb0 00007f66a7b16488 00007f66a7b16be8 00007f66a7aee398 00007f66a7ae976a 00007f66a7ae8bb6
0709 13:06:59.181379 (+  2426us) raft_consensus.cc:1685] finished
0709 13:06:59.181409 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.191984 (+ 10575us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52932,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":3481984,"thread_start_us":109297,"threads_started":2,"wal-append.queue_time_us":45090}
W20260709 13:06:59.194516 25495 consensus_meta.cc:287] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.003s
I20260709 13:06:59.125268 25261 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:58.874581 25449 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:59.249509 25540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.011s	sys 0.025s
I20260709 13:06:59.270009 22176 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:06:58.761664 24843 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.499s
I20260709 13:06:59.283905 22813 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:59.287333 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1766) took 1369 ms. Trace:
I20260709 13:06:59.288012 22100 rpcz_store.cc:276] 0709 13:06:57.912446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.913111 (+   665us) service_pool.cc:224] Handling call
0709 13:06:57.913448 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.937207 (+ 23759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.937235 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.937284 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:57.937315 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.280961 (+1343646us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b540001e854. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:59.281037 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.281268 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54211456}
I20260709 13:06:59.303711 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:59.304816 22181 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:59.287439 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:59.311604 22180 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:06:59.303887 22174 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:06:59.195472 25266 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:59.322759 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 275090us
I20260709 13:06:59.323405 22180 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:59.371552 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 47432.9us
I20260709 13:06:59.373129 22781 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:06:59.403196 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.277830 25449 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:59.416088 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 352322us
I20260709 13:06:59.320914 25433 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:59.421501 22174 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:59.417186 22180 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:59.370371 25492 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.377894 25445 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.410178 25020 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:59.426117 25554 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.455622 25557 consensus_queue.cc:1059] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:59.457914 25557 raft_consensus.cc:3055] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:59.458421 25557 raft_consensus.cc:740] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:59.464247 25266 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:06:59.471611 25545 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 13:06:59.472508 25553 log.cc:927] Time spent T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:06:59.474519 25261 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:59.496605 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1885) took 1237 ms. Trace:
I20260709 13:06:59.497658 25435 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:59.498262 25435 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:59.493427 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 577) took 2131 ms. Trace:
I20260709 13:06:59.499642 22254 rpcz_store.cc:276] 0709 13:06:57.362256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.921209 (+558953us) service_pool.cc:224] Handling call
0709 13:06:57.921482 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.046118 (+124636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.493071 (+1446953us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54002dc654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:59.493347 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284941696}
I20260709 13:06:59.492056 25243 raft_consensus.cc:2955] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 4 to 7, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:06:59.498757 25435 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:59.497085 22246 rpcz_store.cc:276] 0709 13:06:58.259319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.708932 (+449613us) service_pool.cc:224] Handling call
0709 13:06:58.709366 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.710131 (+   765us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:58.710174 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.710883 (+   709us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.120315 (+409432us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:59.120364 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.120446 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.496321 (+375875us) raft_consensus.cc:1685] finished
0709 13:06:59.496347 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.496535 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":257,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":6568,"thread_start_us":358200,"threads_started":1,"wal-append.queue_time_us":399523}
I20260709 13:06:59.506541 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:59.509917 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:59.428488 25433 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:59.513676 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:59.481884 25020 raft_consensus.cc:697] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:06:59.481243 25512 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:59.438971 25492 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:06:59.517668 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 340898us
I20260709 13:06:59.517884 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:59.521384 22246 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:06:59.449446 25445 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:59.508832 25266 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.523819 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:59.452922 25554 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:59.522619 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:59.529551 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:59.531584 22069 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:59.536993 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:06:59.537655 22254 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.538937 25462 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:59.539551 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 487) took 1713 ms. Trace:
I20260709 13:06:59.540035 22103 rpcz_store.cc:276] 0709 13:06:57.826053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.841531 (+ 15478us) service_pool.cc:224] Handling call
0709 13:06:57.841882 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.252533 (+410651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.539221 (+1286688us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b540042b154. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:59.539473 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":936816896}
I20260709 13:06:59.544435 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:59.548213 22246 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 8: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:06:59.527504 25515 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:59.551630 22069 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:06:59.549427 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:59.554967 22246 raft_consensus.cc:2410] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:59.530622 25266 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:59.586263 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:59.584733 25449 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:59.591266 25554 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:59.598685 25374 tablet_bootstrap.cc:492] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:06:59.613341 22254 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:59.616067 22254 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:06:59.616689 22254 pending_rounds.cc:85] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 4
W20260709 13:06:59.620481 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.625164 22254 pending_rounds.cc:107] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:06:59.625576 22254 raft_consensus.cc:2889] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:59.542307 25557 consensus_queue.cc:260] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:59.623077 25554 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.639153 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1785) took 2479 ms. Trace:
W20260709 13:06:59.623533 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.640053 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.642674 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1889) took 1362 ms. Trace:
I20260709 13:06:59.643113 22254 rpcz_store.cc:276] 0709 13:06:58.280574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.615156 (+1334582us) service_pool.cc:224] Handling call
0709 13:06:59.615556 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.642433 (+ 26877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.642620 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.570628 25020 consensus_queue.cc:237] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:59.643659 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:59.639695 22172 rpcz_store.cc:276] 0709 13:06:57.145355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.190710 (+ 45355us) service_pool.cc:224] Handling call
0709 13:06:57.191013 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.161485 (+970472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.624768 (+1463283us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b5400069354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:06:59.624970 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2128680192}
W20260709 13:06:59.675716 22072 leader_election.cc:336] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.641s (SENT)
I20260709 13:06:59.647874 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1887) took 1383 ms. Trace:
I20260709 13:06:59.659349 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:59.649426 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:59.649709 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1886) took 1390 ms. Trace:
I20260709 13:06:59.682674 22174 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.682706 22254 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:06:59.682812 22249 rpcz_store.cc:276] 0709 13:06:58.259583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.036846 (+777263us) service_pool.cc:224] Handling call
0709 13:06:59.037230 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.270218 (+232988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.270249 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:59.270713 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.513674 (+242961us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:59.513717 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.513779 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.649483 (+135704us) raft_consensus.cc:1685] finished
0709 13:06:59.649503 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.649656 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78680,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":7260,"thread_start_us":420456,"threads_started":2,"wal-append.queue_time_us":300219}
I20260709 13:06:59.685350 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:06:59.685926 22249 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:06:59.648326 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:59.661290 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:06:59.688388 22072 leader_election.cc:336] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.655s (SENT)
I20260709 13:06:59.688431 22175 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:06:59.689041 22072 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:59.626500 25465 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:59.694517 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 161722us
I20260709 13:06:59.626690 25512 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:06:59.701969 22174 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:06:59.653574 25374 tablet_bootstrap.cc:492] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:06:59.644181 25466 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.707305 22254 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:06:59.708936 22254 pending_rounds.cc:85] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 5
I20260709 13:06:59.709260 22254 pending_rounds.cc:107] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:06:59.709563 22254 raft_consensus.cc:2889] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:59.626892 25451 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:06:59.716270 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.660076 25550 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:59.649217 25492 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:59.655575 25557 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.652781 25445 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:06:59.663218 25471 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:59.717941 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 166390us
I20260709 13:06:59.720750 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1890) took 1439 ms. Trace:
I20260709 13:06:59.732116 22254 rpcz_store.cc:276] 0709 13:06:58.280874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.703504 (+1422630us) service_pool.cc:224] Handling call
0709 13:06:59.706947 (+  3443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.720365 (+ 13418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.720668 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.663239 25567 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:06:59.652290 25433 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:59.718788 25550 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.648130 25554 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:06:59.762284 22072 leader_election.cc:336] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.728s (SENT)
I20260709 13:06:59.762799 22072 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:59.768332 22807 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:59.705569 25465 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:59.708290 25512 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:59.770823 22807 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:59.760363 25374 ts_tablet_manager.cc:1403] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 2.049s	user 0.032s	sys 0.018s
I20260709 13:06:59.776805 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1892) took 1100 ms. Trace:
I20260709 13:06:59.777397 22252 rpcz_store.cc:276] 0709 13:06:58.676071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.762807 (+1086736us) service_pool.cc:224] Handling call
0709 13:06:59.776134 (+ 13327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.776384 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.776423 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.776479 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:59.776527 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.776596 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.776722 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.779608 22254 raft_consensus.cc:1275] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:06:59.780138 22254 pending_rounds.cc:85] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 3
I20260709 13:06:59.780409 22254 pending_rounds.cc:107] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.4
I20260709 13:06:59.719537 25451 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:59.783864 22254 raft_consensus.cc:2917] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Aborting config change with OpId 5.4: Aborted: Op aborted by new leader
I20260709 13:06:59.719120 25466 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:59.767750 25550 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.789078 25419 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9.
I20260709 13:06:59.792510 25451 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:59.795634 22254 raft_consensus.cc:2889] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:59.799598 22252 raft_consensus.cc:3055] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:59.800077 22252 raft_consensus.cc:740] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:06:59.799394 25512 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:59.915758 22812 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:59.919556 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:59.918078 22180 raft_consensus.cc:1275] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:59.918511 22782 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:59.927037 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:59.927382 22808 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:06:59.937736 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 175467us
I20260709 13:06:59.940934 22072 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:59.945472 22782 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:59.946022 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:06:59.948287 22072 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:59.948824 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:06:59.950169 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.913480 25410 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.015s	sys 0.008s
I20260709 13:06:59.769243 25567 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:59.954272 22782 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:59.956410 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:59.955637 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:59.968163 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:06:59.982585 22782 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:06:59.950330 22252 consensus_queue.cc:260] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:06:59.948110 25492 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:06:59.986742 22782 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:06:59.987829 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:59.992244 22252 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.928785 25266 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:06:59.993605 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:59.928260 25433 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:59.955897 25410 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.015s	sys 0.008s
I20260709 13:07:00.002826 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:45734 (request call id 11) took 12606 ms. Trace:
I20260709 13:06:59.994314 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:06:59.998165 22815 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:07:00.006978 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:00.007663 22178 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:06:59.951754 25466 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:06:59.968303 25164 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:59.979393 25503 raft_consensus.cc:3055] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:00.013692 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1888) took 1749 ms. Trace:
I20260709 13:06:59.990760 25521 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:00.025358 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.029659 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:00.009425 25266 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:00.008074 24843 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:00.003291 22254 rpcz_store.cc:276] 0709 13:06:47.376518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.379055 (+  2537us) service_pool.cc:224] Handling call
0709 13:06:47.485279 (+106224us) log.cc:844] Serialized 506 byte log entry
0709 13:06:47.846197 (+360918us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b2c000ad588. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6856a0a 00007f66a6856693 00007f66a6856631 00007f66a7f8ab52 00007f66a7f8acf5 00007f66a7ec7691 00007f66a7ea7eaa 00007f66a7eaed53 00007f66a7eaecd9 00007f66a7eaec69
0709 13:06:47.911410 (+ 65213us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b180031f5a0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:06:48.637224 (+725814us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b2c000ad588. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6856a0a 00007f66a6856693 00007f66a6856631 00007f66a7f8ab52 00007f66a7f8acf5 00007f66a7ec7691 00007f66a7ea7eaa 00007f66a7eaed53 00007f66a7eaecd9 00007f66a7eaec69
0709 13:06:49.133994 (+496770us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b180031f5a0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e2f2a6 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f8ad01 00007f66a7ec7691 00007f66a7ea7eaa
0709 13:06:49.134441 (+   447us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b1800250020. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f8ad01 00007f66a7ec7691 00007f66a7ea7eaa 00007f66a7eaed53 00007f66a7eaecd9 00007f66a7eaec69 00007f66a7eaec31 00007f66a7eaddfd 000000000038f354 000000000038f199
0709 13:06:50.051732 (+917291us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b1800250020. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f8ad01 00007f66a7ec7691 00007f66a7ea7eaa 00007f66a7eaed53 00007f66a7eaecd9 00007f66a7eaec69 00007f66a7eaec31 00007f66a7eaddfd 000000000038f354 000000000038f199
0709 13:06:59.948235 (+9896503us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50675,"raft.queue_time_us":52682,"raft.run_cpu_time_us":44440,"raft.run_wall_time_us":3774488,"spinlock_wait_cycles":2145087744,"thread_start_us":46418,"threads_started":1,"wal-append.queue_time_us":185330,"wal-append.run_cpu_time_us":2322,"wal-append.run_wall_time_us":1007511}
I20260709 13:07:00.017622 25563 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:00.043267 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:00.017962 25562 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.995553 25492 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.019207 25503 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:00.017788 25578 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:00.031572 25472 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:00.011560 25433 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.029008 25261 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:00.030014 25569 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:00.041072 25571 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:00.055230 25563 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:00.054155 25514 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.070142 25472 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:00.060665 25243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50280 (request call id 82) took 3825 ms. Trace:
I20260709 13:07:00.085449 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1891) took 1409 ms. Trace:
I20260709 13:07:00.058476 25462 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.056891 25445 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.030277 25556 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
I20260709 13:07:00.054385 25559 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:07:00.067173 25562 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:00.098096 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 111447us
I20260709 13:07:00.173520 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:00.086294 25572 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 13:07:00.169144 25429 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.071132 25583 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.076385 25456 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:00.207638 22254 rpcz_store.cc:276] 0709 13:06:58.675779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.759089 (+1083310us) service_pool.cc:224] Handling call
0709 13:06:59.768242 (+  9153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.085054 (+316812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.085366 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:00.205144 22782 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:00.106767 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.210973 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.211266 22781 leader_election.cc:336] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.894s (SENT)
W20260709 13:07:00.141031 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 380327us
I20260709 13:07:00.186941 25588 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:00.095391 25579 log.cc:927] Time spent T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:07:00.218385 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 270166us
I20260709 13:07:00.098486 25563 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:00.121248 25567 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:00.147593 25515 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.134874 25554 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:00.267810 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.333866 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:00.334553 22181 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:07:00.335705 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:00.338101 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:00.338586 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.338752 22809 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:00.339764 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:00.340698 22101 raft_consensus.cc:2393] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:07:00.263875 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 239823us
I20260709 13:07:00.269290 25569 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:00.269482 22103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:07:00.349274 22100 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:07:00.269970 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 64964.5us
I20260709 13:07:00.099766 25472 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:00.082643 25410 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:00.195370 25435 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:00.122000 25521 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.274353 22072 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:00.275935 25584 log.cc:927] Time spent T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:07:00.276741 25582 log.cc:927] Time spent T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 13:07:00.268126 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 57823.5us
W20260709 13:07:00.280028 25580 log.cc:927] Time spent T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:07:00.283018 25588 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.207657 25559 consensus_queue.cc:1243] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer a07ca3d1b5b84f4bbcb907f709a69275 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:00.143182 25578 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:00.383296 25554 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:00.296198 25557 consensus_meta.cc:287] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.001s
I20260709 13:07:00.297021 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:00.353562 25569 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:00.299808 22176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57856 (request call id 444) took 2207 ms (client timeout 1894 ms). Trace:
I20260709 13:07:00.301996 22178 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:00.093238 25374 raft_consensus.cc:359] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:00.307441 22813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35198 (request call id 896) took 1613 ms (client timeout 1555 ms). Trace:
W20260709 13:07:00.426905 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 244972us
W20260709 13:07:00.424314 22176 rpcz_store.cc:269] 0709 13:06:58.092010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.112689 (+ 20679us) service_pool.cc:224] Handling call
0709 13:07:00.299607 (+2186918us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540031bad4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:00.299730 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2605257600}
I20260709 13:07:00.121872 25261 raft_consensus.cc:697] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:07:00.313046 25471 consensus_meta.cc:287] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.002s
I20260709 13:07:00.208674 25445 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.314392 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:00.224651 22252 raft_consensus.cc:1275] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:00.432420 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1893) took 1335 ms. Trace:
I20260709 13:07:00.432910 22252 rpcz_store.cc:276] 0709 13:06:59.096624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.784782 (+688158us) service_pool.cc:224] Handling call
0709 13:06:59.798874 (+ 14092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.432083 (+633209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.432350 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:00.434370 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 160127us
I20260709 13:07:00.435530 22072 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:00.319471 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:00.321866 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:00.323071 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:00.192456 25428 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 13:07:00.340689 22106 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:00.341960 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:00.344743 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.440083 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.349306 22103 raft_consensus.cc:606] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:00.270326 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:00.440568 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.440905 22810 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:07:00.441397 25435 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.442216 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:00.442096 25435 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:00.440587 22103 raft_consensus.cc:614] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:00.440230 22105 raft_consensus.cc:2410] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:00.351630 25515 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.445201 22811 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:00.445442 22105 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:00.446519 25595 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:00.427096 25554 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:00.373806 22181 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 8: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:00.449040 25554 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:00.449110 25588 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:00.408218 25567 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:00.449522 25451 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.449822 25567 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:00.450054 25451 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:00.450644 25550 consensus_meta.cc:287] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.000s
I20260709 13:07:00.390427 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:00.123286 25514 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.397668 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:00.398568 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:00.399665 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:00.405627 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:00.158063 25503 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:00.206713 25462 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:06:59.681807 22253 rpcz_store.cc:276] 0709 13:06:58.264411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.047368 (+782957us) service_pool.cc:224] Handling call
0709 13:06:59.047759 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.047973 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:59.509660 (+461687us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.647424 (+137764us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.647497 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:59.647565 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.647654 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.647805 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":556759,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":11398,"thread_start_us":546630,"threads_started":2}
I20260709 13:07:00.427989 25569 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.413406 22808 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:00.329169 25492 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:00.404436 22069 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:00.409303 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 575) took 3115 ms. Trace:
I20260709 13:07:00.295493 25138 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.350334 25197 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.421511 22174 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
W20260709 13:07:00.565378 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 161026us
I20260709 13:07:00.298807 22172 raft_consensus.cc:3055] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:00.409624 25521 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.388115 25185 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:07:00.400346 25581 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:00.426403 22813 rpcz_store.cc:269] 0709 13:06:58.694180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.694300 (+   120us) service_pool.cc:224] Handling call
0709 13:07:00.307233 (+1612933us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b54005e01d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:00.307338 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1212822272}
I20260709 13:07:00.331112 25491 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:07:00.400426 25457 consensus_queue.cc:1048] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:07:00.411551 25414 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.422813 25578 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.408320 25483 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:07:00.202690 25243 rpcz_store.cc:276] 0709 13:06:56.200994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.202401 (+  1407us) service_pool.cc:224] Handling call
0709 13:06:56.214503 (+ 12102us) spinlock_profiling.cc:243] Waited 8.6 ms on lock 0x7b58005a5fd0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7eaa0aa 00007f66a7f2c447 00007f66a7f4970a 00007f66a7f4a76a 00007f66a7f4991b 00007f66a7f5503c 00007f66a7f546b3 00007f66a7f4c9fa 00007f66acf144c9 00007f66a6490c54
0709 13:06:56.266109 (+ 51606us) log.cc:844] Serialized 501 byte log entry
0709 13:06:56.971727 (+705618us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b540030d520. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7ec3dbe 00007f66a7ece930 00007f66a7ece8d8 00007f66a7ece858 00007f66a7ece813 00007f66a7ecda9c 00007f66addb9626 00007f66addb3dd8 00007f66a7f0a7cb 00007f66a7f0d2c0
0709 13:07:00.026349 (+3054622us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28859,"raft.queue_time_us":31984,"raft.run_cpu_time_us":1210,"raft.run_wall_time_us":1211,"spinlock_wait_cycles":82940544,"thread_start_us":95749,"threads_started":1,"wal-append.queue_time_us":176551,"wal-append.run_cpu_time_us":8622,"wal-append.run_wall_time_us":1529504}
I20260709 13:07:00.388788 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:00.359524 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:00.604212 22102 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:07:00.604746 22100 raft_consensus.cc:2410] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:00.533649 22098 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:07:00.535571 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 585) took 1381 ms. Trace:
I20260709 13:07:00.605278 22252 rpcz_store.cc:276] 0709 13:06:59.154469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.527806 (+1373337us) service_pool.cc:224] Handling call
0709 13:07:00.534950 (+  7144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.535199 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.535238 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:00.535295 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:00.535340 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.535402 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.535502 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:00.606554 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:00.607156 22252 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:07:00.608081 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:00.537302 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 101876us
I20260709 13:07:00.533108 22097 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:00.359788 25456 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.221678 25583 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:00.541771 22254 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:00.539343 22220 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:00.400897 25410 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:00.446707 25515 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:00.412994 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 343546us
I20260709 13:07:00.545903 22249 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:07:00.548312 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:00.611917 22072 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:00.619539 22810 raft_consensus.cc:2410] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:00.620844 22782 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:00.451931 25266 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.621603 25593 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:00.601267 25581 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.625813 25266 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:00.626401 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet 79d645cd970b4b2789be5374cc2005aa: Aborted: Op aborted by new leader
I20260709 13:07:00.626578 25562 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:00.627295 25588 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:00.627818 25588 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.406149 25589 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.152s
I20260709 13:07:00.628199 25588 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:00.629639 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:00.555908 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 180283us
I20260709 13:07:00.566414 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:00.630352 22808 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:07:00.631415 22218 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:00.540512 25554 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.631675 22808 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:00.566247 22172 raft_consensus.cc:740] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:00.635388 25571 consensus_queue.cc:1059] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:00.635705 22172 consensus_queue.cc:260] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.577704 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:00.636718 25571 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:00.637212 22811 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:00.541667 25595 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:00.614979 25456 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:00.550568 22248 rpcz_store.cc:276] 0709 13:06:57.294456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.362543 (+ 68087us) service_pool.cc:224] Handling call
0709 13:06:57.378549 (+ 16006us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.413317 (+ 34768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.413357 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.457707 (+ 44350us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.694331 (+2236624us) spinlock_profiling.cc:243] Waited 9.46 ms on lock 0x7b180028c840. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee0d1 00007f66a7f09a0f
0709 13:06:59.788179 (+ 93848us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:59.788237 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.788340 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.401588 (+613248us) raft_consensus.cc:1685] finished
0709 13:07:00.401617 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.409208 (+  7591us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81763,"raft.queue_time_us":71609,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":36179,"spinlock_wait_cycles":21754624,"thread_start_us":108629,"threads_started":2,"wal-append.queue_time_us":2403724}
W20260709 13:07:00.545313 25576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.017s
I20260709 13:07:00.533135 25557 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:00.640084 25576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.000s	sys 0.017s
I20260709 13:07:00.640237 25557 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.590353 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:00.603813 25556 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:00.644428 25556 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.645417 25567 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:00.591327 25591 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:00.646679 25591 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.647068 25591 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:00.647169 22813 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:00.650425 22100 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:00.530993 25550 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.602238 22255 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:00.621358 25504 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:00.555126 25462 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:00.568288 25492 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.616698 22099 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
W20260709 13:07:00.677374 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 46008.1us
W20260709 13:07:00.683427 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.684367 22218 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.65:33421 timed out after 2.130s (SENT) [suppressed 36 similar messages]
I20260709 13:07:00.614545 22105 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:00.615571 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1895) took 1346 ms. Trace:
W20260709 13:07:00.624987 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.616175 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 76950us
I20260709 13:07:00.687448 22254 rpcz_store.cc:276] 0709 13:06:59.268919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.534685 (+1265766us) service_pool.cc:224] Handling call
0709 13:07:00.541491 (+  6806us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.615290 (+ 73799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.615510 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:00.624922 22782 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:00.636798 22172 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.696414 22220 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:00.639272 25595 raft_consensus.cc:697] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:00.578969 25138 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:00.723345 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.638545 25571 consensus_queue.cc:1059] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:07:00.616353 25471 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:00.622694 25435 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:00.618623 25410 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:00.731026 25243 consensus_queue.cc:1059] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:00.604607 25414 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:00.733645 25414 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:00.708767 25261 consensus_queue.cc:237] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:00.583801 25197 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.709905 22071 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:00.737888 22106 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:00.668696 24932 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.616551 25583 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:00.698166 25483 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:00.690011 25451 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:00.754199 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 44380.3us
I20260709 13:07:00.726293 25567 raft_consensus.cc:3055] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:00.755951 22071 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:00.726502 25374 raft_consensus.cc:740] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:07:00.665323 25554 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.763026 22071 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:00.774817 22071 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:00.745805 25491 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.696841 25492 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.781921 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:00.792388 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:00.752952 25483 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.791127 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:00.802482 22181 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
W20260709 13:07:00.804364 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 170689us
W20260709 13:07:00.805683 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 238872us
I20260709 13:07:00.749200 25462 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:07:00.699156 25504 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.808310 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:00.810726 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:00.761639 25567 raft_consensus.cc:740] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:00.759352 25599 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:00.760457 25576 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:00.751116 24932 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:00.813562 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:00.816939 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:00.822408 22181 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:00.819139 22172 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:00.751427 25593 consensus_queue.cc:1059] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:07:00.789252 25243 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:00.779690 25583 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:00.794878 25578 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:00.823645 22172 pending_rounds.cc:85] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 7
W20260709 13:07:00.808910 25563 consensus_meta.cc:287] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.010s
I20260709 13:07:00.780596 25521 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:00.806793 25483 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.817972 22174 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
W20260709 13:07:00.926146 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.820165 25374 consensus_queue.cc:260] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:00.804392 25603 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:00.948148 22172 pending_rounds.cc:107] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 7.8
W20260709 13:07:00.949334 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 324458us
I20260709 13:07:00.789783 25596 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.199s
I20260709 13:07:00.807475 25514 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:00.980396 22251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 2048) took 2985 ms (client timeout 2287 ms). Trace:
I20260709 13:07:00.826030 25599 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.916324 25445 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:00.805225 25491 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:00.998783 22172 raft_consensus.cc:2889] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:01.000669 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 304846us
I20260709 13:07:01.010010 22781 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:01.001827 22251 rpcz_store.cc:269] 0709 13:06:57.995239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.512996 (+517757us) service_pool.cc:224] Handling call
0709 13:07:00.979319 (+2466323us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540023b754. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:00.980292 (+   973us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352433408}
I20260709 13:07:00.964213 25243 raft_consensus.cc:697] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:07:00.996842 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.008706 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:01.013731 22099 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
W20260709 13:07:01.003230 25429 consensus_meta.cc:287] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.797s	user 0.009s	sys 0.004s
I20260709 13:07:00.998457 25451 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:01.011549 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 193866us
I20260709 13:07:00.991633 25556 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:00.828397 25609 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.186s
I20260709 13:07:00.993919 25583 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:01.028172 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 331792us
I20260709 13:07:01.028637 22247 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:01.005100 25599 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:01.015293 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.015646 25185 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:01.025902 22072 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:01.008948 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:00.974133 25578 consensus_queue.cc:1059] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:07:00.998709 25603 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:01.040278 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:01.031047 22255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 2072) took 2857 ms (client timeout 1687 ms). Trace:
I20260709 13:07:00.977022 25563 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:01.036227 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:01.021224 25557 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:01.017102 22069 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:01.012319 25266 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:01.037456 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:01.039893 22071 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:01.029390 25421 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.057454 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:01.020018 25465 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:01.042048 22255 rpcz_store.cc:269] 0709 13:06:58.173603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.287333 (+113730us) service_pool.cc:224] Handling call
0709 13:07:01.030833 (+2743500us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b5400228dd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:01.030974 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5122034048}
I20260709 13:07:01.055780 22072 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:01.031844 25556 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:01.047235 22220 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:01.058123 22172 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.946475 25595 consensus_queue.cc:237] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:01.003715 25567 consensus_queue.cc:260] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:01.035211 25592 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:01.099704 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 44048.5us
W20260709 13:07:01.098524 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 51416us
I20260709 13:07:01.060770 22103 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:01.026409 25451 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:01.044745 25197 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:01.103825 22072 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:01.104899 22220 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:01.106065 22099 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:07:01.109889 22099 pending_rounds.cc:85] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 4
I20260709 13:07:01.110317 22099 pending_rounds.cc:107] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:07:01.110617 22099 raft_consensus.cc:2889] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:01.046411 25603 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:01.117883 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.041188 25583 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:01.124269 25243 consensus_queue.cc:237] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:01.059250 25266 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:07:01.128491 22248 raft_consensus.cc:1275] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:01.129593 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:01.119712 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:01.119902 22251 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:01.131130 22255 raft_consensus.cc:2393] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 8: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:01.131590 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:01.044406 25185 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:01.099977 25556 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.137459 22254 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:01.096794 25421 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:01.102221 25578 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:07:01.123885 25567 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.153836 22172 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:01.124080 25429 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:01.116520 25138 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:01.161234 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:01.162818 22104 raft_consensus.cc:1275] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:01.034576 25608 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:07:01.165647 25609 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:01.110859 25562 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:07:01.134166 25456 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.166505 22104 raft_consensus.cc:3055] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:01.163821 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:01.174439 22104 raft_consensus.cc:740] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:07:01.168056 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 483698us
I20260709 13:07:01.138897 25554 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:01.136322 25556 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:01.172502 22099 raft_consensus.cc:3055] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:01.174769 22255 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
W20260709 13:07:01.175751 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.142325 25261 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:01.177927 22099 raft_consensus.cc:740] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:01.162995 25266 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:01.159121 25492 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:01.159893 25465 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.177227 21988 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 252049d2bcdd4f329ca5015bf10c1b19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
W20260709 13:07:01.211371 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 171547us
I20260709 13:07:01.195392 22104 consensus_queue.cc:260] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:01.163582 25429 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.263230 22218 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:01.195150 22099 consensus_queue.cc:260] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:01.217864 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.171998 25243 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.184746 25261 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.261683 22071 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:01.232393 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.278702 22099 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:01.228207 25374 ts_tablet_manager.cc:1434] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 1.446s	user 0.017s	sys 0.017s
I20260709 13:07:01.288674 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:01.275418 25600 log.cc:927] Time spent T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:07:01.299595 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:01.299911 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:01.275250 25620 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:01.186297 25266 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:01.284018 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 143160us
I20260709 13:07:01.284494 22071 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:01.295605 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:01.287942 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:01.312849 22177 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:01.301566 22174 raft_consensus.cc:2410] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:01.300396 22181 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
W20260709 13:07:01.275777 25607 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 13:07:01.232954 25554 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.270359 25429 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:01.314867 22810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.023s	sys 0.032s
W20260709 13:07:01.318595 22810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.024s	sys 0.032s
I20260709 13:07:01.315682 22255 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:01.181272 25456 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:01.288424 25261 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.287983 25445 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:01.321573 25456 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:01.273718 22218 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:01.324658 25445 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:01.325886 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 52288us
I20260709 13:07:01.327289 25445 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:01.329908 22218 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:01.330891 25261 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:01.320672 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:01.305112 25020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.015s	sys 0.043s
I20260709 13:07:01.397130 22220 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:01.320621 25554 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:01.270129 25419 consensus_queue.cc:1059] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.083s
W20260709 13:07:01.441120 25020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.020s	sys 0.053s
W20260709 13:07:01.417829 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.285250 25374 ts_tablet_manager.cc:1467] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: Tablet startup took 1505ms
W20260709 13:07:01.352494 25604 log.cc:927] Time spent T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 13:07:01.332765 25601 log.cc:927] Time spent T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
W20260709 13:07:01.406785 25600 log.cc:927] Time spent T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:07:01.333396 25587 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:01.351922 25610 log.cc:927] Time spent T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:07:01.609863 25521 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:01.610517 25521 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:01.314265 25614 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:01.613971 25614 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.614392 25614 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:01.480145 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 194216us
W20260709 13:07:01.351758 25625 log.cc:927] Time spent T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:07:01.616123 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.378142 25569 consensus_meta.cc:287] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.799s	user 0.005s	sys 0.006s
I20260709 13:07:01.536546 25491 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:01.616778 25569 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:01.617456 25521 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:01.315497 25266 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.301064 25138 consensus_queue.cc:1048] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.138s
I20260709 13:07:01.343302 25465 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:01.391284 25620 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:01.476238 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 191794us
I20260709 13:07:01.624931 25465 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:01.625216 25491 consensus_queue.cc:1048] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:01.625818 22071 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:01.392822 25622 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.627346 25622 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:01.414810 22255 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:01.629505 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:01.629719 25622 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:01.539860 25618 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:07:01.573949 25613 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:01.574755 25492 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:01.573933 25619 log.cc:927] Time spent T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:07:01.575263 25419 raft_consensus.cc:3055] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:01.579226 25616 log.cc:927] Time spent T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
W20260709 13:07:01.580317 25617 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.295s	user 0.000s	sys 0.000s
W20260709 13:07:01.581159 25615 log.cc:927] Time spent T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.414s	user 0.000s	sys 0.001s
I20260709 13:07:01.439436 25634 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:01.586802 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 256989us
W20260709 13:07:01.587122 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 570103us
I20260709 13:07:01.605150 22099 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:01.478418 25589 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:01.287266 25243 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:01.616236 25261 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:01.617158 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1781) took 1048 ms. Trace:
I20260709 13:07:01.351027 25621 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:01.629866 25614 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:01.626380 25465 consensus_queue.cc:1059] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:01.624091 25138 consensus_queue.cc:1059] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:01.667723 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:01.872064 22255 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:07:01.630312 25622 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:01.757782 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.828938 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:01.874181 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1791) took 1047 ms. Trace:
I20260709 13:07:01.635010 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:01.893884 22099 rpcz_store.cc:276] 0709 13:07:00.827107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.144031 (+316924us) service_pool.cc:224] Handling call
0709 13:07:01.172337 (+ 28306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.873929 (+701592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.874127 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:01.873118 22102 rpcz_store.cc:276] 0709 13:07:00.568993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.634200 (+ 65207us) service_pool.cc:224] Handling call
0709 13:07:00.634586 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.803888 (+169302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.803917 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.811767 (+  7850us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.052933 (+241166us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:01.052981 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.053051 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.616928 (+563877us) raft_consensus.cc:1685] finished
0709 13:07:01.616964 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.617100 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4717,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":82,"thread_start_us":268182,"threads_started":2,"wal-append.queue_time_us":761062}
W20260709 13:07:01.811250 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.635231 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:01.648888 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:01.875247 25562 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:01.896291 25562 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:01.631129 22809 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:01.869449 22174 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:01.876462 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 595) took 1457 ms. Trace:
W20260709 13:07:01.649714 25630 log.cc:927] Time spent T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:07:01.894884 22254 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.009s	sys 0.009s
W20260709 13:07:01.872867 25591 consensus_meta.cc:287] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.224s	user 0.011s	sys 0.004s
W20260709 13:07:01.899730 22254 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.010s	sys 0.009s
W20260709 13:07:01.696698 25603 consensus_meta.cc:287] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.000s
W20260709 13:07:01.747423 25599 consensus_meta.cc:287] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.696s	user 0.004s	sys 0.007s
I20260709 13:07:01.898424 22253 rpcz_store.cc:276] 0709 13:07:00.418860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.631153 (+212293us) service_pool.cc:224] Handling call
0709 13:07:00.631478 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.676026 (+ 44548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.676057 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.676498 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.998286 (+321788us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:01.364753 (+366467us) log.cc:844] Serialized 14 byte log entry
0709 13:07:01.406310 (+ 41557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.407234 (+   924us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.876184 (+468950us) raft_consensus.cc:1685] finished
0709 13:07:01.876216 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.876388 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159770,"prepare.queue_time_us":463456,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":22035,"raft.queue_time_us":93960,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":36065,"thread_start_us":610333,"threads_started":2,"wal-append.queue_time_us":575592}
I20260709 13:07:01.899312 22178 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.648572 25608 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.866463 25504 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:01.609879 25587 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:01.909368 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.910446 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:01.922178 22248 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.911607 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:01.625301 25620 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.668473 25569 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:01.906566 25138 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.897737 25642 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.907375 22255 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:01.636255 25451 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:01.869966 24932 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:01.715626 25554 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:01.608678 25583 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:01.871846 25589 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.873657 25419 raft_consensus.cc:740] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:01.667402 25578 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:01.870241 25581 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:01.873389 25563 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:01.920261 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:01.668473 25185 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:01.877954 25634 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:01.898537 25621 raft_consensus.cc:697] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:01.934235 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 594) took 1729 ms. Trace:
I20260709 13:07:01.907590 25622 raft_consensus.cc:697] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:01.912847 25261 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:01.913496 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 288881us
I20260709 13:07:01.991583 22147 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:01.993108 25649 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:01.915143 25433 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:01.993620 25649 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:01.888732 25492 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:01.994066 25649 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:01.996340 25492 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:01.948122 22178 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:01.912530 25645 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:01.952574 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1784) took 1366 ms. Trace:
I20260709 13:07:01.925449 25587 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.981034 25578 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:01.998493 25185 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:01.931378 25608 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:01.999780 25578 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:02.000335 25562 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:02.000936 25608 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:01.984649 25634 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:01.964633 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 92990.8us
I20260709 13:07:02.002532 22218 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:01.925835 25504 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.931172 25620 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.003206 25504 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:01.984193 25648 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:07:01.997424 22100 rpcz_store.cc:276] 0709 13:07:00.586097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.662423 (+ 76326us) service_pool.cc:224] Handling call
0709 13:07:00.662870 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.670437 (+  7567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.670479 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.691003 (+ 20524us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.008393 (+317390us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:01.008451 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.008542 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.952266 (+943724us) raft_consensus.cc:1685] finished
0709 13:07:01.952294 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.952495 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4587,"raft.queue_time_us":5934,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":23525,"thread_start_us":279441,"threads_started":1,"wal-append.queue_time_us":385794}
W20260709 13:07:01.961887 25472 consensus_meta.cc:287] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 1.562s	user 0.007s	sys 0.009s
I20260709 13:07:02.009325 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:01.986523 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:01.987027 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:01.962255 25589 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:01.997748 25637 log.cc:927] Time spent T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260709 13:07:02.031530 25620 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:01.946395 25138 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:01.998726 25614 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:02.005674 25504 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:01.915825 25603 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:01.984313 22249 rpcz_store.cc:276] 0709 13:07:00.204998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.623767 (+418769us) service_pool.cc:224] Handling call
0709 13:07:00.624097 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.668375 (+ 44278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.668410 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.673876 (+  5466us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.979610 (+305734us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:00.979650 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.979727 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.933931 (+954204us) raft_consensus.cc:1685] finished
0709 13:07:01.933960 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.934157 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":233241,"threads_started":1,"wal-append.queue_time_us":459068}
W20260709 13:07:02.011399 25429 consensus_meta.cc:287] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.605s	user 0.004s	sys 0.007s
I20260709 13:07:02.007900 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:01.917606 25599 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:01.908790 25591 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.011238 22173 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:02.011263 22174 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
W20260709 13:07:02.048256 25556 consensus_meta.cc:287] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.821s	user 0.013s	sys 0.000s
I20260709 13:07:02.015738 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:02.019557 25654 consensus_queue.cc:1059] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:07:02.021413 25483 consensus_meta.cc:287] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 1.027s	user 0.011s	sys 0.000s
W20260709 13:07:02.024886 25626 log.cc:927] Time spent T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:07:02.094169 25614 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:02.094946 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:02.026154 25647 log.cc:927] Time spent T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:02.095634 25654 raft_consensus.cc:3055] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:02.096145 25654 raft_consensus.cc:740] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:02.097011 25654 consensus_queue.cc:260] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.025537 25587 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.099970 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:02.100939 22101 raft_consensus.cc:2410] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:07:02.101420 22101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1677) took 1758 ms (client timeout 1539 ms). Trace:
W20260709 13:07:02.101814 22101 rpcz_store.cc:269] 0709 13:07:00.342473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.353090 (+ 10617us) service_pool.cc:224] Handling call
0709 13:07:02.099799 (+1746709us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5800003398. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:07:02.101315 (+  1516us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29093248}
I20260709 13:07:01.953619 25642 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:01.997382 25645 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.041222 22248 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:02.103928 25621 consensus_queue.cc:237] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:02.105976 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:02.047679 22102 raft_consensus.cc:2368] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10.
I20260709 13:07:02.052505 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:02.001183 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.066493 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:02.077225 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:02.107935 22178 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.108184 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 638) took 1525 ms. Trace:
I20260709 13:07:02.108283 22175 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
W20260709 13:07:02.077855 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 206666us
I20260709 13:07:02.061228 22071 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:02.080600 22174 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:01.993247 22147 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:02.083253 22220 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:02.010334 25261 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.084661 22815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 633) took 1540 ms. Trace:
I20260709 13:07:02.087219 22172 raft_consensus.cc:2393] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:07:02.093549 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 91068.9us
I20260709 13:07:02.093292 25483 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.036291 25472 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.138558 22099 raft_consensus.cc:2393] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:07:02.288591 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 295433us
W20260709 13:07:02.251098 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.141105 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:02.290977 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:02.288354 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 227226us
I20260709 13:07:02.291188 22147 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:02.288995 22815 rpcz_store.cc:276] 0709 13:07:00.544763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.544911 (+   148us) service_pool.cc:224] Handling call
0709 13:07:01.735171 (+1190260us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29eee 0000000000375939 00007f66ace9d1e0 00007f66acf660c4 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:07:01.735411 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.735703 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:02.049262 (+313559us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.068206 (+ 18944us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.068524 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.068691 (+   167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:02.068748 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:02.068805 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.068885 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.084589 (+ 15704us) inbound_call.cc:177] Queueing success response
0709 13:07:02.099065 (+ 14476us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b18003af900. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
Metrics: {"prepare.queue_time_us":332361,"raft.queue_time_us":293,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":15134,"spinlock_wait_cycles":146980352,"thread_start_us":320521,"threads_started":2,"wal-append.queue_time_us":208821}
I20260709 13:07:02.294786 22178 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
W20260709 13:07:02.293196 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 210064us
I20260709 13:07:02.111660 22782 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:02.296820 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 185257us
I20260709 13:07:02.297494 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:02.067179 25608 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:01.587944 25374 ts_tablet_manager.cc:1469] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: Trace:
0709 13:06:52.768658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.995929 (+227271us) service_pool.cc:224] Handling call
0709 13:06:54.801811 (+1805882us) ts_tablet_manager.cc:934] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
0709 13:06:55.849377 (+1047566us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:56.326042 (+476665us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:56.326170 (+   128us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:56.429275 (+103105us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:56.429726 (+   451us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:56.430107 (+   381us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:56.430230 (+   123us) inbound_call.cc:177] Queueing success response
0709 13:06:57.711389 (+1281159us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:59.782005 (+2070616us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:07:00.089782 (+307777us) tablet_replica.cc:261] Starting instrumentation
0709 13:07:00.090653 (+   871us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":293,"mutex_wait_us":2475,"raft.queue_time_us":7514,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":6034,"tablet-copy.queue_time_us":809325,"tablet-download-pool.queue_time_us":160,"tablet-download-pool.run_cpu_time_us":1218,"tablet-download-pool.run_wall_time_us":30115,"thread_start_us":252582,"threads_started":2}
I20260709 13:07:02.295879 22220 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:02.108646 22810 rpcz_store.cc:276] 0709 13:07:00.582779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.620226 (+ 37447us) service_pool.cc:224] Handling call
0709 13:07:00.620526 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.698773 (+ 78247us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:00.744975 (+ 46202us) log.cc:844] Serialized 14 byte log entry
0709 13:07:01.319184 (+574209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:01.319241 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:01.319281 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.107962 (+788681us) spinlock_profiling.cc:243] Waited 78 ms on lock 0x7b54007201d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:02.108015 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.108133 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":46698,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":1839,"raft.queue_time_us":109,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":233803008,"thread_start_us":573831,"threads_started":1,"wal-append.queue_time_us":926129}
W20260709 13:07:02.207120 25643 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
W20260709 13:07:02.159533 25588 consensus_meta.cc:287] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 1.531s	user 0.012s	sys 0.003s
W20260709 13:07:02.245528 25567 consensus_meta.cc:287] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.078s	user 0.011s	sys 0.002s
I20260709 13:07:02.305454 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1912) took 1164 ms. Trace:
I20260709 13:07:02.255234 25654 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:02.332207 22255 rpcz_store.cc:276] 0709 13:07:01.141876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.939667 (+797791us) service_pool.cc:224] Handling call
0709 13:07:01.956383 (+ 16716us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.965781 (+  9398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.965810 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.966356 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.287492 (+321136us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:02.304724 (+ 17232us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.305093 (+   369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.305174 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.305230 (+    56us) raft_consensus.cc:1685] finished
0709 13:07:02.305247 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.305386 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9095,"prepare.queue_time_us":16961,"raft.queue_time_us":65982,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":112,"spinlock_wait_cycles":28928,"thread_start_us":260723,"threads_started":1,"wal-append.queue_time_us":273049}
W20260709 13:07:02.095659 25565 log.cc:927] Time spent T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 2.447s	user 0.010s	sys 0.006s
I20260709 13:07:02.306597 22218 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:02.110284 25556 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:02.214087 25266 consensus_meta.cc:287] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.001s
I20260709 13:07:02.253728 25613 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:02.212930 25243 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:02.184892 25620 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:02.087795 25429 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:02.108804 25554 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.214387 25599 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:02.070752 25419 consensus_queue.cc:260] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:02.259593 25603 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:02.297050 25504 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:02.152299 25646 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:02.301209 25614 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:02.341322 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.206207 25138 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:02.308743 22812 raft_consensus.cc:1240] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:02.300932 25657 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:02.330538 25562 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:02.296419 25650 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:02.335319 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:02.420559 22254 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.308662 25642 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:02.369304 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 67424.9us
I20260709 13:07:02.254643 25634 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:02.387948 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 85421.8us
I20260709 13:07:02.388435 25672 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:02.303313 25185 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:07:02.245422 25589 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.416383 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1817) took 1114 ms. Trace:
I20260709 13:07:02.342831 25567 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.138634 25622 consensus_queue.cc:237] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.309399 25608 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:02.417011 25657 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:02.354370 25645 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:02.425266 25581 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:02.430812 25650 raft_consensus.cc:697] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:02.440065 22097 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:07:02.440277 25634 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:02.413923 25614 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.393056 25504 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.340205 25588 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.342633 25266 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.442636 22180 rpcz_store.cc:276] 0709 13:07:01.302031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.302307 (+   276us) service_pool.cc:224] Handling call
0709 13:07:01.318715 (+ 16408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.321940 (+  3225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.321981 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.322525 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.481112 (+158587us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:01.481172 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.481750 (+   578us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.416141 (+934391us) raft_consensus.cc:1685] finished
0709 13:07:02.416163 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.416319 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1959,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":157955,"threads_started":1,"wal-append.queue_time_us":545009}
I20260709 13:07:02.461655 22254 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:02.417237 25562 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:02.415649 25587 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:02.435221 25138 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.392766 25243 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:07:02.462785 25656 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:02.467099 25570 log.cc:927] Time spent T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 2.406s	user 0.004s	sys 0.008s
W20260709 13:07:02.468271 22099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 503) took 1235 ms (client timeout 1608 ms). Trace:
I20260709 13:07:02.468523 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 449) took 4187 ms. Trace:
I20260709 13:07:02.468888 25562 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.468657 25138 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.469204 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1773) took 2046 ms. Trace:
I20260709 13:07:02.469957 25261 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:02.472066 25138 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:02.467375 25656 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:02.473383 25656 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.473861 25588 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:02.474597 25556 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:02.466845 25266 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:02.480634 25472 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:02.462846 22782 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:02.461154 25504 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:00.019861 22246 rpcz_store.cc:276] 0709 13:06:58.264665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.600208 (+1335543us) service_pool.cc:224] Handling call
0709 13:06:59.600668 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.600965 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:59.758066 (+157101us) log.cc:844] Serialized 14 byte log entry
0709 13:07:00.012794 (+254728us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:00.012964 (+   170us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:00.013048 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.013227 (+   179us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.013573 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3777,"prepare.queue_time_us":89651,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":147,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":7124,"thread_start_us":361261,"threads_started":2}
W20260709 13:07:02.463089 25665 log.cc:927] Time spent T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:07:02.466687 25591 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:02.447607 25567 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:02.464059 25663 log.cc:927] Time spent T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:02.485235 25567 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:02.485823 25483 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:02.456888 25581 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:02.487207 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1913) took 1324 ms. Trace:
I20260709 13:07:02.487839 25581 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:02.469626 22106 rpcz_store.cc:276] 0709 13:07:00.430896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.439106 (+  8210us) service_pool.cc:224] Handling call
0709 13:07:00.439456 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.738296 (+298840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.468991 (+1730695us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b5400124154. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:02.469151 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685884288}
I20260709 13:07:02.487591 22251 rpcz_store.cc:276] 0709 13:07:01.163056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.029316 (+866260us) service_pool.cc:224] Handling call
0709 13:07:02.029733 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.030070 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.030094 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.030534 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.107382 (+ 76848us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:02.107446 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.107509 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.487014 (+379505us) raft_consensus.cc:1685] finished
0709 13:07:02.487033 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.487154 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44808,"raft.queue_time_us":40293,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":52318,"thread_start_us":76480,"threads_started":1,"wal-append.queue_time_us":324900}
I20260709 13:07:02.427975 25599 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:02.386178 25554 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.453477 25657 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:02.465471 25597 log.cc:927] Time spent T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 1.714s	user 0.000s	sys 0.002s
I20260709 13:07:02.481069 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1786) took 1847 ms. Trace:
I20260709 13:07:02.485965 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1911) took 1356 ms. Trace:
W20260709 13:07:02.453016 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 117645us
W20260709 13:07:02.480674 25661 log.cc:927] Time spent T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:02.486776 25421 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:02.468705 22099 rpcz_store.cc:269] 0709 13:07:01.233017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.906781 (+673764us) service_pool.cc:224] Handling call
0709 13:07:02.468073 (+561292us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54002b8254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:02.468209 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384231168}
I20260709 13:07:02.453567 22264 tablet_copy_service.cc:342] P 765d912bde9e48959e50d9efec3c26b6: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-79d645cd970b4b2789be5374cc2005aa received from {username='slave'} at 127.0.0.1:45738
I20260709 13:07:02.460286 25614 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.503746 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:02.416919 25646 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:02.498819 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:02.540540 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 506) took 1222 ms. Trace:
I20260709 13:07:02.468925 22179 rpcz_store.cc:276] 0709 13:06:58.281060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.500118 (+219058us) service_pool.cc:224] Handling call
0709 13:06:58.515460 (+ 15342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.515783 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.515814 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.528904 (+ 13090us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.463737 (+934833us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b18003f7660. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee0d1 00007f66a7f09a0f
0709 13:06:59.780244 (+316507us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:59.780301 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.781625 (+  1324us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.303209 (+2521584us) spinlock_profiling.cc:243] Waited 8.82 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:02.468314 (+165105us) raft_consensus.cc:1685] finished
0709 13:07:02.468337 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.468466 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":161,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":16846,"spinlock_wait_cycles":46488064,"thread_start_us":315227,"threads_started":1,"wal-append.queue_time_us":1440179}
W20260709 13:07:02.512108 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.507869 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:02.491600 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:02.542428 22251 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:02.462998 25658 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:02.528692 22814 pending_rounds.cc:85] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting all ops after (but not including) 4
I20260709 13:07:02.441825 25649 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:02.529963 22071 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:02.496112 25599 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:02.541025 22106 rpcz_store.cc:276] 0709 13:07:01.318216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.498473 (+1180257us) service_pool.cc:224] Handling call
0709 13:07:02.540460 (+ 41987us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.535702 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:02.530015 22253 rpcz_store.cc:276] 0709 13:07:01.130004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.932931 (+802927us) service_pool.cc:224] Handling call
0709 13:07:01.956383 (+ 23452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.966606 (+ 10223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.966644 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.967297 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.068745 (+101448us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:02.094579 (+ 25834us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.094780 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.094849 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.485763 (+390914us) raft_consensus.cc:1685] finished
0709 13:07:02.485783 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.485909 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116692,"prepare.queue_time_us":27447,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":107,"raft.queue_time_us":62962,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":45602,"thread_start_us":37375,"threads_started":1,"wal-append.queue_time_us":249892}
I20260709 13:07:02.529181 22105 rpcz_store.cc:276] 0709 13:07:00.633171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.044641 (+411470us) service_pool.cc:224] Handling call
0709 13:07:01.045098 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.139743 (+ 94645us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:01.140031 (+   288us) log.cc:844] Serialized 14 byte log entry
0709 13:07:01.167336 (+ 27305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:01.167420 (+    84us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:01.167479 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.667112 (+499633us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b48000030d8. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66ace77aa1 00007f66ace6eb37 00007f66ace6e9ca 00007f66acf6626f 00007f66acf65f37 00007f66acf7a55c 00007f66acf7a508 00007f66acf7a488 00007f66acf7a443 00007f66acf796ec 00007f66abea3a96
0709 13:07:02.480775 (+813663us) spinlock_profiling.cc:243] Waited 94.4 ms on lock 0x7b54000b8e54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:02.480840 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.481000 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4400,"prepare.queue_time_us":134,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":34,"raft.queue_time_us":159488,"raft.run_cpu_time_us":2473,"raft.run_wall_time_us":348674,"spinlock_wait_cycles":251304064,"thread_start_us":16202,"threads_started":1,"wal-append.queue_time_us":134886,"wal-append.run_cpu_time_us":1417,"wal-append.run_wall_time_us":1055275}
I20260709 13:07:02.562260 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:02.562748 22813 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:02.562969 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:02.563119 22106 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:02.492931 25639 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.464839 25650 consensus_queue.cc:237] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:02.545058 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:02.507651 25556 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:02.566408 25556 raft_consensus.cc:697] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:02.566635 22251 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:02.567442 25556 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.547420 22814 pending_rounds.cc:107] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:07:02.568702 22814 raft_consensus.cc:2889] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:02.568444 22782 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:02.545518 22264 tablet_copy_service.cc:434] P 765d912bde9e48959e50d9efec3c26b6: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-79d645cd970b4b2789be5374cc2005aa on tablet 79d645cd970b4b2789be5374cc2005aa with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:02.557005 25621 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:02.558395 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 251892us
I20260709 13:07:02.558660 25567 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.559420 25675 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.570828 25621 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.571602 25621 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.559834 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:02.572057 22218 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:02.560220 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.560388 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:02.574975 22172 raft_consensus.cc:2410] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:02.559892 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:02.560781 25591 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:02.558976 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:02.579618 22179 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:02.562614 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:02.538362 22246 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:02.542763 22807 raft_consensus.cc:2368] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9.
W20260709 13:07:02.537469 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 228501us
I20260709 13:07:02.563797 22105 raft_consensus.cc:2410] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:02.564435 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:02.585098 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:02.587278 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:02.588254 22105 raft_consensus.cc:2393] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:02.589546 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:02.590137 22176 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:02.590646 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:02.589257 25591 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:02.592168 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:02.537521 24843 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:07:02.594130 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:02.592905 22172 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.595598 25667 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:02.564072 25599 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:02.601915 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:02.602883 22181 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.605540 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:02.606019 22218 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:02.612953 22106 raft_consensus.cc:2393] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:02.614063 22218 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:02.618523 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.571537 25675 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.612432 25667 raft_consensus.cc:697] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:02.637706 25679 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:02.540647 25656 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.639330 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:02.640332 22174 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:02.647850 25659 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:02.637967 25667 consensus_queue.cc:237] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.647766 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:02.652271 22106 raft_consensus.cc:2410] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:02.638305 25679 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:02.656533 22099 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:02.656733 25679 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:02.657058 25676 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:07:02.657193 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 510) took 1308 ms. Trace:
I20260709 13:07:02.658010 22106 rpcz_store.cc:276] 0709 13:07:01.349231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.635217 (+1285986us) service_pool.cc:224] Handling call
0709 13:07:02.657134 (+ 21917us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.571645 25567 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.631464 25672 raft_consensus.cc:697] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:02.667301 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:02.668653 22218 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:02.651145 25562 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.670414 22180 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 5.
I20260709 13:07:02.671926 22179 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:02.674608 22172 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
W20260709 13:07:02.672608 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 238460us
I20260709 13:07:02.676417 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:02.632215 25670 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:02.679889 22218 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:02.596594 25639 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:02.666941 25627 log.cc:927] Time spent T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 1.366s	user 0.004s	sys 0.000s
W20260709 13:07:02.677173 25410 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:07:02.686326 22176 raft_consensus.cc:1240] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:02.670912 25659 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:02.687463 22248 raft_consensus.cc:1240] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:02.667290 25603 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.664265 25622 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:02.681450 25589 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:02.697751 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:02.687995 25677 log.cc:927] Time spent T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:07:02.696507 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:02.704036 22179 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 5.
I20260709 13:07:02.706281 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:02.707079 22180 raft_consensus.cc:2368] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10.
I20260709 13:07:02.699457 22246 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:02.701579 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:02.702011 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:02.710177 22176 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:02.710187 22106 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:02.711730 22782 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:02.695736 25608 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:02.716296 22218 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:02.718873 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:02.719910 22172 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:02.717511 24843 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:02.707939 25589 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:02.745146 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:02.745867 22106 raft_consensus.cc:2410] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:02.698730 25622 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.724175 22218 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:02.697751 25603 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.751196 22218 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:02.716881 25659 raft_consensus.cc:2764] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:02.755530 25559 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:02.731670 25591 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:02.756417 25674 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:02.724419 25688 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:02.741170 25491 raft_consensus.cc:3055] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:02.815960 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:02.842787 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.690327 25670 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.751027 25656 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:03.047590 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 904) took 2620 ms. Trace:
I20260709 13:07:03.043792 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.048564 22809 rpcz_store.cc:276] 0709 13:07:00.357828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.358264 (+   436us) service_pool.cc:224] Handling call
0709 13:07:00.358668 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.902567 (+1543899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.978173 (+1075606us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540054db54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:02.978413 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2911965440}
I20260709 13:07:02.728857 25672 consensus_queue.cc:237] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:02.761056 24843 raft_consensus.cc:697] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:03.080376 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.112676 22809 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:03.072374 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:03.116298 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1774) took 2645 ms. Trace:
I20260709 13:07:03.117269 22103 rpcz_store.cc:276] 0709 13:07:00.431208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.447737 (+ 16529us) service_pool.cc:224] Handling call
0709 13:07:00.448126 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.108443 (+660317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.075950 (+1967507us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54002ab7d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:03.076201 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408429952}
I20260709 13:07:02.929177 22781 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:02.917421 25593 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.919850 25654 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:03.131036 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.134413 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 205386us
I20260709 13:07:02.917202 25675 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:02.881542 25491 raft_consensus.cc:740] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:02.756979 25589 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:03.095304 25646 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:03.048413 25649 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:03.144634 22781 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:03.152858 22103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:07:03.163793 22103 raft_consensus.cc:606] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:03.159799 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:03.167431 25687 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:03.177186 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33706 (request call id 24) took 1248 ms. Trace:
I20260709 13:07:03.143275 25654 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.182129 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.177886 22103 rpcz_store.cc:276] 0709 13:07:01.915963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.146460 (+1230497us) service_pool.cc:224] Handling call
0709 13:07:03.164544 (+ 18084us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:03.183434 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.184267 25678 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.184782 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.194615 22249 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:03.147416 25567 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:03.185472 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:03.196033 22181 consensus_meta.cc:287] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 13:07:03.193053 22251 raft_consensus.cc:1275] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:03.196765 22181 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:03.194885 22253 raft_consensus.cc:2393] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:03.146356 25410 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:03.151790 25562 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:03.199975 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:03.180785 25685 log.cc:927] Time spent T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.421s	user 0.000s	sys 0.001s
I20260709 13:07:03.231894 22249 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:03.233294 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.237732 22106 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:03.234637 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.242532 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.243244 22251 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:07:03.175369 25433 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:03.254199 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.255276 22253 raft_consensus.cc:2393] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:03.256310 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:03.257125 22253 raft_consensus.cc:2393] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:03.258370 22253 raft_consensus.cc:1240] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:03.168234 25687 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:03.238535 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 504) took 2005 ms. Trace:
I20260709 13:07:03.259888 22106 rpcz_store.cc:276] 0709 13:07:01.233307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.179070 (+1945763us) service_pool.cc:224] Handling call
0709 13:07:03.237345 (+ 58275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.238248 (+   903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.238484 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:03.248993 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.264837 22253 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:07:03.180056 25659 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.273486 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.191840 25639 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:03.148524 25593 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.274143 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.199822 25654 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:03.273726 25667 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.282966 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 505) took 1966 ms. Trace:
I20260709 13:07:03.267110 25433 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.283034 22254 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:03.309175 22103 rpcz_store.cc:276] 0709 13:07:01.316347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.242089 (+1925742us) service_pool.cc:224] Handling call
0709 13:07:03.282176 (+ 40087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.282428 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.282465 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.282527 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:03.282572 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.282645 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.282799 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:03.301802 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 507) took 1968 ms. Trace:
I20260709 13:07:03.309489 22253 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:03.317937 22106 rpcz_store.cc:276] 0709 13:07:01.333028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.261712 (+1928684us) service_pool.cc:224] Handling call
0709 13:07:03.301032 (+ 39320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.301253 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.301290 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.301349 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:03.301393 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.301464 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.301722 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:03.242174 25410 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.277690 25678 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.340406 25670 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:03.341094 22246 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:07:03.341533 25678 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:03.344857 25593 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:03.347466 25589 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:03.348331 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 508) took 1999 ms. Trace:
I20260709 13:07:03.348775 22103 rpcz_store.cc:276] 0709 13:07:01.348580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.323341 (+1974761us) service_pool.cc:224] Handling call
0709 13:07:03.347808 (+ 24467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.347998 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.348028 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.348076 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:03.348109 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.348163 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.348272 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:03.314857 24843 consensus_queue.cc:237] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:03.319818 25433 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.339270 25684 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:03.360246 22106 raft_consensus.cc:1240] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:03.361086 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 509) took 2012 ms. Trace:
I20260709 13:07:03.361472 22106 rpcz_store.cc:276] 0709 13:07:01.348949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.323542 (+1974593us) service_pool.cc:224] Handling call
0709 13:07:03.359427 (+ 35885us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.360776 (+  1349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.361022 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:03.378469 25602 log.cc:927] Time spent T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 2.571s	user 0.000s	sys 0.014s
I20260709 13:07:03.379051 25684 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.379561 25684 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:03.379967 22816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 906) took 2976 ms. Trace:
I20260709 13:07:03.325587 25491 consensus_queue.cc:260] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.315400 25667 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:03.380364 22816 rpcz_store.cc:276] 0709 13:07:00.403876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.404067 (+   191us) service_pool.cc:224] Handling call
0709 13:07:00.417734 (+ 13667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.417970 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.417993 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.422427 (+  4434us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.604101 (+181674us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:00.604239 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.604454 (+   215us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.349547 (+2745093us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:03.379638 (+ 30091us) raft_consensus.cc:1685] finished
0709 13:07:03.379662 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.379904 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12205952,"thread_start_us":173840,"threads_started":1,"wal-append.queue_time_us":325460}
I20260709 13:07:03.382989 25667 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:03.364730 25690 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 13:07:03.384682 25679 consensus_meta.cc:287] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.727s	user 0.009s	sys 0.001s
I20260709 13:07:03.385146 25679 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:03.388804 25621 consensus_meta.cc:287] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.000s
W20260709 13:07:03.396739 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 187929us
W20260709 13:07:03.398216 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.389984 25687 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:03.411705 25608 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:03.412302 25679 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:03.412362 25608 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:03.412981 25503 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:03.413466 22103 raft_consensus.cc:1240] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:03.414143 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 511) took 2064 ms. Trace:
I20260709 13:07:03.414434 22103 rpcz_store.cc:276] 0709 13:07:01.349683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.403403 (+2053720us) service_pool.cc:224] Handling call
0709 13:07:03.413287 (+  9884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.413901 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.414088 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:03.415078 25622 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:03.415199 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:03.391822 25686 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.648s	user 0.002s	sys 0.000s
I20260709 13:07:03.416646 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:03.417407 22172 raft_consensus.cc:2393] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:03.418213 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:03.285498 25659 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.420060 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:03.422076 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:03.428020 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.431536 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.433207 22106 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:03.434036 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 515) took 2083 ms. Trace:
I20260709 13:07:03.434398 22106 rpcz_store.cc:276] 0709 13:07:01.350994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.403478 (+2052484us) service_pool.cc:224] Handling call
0709 13:07:03.432901 (+ 29423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.433787 (+   886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.433980 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:03.391675 25491 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:03.437883 25599 consensus_meta.cc:287] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.803s	user 0.007s	sys 0.006s
I20260709 13:07:03.438331 25599 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.435429 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:03.442278 22172 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:03.443244 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:03.444064 22172 raft_consensus.cc:2393] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:03.389245 25621 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.445850 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.414781 25608 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:03.450616 22253 raft_consensus.cc:1240] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:03.370844 25603 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:03.449326 22072 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.017s	sys 0.021s
W20260709 13:07:03.466566 22072 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.018s	sys 0.021s
W20260709 13:07:03.466933 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 663568us
I20260709 13:07:03.467965 22072 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:03.413522 25614 consensus_meta.cc:287] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.867s	user 0.007s	sys 0.002s
I20260709 13:07:03.440060 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:03.470269 22254 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:03.451181 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:03.472298 25316 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:03.473134 25316 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.453011 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:03.475785 22174 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:03.476976 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:03.421058 25410 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:03.440099 25657 consensus_meta.cc:287] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.909s	user 0.005s	sys 0.011s
I20260709 13:07:03.470402 22809 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.484742 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:03.485517 22816 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:03.479677 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.480443 22072 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:03.483546 22105 raft_consensus.cc:2393] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:03.452086 25679 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.488834 22072 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:03.490660 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2075) took 5316 ms. Trace:
I20260709 13:07:03.491755 22072 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:03.491194 22250 rpcz_store.cc:276] 0709 13:06:58.174694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.673673 (+498979us) service_pool.cc:224] Handling call
0709 13:07:00.979477 (+2305804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.979885 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.979922 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:00.979977 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:00.980019 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.980095 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.490433 (+2510338us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b540023b750. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:03.490584 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12075,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5420,"spinlock_wait_cycles":5302149504}
I20260709 13:07:03.507723 22174 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:03.485802 25410 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.505472 25675 consensus_queue.cc:1059] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:07:03.527064 22173 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:03.527240 25410 consensus_queue.cc:1059] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:03.528422 25671 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.529054 25671 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.531925 25599 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:03.532584 22809 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
W20260709 13:07:03.515079 25695 log.cc:927] Time spent T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:07:03.515946 25621 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:03.500816 25646 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:03.540719 25646 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:03.541111 25646 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:03.541391 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:03.541999 22180 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:03.514279 25636 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 1.819s	user 0.012s	sys 0.019s
I20260709 13:07:03.490440 25657 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.519774 25659 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:03.487334 25609 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:07:03.499152 25679 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:03.522260 25684 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:03.522636 25654 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.523150 25433 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:03.499505 25608 consensus_queue.cc:1059] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:07:03.499775 25622 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:03.484442 25614 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.489964 25650 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:03.516964 25316 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:03.488690 22172 raft_consensus.cc:1240] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:03.560357 25614 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:03.560388 22172 raft_consensus.cc:3055] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:03.562253 22172 raft_consensus.cc:740] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:03.553054 25659 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.563891 25659 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.566444 25659 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:03.554522 22813 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 9: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:03.567178 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 611) took 1031 ms. Trace:
I20260709 13:07:03.567653 22248 rpcz_store.cc:276] 0709 13:07:02.536257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.536390 (+   133us) service_pool.cc:224] Handling call
0709 13:07:02.537473 (+  1083us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.690400 (+152927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.566940 (+876540us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54003bcc54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:03.567117 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344500096}
I20260709 13:07:03.568765 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:03.576509 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:03.542019 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.556367 22251 raft_consensus.cc:2393] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 11: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:03.569839 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 592) took 3762 ms. Trace:
I20260709 13:07:03.556574 25433 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:03.557318 25654 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:03.557986 25608 raft_consensus.cc:3055] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:03.558585 25622 raft_consensus.cc:3055] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:03.552127 22175 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:03.576987 22174 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:03.577592 22809 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:03.550655 22816 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:03.577546 22252 rpcz_store.cc:276] 0709 13:06:59.807700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.609751 (+802051us) service_pool.cc:224] Handling call
0709 13:07:00.610039 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.813457 (+203418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.813499 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.820239 (+  6740us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.100284 (+280045us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:01.100327 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.569430 (+2469103us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54002db254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:03.569499 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.569544 (+    45us) raft_consensus.cc:1685] finished
0709 13:07:03.569557 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.569781 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2943,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":133579,"spinlock_wait_cycles":466803584,"thread_start_us":105202,"threads_started":1,"wal-append.queue_time_us":207488,"wal-append.run_cpu_time_us":9161,"wal-append.run_wall_time_us":1466974}
I20260709 13:07:03.555503 25684 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:03.591369 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:03.590684 25622 raft_consensus.cc:740] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:03.594611 25696 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:03.599469 25696 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:03.599850 25554 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:03.600010 25679 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:03.601388 22815 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:03.601555 25657 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:03.601987 22815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 491) took 1111 ms. Trace:
I20260709 13:07:03.602311 22815 rpcz_store.cc:276] 0709 13:07:02.490566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.490708 (+   142us) service_pool.cc:224] Handling call
0709 13:07:03.601048 (+1110340us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:07:03.601226 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.601768 (+   542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.601938 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8341888}
W20260709 13:07:03.602761 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.618582 22180 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:07:03.590437 25608 raft_consensus.cc:740] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:03.623435 22180 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:03.567200 25603 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.630143 22172 consensus_queue.cc:260] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.634357 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:03.640679 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.641696 22172 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:03.642024 22813 raft_consensus.cc:2368] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6.
I20260709 13:07:03.642776 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:03.643214 22180 raft_consensus.cc:2376] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10. Re-sending same reply.
I20260709 13:07:03.643404 22813 raft_consensus.cc:2376] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8. Re-sending same reply.
I20260709 13:07:03.644246 22180 raft_consensus.cc:1240] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:03.644268 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.649000 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.649689 22809 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:03.651463 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:03.651278 25679 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.653860 25608 consensus_queue.cc:260] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:03.654126 25679 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.656169 25679 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:03.657258 25667 consensus_queue.cc:1059] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:03.658279 25667 raft_consensus.cc:3055] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:03.658608 25650 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:03.659741 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:03.669418 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.660898 22815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47484
I20260709 13:07:03.670337 22815 raft_consensus.cc:606] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:03.670835 22815 raft_consensus.cc:614] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:03.660681 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:03.662406 22099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1685) took 1751 ms (client timeout 1541 ms). Trace:
W20260709 13:07:03.671985 22099 rpcz_store.cc:269] 0709 13:07:01.911502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.537355 (+625853us) service_pool.cc:224] Handling call
0709 13:07:03.662165 (+1124810us) spinlock_profiling.cc:243] Waited 89.9 ms on lock 0x7b5400215554. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:03.662321 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206695680}
I20260709 13:07:03.670547 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.688097 25646 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:03.710217 25646 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:03.681778 25679 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:03.633849 25569 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:03.716575 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:03.733219 25569 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:03.658644 25667 raft_consensus.cc:740] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:03.763157 25569 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:03.763701 25699 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:03.764334 22808 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:03.764640 25556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.010s	sys 0.022s
I20260709 13:07:03.765722 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:03.773782 22815 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:03.765995 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.774839 22172 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:03.767781 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.598006 25622 consensus_queue.cc:260] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:03.689291 25504 consensus_meta.cc:287] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 1.201s	user 0.011s	sys 0.004s
W20260709 13:07:03.771399 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 271357us
I20260709 13:07:03.650534 25603 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:03.777338 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.775136 25699 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.778857 25667 consensus_queue.cc:260] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:03.779482 25550 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:03.778157 22072 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:03.782325 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:03.783334 22813 raft_consensus.cc:2393] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 11: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
W20260709 13:07:03.775347 25556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.010s	sys 0.022s
I20260709 13:07:03.784647 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.803596 22809 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:03.804651 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.780200 25667 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:03.807025 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.775408 22172 pending_rounds.cc:85] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 3
I20260709 13:07:03.807871 22172 pending_rounds.cc:107] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:03.808243 22172 raft_consensus.cc:2889] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:03.810668 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.812052 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:03.812968 22809 raft_consensus.cc:2368] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6.
I20260709 13:07:03.819954 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:07:03.825241 22144 connection.cc:256] RPC call timeout handler was delayed by -1.7881391519999852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 13:07:03.771610 25679 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.828186 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:03.843595 22809 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.799574 25550 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:03.831923 22144 connection.cc:256] RPC call timeout handler was delayed by -1.7773391519999677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
I20260709 13:07:03.838181 22808 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:03.849896 22815 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
W20260709 13:07:03.852687 22144 connection.cc:256] RPC call timeout handler was delayed by -1.7710391519999575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260709 13:07:03.853087 22144 connection.cc:256] RPC call timeout handler was delayed by -1.6603391520000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260709 13:07:03.853353 22144 connection.cc:256] RPC call timeout handler was delayed by -1.4605391520000239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260709 13:07:03.853649 22144 connection.cc:256] RPC call timeout handler was delayed by -1.0798391519999768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2339s for a response
I20260709 13:07:03.854637 25316 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:03.827596 25657 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.781457 25504 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:03.874727 25675 raft_consensus.cc:993] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:07:03.818751 25650 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:07:03.850878 25550 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.885145 25675 raft_consensus.cc:1081] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Signalling peer 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:07:03.872582 25699 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:03.896493 22177 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:03.896644 22809 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:03.884608 22144 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:03.886094 25650 consensus_queue.cc:1243] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:03.892505 25550 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:03.883664 25657 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:03.903784 25696 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:03.922313 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.912134 25708 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:03.929813 25708 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:03.930362 25708 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.934103 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.933802 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:03.941252 22103 raft_consensus.cc:2393] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:03.919667 25603 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:03.940979 25701 log.cc:927] Time spent T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:03.949436 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.949733 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:03.945574 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:03.946677 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.951247 22815 raft_consensus.cc:2393] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:03.950065 22809 raft_consensus.cc:1813] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Handling vote request from an unknown peer 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:03.953157 22809 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:07:03.945425 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 45033.7us
I20260709 13:07:03.948696 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:03.954566 22103 raft_consensus.cc:2393] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:03.947551 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.960038 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:03.963572 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:03.965745 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:03.964489 22099 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:03.950091 25657 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:03.968969 25657 consensus_queue.cc:1048] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:03.970144 25710 log.cc:927] Time spent T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 13:07:03.971143 25707 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:07:03.972286 22811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 495) took 1478 ms. Trace:
I20260709 13:07:03.972681 22811 rpcz_store.cc:276] 0709 13:07:02.493788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.493933 (+   145us) service_pool.cc:224] Handling call
0709 13:07:03.388987 (+895054us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:07:03.389190 (+   203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.408661 (+ 19471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.408706 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.420677 (+ 11971us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.826053 (+405376us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:03.826112 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.826212 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.971995 (+145783us) raft_consensus.cc:1685] finished
0709 13:07:03.972015 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.972230 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18977,"raft.queue_time_us":19126,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7487,"spinlock_wait_cycles":7160576,"thread_start_us":358406,"threads_started":1,"wal-append.queue_time_us":463397}
I20260709 13:07:03.979077 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.979347 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.979528 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1680) took 2069 ms. Trace:
I20260709 13:07:03.980012 22248 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:03.979984 22105 rpcz_store.cc:276] 0709 13:07:01.909890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.593908 (+684018us) service_pool.cc:224] Handling call
0709 13:07:03.979310 (+1385402us) spinlock_profiling.cc:243] Waited 888 ms on lock 0x7b540001f754. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:03.979467 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2043451648}
I20260709 13:07:03.981178 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.981479 25679 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:03.981904 22248 raft_consensus.cc:2393] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 10: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:07:03.982110 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.982401 25504 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:03.959335 25486 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:07:03.983783 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:03.984961 25682 log.cc:927] Time spent T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 1.256s	user 0.006s	sys 0.000s
I20260709 13:07:03.986523 22814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 493) took 1493 ms. Trace:
I20260709 13:07:03.986896 22814 rpcz_store.cc:276] 0709 13:07:02.492968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.493148 (+   180us) service_pool.cc:224] Handling call
0709 13:07:02.528146 (+ 34998us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:02.569423 (+ 41277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.569452 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:02.569994 (+   542us) log.cc:844] Serialized 52 byte log entry
0709 13:07:02.676547 (+106553us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:02.676586 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.676656 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.984314 (+1307658us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:03.986203 (+  1889us) raft_consensus.cc:1685] finished
0709 13:07:03.986226 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.986460 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2575,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":16779648,"thread_start_us":106218,"threads_started":1,"wal-append.queue_time_us":131548}
I20260709 13:07:03.982779 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.988720 22255 raft_consensus.cc:2393] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 10: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:03.983114 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.982951 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:03.990619 22250 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:03.990785 22253 raft_consensus.cc:2368] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9.
I20260709 13:07:03.979795 22252 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:03.994730 22252 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:03.982769 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:04.002296 22248 raft_consensus.cc:2393] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:04.007508 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:04.015269 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 58896.1us
W20260709 13:07:04.019011 22147 leader_election.cc:336] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.571s (SENT)
W20260709 13:07:04.025274 25714 log.cc:927] Time spent T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:04.027977 22813 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:04.028434 22813 pending_rounds.cc:85] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: Aborting all ops after (but not including) 7
I20260709 13:07:04.028671 22813 pending_rounds.cc:107] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:04.029266 22813 raft_consensus.cc:2889] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:04.030200 25608 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.031821 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:04.033344 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:04.034142 22816 raft_consensus.cc:2393] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 11: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
W20260709 13:07:04.042654 22102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 513) took 2689 ms (client timeout 1546 ms). Trace:
W20260709 13:07:04.043159 22102 rpcz_store.cc:269] 0709 13:07:01.350367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.911287 (+560920us) service_pool.cc:224] Handling call
0709 13:07:04.039106 (+2127819us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400344ed4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:04.039268 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269914496}
W20260709 13:07:04.060686 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.086808 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.098652 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:04.131868 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:04.132611 22814 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:04.134367 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2153) took 1576 ms. Trace:
I20260709 13:07:04.136145 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:04.140295 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 92175.7us
I20260709 13:07:04.206501 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:04.207252 22248 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.210026 25708 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:04.166198 22175 rpcz_store.cc:276] 0709 13:07:02.557917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.559082 (+  1165us) service_pool.cc:224] Handling call
0709 13:07:02.559441 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.590512 (+1031071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.134052 (+543540us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b5400120054. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:04.134284 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2279731712}
I20260709 13:07:04.302772 22248 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:04.304052 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:04.304877 22248 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
W20260709 13:07:04.306111 22247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1894) took 5023 ms (client timeout 2339 ms). Trace:
W20260709 13:07:04.306556 22247 rpcz_store.cc:269] 0709 13:06:59.242635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.531728 (+289093us) service_pool.cc:224] Handling call
0709 13:07:04.265395 (+4733667us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540023b254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:04.265528 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3411721088}
W20260709 13:07:04.306571 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 225136us
W20260709 13:07:04.311700 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 174357us
I20260709 13:07:04.319664 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:04.319711 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 301354us
I20260709 13:07:04.320573 22247 raft_consensus.cc:2393] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:07:04.341876 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.333434 22180 raft_consensus.cc:1240] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:04.354068 22779 leader_election.cc:336] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Timed out: RequestConsensusVote RPC to 127.20.130.65:33421 timed out after 1.608s (SENT)
I20260709 13:07:04.354449 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:04.355765 22779 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:04.357005 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:04.360776 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:04.361624 22175 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:04.358706 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:04.362860 22181 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:07:04.369650 22220 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:04.370638 22220 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:04.370754 22779 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:04.372920 22779 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:04.373112 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:04.374603 22812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 903) took 4037 ms. Trace:
I20260709 13:07:04.374953 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:04.376426 22179 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:04.377429 22220 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:04.375182 22812 rpcz_store.cc:276] 0709 13:07:00.337554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.337856 (+   302us) service_pool.cc:224] Handling call
0709 13:07:00.338309 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.415551 (+2077242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.374390 (+1958839us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b5400512a54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:04.374547 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4531140864}
I20260709 13:07:04.379035 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:04.380245 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:04.379868 22247 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:04.387816 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:04.392617 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:04.395586 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:04.374432 25667 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:04.374908 25680 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:04.382015 25603 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:07:04.382900 25571 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.415753 25571 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:04.417821 25571 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:04.379874 25679 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:04.418503 25679 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.418862 25679 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:04.402761 25719 log.cc:927] Time spent T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:07:04.404093 25648 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:04.430472 25648 raft_consensus.cc:697] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:04.431704 25708 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:04.431463 25648 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:04.378788 25428 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:04.435145 25639 consensus_queue.cc:1059] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:04.436044 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2114) took 1229 ms. Trace:
I20260709 13:07:04.436487 22254 rpcz_store.cc:276] 0709 13:07:03.206813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.315731 (+108918us) service_pool.cc:224] Handling call
0709 13:07:03.332700 (+ 16969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.470746 (+138046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.435814 (+965068us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54002288d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:04.435988 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307626752}
I20260709 13:07:04.437664 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:04.437791 25639 raft_consensus.cc:3055] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:04.438197 25639 raft_consensus.cc:740] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:04.401623 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:04.389122 25696 consensus_queue.cc:1059] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:07:04.439486 22181 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:04.439790 25696 raft_consensus.cc:3055] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:04.440218 25696 raft_consensus.cc:740] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:04.441128 25696 consensus_queue.cc:260] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:04.442139 22179 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:04.447224 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:04.406102 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:04.407378 25671 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:04.355459 25720 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:07:04.382400 25654 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:04.411338 25121 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:07:04.412201 25650 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.515172 25650 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:04.516239 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2165) took 1347 ms. Trace:
I20260709 13:07:04.516673 22174 rpcz_store.cc:276] 0709 13:07:03.169235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.509913 (+340678us) service_pool.cc:224] Handling call
0709 13:07:03.576628 (+ 66715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.592328 (+ 15700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.516023 (+923695us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b540031b5d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:04.516176 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121795456}
I20260709 13:07:04.517488 25650 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:04.412941 25672 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:04.423386 25723 consensus_queue.cc:1059] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:04.323191 25550 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:04.518872 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.519695 22247 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:04.452654 22249 raft_consensus.cc:2393] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 10: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:04.519699 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:04.438216 22254 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:04.520953 22179 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
W20260709 13:07:04.494745 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.496363 22250 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:04.485775 22071 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:04.479825 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:04.475950 22104 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:04.526445 22782 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:04.501482 22181 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:04.480712 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2156) took 1921 ms. Trace:
I20260709 13:07:04.527328 22177 rpcz_store.cc:276] 0709 13:07:02.559660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.560442 (+   782us) service_pool.cc:224] Handling call
0709 13:07:02.560729 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.897034 (+1336305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.480453 (+583419us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540045f6d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:04.480656 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3071308160}
W20260709 13:07:04.479856 25692 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 1.237s	user 0.006s	sys 0.001s
I20260709 13:07:04.481663 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:04.482969 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.533638 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.480216 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.480937 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.536091 22103 raft_consensus.cc:2410] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:04.496210 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 2109) took 1290 ms. Trace:
I20260709 13:07:04.536669 22251 rpcz_store.cc:276] 0709 13:07:03.205373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.266568 (+ 61195us) service_pool.cc:224] Handling call
0709 13:07:04.495845 (+1229277us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54001b03d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:04.496098 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646681856}
I20260709 13:07:04.478686 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.517918 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:04.526222 22176 raft_consensus.cc:2376] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11. Re-sending same reply.
I20260709 13:07:04.538363 22174 raft_consensus.cc:2393] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 8: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:04.519891 22106 raft_consensus.cc:2410] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:04.477761 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:04.538378 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1687) took 1139 ms. Trace:
I20260709 13:07:04.525067 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:04.539510 22098 rpcz_store.cc:276] 0709 13:07:03.399368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.478400 (+1079032us) service_pool.cc:224] Handling call
0709 13:07:04.538299 (+ 59899us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.479436 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.527480 22071 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:04.442649 25696 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.528995 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:04.539973 22105 raft_consensus.cc:2410] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:04.525384 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:04.545015 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:04.545593 22247 raft_consensus.cc:2393] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:04.524194 22175 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:04.546715 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:04.547143 22175 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:04.523950 25121 raft_consensus.cc:3055] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:04.549031 25121 raft_consensus.cc:740] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:04.549166 25550 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:04.549499 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:04.549962 25121 consensus_queue.cc:260] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:04.551470 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.551664 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:04.552250 22105 raft_consensus.cc:2393] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:04.552292 22249 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:04.553534 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:04.554785 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:04.550778 25632 log.cc:927] Time spent T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 2.855s	user 0.016s	sys 0.018s
I20260709 13:07:04.555819 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.556234 25429 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:04.556392 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.557070 22098 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:04.558145 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:04.452507 25603 consensus_queue.cc:1175] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "765d912bde9e48959e50d9efec3c26b6" responder_term: 7 status { last_received { term: 6 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:04.550796 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.561031 25593 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:04.561103 25679 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:04.557392 22254 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:04.559204 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:04.563484 22105 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.564167 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:04.565760 22248 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:04.561136 22099 raft_consensus.cc:2393] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:04.567126 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.567749 22098 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:04.567945 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.568584 22099 raft_consensus.cc:1813] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Handling vote request from an unknown peer 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:04.569154 22099 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:04.569466 25608 consensus_queue.cc:1059] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:04.569715 22071 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:04.570551 25550 raft_consensus.cc:3055] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:04.570623 25593 raft_consensus.cc:697] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:04.563401 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.572839 22101 raft_consensus.cc:2393] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:07:04.582300 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.556842 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.589073 22071 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:04.589571 22104 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:04.591349 25593 consensus_queue.cc:237] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:04.592283 25595 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:04.592826 25595 raft_consensus.cc:697] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:04.592775 22071 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:04.593890 25595 consensus_queue.cc:237] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:04.594800 25583 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:04.590158 25591 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.595317 25410 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:04.595708 25591 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:04.596504 25583 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:04.596802 25609 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:04.597167 25414 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:07:04.597282 25609 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.597761 25609 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:04.597994 25583 consensus_queue.cc:1059] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:04.603307 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:04.571027 25550 raft_consensus.cc:740] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:04.538985 25650 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:04.543180 25164 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:04.605983 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:04.607923 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.605976 25628 raft_consensus.cc:3055] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:04.537516 25654 raft_consensus.cc:697] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:04.618126 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.608335 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1795) took 3567 ms. Trace:
I20260709 13:07:04.610489 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:04.621310 22099 raft_consensus.cc:2393] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:04.613051 22103 raft_consensus.cc:2410] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:04.622764 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:04.626083 22101 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:04.627094 22105 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:04.610574 25650 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.520288 25639 consensus_queue.cc:260] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:04.630076 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:04.620621 25428 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:04.610519 25164 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:04.614384 25628 raft_consensus.cc:740] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:04.634721 22099 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:04.631325 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:04.649287 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 296567us
I20260709 13:07:04.633705 25650 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:04.624495 25679 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:04.649747 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:04.651335 25639 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.647716 25428 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:04.647794 25164 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:04.635464 25550 consensus_queue.cc:260] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:04.667538 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.671792 22147 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:04.671924 25628 consensus_queue.cc:260] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:04.678010 25428 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:04.690310 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 343570us
I20260709 13:07:04.698835 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.703825 22105 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:07:04.706351 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.710204 22104 rpcz_store.cc:276] 0709 13:07:01.041326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.166114 (+124788us) service_pool.cc:224] Handling call
0709 13:07:01.166394 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.453166 (+3286772us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b58002bc7d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7eaa0aa 00007f66a7f2c447 00007f66a7f44fe7 00007f66a7f467de 00007f66a7f50b49 00007f66a7f51416 00007f66a7f4dd8f 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4
0709 13:07:04.589937 (+136771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.608240 (+ 18303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5289455360}
W20260709 13:07:04.754189 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 484603us
I20260709 13:07:04.761901 22072 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:04.776400 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.779915 22099 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:04.687371 25708 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:04.688683 25550 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:04.665886 25654 consensus_queue.cc:237] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:04.804826 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 424490us
I20260709 13:07:04.831127 22779 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:04.832604 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 64461.1us
I20260709 13:07:04.835242 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:04.836056 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:04.836416 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.839195 22144 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:04.855760 25480 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:04.856366 25480 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.856797 25480 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:04.859717 25642 consensus_queue.cc:1059] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:04.860857 25642 raft_consensus.cc:3055] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:04.861198 25642 raft_consensus.cc:740] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:04.862025 25642 consensus_queue.cc:260] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:04.780036 24932 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:04.863565 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:04.864007 22105 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:04.864455 22810 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 9: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:04.863472 24932 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:04.871519 22105 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:07:04.874235 22106 raft_consensus.cc:1240] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:04.874365 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.875644 22103 raft_consensus.cc:2410] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:04.801610 25410 raft_consensus.cc:697] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:07:04.889981 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 50858.8us
W20260709 13:07:04.890475 22097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 512) took 3540 ms (client timeout 1946 ms). Trace:
I20260709 13:07:04.893067 22144 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:04.890851 22097 rpcz_store.cc:269] 0709 13:07:01.350060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.094630 (+744570us) service_pool.cc:224] Handling call
0709 13:07:04.890249 (+2795619us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54002b9654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:04.890402 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791874816}
I20260709 13:07:04.802173 25671 consensus_queue.cc:1059] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:07:04.872232 25708 raft_consensus.cc:697] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:04.879482 25642 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:04.780138 25609 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:04.904112 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:04.911351 22248 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:04.901999 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.906455 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:04.908414 22101 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
W20260709 13:07:04.916575 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.918872 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:04.895227 25456 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:04.896150 25428 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 13:07:04.945724 22246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 2094) took 1764 ms (client timeout 1686 ms). Trace:
W20260709 13:07:04.951176 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 356773us
W20260709 13:07:04.951432 22246 rpcz_store.cc:269] 0709 13:07:03.181597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.181767 (+   170us) service_pool.cc:224] Handling call
0709 13:07:04.945505 (+1763738us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54001ccad4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:04.945656 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339292928}
I20260709 13:07:04.953014 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:04.947237 22072 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:04.958109 22099 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:04.917171 25729 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:04.948323 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:04.964108 22248 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:04.949769 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.954545 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:04.967214 22246 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:04.947242 22220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.009s	sys 0.053s
I20260709 13:07:04.894572 25667 consensus_queue.cc:1059] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:07:04.926973 25730 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:04.971302 22220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.009s	sys 0.053s
W20260709 13:07:04.975347 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 597959us
W20260709 13:07:04.978120 22218 leader_election.cc:336] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Timed out: RequestConsensusVote RPC to 127.20.130.65:33421 timed out after 2.130s (SENT)
I20260709 13:07:04.978726 22218 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:04.977131 22220 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:04.925827 25503 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:07:04.964411 25456 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:04.985713 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:04.986478 22101 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
W20260709 13:07:04.990857 22218 leader_election.cc:336] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Timed out: RequestConsensusVote RPC to 127.20.130.65:33421 timed out after 2.133s (SENT)
I20260709 13:07:04.991403 22218 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:04.993275 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:04.975172 25730 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:04.995434 22218 leader_election.cc:336] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Timed out: RequestConsensusVote RPC to 127.20.130.65:33421 timed out after 2.162s (SENT)
I20260709 13:07:04.995752 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:04.998039 22218 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:04.998404 22179 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
W20260709 13:07:04.967557 25491 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.076s	sys 0.094s
I20260709 13:07:04.993778 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:04.992964 25429 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:04.996323 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:05.000358 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:04.992444 22220 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:05.020597 22101 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 5.
I20260709 13:07:04.943298 25410 consensus_queue.cc:237] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.008987 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:05.012758 25491 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.077s	sys 0.094s
I20260709 13:07:04.995280 25613 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:05.025447 22218 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:04.999532 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:05.016822 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 98058us
I20260709 13:07:04.998332 25679 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.022653 22176 raft_consensus.cc:2368] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10.
I20260709 13:07:04.994647 25740 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:05.028152 22101 raft_consensus.cc:1240] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:05.028796 22218 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:05.021217 22220 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:04.998643 25730 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.002303 25658 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:05.030165 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:05.049809 22179 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:05.050801 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:05.051406 22179 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.026604 22246 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:07:05.031638 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:05.033883 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:05.035468 25429 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.063860 25609 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:05.064973 25609 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:05.065156 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2148) took 3012 ms. Trace:
I20260709 13:07:05.065577 25609 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:05.072053 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 50917.2us
I20260709 13:07:05.032315 22781 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:05.074069 22220 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:05.075232 22781 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:05.040131 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:05.044646 22069 leader_election.cc:336] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Timed out: RequestConsensusVote RPC to 127.20.130.68:35973 timed out after 1.555s (SENT)
I20260709 13:07:05.048717 22144 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:05.084411 22172 raft_consensus.cc:2393] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:05.085482 22144 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:05.023850 25648 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:05.035948 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:05.053323 22807 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:05.087155 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:05.036469 25593 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:05.065634 22173 rpcz_store.cc:276] 0709 13:07:02.053150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.078995 (+ 25845us) service_pool.cc:224] Handling call
0709 13:07:02.079284 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.527604 (+1448320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.064907 (+1537303us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400328cd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:05.065095 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3328629632}
I20260709 13:07:05.088665 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:04.993378 25708 consensus_queue.cc:237] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:05.089859 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:05.053747 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.071478 22218 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:05.091979 22144 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:05.089872 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:05.091733 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.027216 25613 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:05.087046 25503 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.102665 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.103314 22246 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:07:05.096761 22179 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:07:05.104120 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:05.104965 22246 raft_consensus.cc:2393] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:05.105973 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.101750 25316 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:05.107694 25316 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.108060 25316 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.098266 22248 raft_consensus.cc:2393] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:05.111346 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.112071 22218 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:05.039968 25740 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:05.090440 25729 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.100381 25429 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:05.093912 25164 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.100952 25671 raft_consensus.cc:2764] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:07:05.101301 25736 log.cc:927] Time spent T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:07:05.077404 25667 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.077657 25609 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:05.085214 25428 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.085057 25656 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:05.114377 25729 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:05.119570 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.120919 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:05.072088 25732 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:05.122207 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.123875 25648 raft_consensus.cc:697] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:05.125633 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:05.125984 25657 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.097975 25456 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:07:05.102145 25613 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:05.160976 25639 consensus_meta.cc:287] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 13:07:05.161623 22810 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:07:05.167215 25613 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:05.169960 25613 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:05.158178 25480 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:05.123317 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 176197us
I20260709 13:07:05.119449 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:05.137499 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.114244 25740 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.118757 25445 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:05.101788 25699 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:05.147240 25679 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.147585 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.148164 25428 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:05.194015 22248 raft_consensus.cc:2393] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 11: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:05.193847 22246 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:05.197224 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:05.205258 22100 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.206539 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:05.207156 22253 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:05.174873 25696 consensus_meta.cc:287] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.000s
I20260709 13:07:05.200654 25445 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:05.128716 25667 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.203459 25699 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.145531 25729 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.190951 25480 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:05.206157 25428 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:05.222806 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1940) took 1086 ms. Trace:
I20260709 13:07:05.222558 22246 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:05.305272 22248 rpcz_store.cc:276] 0709 13:07:04.136711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.205846 (+1069135us) service_pool.cc:224] Handling call
0709 13:07:05.222144 (+ 16298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.222387 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.222423 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.222479 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:05.222522 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.222593 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.222729 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.306768 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1941) took 1169 ms. Trace:
I20260709 13:07:05.307307 22246 rpcz_store.cc:276] 0709 13:07:04.137027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.305725 (+1168698us) service_pool.cc:224] Handling call
0709 13:07:05.306132 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.306363 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.306401 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.306457 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:05.306501 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.306571 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.306702 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.310091 22246 raft_consensus.cc:1240] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:05.242942 22253 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:05.313263 22253 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:05.198218 22072 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:05.284785 22147 leader_election.cc:336] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.339s (SENT)
W20260709 13:07:05.315924 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 117812us
I20260709 13:07:05.316936 22072 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:05.314744 22253 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:05.320803 22246 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:05.322475 22246 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:07:05.324244 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.191107 25657 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:05.310149 22100 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:05.311040 25428 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.219127 25445 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:05.335704 25621 raft_consensus.cc:3055] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:05.304167 25650 consensus_meta.cc:287] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.000s
I20260709 13:07:05.225302 25699 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:05.328706 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.349486 22779 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:05.325291 25738 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:05.354794 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 280787us
W20260709 13:07:05.358503 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 271908us
W20260709 13:07:05.357913 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 258493us
W20260709 13:07:05.366437 22069 connection.cc:256] RPC call timeout handler was delayed by -1.4614752549999821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 13:07:05.368825 22069 connection.cc:256] RPC call timeout handler was delayed by -1.4163319299999557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 13:07:05.369572 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:05.369982 22069 connection.cc:256] RPC call timeout handler was delayed by -1.1844496530000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
W20260709 13:07:05.370488 22069 connection.cc:256] RPC call timeout handler was delayed by -1.1402202670000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 13:07:05.379407 22069 connection.cc:256] RPC call timeout handler was delayed by -1.1141202670000894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
I20260709 13:07:05.366568 22144 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:05.346081 25593 raft_consensus.cc:2764] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:05.347903 25621 raft_consensus.cc:740] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:05.354481 25480 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:05.427263 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1926) took 1446 ms. Trace:
I20260709 13:07:05.427711 22250 rpcz_store.cc:276] 0709 13:07:03.980748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.991357 (+ 10609us) service_pool.cc:224] Handling call
0709 13:07:04.496026 (+504669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.522340 (+ 26314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.427046 (+904706us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54001b03d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:05.427195 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1159643392}
I20260709 13:07:05.429437 22250 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:07:05.433223 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 321233us
I20260709 13:07:05.434337 22218 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:05.371254 25656 raft_consensus.cc:697] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:05.353287 25650 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:05.447206 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:05.444926 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 78458.5us
I20260709 13:07:05.449240 22069 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:05.453359 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:05.433132 22250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:51872
I20260709 13:07:05.455363 22250 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:05.455852 22250 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.343891 25648 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.464500 22072 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:05.464707 22144 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:05.465323 22177 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:05.466634 22177 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:05.461555 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 386394us
I20260709 13:07:05.460836 22069 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:05.469996 22781 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:05.472903 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:05.438171 25429 raft_consensus.cc:697] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:05.458986 25708 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:05.475754 25723 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:05.475754 25649 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:05.440898 25654 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:05.491253 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1834) took 1167 ms. Trace:
I20260709 13:07:05.488447 22782 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:05.478874 25591 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:05.443084 25164 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:05.503831 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 624) took 1070 ms. Trace:
I20260709 13:07:05.442246 25480 raft_consensus.cc:697] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:05.504264 22253 rpcz_store.cc:276] 0709 13:07:04.433003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.319414 (+886411us) service_pool.cc:224] Handling call
0709 13:07:05.319743 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.319992 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:05.433977 (+113985us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.503511 (+ 69534us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.503559 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:05.503603 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.503669 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.503780 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11530,"raft.queue_time_us":11883,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":155432,"threads_started":2}
I20260709 13:07:05.505141 25480 consensus_queue.cc:237] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.502856 22180 rpcz_store.cc:276] 0709 13:07:04.323681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.325157 (+  1476us) service_pool.cc:224] Handling call
0709 13:07:04.325527 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.352284 (+ 26757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.485159 (+1132875us) spinlock_profiling.cc:243] Waited 7.59 ms on lock 0x7b540028c654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:05.491184 (+  6025us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17459584}
W20260709 13:07:05.509509 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.495031 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:05.492594 22781 leader_election.cc:400] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10.
I20260709 13:07:05.510491 22781 leader_election.cc:403] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:05.481949 25746 log.cc:927] Time spent T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:07:05.494632 22250 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:05.499166 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:05.531008 22177 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.499805 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:05.498358 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:05.511804 22781 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:05.467371 25745 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:05.517937 25609 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:05.518972 25667 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:05.519711 25419 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.523124 24932 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:05.486002 25639 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:05.497149 25550 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.496502 25486 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:05.497068 25563 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.553352 25696 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:07:05.556165 25650 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:05.530161 25761 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.538511 25164 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10.
I20260709 13:07:05.537101 25754 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.564422 25429 consensus_queue.cc:237] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:05.503134 25316 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.567051 25754 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:05.472441 25621 consensus_queue.cc:260] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.559376 25667 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:05.568398 25761 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.575114 25622 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.548216 25672 consensus_queue.cc:1059] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:07:05.573904 25667 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.573339 25754 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.584426 25657 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:05.588063 25734 raft_consensus.cc:3055] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:05.588472 25734 raft_consensus.cc:740] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:05.589025 25730 consensus_meta.cc:287] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.002s
I20260709 13:07:05.589421 25730 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.589299 25734 consensus_queue.cc:260] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.591166 25667 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.594090 25730 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:05.586364 25740 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:05.597183 25740 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:05.598903 25754 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.602253 25699 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:05.604046 25699 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:05.605921 25754 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:05.606825 25729 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.610551 25761 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:05.607638 25734 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.611286 25729 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:05.489698 22069 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:05.496018 22102 raft_consensus.cc:2393] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:05.504072 22100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:33706
W20260709 13:07:05.483354 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 530556us
I20260709 13:07:05.643435 22100 raft_consensus.cc:606] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:05.527880 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:05.645588 22174 raft_consensus.cc:2393] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:05.647500 22100 raft_consensus.cc:614] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:05.501650 22147 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:05.651602 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 149852us
I20260709 13:07:05.655930 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:05.656822 22072 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:05.658404 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 163350us
I20260709 13:07:05.659859 22181 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:07:05.660873 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 170511us
W20260709 13:07:05.666625 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 126585us
I20260709 13:07:05.669690 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:05.670439 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.672344 22218 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:05.676383 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.680047 22250 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:05.681555 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.682358 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.683625 22250 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:05.685148 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.685271 22069 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:05.685770 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.685559 22220 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:05.686335 22250 raft_consensus.cc:2393] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:05.687673 22246 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:05.687749 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.688985 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.689502 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:05.690166 22249 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:05.690462 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.700017 22097 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: [7.4-10.5]
I20260709 13:07:05.701458 22220 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:05.702355 22254 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 9. Ops: []
I20260709 13:07:05.703202 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 1925) took 1722 ms. Trace:
I20260709 13:07:05.704434 22254 raft_consensus.cc:1240] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:05.703697 22255 rpcz_store.cc:276] 0709 13:07:03.980530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.989390 (+  8860us) service_pool.cc:224] Handling call
0709 13:07:04.945650 (+956260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.946046 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.946076 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.946538 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.132527 (+185989us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:05.433285 (+300758us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.433542 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.433611 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.701509 (+267898us) raft_consensus.cc:1685] finished
0709 13:07:05.701545 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.702811 (+  1266us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54001ccad0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:05.702979 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11563,"prepare.queue_time_us":380080,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":863,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":19153,"spinlock_wait_cycles":2198242688,"thread_start_us":379321,"threads_started":2,"wal-append.queue_time_us":372271}
I20260709 13:07:05.707377 22246 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
W20260709 13:07:05.708685 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.714970 22254 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:05.716140 22255 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:05.696382 22253 raft_consensus.cc:2410] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:05.696146 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:05.728885 22098 raft_consensus.cc:2393] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:05.696686 22251 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:05.697213 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:05.697845 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1690) took 1219 ms. Trace:
I20260709 13:07:05.698951 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.699391 22069 leader_election.cc:400] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 5 election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6.
I20260709 13:07:05.716864 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:05.718487 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:05.722116 22106 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:07:05.723698 22100 raft_consensus.cc:1240] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:05.725585 22072 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:05.692518 22249 raft_consensus.cc:1217] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-10.6]   Dedup: 5.3->[6.4-10.6]
I20260709 13:07:05.675328 22218 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:05.732545 22249 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11. Ops: [3.2-10.6]
I20260709 13:07:05.730209 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:05.741824 25316 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:05.743577 22175 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 9: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:05.730872 22102 rpcz_store.cc:276] 0709 13:07:04.478133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.479972 (+  1839us) service_pool.cc:224] Handling call
0709 13:07:05.697455 (+1217483us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b54002ab2d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:05.697655 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2191689472}
I20260709 13:07:05.753314 22250 raft_consensus.cc:2368] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9.
W20260709 13:07:05.752449 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 51146.3us
I20260709 13:07:05.692533 22071 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:05.757838 22101 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:05.759613 22101 raft_consensus.cc:1240] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:05.759657 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:05.761617 25613 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.762842 25138 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:05.763123 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:05.763427 25138 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.763835 25138 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.764016 22179 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.767431 25654 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.768425 25654 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.769146 25654 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:05.769508 24932 consensus_queue.cc:1059] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:05.772485 25491 consensus_queue.cc:1059] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:05.773190 25609 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:05.775416 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.777271 25658 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:05.780570 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 105625us
I20260709 13:07:05.579453 25621 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.787478 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:05.559867 25656 consensus_queue.cc:237] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.784687 25648 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.784267 25410 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.785399 25563 consensus_queue.cc:1059] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:05.791443 25449 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:05.783281 25550 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:05.754264 22177 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:05.800633 22248 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:05.802318 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 76891.1us
I20260709 13:07:05.803108 22147 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:05.803725 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 111375us
I20260709 13:07:05.818554 25456 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:05.819168 22071 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:05.803910 25730 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.820290 25730 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:05.803737 25679 raft_consensus.cc:3055] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:05.804549 25729 raft_consensus.cc:3055] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:05.805151 25595 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:05.821310 22808 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:05.828297 25740 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:05.821702 25583 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:05.823120 25679 raft_consensus.cc:740] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:05.830240 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:05.823374 25729 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:05.832782 25729 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:05.826202 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:05.829310 25449 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:05.830991 22250 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:05.827301 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:05.823444 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:05.836324 25121 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:05.843302 25449 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:05.770902 24932 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:05.847098 25445 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.847680 22177 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:05.848869 22247 raft_consensus.cc:2393] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 12: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:05.849658 25563 raft_consensus.cc:3055] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:05.850106 25563 raft_consensus.cc:740] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:05.851179 25563 consensus_queue.cc:260] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:05.850720 25628 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.852851 25563 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:05.855238 22072 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:05.857601 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:05.858384 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:05.859346 22253 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:05.836045 25654 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:05.867727 25785 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.868806 25592 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:05.869499 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 170497us
I20260709 13:07:05.869655 25609 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:05.869902 22220 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:05.870568 22069 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:05.871555 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:05.873435 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:05.873507 22069 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:05.874531 22180 raft_consensus.cc:2393] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 10: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:05.870829 25583 raft_consensus.cc:697] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:05.875784 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:05.876202 25583 consensus_queue.cc:237] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.877308 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:05.849684 25445 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:05.877532 25428 consensus_meta.cc:287] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.511s	user 0.004s	sys 0.009s
I20260709 13:07:05.878192 22176 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:05.877442 25671 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:05.868487 25785 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.861608 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:05.898881 22179 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:05.893927 25671 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:05.863930 25456 raft_consensus.cc:697] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:05.915046 22176 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:05.921869 22181 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:05.914083 22173 raft_consensus.cc:1240] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:05.925910 22177 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:05.835752 25679 consensus_queue.cc:260] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:05.881338 25729 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:05.930284 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 127420us
W20260709 13:07:05.915287 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 386527us
I20260709 13:07:05.911342 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:05.913276 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 401412us
I20260709 13:07:05.933316 22178 raft_consensus.cc:2393] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 9: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:05.912684 25671 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:05.936620 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:05.920763 25608 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:05.921793 25654 raft_consensus.cc:2764] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:07:05.918951 25410 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.925576 25428 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.936033 25592 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:05.951320 25648 consensus_queue.cc:1059] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 13:07:05.954581 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 97170.3us
I20260709 13:07:05.956312 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:05.956987 22147 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:05.958664 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.959129 22180 raft_consensus.cc:1275] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:05.959481 25428 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:05.960466 22072 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:05.961753 25164 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:05.962231 25785 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:05.920463 25456 consensus_queue.cc:237] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:05.963393 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:05.963299 25754 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:05.964359 22173 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:05.965190 25138 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.932389 25595 raft_consensus.cc:697] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:05.970722 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:05.977169 25783 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:05.977717 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 158711us
I20260709 13:07:05.977941 25783 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:05.978994 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 105671us
I20260709 13:07:05.980326 25783 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:05.981436 25486 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.981668 22147 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:05.983434 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 190159us
I20260709 13:07:05.986021 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:05.986819 25592 raft_consensus.cc:697] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:05.988436 22252 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:05.988363 25592 consensus_queue.cc:237] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:05.991189 25421 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.991158 25449 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:05.992017 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 613) took 1572 ms. Trace:
I20260709 13:07:05.992055 25421 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:05.954391 25679 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.993839 25745 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:05.993511 22071 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:05.992419 22248 rpcz_store.cc:276] 0709 13:07:04.419662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.306568 (+886906us) service_pool.cc:224] Handling call
0709 13:07:05.343427 (+ 36859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.820636 (+477209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.991722 (+171086us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b540005d7d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:05.991946 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013613824}
I20260709 13:07:05.998749 25622 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:05.999841 22781 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:06.000358 25622 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:06.001405 22781 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:06.002362 25754 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:06.003484 25754 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.948827 25730 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:06.004854 25730 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:05.990623 22252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 1936) took 1954 ms (client timeout 1793 ms). Trace:
W20260709 13:07:06.007020 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.969045 22105 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:06.011826 22181 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
W20260709 13:07:06.016860 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 56475.3us
I20260709 13:07:06.017844 22072 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:06.018471 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:06.019459 22069 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:06.006534 22252 rpcz_store.cc:269] 0709 13:07:04.035746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.098272 (+ 62526us) service_pool.cc:224] Handling call
0709 13:07:05.990386 (+1892114us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b540019cb54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:05.990537 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4343349504}
I20260709 13:07:05.983469 22147 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:06.005200 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:06.031250 25745 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:06.031466 25748 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:07:06.031469 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:06.042663 22101 raft_consensus.cc:2393] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:06.043036 22220 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:06.029174 25608 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:06.045567 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:06.027927 25740 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:06.050107 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 47322.3us
I20260709 13:07:06.051129 22781 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:06.051290 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:06.052125 22255 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:07:06.053988 22069 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:06.054636 25782 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:07:06.055815 25622 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:06.038200 25410 consensus_queue.cc:1059] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:07:06.056257 25622 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:06.056695 25622 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:06.059072 22104 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:06.059629 25745 raft_consensus.cc:697] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:06.054234 22099 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:06.060935 25745 consensus_queue.cc:237] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:06.061988 22104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 531) took 1227 ms (client timeout 1517 ms). Trace:
I20260709 13:07:06.059803 25650 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.062615 22104 rpcz_store.cc:269] 0709 13:07:04.834870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.835017 (+   147us) service_pool.cc:224] Handling call
0709 13:07:06.061663 (+1226646us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540001e354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:06.061886 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2396495232}
I20260709 13:07:06.056699 25410 raft_consensus.cc:3055] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:06.064258 25410 raft_consensus.cc:740] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:06.064761 25421 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:06.065217 25410 consensus_queue.cc:260] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.022219 25785 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:07:06.067258 25730 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:06.070396 25738 consensus_queue.cc:1059] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:06.072676 25740 raft_consensus.cc:3055] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:06.073072 25740 raft_consensus.cc:740] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:06.073777 22177 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:06.074504 22810 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:06.075744 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:06.076013 25486 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:06.076398 22813 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.076476 25486 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.077034 25486 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:06.077323 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:06.078055 25428 consensus_queue.cc:1059] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:06.078969 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:06.079779 22812 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:06.079981 25419 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:06.080382 25419 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.080715 25419 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:06.063208 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 77328us
I20260709 13:07:06.076028 22173 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:06.075621 22808 raft_consensus.cc:1240] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:06.088721 22220 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:06.089541 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 45713us
I20260709 13:07:06.089982 22178 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:06.090698 25504 consensus_queue.cc:1059] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:06.091089 25648 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:06.091645 25648 raft_consensus.cc:697] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:06.092257 25504 raft_consensus.cc:3055] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:06.092775 25504 raft_consensus.cc:740] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:06.092690 25648 consensus_queue.cc:237] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:06.093889 25504 consensus_queue.cc:260] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:06.095148 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.095773 25449 consensus_queue.cc:1048] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:07:06.097347 25642 consensus_meta.cc:287] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 1.172s	user 0.012s	sys 0.005s
I20260709 13:07:06.098132 22172 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:06.054044 25571 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:06.099901 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:06.063378 25650 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.092123 25654 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:06.102682 24932 raft_consensus.cc:3055] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:06.103168 24932 raft_consensus.cc:740] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:06.101007 22218 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:06.103405 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 120031us
I20260709 13:07:06.104203 24932 consensus_queue.cc:260] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.104744 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:06.018785 25667 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.105702 24932 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.107184 25667 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:06.108187 25445 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:06.108810 25445 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:06.110085 25483 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:06.109822 25445 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:06.113925 22782 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:06.115100 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:06.115784 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57856 (request call id 488) took 1064 ms. Trace:
I20260709 13:07:06.116266 25672 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:06.116211 22172 rpcz_store.cc:276] 0709 13:07:05.054151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.089603 (+ 35452us) service_pool.cc:224] Handling call
0709 13:07:06.115594 (+1025991us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b54003296d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:06.115734 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2298125184}
I20260709 13:07:06.117005 25672 raft_consensus.cc:697] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:06.117614 25428 consensus_queue.cc:1243] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:06.118058 25672 consensus_queue.cc:237] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:06.115805 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 64806.8us
I20260709 13:07:06.106516 22218 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:06.104652 22147 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:06.122186 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.130354 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 71147.4us
I20260709 13:07:06.066737 25410 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.135953 22813 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:07:06.130385 25571 raft_consensus.cc:697] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:06.138500 25571 consensus_queue.cc:237] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.143761 22004 catalog_manager.cc:5697] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.145592 22781 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:06.145939 25748 consensus_queue.cc:1059] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:06.147326 25738 raft_consensus.cc:3055] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:06.147701 25738 raft_consensus.cc:740] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:06.151567 25583 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:07:06.155452 25595 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.159296 25642 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:06.146384 22004 catalog_manager.cc:5697] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.160920 25754 raft_consensus.cc:3055] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:06.165917 25754 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:06.167042 22069 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:06.167826 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:06.140486 25783 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:06.174089 25667 consensus_queue.cc:1059] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:06.174325 25483 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:06.164407 25679 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:06.176120 25740 consensus_queue.cc:260] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:06.134763 25138 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:06.161303 25504 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:06.194729 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 75665.5us
I20260709 13:07:06.198454 22147 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:06.210448 25696 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:06.210028 25483 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:06.211503 25754 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.212898 25754 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:06.215204 22000 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40410 (request call id 195) took 20619 ms (client timeout 15000 ms). Trace:
I20260709 13:07:06.216246 25483 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:06.217265 22004 catalog_manager.cc:5697] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 3 to 5, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 5 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:06.219787 25642 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:06.220306 25642 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:06.220789 25667 raft_consensus.cc:3055] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:06.221170 25667 raft_consensus.cc:740] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:06.222149 25667 consensus_queue.cc:260] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.223482 22103 raft_consensus.cc:2410] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:06.224793 25650 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:06.225688 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1711) took 1324 ms. Trace:
W20260709 13:07:06.226050 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.227681 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.189318 22176 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
W20260709 13:07:06.229686 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.228178 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:06.177482 25783 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.226135 22103 rpcz_store.cc:276] 0709 13:07:04.901084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.901670 (+   586us) service_pool.cc:224] Handling call
0709 13:07:06.225425 (+1323755us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400215f54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:06.225625 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2908014464}
W20260709 13:07:06.237027 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 91601.9us
I20260709 13:07:06.237422 25667 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:06.166499 25748 consensus_queue.cc:1059] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:07:06.242815 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 81606.6us
W20260709 13:07:06.249321 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.259860 22220 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:06.260159 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.231807 25628 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:06.275488 22172 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:06.234153 25679 raft_consensus.cc:697] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:07:06.287585 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 82161.8us
I20260709 13:07:06.285220 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:06.241230 25783 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:06.295230 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 96862.6us
W20260709 13:07:06.286417 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 180057us
I20260709 13:07:06.264546 22004 catalog_manager.cc:5697] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:06.279480 25628 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:06.307325 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:06.304698 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:06.287295 25456 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.283569 25740 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.322552 22147 leader_election.cc:400] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9.
I20260709 13:07:06.323030 22147 leader_election.cc:403] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:06.324368 22147 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:06.324908 25457 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:06.320538 22103 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:07:06.204069 25738 consensus_queue.cc:260] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:06.318994 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:06.352882 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:06.351895 22779 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:06.333302 22004 catalog_manager.cc:5697] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 3 to 5, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 5 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.317080 25628 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:06.370777 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 57017.9us
I20260709 13:07:06.377185 22144 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:06.380479 22105 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:07:06.390354 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 56850.5us
I20260709 13:07:06.414500 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:06.414171 25503 consensus_queue.cc:1059] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:07:06.427145 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 119095us
I20260709 13:07:06.427500 25164 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:06.428917 25672 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:06.429510 25672 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:06.215648 22000 rpcz_store.cc:269] 0709 13:06:45.595907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.596243 (+   336us) service_pool.cc:224] Handling call
0709 13:07:06.214905 (+20618662us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:56.453345 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:56.453783 (+   438us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:56.453821 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:06:56.453836 (+    15us) tablet.cc:662] Decoding operations
0709 13:06:56.454545 (+   709us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:56.454616 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:56.454633 (+    17us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:06:56.519082 (+ 64449us) tablet.cc:701] Row locks acquired
0709 13:06:56.519141 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:06:56.519309 (+   168us) write_op.cc:270] Start()
0709 13:06:56.519465 (+   156us) write_op.cc:276] Timestamp: P: 1783602416519244 usec, L: 0
0709 13:06:56.519487 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:56.520196 (+   709us) log.cc:844] Serialized 3980 byte log entry
0709 13:06:57.564352 (+1044156us) op_driver.cc:464] REPLICATION: finished
0709 13:06:57.955262 (+390910us) write_op.cc:301] APPLY: starting
0709 13:06:57.957500 (+  2238us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:58.037633 (+ 80133us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:58.071977 (+ 34344us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:58.212551 (+140574us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:58.212841 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:06:58.212897 (+    56us) write_op.cc:312] APPLY: finished
0709 13:06:58.213264 (+   367us) log.cc:844] Serialized 77 byte log entry
0709 13:06:58.213449 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:58.213587 (+   138us) write_op.cc:454] Released schema lock
0709 13:06:58.213652 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:58.214086 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:58.214118 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":826818,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":330632,"apply.run_cpu_time_us":8171,"apply.run_wall_time_us":275354,"num_ops":10,"prepare.queue_time_us":150034,"prepare.run_cpu_time_us":76280,"prepare.run_wall_time_us":455705,"raft.queue_time_us":217647,"raft.run_cpu_time_us":16815,"raft.run_wall_time_us":363329,"replication_time_us":939586,"thread_start_us":626954,"threads_started":4,"wal-append.queue_time_us":490592,"wal-append.run_cpu_time_us":30736,"wal-append.run_wall_time_us":2206867}]]}
I20260709 13:07:06.431411 22004 catalog_manager.cc:5697] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 2 to 5, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 5 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:06.435822 25503 raft_consensus.cc:3055] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:06.436446 25503 raft_consensus.cc:740] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:06.440575 25720 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:06.441213 25720 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.441607 25720 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:06.443061 25656 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:06.443549 25656 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.443948 25656 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:06.444628 25563 consensus_meta.cc:287] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.591s	user 0.014s	sys 0.000s
W20260709 13:07:06.445326 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.464610 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 133253us
W20260709 13:07:06.467742 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.331005 25696 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 13:07:06.350493 25730 consensus_queue.cc:1059] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
W20260709 13:07:06.486280 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 109188us
I20260709 13:07:06.494117 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:06.509968 22218 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:06.505774 25744 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.512341 25744 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:06.512913 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:06.519379 25799 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:07:06.524814 25672 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:06.529408 25622 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.471052 25679 consensus_queue.cc:237] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:06.539160 25738 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.543036 25649 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:06.425040 25486 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.544998 25608 raft_consensus.cc:3055] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:06.545375 25486 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:06.545652 25608 raft_consensus.cc:740] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:06.548815 22781 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:06.551571 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.555546 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:06.556340 22246 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:06.557315 22247 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:06.561291 25671 consensus_meta.cc:287] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.590s	user 0.002s	sys 0.006s
I20260709 13:07:06.561750 25671 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:06.563046 25794 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 13:07:06.564036 25793 log.cc:927] Time spent T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.347s	user 0.003s	sys 0.000s
I20260709 13:07:06.571712 22174 raft_consensus.cc:1240] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:06.437752 25503 consensus_queue.cc:260] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.514634 25744 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:06.517668 25729 consensus_meta.cc:287] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.571s	user 0.015s	sys 0.000s
I20260709 13:07:06.593852 22172 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:06.595837 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:06.598623 25654 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:06.599684 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 89822.3us
I20260709 13:07:06.592108 25164 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:06.602264 25419 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:06.603226 25608 consensus_queue.cc:260] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.614037 25138 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:06.616093 25671 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:06.632633 25654 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:06.595925 25642 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:06.638499 22218 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:06.628448 22004 catalog_manager.cc:5697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 2 to 5, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 5 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.639866 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:06.646970 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:06.618907 25783 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.689761 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:06.692528 22106 raft_consensus.cc:2393] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:06.699544 22180 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:06.701614 25483 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:06.702206 25483 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:06.702670 25803 log.cc:927] Time spent T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:07:06.702754 25483 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.648259 25613 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:07:06.705454 22004 catalog_manager.cc:5697] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 1 to 4, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 4 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:06.709173 22004 catalog_manager.cc:5697] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:06.710587 25457 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9.
I20260709 13:07:06.714037 25783 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:06.715056 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.715180 25738 consensus_queue.cc:1059] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:06.720975 22098 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
W20260709 13:07:06.732847 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 75504.8us
I20260709 13:07:06.652601 25654 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:06.741138 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.748018 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 138950us
W20260709 13:07:06.753525 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.753547 22147 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:06.768781 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:06.769429 22099 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.777069 25729 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:07:06.778402 25729 raft_consensus.cc:3055] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:06.778800 25729 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:06.779723 25729 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.781045 25729 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:06.783092 22102 raft_consensus.cc:2376] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8. Re-sending same reply.
I20260709 13:07:06.783879 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:06.784129 25608 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:06.784642 22174 raft_consensus.cc:2393] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 9: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:06.786293 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:06.787258 22808 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:06.788365 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:06.790274 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:06.757020 25783 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:07:06.794559 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:06.795387 22807 raft_consensus.cc:1240] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:06.797631 22811 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:06.797655 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:06.799358 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:06.800340 22178 raft_consensus.cc:2393] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 9: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:07:06.801440 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 163054us
W20260709 13:07:06.803066 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.804925 25419 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:06.805934 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:06.806836 22106 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:07:06.695708 25138 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.809145 25138 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:06.654826 25410 consensus_queue.cc:1059] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 13:07:06.811635 25121 raft_consensus.cc:3055] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:06.811728 25592 raft_consensus.cc:3055] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:06.812243 25592 raft_consensus.cc:740] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:06.813217 25592 consensus_queue.cc:260] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:06.814524 25592 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:06.815040 25792 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:07:06.820801 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:06.821772 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:06.824278 25622 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:06.829245 25642 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:06.833571 25720 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:06.773465 25671 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:06.835126 25671 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:06.835645 25671 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:06.837255 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.839803 25740 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.786438 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:06.841261 22779 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:06.842070 22813 raft_consensus.cc:2410] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:07:06.845568 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.834100 25456 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:06.849817 25445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.000s	sys 0.016s
W20260709 13:07:06.850297 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 337823us
W20260709 13:07:06.909763 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.865433 22813 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:06.874270 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:06.884114 22255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.008s	sys 0.013s
W20260709 13:07:06.912626 22255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.008s	sys 0.013s
I20260709 13:07:06.751531 25503 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:06.917600 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 72316.5us
I20260709 13:07:06.922672 22810 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
W20260709 13:07:06.903677 25785 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.012s	sys 0.002s
I20260709 13:07:06.921911 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:06.930815 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:06.967113 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.899295 25121 raft_consensus.cc:740] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:06.917161 25445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.000s	sys 0.017s
I20260709 13:07:06.923471 25628 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:06.972182 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 129298us
I20260709 13:07:06.840409 25740 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:06.977334 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.983081 25734 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:06.994315 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 72861.3us
I20260709 13:07:06.917493 25642 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.969302 25456 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.968056 25785 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.012s	sys 0.006s
I20260709 13:07:07.034313 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:07.006359 25656 consensus_meta.cc:287] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.001s
I20260709 13:07:07.000846 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:07.041441 22813 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.005573 22174 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:07.042740 22178 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:06.997865 22172 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:06.999871 25592 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:07.029881 25745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.010s	sys 0.075s
W20260709 13:07:07.062472 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.031136 25583 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:07.065439 25583 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.055292 25642 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.068333 25583 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:07.069199 25642 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:07.070212 25622 raft_consensus.cc:3055] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:07.070626 25622 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:07.071549 25622 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.072597 25622 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:07.073371 25567 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:07.074128 25567 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.076692 25567 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:07.030486 25734 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:07:07.061305 25745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.010s	sys 0.076s
I20260709 13:07:07.100204 25734 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.003564 25654 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.102224 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:07.105160 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:07.107530 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:07.107853 22811 raft_consensus.cc:2393] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:07.108153 22097 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:07.060073 25592 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.119167 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:07.103742 25571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.045s	sys 0.098s
W20260709 13:07:07.134393 22181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.005s	sys 0.025s
W20260709 13:07:07.136053 22181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.005s	sys 0.026s
I20260709 13:07:07.135134 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:07.143251 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:07.146188 22097 raft_consensus.cc:2410] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:07.148729 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:07.150882 22178 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:07.154039 22249 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:07.061570 25456 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:07.135133 25571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.046s	sys 0.098s
I20260709 13:07:07.054829 25656 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.087615 25483 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.152664 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:07.171416 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:07.157279 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:07.161741 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 130496us
I20260709 13:07:07.167546 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:07.169296 22813 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
W20260709 13:07:07.201988 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.202956 22246 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.119474 25504 consensus_queue.cc:1059] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:07:07.204793 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:07.213359 22069 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:07.160677 22072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.652s (SENT) [suppressed 43 similar messages]
I20260709 13:07:07.200713 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:07.219161 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.220230 22247 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:07.226024 22808 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:07.240562 22254 raft_consensus.cc:1240] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:07.225878 25754 consensus_meta.cc:287] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 1.013s	user 0.009s	sys 0.007s
I20260709 13:07:07.220506 25592 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:07.239310 25720 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:07.260650 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 47405.5us
I20260709 13:07:07.258613 25571 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.249933 25410 consensus_queue.cc:1059] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:07:07.249794 25748 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:07:07.279881 25671 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.285205 25628 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:07.362308 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.363047 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.375787 22180 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:07.363224 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 65883.7us
I20260709 13:07:07.380693 22069 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:07.280494 25745 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
W20260709 13:07:07.387966 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 227304us
W20260709 13:07:07.410804 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.411530 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.412030 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.385886 25571 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:07.421320 22099 consensus_meta.cc:287] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.000s
I20260709 13:07:07.424371 22099 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:07.388620 25654 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:07.428043 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:07.433264 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:07.425387 25656 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:07.435143 25813 log.cc:927] Time spent T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 13:07:07.435642 25483 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:07.436321 25821 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.436939 25821 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:07.439671 25816 log.cc:927] Time spent T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:07:07.441354 25823 log.cc:927] Time spent T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:07:07.435266 25835 log.cc:927] Time spent T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:07:07.444882 22807 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:07:07.445330 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:07.451452 25819 log.cc:927] Time spent T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:07:07.454144 25828 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.454788 25828 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.434089 25456 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:07.460820 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.461742 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1862) took 1304 ms. Trace:
W20260709 13:07:07.476424 25817 log.cc:927] Time spent T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:07:07.478173 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 633) took 1366 ms. Trace:
I20260709 13:07:07.478660 22255 rpcz_store.cc:276] 0709 13:07:06.112034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.134557 (+ 22523us) service_pool.cc:224] Handling call
0709 13:07:06.144255 (+  9698us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:06.176949 (+ 32694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.176981 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:06.185962 (+  8981us) log.cc:844] Serialized 52 byte log entry
0709 13:07:06.913014 (+727052us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:06.913052 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.913129 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.477879 (+564750us) raft_consensus.cc:1685] finished
0709 13:07:07.477910 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.478100 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32141,"raft.queue_time_us":32784,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":22812,"thread_start_us":675187,"threads_started":1,"wal-append.queue_time_us":866015}
W20260709 13:07:07.483405 25800 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:07.485296 25671 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:07.499589 25121 consensus_queue.cc:260] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:07.501351 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.505640 25740 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:07.512691 25818 log.cc:927] Time spent T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.447s	user 0.002s	sys 0.000s
I20260709 13:07:07.462138 22173 rpcz_store.cc:276] 0709 13:07:06.157111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.167089 (+  9978us) service_pool.cc:224] Handling call
0709 13:07:06.177319 (+ 10230us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:06.267081 (+ 89762us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:06.427046 (+159965us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b1800463780. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e5e455 00007f66ab9463c7 00007f66a7f589a7 00007f66a7f680bf 00007f66a7f68038
0709 13:07:06.627689 (+200643us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.200909 (+573220us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:07.214068 (+ 13159us) log.cc:844] Serialized 52 byte log entry
0709 13:07:07.214259 (+   191us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.214304 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.214388 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.461386 (+246998us) raft_consensus.cc:1685] finished
0709 13:07:07.461497 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.461654 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89674,"prepare.queue_time_us":34685,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":80691,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":33059,"spinlock_wait_cycles":6578304,"thread_start_us":670893,"threads_started":2,"wal-append.queue_time_us":642880}
I20260709 13:07:07.518539 25821 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:07.519114 25810 log.cc:927] Time spent T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.448s	user 0.003s	sys 0.000s
W20260709 13:07:07.520731 25608 consensus_meta.cc:287] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.002s
I20260709 13:07:07.523689 22105 raft_consensus.cc:2410] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:07.539912 22246 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:07.542380 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:07.545565 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:07.546717 22099 raft_consensus.cc:2410] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:07.543944 22782 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:07.548408 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:07.540448 25503 consensus_meta.cc:287] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.614s	user 0.005s	sys 0.010s
I20260709 13:07:07.529718 25483 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.557222 22102 raft_consensus.cc:2410] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:07.557289 22106 raft_consensus.cc:2410] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:07.553246 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:07.561832 25838 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:07.562880 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:07.563556 22810 raft_consensus.cc:2376] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8. Re-sending same reply.
I20260709 13:07:07.564651 25825 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:07.565331 25825 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.567111 25696 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.567772 25846 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.567646 25696 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.568383 25846 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.569854 25696 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:07.571405 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:07.572582 22807 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 9: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:07.559446 25845 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:07.575973 25845 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.578153 25845 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:07.579275 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1865) took 1343 ms. Trace:
I20260709 13:07:07.579715 25671 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.580034 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:07.581626 22144 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:07.583002 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:07.583235 25656 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.583753 22246 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 10: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:07.583595 25734 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.587031 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:07.587791 22099 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.590713 22177 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:07:07.593647 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.579666 22179 rpcz_store.cc:276] 0709 13:07:06.236286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.261255 (+ 24969us) service_pool.cc:224] Handling call
0709 13:07:06.283746 (+ 22491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.308103 (+ 24357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.308150 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.321816 (+ 13666us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.515904 (+194088us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b180046a320. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee0d1 00007f66a7f09a0f
0709 13:07:06.855433 (+339529us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:06.855478 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.855553 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.511710 (+656157us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:07.579055 (+ 67345us) raft_consensus.cc:1685] finished
0709 13:07:07.579076 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.579218 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5850,"raft.queue_time_us":15182,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":12309,"spinlock_wait_cycles":90575616,"thread_start_us":339316,"threads_started":1,"wal-append.queue_time_us":701825}
W20260709 13:07:07.624598 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 103929us
W20260709 13:07:07.590755 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 160919us
I20260709 13:07:07.631839 22251 raft_consensus.cc:1275] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:07.633710 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:07.635568 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:07.635813 25503 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:07.636739 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:07.636860 25503 raft_consensus.cc:3055] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:07.637277 25503 raft_consensus.cc:740] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:07.638274 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:07.638049 25503 consensus_queue.cc:260] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.552420 25821 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:07:07.639781 25820 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:07.640275 22250 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:07.640466 25820 raft_consensus.cc:697] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:07.641459 25820 consensus_queue.cc:237] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.642206 22250 raft_consensus.cc:1275] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:07.642817 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:07.641909 25825 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:07.643474 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:07.644605 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:07.644903 22807 raft_consensus.cc:2393] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:07.645066 22810 raft_consensus.cc:2376] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9. Re-sending same reply.
I20260709 13:07:07.645296 22815 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:07:07.645767 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:07.644122 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:07.646188 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:07.647064 22815 raft_consensus.cc:2393] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 12: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:07.647223 22807 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:07.647537 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 65983.6us
I20260709 13:07:07.647964 22815 raft_consensus.cc:1240] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:07.648522 22144 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:07.648685 22807 raft_consensus.cc:1240] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:07.649955 22144 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:07.651276 25847 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:07.652066 25847 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.652341 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:07.652761 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:07.651170 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:07.653492 22252 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:07.654529 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:07.646221 22810 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:07.655360 22251 raft_consensus.cc:2393] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:07.639765 25503 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.657430 25734 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:07.658059 25483 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.583774 25656 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.666149 25656 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:07.666616 25812 log.cc:927] Time spent T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.601s	user 0.000s	sys 0.001s
I20260709 13:07:07.668057 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:07.668743 22097 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:07.669708 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:07.670234 22100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:07:07.670426 22103 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:07.670801 22100 raft_consensus.cc:606] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:07.671198 22100 raft_consensus.cc:614] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:07.671250 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:07.671818 22098 raft_consensus.cc:1275] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:07.671887 22101 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
W20260709 13:07:07.672266 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.673256 22104 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:07.674026 25845 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.674486 25845 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.627941 25654 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.675464 25654 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.676573 25845 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:07.676705 22253 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:07.677780 25654 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:07.679124 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:07.679836 22097 raft_consensus.cc:2393] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 9: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:07:07.681397 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.654701 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:07.684918 22252 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:07.688900 22816 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:07.693233 22099 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:07.694741 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:07.696717 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 69235.6us
I20260709 13:07:07.703912 22813 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:07.704082 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:07.695621 22173 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
W20260709 13:07:07.706764 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 79079.4us
I20260709 13:07:07.708240 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:07.708716 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:07.709046 22252 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.709251 22173 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.688408 25838 raft_consensus.cc:697] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:07.625670 25642 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.712827 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:07.722021 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:07.688633 25847 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.714872 22181 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:07.723166 22071 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:07.560237 25571 raft_consensus.cc:697] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:07.723933 22815 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:07.724486 22069 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:07.730342 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:07.731725 22248 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:07.734810 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:07.739249 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:07.724282 22781 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:07.742141 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:07.732788 22218 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:07.745278 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:07.710168 25456 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.747480 25456 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.747990 25729 raft_consensus.cc:3055] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:07.748484 25729 raft_consensus.cc:740] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:07.736470 25748 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:07.750581 25740 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:07.750415 25748 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.751070 25740 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.751436 25740 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:07.752203 25583 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:07.752604 25748 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:07.752751 25583 raft_consensus.cc:697] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:07.753293 25847 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.753808 25583 consensus_queue.cc:237] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.719349 25483 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:07.700068 25654 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:07:07.755987 25595 raft_consensus.cc:3055] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:07.756434 25595 raft_consensus.cc:740] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:07.757328 25595 consensus_queue.cc:260] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.758404 25595 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.763180 22809 raft_consensus.cc:1240] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:07.763568 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:07.763756 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:07.764189 22180 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:07.755993 25720 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.766520 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:07.767062 25846 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:07.766855 25720 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.767584 25649 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:07.768028 25838 consensus_queue.cc:237] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.768314 25649 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.767524 25734 raft_consensus.cc:2955] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Committing config change with OpId 7.7: config changed from index 4 to 7, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:07.769057 25720 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:07.769604 25642 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:07.771626 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:07.779438 22181 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
W20260709 13:07:07.784651 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.790197 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2200) took 1220 ms. Trace:
I20260709 13:07:07.790635 22177 rpcz_store.cc:276] 0709 13:07:06.569702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.574994 (+  5292us) service_pool.cc:224] Handling call
0709 13:07:06.591874 (+ 16880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.591183 (+999309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.789996 (+198813us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b540013db54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:07.790144 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296353536}
I20260709 13:07:07.809027 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:07.810671 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:07.805599 25622 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.839128 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:07.839356 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:07.839807 22097 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:07.841439 25849 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:07.842159 25849 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.785254 25848 consensus_queue.cc:1059] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:07:07.816975 25649 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:07.851125 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:07:07.855687 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.846510 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 141221us
I20260709 13:07:07.856758 22781 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:07.858384 22781 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:07.855741 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:07.861089 22102 raft_consensus.cc:2410] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:07.830404 25745 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:07.872188 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:07.845310 25650 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.846655 25592 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.877631 22781 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:07.882382 22781 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:07.853617 25748 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:07.855911 25628 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:07.894762 22104 raft_consensus.cc:1275] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:07.855131 25849 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:07.866125 25164 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.840350 25622 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:07.873974 25419 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.027s	sys 0.009s
I20260709 13:07:07.885468 25783 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.885586 25672 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.874131 25745 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.886171 25567 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:07:07.893486 25592 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:07.900589 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 197112us
I20260709 13:07:07.898883 22781 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:07.907997 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:07.923794 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:07.926200 22814 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:07:07.966132 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.901399 22144 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:07.863528 25571 consensus_queue.cc:237] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.887444 25650 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:08.005463 25802 log.cc:927] Time spent T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.621s	user 0.006s	sys 0.003s
I20260709 13:07:07.947319 25748 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:07.951061 25628 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:07.899331 25754 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:07.945819 25419 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.028s	sys 0.010s
I20260709 13:07:08.021628 22173 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:08.028311 22175 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
W20260709 13:07:08.030504 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 53240.1us
W20260709 13:07:08.047413 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.048406 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.031503 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 130219us
I20260709 13:07:08.027849 22103 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:08.039031 22097 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:08.039404 22105 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
W20260709 13:07:08.116422 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.114874 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:08.116405 22106 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:07:08.118171 22106 pending_rounds.cc:85] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 5
W20260709 13:07:08.121347 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 222440us
I20260709 13:07:08.123742 22173 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:08.117197 25649 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.121604 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:08.044312 25744 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:08.118439 22106 pending_rounds.cc:107] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:07:08.134675 22106 raft_consensus.cc:2889] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:08.136993 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 333433us
I20260709 13:07:08.134503 22252 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:08.142751 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:08.143575 22173 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
W20260709 13:07:08.153352 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 328896us
W20260709 13:07:08.155432 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 422735us
I20260709 13:07:08.157282 22220 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:08.132450 25720 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:08.127279 25730 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.127213 25783 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:08.190107 22220 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:08.135712 25656 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.195056 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 342667us
I20260709 13:07:08.195722 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:08.114464 25848 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:07:08.138353 25855 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:08.133066 25837 raft_consensus.cc:2764] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:08.115537 25740 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:08.201237 22218 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:08.137975 25649 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:08.208572 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.211634 22179 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
W20260709 13:07:08.218454 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 86014.8us
I20260709 13:07:08.229686 25855 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:08.141172 25483 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:08.216614 25783 raft_consensus.cc:697] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:08.237691 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:08.264678 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 74654.9us
I20260709 13:07:08.206962 25656 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.270013 22179 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:08.272378 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:08.277169 22220 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:08.208140 25730 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:08.237303 25419 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:08.278582 22147 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:08.279471 22781 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:08.273042 22811 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:08.283488 22808 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:08.271410 25850 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:08.244572 25865 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.259356 25863 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:08.273747 25864 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:08.316985 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 115870us
I20260709 13:07:08.316989 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:08.318373 22814 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:08.265990 25838 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.323467 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:08.325232 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:08.328148 22104 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:08.236332 25869 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:07:08.283630 25622 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:08.332960 22100 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:08.336467 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:08.332839 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.336793 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:08.371091 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:08.375578 22099 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:07:08.335397 22102 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:08.377053 22099 pending_rounds.cc:85] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 6
I20260709 13:07:08.377539 22099 pending_rounds.cc:107] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:08.377910 22099 raft_consensus.cc:2889] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:08.276757 25754 consensus_queue.cc:1059] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:07:08.316428 25864 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.382722 22252 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:08.287247 25419 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.324378 25745 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:08.385262 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 90537.1us
I20260709 13:07:08.395684 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:08.392225 22099 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:07:08.403412 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 84683.4us
I20260709 13:07:08.405205 22781 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:08.405244 22098 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:08.409628 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:08.381524 25622 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:08.410375 22102 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:08.379112 25820 consensus_queue.cc:1059] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:07:08.383620 25592 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.413628 22100 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:08.333875 25838 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.393476 25419 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:08.386334 25864 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:08.466372 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.326673 25865 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.332815 25863 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:08.427131 25723 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:08.427699 25871 log.cc:927] Time spent T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:07:08.427839 25880 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:07:08.428608 25848 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.429610 25861 log.cc:927] Time spent T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:07:08.394713 25748 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.430862 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:08.440687 22220 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:08.395198 25628 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:08.409662 25734 consensus_meta.cc:287] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.640s	user 0.015s	sys 0.000s
I20260709 13:07:08.383209 25850 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.435135 25121 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:08.469128 25649 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.425454 25679 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:08.437189 25730 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:08.458957 25672 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:08.515846 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 45499.7us
I20260709 13:07:08.431807 25860 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.494575 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 171284us
I20260709 13:07:08.466980 25567 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:08.469316 25656 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.470113 25740 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:08.500744 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 60151.6us
I20260709 13:07:08.432369 25729 consensus_queue.cc:260] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:08.445055 25622 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.431414 25889 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.516846 22218 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:08.509955 25164 consensus_meta.cc:287] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.572s	user 0.012s	sys 0.000s
I20260709 13:07:08.500665 25863 raft_consensus.cc:697] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:08.500263 25628 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:08.518065 25679 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:08.506486 25869 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:08.534638 22147 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:08.415295 25783 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.516258 25672 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.557407 25164 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:08.565569 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 48832.9us
I20260709 13:07:08.492749 25848 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.553630 25656 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:08.580791 25876 log.cc:927] Time spent T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:07:08.581812 25854 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:07:08.561606 25672 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:08.587009 25138 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:08.587411 25622 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.587738 25138 consensus_queue.cc:1243] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:08.588315 25848 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.562454 25889 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:08.591907 25650 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:08.592003 25889 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:08.579979 25872 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.593143 25872 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.595944 25872 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.597995 25825 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:08.567668 25820 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:08.589634 25866 log.cc:927] Time spent T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:07:08.543478 25808 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:08.605912 25808 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.606374 25808 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:08.607100 25855 raft_consensus.cc:3055] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:08.603407 25865 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.604182 25820 raft_consensus.cc:697] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:08.608695 25820 consensus_queue.cc:237] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:08.579691 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:08.609853 25679 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:08.569223 25869 raft_consensus.cc:697] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:08.611819 25642 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:08.611701 25869 consensus_queue.cc:237] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:08.612428 25642 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.616565 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:08.616827 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 50408.1us
I20260709 13:07:08.618422 25744 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:08.619012 25744 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:08.619765 25138 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:08.620118 25847 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.620453 25138 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:08.623750 25878 log.cc:927] Time spent T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:08.625396 25828 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:08.625787 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:08.627314 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:08.575299 25628 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:08.629007 25862 log.cc:927] Time spent T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.297s	user 0.003s	sys 0.000s
I20260709 13:07:08.607551 25855 raft_consensus.cc:740] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:08.524953 25860 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:08.631659 25855 consensus_queue.cc:260] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:08.633076 25855 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.633667 25860 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:08.579809 25863 consensus_queue.cc:237] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:08.618466 22218 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:08.631664 25838 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:08.625411 25850 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.653539 25886 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.644232 25889 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:08.654330 25889 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:08.526777 25567 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.655030 25889 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:08.655441 22099 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.656662 25567 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.646567 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:08.647920 25656 consensus_queue.cc:1048] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:08.648145 22254 raft_consensus.cc:1217] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-11.6]   Dedup: 5.3->[6.4-11.6]
I20260709 13:07:08.658071 22254 pending_rounds.cc:85] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 3
I20260709 13:07:08.658308 22254 pending_rounds.cc:107] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:07:08.658535 22254 raft_consensus.cc:2889] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:08.649137 25138 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:08.679598 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.654151 25886 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.681355 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:08.647936 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:08.630631 25628 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.687839 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:08.682614 22180 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:08.683809 22218 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:08.685348 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:08.691912 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:08.692759 22180 raft_consensus.cc:2393] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:08.695189 22218 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:08.614792 25642 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.698755 22218 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:08.699271 22220 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:08.699313 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:08.706787 22099 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:08.697728 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:08.708706 22180 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:08.689373 25503 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.720245 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 310439us
I20260709 13:07:08.700084 25656 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:08.728417 25429 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:08.722398 25503 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:08.702863 25679 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:08.731940 25679 raft_consensus.cc:697] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:08.732904 25679 consensus_queue.cc:237] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:08.690145 25860 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:07:08.738102 25672 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.740670 25672 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:08.741139 25595 consensus_meta.cc:287] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.982s	user 0.014s	sys 0.000s
I20260709 13:07:08.742128 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:08.742787 22176 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:08.750375 25849 raft_consensus.cc:3055] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:08.750842 25849 raft_consensus.cc:740] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:08.751673 25849 consensus_queue.cc:260] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:08.752665 25849 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:08.753054 25410 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:08.753556 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:08.754195 22178 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:08.754688 22180 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:08.767524 25483 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:08.774000 25864 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:08.775146 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:08.775810 22176 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:08.776330 25864 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:08.753604 25410 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:08.778956 25410 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:08.773895 25483 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.781332 25483 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.781749 25723 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:08.784322 25656 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:08.784477 22071 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:08.785712 22071 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:08.787111 25595 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:08.787614 25595 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.788017 25595 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:08.791671 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.776932 25864 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:08.793447 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:08.794802 22174 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
W20260709 13:07:08.793771 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 386221us
W20260709 13:07:08.803889 25900 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.198s	user 0.002s	sys 0.002s
I20260709 13:07:08.803671 25744 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:08.786784 25628 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:08.822666 22779 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:08.824165 22781 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:08.767633 25672 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.828867 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:08.825954 25785 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:08.826256 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:08.827085 25828 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:08.827821 25837 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:08.831171 22174 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:08.822620 25649 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.849615 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:08.865056 22252 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:08.823966 25628 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.870994 22173 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:08.828567 25744 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:08.823688 25821 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.836128 25837 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:08.882736 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.885686 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:08.886332 22106 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:08.800372 25864 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.837649 25672 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:08.867367 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 167991us
I20260709 13:07:08.865878 25838 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:08.884016 25628 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:08.907620 22178 raft_consensus.cc:3055] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:08.896489 25837 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:08.908416 22178 raft_consensus.cc:740] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:08.913954 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 215254us
I20260709 13:07:08.915457 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:08.916762 22178 consensus_queue.cc:260] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.921813 22252 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:07:08.905059 25838 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:08.880112 25649 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:08.887293 25891 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:07:08.926350 22178 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:08.896240 25821 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.953557 22106 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:08.935793 22178 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:08.960242 22072 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:08.961323 22072 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:08.961652 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:08.962263 22807 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:07:08.940968 25864 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.941972 25595 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.944730 25672 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:08.924796 25838 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:08.948904 25419 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:09.007622 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:08.963752 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:09.008291 22179 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:09.008144 25628 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:09.013849 25901 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:09.014169 22782 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:09.015244 25785 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:09.015637 25785 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.015964 25785 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.016868 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:09.017629 22173 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:08.967871 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:09.019434 22252 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 10: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:09.020808 25649 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:08.969996 25563 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:09.021474 25563 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.021860 25563 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:09.022564 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:09.023295 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet c42ecdbc6a0d4ed88048a3ea9bc6b893: Illegal state: Replica c0694f6572bf406a92d55f1f2ab46ef2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:09.023664 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:09.025053 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:09.025694 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:08.973455 25503 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:08.975044 25738 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:08.968632 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 62599.8us
I20260709 13:07:09.026778 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:09.027606 22779 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:09.028023 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:09.028601 22779 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:08.982087 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:08.975721 25567 consensus_queue.cc:1048] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:08.977789 25849 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:08.984360 25886 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:08.979405 25808 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.986950 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:09.030195 25889 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:09.030808 22247 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:07:09.009485 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:09.030239 25672 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:09.032015 25808 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:08.963853 22218 connection.cc:256] RPC call timeout handler was delayed by -2.1005571659999305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
I20260709 13:07:08.992129 25890 raft_consensus.cc:3055] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:09.032450 25672 raft_consensus.cc:697] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:09.023304 22816 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:09.032830 25890 raft_consensus.cc:740] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:08.992369 25821 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:09.033710 25890 consensus_queue.cc:260] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:08.901561 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:09.002362 25837 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:09.017686 25899 log.cc:927] Time spent T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.413s	user 0.001s	sys 0.002s
W20260709 13:07:09.034780 22218 connection.cc:256] RPC call timeout handler was delayed by -2.0393571659999452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
W20260709 13:07:09.035161 22218 connection.cc:256] RPC call timeout handler was delayed by -1.9034571659999528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
I20260709 13:07:09.008709 25419 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:09.026072 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:09.028834 22809 raft_consensus.cc:2393] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:08.984001 25429 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:09.034446 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.995642 25908 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:08.968091 25456 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:08.987819 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:09.042382 22174 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:09.025701 22808 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:09.047654 22144 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:09.049099 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:09.049749 22181 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:09.051232 22782 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:09.032359 25889 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:09.054395 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:09.048040 22179 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
W20260709 13:07:09.058620 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.059314 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:09.059311 22247 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:09.066078 22144 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:09.066042 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.067513 22181 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:09.068595 22781 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:09.072616 22810 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:09.073043 22173 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:09.073102 22144 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:09.037202 25902 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:09.075282 22144 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:09.055723 25808 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.080204 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.082466 22103 raft_consensus.cc:2410] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:09.085485 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.071406 25503 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:09.080657 25456 raft_consensus.cc:2764] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:09.074088 25649 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:09.074342 25828 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:09.095675 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.095963 25828 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.089988 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.096647 25828 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.090137 22102 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:09.078390 25567 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:09.100502 25567 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:09.077397 25855 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:09.102983 25855 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:09.103273 25567 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:09.103459 25855 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:09.090826 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:09.082571 25902 raft_consensus.cc:697] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:09.105960 25902 consensus_queue.cc:237] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:09.092572 25821 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:09.086890 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:09.107868 22809 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:09.086977 25808 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:09.089349 25672 consensus_queue.cc:237] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:09.110222 25729 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:09.112388 25890 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:09.110150 25808 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:09.116106 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:09.116379 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:09.116811 22254 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:09.089131 25503 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.119035 22071 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:09.122277 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:09.127293 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:09.122632 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:09.129364 22250 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:09.133683 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:09.127903 22101 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:09.129637 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:09.145126 22174 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:09.146219 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.146711 22144 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:09.148509 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.148950 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:09.149231 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.149335 22100 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:09.150269 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:09.150588 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.152024 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.153470 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.154106 22100 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:09.159389 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:09.161901 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:09.162128 25563 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:09.162631 22249 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:09.148511 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:09.167876 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:09.150835 22103 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:09.168474 22102 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:09.149636 22175 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:07:09.169142 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:09.132431 22071 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:09.127960 22181 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
W20260709 13:07:09.172308 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 52076.9us
I20260709 13:07:09.173949 22144 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:09.176822 22071 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:09.171572 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 45901.9us
W20260709 13:07:09.178442 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.126868 25567 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.129545 25503 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:09.189867 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:09.191928 22173 raft_consensus.cc:2368] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:09.187258 22144 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:09.178006 25849 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:07:09.191829 22097 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:09.193213 25920 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:09.193764 25920 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:09.196096 25920 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:09.197448 22174 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:09.198887 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:09.183593 25734 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 13:07:09.206292 22218 connection.cc:256] RPC call timeout handler was delayed by -1.6271571659999609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
I20260709 13:07:09.206656 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.207417 22098 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:09.207729 22220 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:09.208137 25837 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:09.208520 25563 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:09.209255 25595 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:09.188294 25738 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:09.167520 25740 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:09.210400 25738 raft_consensus.cc:697] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:09.210702 25740 raft_consensus.cc:697] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:09.211416 25738 consensus_queue.cc:237] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:09.211719 25740 consensus_queue.cc:237] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:09.212517 25863 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:09.213034 25863 raft_consensus.cc:697] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:09.167423 25821 raft_consensus.cc:697] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:09.213789 25815 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:09.206715 22218 connection.cc:256] RPC call timeout handler was delayed by -1.5929571659999056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
I20260709 13:07:09.194702 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.226106 22147 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:09.213864 25863 consensus_queue.cc:237] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:09.231417 25821 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:09.185268 25730 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:09.242610 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.257810 22106 raft_consensus.cc:1240] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:09.258086 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:09.259171 22181 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:09.260699 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:09.279989 22100 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:09.280025 22218 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:09.248718 25815 raft_consensus.cc:697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:09.241418 25486 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:09.290094 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.226037 25567 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:09.292529 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 105386us
I20260709 13:07:09.292222 22147 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:09.301816 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:09.302436 22809 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:09.288800 25783 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.009s	sys 0.019s
I20260709 13:07:09.289597 25486 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:09.310220 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.318310 22144 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:09.306617 25864 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.320356 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.321703 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:09.322476 22810 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:09.325277 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:09.326464 22181 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 10: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:09.346792 22811 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:09.291723 25730 raft_consensus.cc:697] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:09.303252 25457 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:09.312983 25783 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.009s	sys 0.019s
I20260709 13:07:09.299532 25734 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:09.282790 25855 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:09.323285 25486 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:09.288453 25785 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:09.401827 22781 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:09.308465 25628 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:09.299985 25121 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:07:09.299510 25608 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:07:09.344630 25754 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:09.352586 25895 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:09.438290 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.392736 25744 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:09.643566 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:09.577656 22180 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:09.366463 25457 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:09.353792 25856 raft_consensus.cc:2764] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:09.605770 22807 raft_consensus.cc:1240] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:09.605666 22104 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.020s	sys 0.039s
W20260709 13:07:09.653446 22104 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.021s	sys 0.039s
I20260709 13:07:09.611034 25891 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:09.414083 25905 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:09.420135 25410 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:09.651116 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 299701us
W20260709 13:07:09.644793 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 323768us
W20260709 13:07:09.658952 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet 16e48ec055f940c49e01d5a5d77581aa: Illegal state: Replica 79683575881f4334bd4dc6d9bdbb45c3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } }
I20260709 13:07:09.403898 25734 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:09.613615 25744 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:09.667395 22178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.029s	sys 0.053s
W20260709 13:07:09.674335 22178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.029s	sys 0.053s
I20260709 13:07:09.674902 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:09.430661 22810 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:09.406222 25904 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.262s
I20260709 13:07:09.669866 22246 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:09.670688 22144 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:09.730001 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 59589.8us
I20260709 13:07:09.673372 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:09.678113 22103 consensus_meta.cc:287] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.000s
I20260709 13:07:09.733021 22103 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:09.647496 25825 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.680073 25657 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:09.641132 25754 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:09.683684 25567 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:09.686367 22100 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:09.666205 25730 consensus_queue.cc:237] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:09.689975 25838 consensus_meta.cc:287] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.686s	user 0.007s	sys 0.000s
I20260709 13:07:09.696075 25855 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:09.699011 25744 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:09.652882 25457 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:09.701432 22102 consensus_meta.cc:287] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.000s
W20260709 13:07:09.704622 25925 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:07:09.705403 22809 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:09.708948 25734 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:09.709209 25785 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:09.352768 25815 consensus_queue.cc:237] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:09.792631 22181 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:09.661268 25891 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.648232 25895 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:09.737955 22248 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 10: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:09.638813 25628 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:07:09.726086 22252 raft_consensus.cc:2955] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:09.743783 22144 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:07:09.759567 22176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.026s	sys 0.065s
W20260709 13:07:09.800087 22176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.026s	sys 0.065s
W20260709 13:07:09.759456 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 84627.9us
W20260709 13:07:09.766348 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 371767us
I20260709 13:07:09.801530 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:09.803306 22172 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:09.670503 25905 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:09.806073 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 62333.7us
I20260709 13:07:09.772230 22102 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:09.734854 25886 raft_consensus.cc:2764] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:09.814630 25886 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:09.742990 25121 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:09.754294 25729 consensus_meta.cc:287] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.643s	user 0.007s	sys 0.004s
W20260709 13:07:09.759979 25890 consensus_meta.cc:287] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.001s
W20260709 13:07:09.772650 25828 consensus_meta.cc:287] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.001s
I20260709 13:07:09.815658 25121 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.816071 25828 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:09.818363 25828 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:09.810323 22106 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:09.819099 22808 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:09.813306 25938 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:09.819901 25938 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.820330 25938 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:09.820463 25905 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:09.816093 25121 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:09.825230 25121 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:09.823099 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:09.825963 25744 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:09.827917 25895 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:09.829037 25744 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:09.831164 25486 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:09.832579 25938 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:09.833469 25486 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:09.799832 25891 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:09.834611 25938 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:09.839962 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2226) took 1127 ms. Trace:
I20260709 13:07:09.840400 22177 rpcz_store.cc:276] 0709 13:07:08.712314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.712534 (+   220us) service_pool.cc:224] Handling call
0709 13:07:08.726030 (+ 13496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.727843 (+  1813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.727878 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.036395 (+308517us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b2c00040298. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6857372 00007f66a7f89a01 00007f66a7f4e43a 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2
0709 13:07:09.036878 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.226422 (+189544us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:09.226471 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.226562 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.839614 (+613052us) raft_consensus.cc:1685] finished
0709 13:07:09.839640 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.839879 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1406,"raft.queue_time_us":1801,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":64187136,"thread_start_us":188703,"threads_started":1,"wal-append.queue_time_us":325041}
W20260709 13:07:09.860419 25926 log.cc:927] Time spent T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:09.864193 22069 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:09.745656 25825 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:09.873193 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 71745.1us
I20260709 13:07:09.890497 22099 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:09.890343 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:09.892462 22071 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:09.897938 25410 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:09.931824 25850 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.963718 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:09.943008 22218 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:09.954890 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 62512.3us
W20260709 13:07:09.829048 25931 log.cc:927] Time spent T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:07:09.970429 22782 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:09.763387 25838 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:09.975339 22098 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.040s	sys 0.085s
W20260709 13:07:09.977432 22098 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.040s	sys 0.086s
I20260709 13:07:09.982569 22779 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:09.974025 25745 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.986500 25745 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:09.987097 25745 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.870106 25592 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:10.000247 22816 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:07:09.957221 25410 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.018190 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:10.023327 22172 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:10.026283 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.972254 25912 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:09.993359 25734 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:10.067363 25910 log.cc:927] Time spent T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.005s
I20260709 13:07:10.067467 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:10.068323 22248 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:07:10.071070 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:10.071748 22248 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.082458 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 665) took 1042 ms. Trace:
I20260709 13:07:10.083065 22252 rpcz_store.cc:276] 0709 13:07:09.040022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.040171 (+   149us) service_pool.cc:224] Handling call
0709 13:07:09.040892 (+   721us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:09.189374 (+148482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.189421 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:09.223878 (+ 34457us) log.cc:844] Serialized 527 byte log entry
0709 13:07:09.725890 (+502012us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:09.818160 (+ 92270us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.820345 (+  2185us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.820740 (+   395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.820809 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.082136 (+261327us) raft_consensus.cc:1685] finished
0709 13:07:10.082164 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.082362 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147831,"prepare.queue_time_us":170,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":165657,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":218,"thread_start_us":495085,"threads_started":1,"wal-append.queue_time_us":723798}
I20260709 13:07:09.970782 25608 consensus_queue.cc:1059] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:07:10.093508 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:10.093979 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:10.094192 22249 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.095954 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:09.978231 25850 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:10.056255 25592 raft_consensus.cc:697] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:10.138855 22172 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:10.148088 22248 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:10.099704 25419 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:10.087538 25483 consensus_queue.cc:1059] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 13:07:10.210029 22220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.016s	sys 0.015s
W20260709 13:07:10.211309 22220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.016s	sys 0.015s
W20260709 13:07:10.212244 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 102999us
W20260709 13:07:10.156054 25503 consensus_meta.cc:287] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.919s	user 0.010s	sys 0.002s
I20260709 13:07:10.131661 25649 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.141952 25608 raft_consensus.cc:3055] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:10.223444 22172 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:10.228006 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:10.219918 25940 log.cc:927] Time spent T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:07:10.207120 25429 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.221148 25672 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:10.219143 25754 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:10.220947 25939 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:07:10.103123 25935 consensus_queue.cc:1059] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 13:07:10.206768 25419 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:10.243451 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:10.237298 25649 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:10.483978 25649 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:10.484253 25457 consensus_meta.cc:287] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.689s	user 0.008s	sys 0.001s
W20260709 13:07:10.235947 25923 log.cc:927] Time spent T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:07:10.380805 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:10.489216 22249 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:10.291390 25740 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.488026 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 247936us
I20260709 13:07:10.513005 25457 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:10.493261 22220 leader_election.cc:400] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:10.516214 22220 leader_election.cc:403] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:10.516757 22172 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:10.268970 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:10.517465 22255 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:10.517576 25457 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:10.517841 25419 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:10.230930 25608 raft_consensus.cc:740] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:10.518934 25608 consensus_queue.cc:260] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:10.520165 25608 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.520301 22220 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:10.444270 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:10.523134 25912 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:10.527187 25483 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:10.527323 25869 consensus_queue.cc:1059] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:10.528627 25457 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:10.528822 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 84688.8us
W20260709 13:07:10.495368 25891 consensus_meta.cc:287] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
I20260709 13:07:10.532151 22250 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:07:10.252610 25628 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.229945 25486 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:10.495579 25825 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:10.515548 25740 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:10.529706 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:10.268834 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:10.291759 25941 log.cc:927] Time spent T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:07:10.224524 25656 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.275s
I20260709 13:07:10.571172 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:10.534510 22247 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:10.486697 25943 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.223413 25503 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:10.403138 25921 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.014s	sys 0.051s
W20260709 13:07:10.511718 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 499093us
I20260709 13:07:10.567144 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:10.606482 22144 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:10.576897 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:10.607704 22098 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:10.578425 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:10.608770 22099 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:10.251291 25592 consensus_queue.cc:237] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:10.607059 22177 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:10.614470 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:10.618891 22104 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:10.496081 25429 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:10.625183 22178 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:10.620690 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:10.626731 22106 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:10.636526 22099 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
W20260709 13:07:10.637876 22072 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.006s	sys 0.020s
I20260709 13:07:10.584311 25457 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:10.606559 25921 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.019s	sys 0.061s
I20260709 13:07:10.532829 25860 consensus_queue.cc:1059] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:07:10.638546 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:10.650888 22811 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.644891 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:10.646214 22254 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.009s	sys 0.046s
W20260709 13:07:10.651731 22254 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.009s	sys 0.046s
W20260709 13:07:10.646576 22072 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.007s	sys 0.021s
I20260709 13:07:10.603760 25649 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:10.534055 25891 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:10.616107 25729 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.621896 25940 log.cc:927] Time spent T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:10.585474 25419 consensus_queue.cc:1059] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
W20260709 13:07:10.641269 25941 log.cc:927] Time spent T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:10.627149 25820 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:10.574698 25825 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.561987 25486 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:10.561054 25628 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:10.686175 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:10.699779 22099 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:10.698001 22174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.014s	sys 0.022s
W20260709 13:07:10.701728 22174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.014s	sys 0.022s
W20260709 13:07:10.652617 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 547846us
I20260709 13:07:10.611114 25935 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:07:10.615567 25785 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:07:10.706805 22104 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:10.692567 25850 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:10.727439 25503 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:10.729380 22253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.026s	sys 0.041s
W20260709 13:07:10.729815 22253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.026s	sys 0.041s
I20260709 13:07:10.606153 25943 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:10.729751 22782 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.006s	sys 0.017s
W20260709 13:07:10.730953 22782 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.006s	sys 0.018s
W20260709 13:07:10.731328 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 707041us
I20260709 13:07:10.639405 25846 consensus_queue.cc:1059] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:07:10.649969 25457 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:10.738379 22106 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:10.746369 22099 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
W20260709 13:07:10.741339 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 225466us
I20260709 13:07:10.737923 25860 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:07:10.790804 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:10.791549 25860 raft_consensus.cc:3055] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:10.792120 25860 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:10.752243 25457 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.744297 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1748) took 1550 ms. Trace:
I20260709 13:07:10.793533 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:10.738840 22072 leader_election.cc:336] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.652s (SENT)
I20260709 13:07:10.716958 25164 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.793653 22101 rpcz_store.cc:276] 0709 13:07:09.182749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.244162 (+ 61413us) service_pool.cc:224] Handling call
0709 13:07:09.244546 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.260290 (+ 15744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.260332 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.305900 (+ 45568us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.735161 (+429261us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:09.763968 (+ 28807us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.764259 (+   291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.764373 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.733014 (+968641us) raft_consensus.cc:1685] finished
0709 13:07:10.733032 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.733148 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28588,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":7837,"raft.queue_time_us":8438,"raft.run_cpu_time_us":2842,"raft.run_wall_time_us":43050,"thread_start_us":369212,"threads_started":1,"wal-append.queue_time_us":638673}
I20260709 13:07:10.795261 25164 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:10.796535 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:10.797631 22249 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:10.797894 25164 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:10.733958 25864 consensus_meta.cc:287] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 1.413s	user 0.013s	sys 0.001s
I20260709 13:07:10.798772 25864 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.745692 25944 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.799603 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:10.799810 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:10.800223 25944 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:10.800966 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:10.697793 25942 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.008s	sys 0.027s
I20260709 13:07:10.802977 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:10.805573 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:10.806263 22251 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:10.806663 22246 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:10.799633 25864 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:07:10.808115 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:10.809638 25864 raft_consensus.cc:2764] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:10.810907 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:10.813680 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:10.815689 22246 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:10.814677 25944 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:10.794656 22072 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:10.822813 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 84021.2us
I20260709 13:07:10.823342 25738 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:10.823666 22072 leader_election.cc:336] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.561s (SENT)
I20260709 13:07:10.824251 22072 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:10.825152 25738 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:10.825521 22072 leader_election.cc:336] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.607s (SENT)
I20260709 13:07:10.826059 22072 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:10.752084 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 229152us
I20260709 13:07:10.820958 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:10.826968 25738 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:10.826354 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.827876 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:10.829164 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:10.830122 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:10.831112 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:10.832136 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:10.832679 22251 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:10.832980 25738 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.833549 25738 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:10.836344 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:10.836666 25738 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:10.837177 22181 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:10.819664 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:10.849572 25938 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.850651 25938 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:10.816169 25860 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:10.857550 25938 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:10.741137 25905 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.034s	sys 0.000s
I20260709 13:07:10.864995 22220 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:10.869971 25905 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.048s	sys 0.000s
W20260709 13:07:10.887516 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 236617us
W20260709 13:07:10.752686 25745 consensus_meta.cc:287] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.765s	user 0.013s	sys 0.000s
I20260709 13:07:10.696094 25729 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:10.926419 22255 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:10.870332 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:10.927500 22246 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
W20260709 13:07:10.859843 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.743484 25483 raft_consensus.cc:697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:10.916846 22782 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:10.938192 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:10.939010 22782 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:10.933226 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:10.934938 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:10.935081 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:10.924782 22144 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:10.715857 25825 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:10.759187 25869 raft_consensus.cc:3055] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:10.874457 25820 raft_consensus.cc:697] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:10.943270 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 78243.2us
I20260709 13:07:10.951526 22177 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:11.145851 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 960) took 1218 ms. Trace:
I20260709 13:07:11.146543 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 961) took 1318 ms. Trace:
I20260709 13:07:10.894106 25957 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:11.176777 22809 rpcz_store.cc:276] 0709 13:07:09.804796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.808809 (+  4013us) service_pool.cc:224] Handling call
0709 13:07:09.809018 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.809174 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:10.224274 (+415100us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.022545 (+798271us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:11.022626 (+    81us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:11.022698 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.022783 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.022960 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":698670,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":258890,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5688,"thread_start_us":1191835,"threads_started":3}
I20260709 13:07:11.126832 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:11.224123 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:11.230685 22101 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:11.234462 22807 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:10.926185 25745 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:10.951336 25869 raft_consensus.cc:740] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:11.243626 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:11.235432 22247 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:07:11.185521 25846 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:11.145918 25944 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:11.291867 22101 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:11.296891 22246 raft_consensus.cc:2393] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:11.172168 25847 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:11.297482 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:11.332517 25954 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.435s	user 0.000s	sys 0.000s
I20260709 13:07:11.332954 25745 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:11.245203 25938 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.334590 25971 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:11.334969 25938 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:11.335395 25971 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:11.337137 25938 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:11.338534 25971 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:11.339128 22104 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:11.340517 22098 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:11.342262 22104 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:11.342737 22103 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:07:11.342900 22098 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:11.343152 22103 pending_rounds.cc:85] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 3
I20260709 13:07:11.343431 22103 pending_rounds.cc:107] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:07:11.343672 22103 raft_consensus.cc:2889] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:11.343559 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:11.344163 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:11.345036 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:11.345785 22247 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:07:11.296077 25846 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.346817 25846 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:11.348126 25952 log.cc:927] Time spent T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.407s	user 0.000s	sys 0.001s
W20260709 13:07:11.302408 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.351228 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:11.352643 22101 raft_consensus.cc:2410] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:11.351835 25847 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:11.353655 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:11.345939 22811 consensus_meta.cc:287] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.663s	user 0.010s	sys 0.000s
I20260709 13:07:11.355645 22246 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:11.355396 22811 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:11.359917 22246 raft_consensus.cc:1240] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:11.365742 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:11.376792 22102 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:11.346901 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:11.380333 22247 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:11.243407 25957 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:11.411228 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:11.414222 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:11.407935 22252 raft_consensus.cc:3055] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:11.454878 22106 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:07:11.411602 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:07:11.358901 25912 consensus_meta.cc:287] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.835s	user 0.008s	sys 0.000s
W20260709 13:07:11.457442 22144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.033s	sys 0.057s
W20260709 13:07:11.490016 22144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.033s	sys 0.058s
W20260709 13:07:11.490382 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 548436us
I20260709 13:07:11.188956 25958 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:11.472617 22252 raft_consensus.cc:740] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:11.473274 22103 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:11.363703 25959 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 13:07:11.359951 25955 log.cc:927] Time spent T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.615s	user 0.000s	sys 0.000s
I20260709 13:07:11.482765 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:11.491179 22144 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:11.268898 25785 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:11.399616 25964 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:07:11.394671 25608 consensus_meta.cc:287] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.874s	user 0.007s	sys 0.003s
I20260709 13:07:11.361166 25628 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:11.328088 25740 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:11.398949 25974 log.cc:927] Time spent T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:07:11.360380 25847 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:11.502472 22250 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.513327 22103 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:11.534706 22144 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:11.536159 22144 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:11.403630 25745 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:07:11.395181 25410 consensus_meta.cc:287] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.338s	user 0.010s	sys 0.003s
I20260709 13:07:11.519572 22252 consensus_queue.cc:260] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:11.395402 25971 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:11.408849 25943 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:11.407719 25891 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:11.493381 25958 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:11.507506 25785 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:11.513518 25963 log.cc:927] Time spent T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.193s	user 0.000s	sys 0.003s
I20260709 13:07:11.583592 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2238) took 1623 ms. Trace:
I20260709 13:07:11.481966 25429 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:11.543550 22144 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:11.546514 25657 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:11.377712 25483 consensus_queue.cc:237] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:11.565295 22252 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:11.594883 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:11.595651 22101 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:11.547812 25938 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:11.586907 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:11.587944 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:11.539810 22099 raft_consensus.cc:2410] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:11.584077 22180 rpcz_store.cc:276] 0709 13:07:09.960187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.960362 (+   175us) service_pool.cc:224] Handling call
0709 13:07:09.964788 (+  4426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.080117 (+115329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.080152 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.080672 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.580964 (+500292us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:10.580997 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.581054 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.583348 (+1002294us) raft_consensus.cc:1685] finished
0709 13:07:11.583372 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.583518 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114828,"raft.queue_time_us":122686,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4178,"thread_start_us":499885,"threads_started":1,"wal-append.queue_time_us":809152}
I20260709 13:07:11.523963 25486 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:11.578339 25973 consensus_queue.cc:1059] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:07:11.555641 25971 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:11.551640 25847 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:11.502776 25820 consensus_queue.cc:237] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:11.578359 25955 log.cc:927] Time spent T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:11.666009 22103 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
W20260709 13:07:11.685266 22781 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.033s	sys 0.045s
I20260709 13:07:11.597999 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:11.678853 22252 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:11.579211 25958 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:11.576643 22072 leader_election.cc:336] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.859s (SENT)
W20260709 13:07:11.563485 25921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.006s	sys 0.003s
W20260709 13:07:11.707824 22781 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.036s	sys 0.045s
W20260709 13:07:11.708098 22147 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.006s	sys 0.004s
I20260709 13:07:11.708407 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 680) took 1605 ms. Trace:
I20260709 13:07:11.584077 25785 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:11.501120 25912 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:11.546514 25745 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:11.670131 25457 consensus_meta.cc:287] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.866s	user 0.012s	sys 0.002s
I20260709 13:07:11.711203 22072 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:11.732684 25847 raft_consensus.cc:697] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:11.598938 25825 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:11.722407 22147 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.007s	sys 0.004s
I20260709 13:07:11.601154 25983 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:11.722841 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 1.12373e+06us
I20260709 13:07:11.554796 25410 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:11.722455 22252 rpcz_store.cc:276] 0709 13:07:10.103233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.106616 (+  3383us) service_pool.cc:224] Handling call
0709 13:07:10.107040 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.407846 (+1300806us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x7b54000382a0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7ec5dc0 00007f66a7f501c0 00007f66a7f51231 00007f66a7f4dd8f 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c
0709 13:07:11.708047 (+300201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.708338 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153835776}
W20260709 13:07:11.843005 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 266370us
I20260709 13:07:11.601334 25729 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:11.845120 25849 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:11.705219 25938 raft_consensus.cc:697] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:11.725996 25921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.007s	sys 0.004s
I20260709 13:07:11.551625 25869 consensus_queue.cc:260] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:11.680258 25486 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:11.727146 25981 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.668406 25972 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:11.832847 22218 connection.cc:256] RPC call timeout handler was delayed by -1.0115573399999676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
I20260709 13:07:11.840575 22249 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:11.849364 22781 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:11.831651 25905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.000s	sys 0.035s
I20260709 13:07:11.857556 22218 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:11.860001 22102 raft_consensus.cc:1240] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:11.880167 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:11.856915 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 393837us
W20260709 13:07:11.884953 22072 leader_election.cc:336] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.966s (SENT)
I20260709 13:07:11.880533 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:11.888487 22815 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:11.879966 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:11.886878 22072 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:11.830590 25457 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:11.898711 22218 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:11.903666 22218 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:11.858273 25869 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:11.908694 22072 leader_election.cc:336] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.116s (SENT)
I20260709 13:07:11.911367 22072 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:11.868476 25905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.000s	sys 0.035s
I20260709 13:07:11.858426 25983 raft_consensus.cc:697] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:11.885466 25970 raft_consensus.cc:3055] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:11.900776 25592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.017s	sys 0.016s
I20260709 13:07:11.906751 22812 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:11.907088 25988 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:11.858029 25486 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:11.920349 25946 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 13:07:11.920984 25976 log.cc:927] Time spent T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:07:11.862725 25957 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:11.906849 25912 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.926736 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 667) took 2844 ms. Trace:
I20260709 13:07:11.907830 25849 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:11.924969 25592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.017s	sys 0.016s
I20260709 13:07:11.925613 25943 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:11.861424 25981 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:11.941028 22218 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:11.861696 25972 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:11.920837 25970 raft_consensus.cc:740] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:11.945096 22808 rpcz_store.cc:276] 0709 13:07:09.077843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.077976 (+   133us) service_pool.cc:224] Handling call
0709 13:07:09.087271 (+  9295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.819474 (+732203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.921956 (+2102482us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b5400736c54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:11.922089 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682649984}
I20260709 13:07:11.932544 22072 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:11.961597 22147 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:11.925930 25988 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:11.937925 25971 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:11.966449 22250 raft_consensus.cc:2410] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:07:11.967501 22098 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.008s	sys 0.025s
I20260709 13:07:11.967312 22218 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:11.970885 22146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.004s	sys 0.028s
I20260709 13:07:11.937003 25879 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.938283 25729 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.012434 22146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.005s	sys 0.028s
W20260709 13:07:12.013326 22098 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.009s	sys 0.026s
W20260709 13:07:12.014835 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 47943us
I20260709 13:07:12.015661 22218 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:12.016953 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:12.013015 25863 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:11.977056 25592 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:11.921135 25938 consensus_queue.cc:237] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:11.923452 25847 consensus_queue.cc:237] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:12.013567 25992 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:12.021292 25973 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:11.979876 25988 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.021860 25971 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:12.021848 25429 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:12.149281 25990 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:12.017416 22072 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:12.192962 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 175621us
W20260709 13:07:12.171437 25969 log.cc:927] Time spent T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:07:12.178025 25972 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:12.203790 25994 log.cc:927] Time spent T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:07:12.033286 25745 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.018206 25729 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:12.103703 25993 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:07:12.173429 25995 log.cc:927] Time spent T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
W20260709 13:07:12.172926 25996 log.cc:927] Time spent T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:07:12.021541 25879 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:12.171437 25999 log.cc:927] Time spent T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:07:12.027532 25985 consensus_queue.cc:1059] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.186s
W20260709 13:07:12.172268 25989 log.cc:927] Time spent T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:07:12.179620 25410 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.027287 25983 consensus_queue.cc:237] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:12.176641 25981 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:12.250998 25991 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.241567 25592 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:12.244728 26003 log.cc:927] Time spent T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:07:12.160391 25970 consensus_queue.cc:260] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:12.248762 25993 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.261554 25991 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.265172 25993 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.265348 25486 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:12.262799 25457 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.266513 25991 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:12.266772 25846 consensus_meta.cc:287] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.919s	user 0.009s	sys 0.004s
I20260709 13:07:12.262962 25970 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.267225 25846 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:12.267730 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2177) took 1418 ms. Trace:
I20260709 13:07:12.269233 25846 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:12.268237 22246 rpcz_store.cc:276] 0709 13:07:10.875186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.397176 (+521990us) service_pool.cc:224] Handling call
0709 13:07:11.397608 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.397887 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.397925 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.414476 (+ 16551us) log.cc:844] Serialized 26 byte log entry
0709 13:07:11.904753 (+490277us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:11.920677 (+ 15924us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.920894 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.920997 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.267492 (+346495us) raft_consensus.cc:1685] finished
0709 13:07:12.267520 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.267662 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16428,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":2664,"raft.queue_time_us":2202,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2207,"thread_start_us":353137,"threads_started":1,"wal-append.queue_time_us":446268}
I20260709 13:07:12.271906 25879 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.273192 25729 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:12.274663 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2178) took 1348 ms. Trace:
I20260709 13:07:12.275848 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2031) took 1094 ms. Trace:
I20260709 13:07:12.277515 22246 rpcz_store.cc:276] 0709 13:07:11.181648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.270519 (+1088871us) service_pool.cc:224] Handling call
0709 13:07:12.270907 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.275324 (+  4417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.275461 (+   137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.275531 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:12.275580 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.275655 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.275785 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:12.275089 22247 rpcz_store.cc:276] 0709 13:07:10.926599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.398680 (+472081us) service_pool.cc:224] Handling call
0709 13:07:11.399133 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.399572 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.399614 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.400080 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:07:11.899820 (+499740us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:11.899898 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.900000 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.274442 (+374442us) raft_consensus.cc:1685] finished
0709 13:07:12.274461 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.274602 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2460,"raft.queue_time_us":307373,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":11053,"thread_start_us":499197,"threads_started":1,"wal-append.queue_time_us":529523}
I20260709 13:07:12.276714 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2179) took 1345 ms. Trace:
I20260709 13:07:12.279174 22252 rpcz_store.cc:276] 0709 13:07:10.932110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.843334 (+911224us) service_pool.cc:224] Handling call
0709 13:07:11.843792 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.844143 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.844175 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.844703 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:07:11.952194 (+107491us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:11.972511 (+ 20317us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.014535 (+ 42024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.014609 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.276506 (+261897us) raft_consensus.cc:1685] finished
0709 13:07:12.276524 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.276656 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39234,"prepare.queue_time_us":23319,"prepare.run_cpu_time_us":207,"prepare.run_wall_time_us":1857,"raft.queue_time_us":42692,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":8552,"thread_start_us":107008,"threads_started":1,"wal-append.queue_time_us":333242}
I20260709 13:07:12.286589 25988 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.288059 25486 raft_consensus.cc:3055] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:12.288512 25486 raft_consensus.cc:740] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:12.289501 25486 consensus_queue.cc:260] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.291132 25486 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.298935 25911 raft_consensus.cc:3055] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:12.299489 25911 raft_consensus.cc:740] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:12.300539 25911 consensus_queue.cc:260] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.302016 25911 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:12.303467 25785 consensus_meta.cc:287] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.003s
W20260709 13:07:12.250085 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 233170us
W20260709 13:07:12.315202 22072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.597s (SENT) [suppressed 20 similar messages]
W20260709 13:07:12.322680 25958 consensus_meta.cc:287] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.001s
W20260709 13:07:12.360556 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 342862us
W20260709 13:07:12.367563 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.357481 25993 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.371300 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:12.374033 22103 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:12.372529 22072 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:12.375365 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:12.372910 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:12.377359 22808 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:12.319478 25785 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.378217 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:12.380496 22072 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:12.380509 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:12.381273 22172 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:12.380507 22811 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:12.382097 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.383275 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:12.381381 22144 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:12.380605 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:12.384902 22180 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:12.386036 22252 raft_consensus.cc:2393] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:12.386850 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.371959 25729 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:12.388629 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.389267 22247 raft_consensus.cc:2410] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:12.389132 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.377454 25956 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:12.390375 25956 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.392567 25956 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:12.363227 25656 consensus_queue.cc:1059] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:07:12.395635 25656 raft_consensus.cc:3055] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:12.396027 25656 raft_consensus.cc:740] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:12.396917 25656 consensus_queue.cc:260] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:12.398203 25656 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.388248 26002 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:12.399896 26002 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.366617 25970 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:07:12.366619 25946 consensus_queue.cc:1059] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:07:12.389925 22252 raft_consensus.cc:2410] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:12.364285 25958 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:12.384223 25972 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:12.371521 25429 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:07:12.408274 22172 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:12.388737 25410 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:12.410233 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.386798 25846 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:12.383132 25938 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:12.385283 25988 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:12.384120 25943 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:12.414876 22252 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:07:12.416391 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.416785 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:12.416764 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.418087 22252 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:12.419008 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.400295 26002 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:12.419929 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:12.424775 22072 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:12.426122 22218 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:12.427911 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.381886 25993 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.421060 25938 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:12.430429 25993 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.430826 25938 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:12.428781 22252 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:07:12.433985 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.434671 22252 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:12.434644 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.437666 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.438477 22247 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:12.442380 22072 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:12.444077 22072 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:12.418072 25846 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.445140 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.446012 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.446589 25745 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:12.447383 25785 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:12.435966 25972 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:12.460978 25972 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:12.461434 25972 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.455045 22252 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:12.463406 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.463537 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:12.464252 22252 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:12.455045 22247 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:12.448251 22072 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:12.452206 25958 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:12.419214 25943 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.453158 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:12.468954 22097 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:12.453997 25860 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.406678 25729 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.459995 25846 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.477748 22072 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:12.459925 25745 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:12.479516 25745 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:12.480003 25745 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.440656 25592 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.433113 25856 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:12.481927 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:12.482565 22181 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:12.468616 25970 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.476835 25895 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:12.469417 25943 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:12.468357 25419 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:12.485181 22072 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:12.483971 22781 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:12.489049 25785 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:12.489560 25785 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.489966 25785 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.486501 25895 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:12.488384 22781 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:12.486991 25503 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:12.496541 25563 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:12.496883 25503 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.499203 25503 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.499637 25785 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.500180 25988 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:12.500595 25988 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:12.500682 25825 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:12.501329 25988 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:12.501763 25785 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:12.490492 25895 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:12.508601 22249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 2164) took 1699 ms (client timeout 1854 ms). Trace:
I20260709 13:07:12.508868 22246 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:07:12.509063 22249 rpcz_store.cc:269] 0709 13:07:10.810149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.810352 (+   203us) service_pool.cc:224] Handling call
0709 13:07:12.508413 (+1698061us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540019bc54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:12.508540 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2335110528}
I20260709 13:07:12.491811 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:12.513459 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.514084 22249 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:07:12.514551 25958 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:12.515246 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.515151 25958 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.486724 25856 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.516341 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:12.516894 22252 raft_consensus.cc:2376] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8. Re-sending same reply.
I20260709 13:07:12.517668 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.517834 25856 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.517753 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:12.518316 22252 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:12.519691 25734 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:12.520068 25958 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.514819 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.521747 22249 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:12.491429 25970 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.523743 25949 raft_consensus.cc:3055] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:12.524192 25949 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:12.524324 25970 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.503036 25419 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.525041 25949 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.527261 22782 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:12.551671 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:12.535327 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:12.549815 22072 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:12.534153 22101 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:12.553481 22782 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:12.552688 22812 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:12.555630 22782 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:12.555756 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 45268.6us
I20260709 13:07:12.551685 25939 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:12.556887 25734 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:12.557766 25734 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:12.557502 25939 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:12.558511 25734 raft_consensus.cc:697] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:12.559141 26012 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:12.559624 26012 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:12.560039 26012 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.559778 25734 consensus_queue.cc:237] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.561249 25939 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:12.517716 25947 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:12.586412 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:12.586287 25745 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:12.586741 25947 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.562834 22072 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:12.565707 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:12.486634 26015 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.590227 22072 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:12.552205 25855 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.582700 25592 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:12.592442 22097 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:07:12.585767 22816 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35198 (request call id 963) took 2764 ms (client timeout 1597 ms). Trace:
I20260709 13:07:12.584899 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.508735 25729 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.526172 25949 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:12.532011 25979 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:12.592917 22816 rpcz_store.cc:269] 0709 13:07:09.821828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.822819 (+   991us) service_pool.cc:224] Handling call
0709 13:07:12.585533 (+2762714us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54002008d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:12.585671 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399485696}
I20260709 13:07:12.593389 22251 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:12.592008 22072 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:12.596004 22782 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:12.596482 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 2173) took 1764 ms. Trace:
I20260709 13:07:11.177057 22810 rpcz_store.cc:276] 0709 13:07:09.805439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.809333 (+  3894us) service_pool.cc:224] Handling call
0709 13:07:09.809598 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.809855 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:10.206732 (+396877us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.123237 (+916505us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:11.123301 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:11.123375 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.123464 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.123615 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12375,"prepare.queue_time_us":709077,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":287126,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":11609,"spinlock_wait_cycles":29132288,"thread_start_us":1297568,"threads_started":3,"wal-append.queue_time_us":717575}
I20260709 13:07:12.596973 22251 rpcz_store.cc:276] 0709 13:07:10.832732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.584596 (+1751864us) service_pool.cc:224] Handling call
0709 13:07:12.596410 (+ 11814us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:12.598713 22072 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:12.564765 25419 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.564597 25828 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:12.595506 25979 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.617023 25979 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.591076 25855 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.523995 25972 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:12.604527 25970 consensus_queue.cc:1059] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:07:12.605667 26015 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:12.604496 25592 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:12.608911 25825 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:12.586184 26012 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:12.614331 25947 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.614847 25828 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.628623 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:12.631922 22099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 572) took 1697 ms (client timeout 1513 ms). Trace:
W20260709 13:07:12.632391 22099 rpcz_store.cc:269] 0709 13:07:10.934728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.934829 (+   101us) service_pool.cc:224] Handling call
0709 13:07:12.631690 (+1696861us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b540042b654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:12.631840 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375034112}
W20260709 13:07:12.635944 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 46472us
I20260709 13:07:12.637928 26024 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:12.638411 26024 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:12.638878 26024 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.634562 25943 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:12.639217 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 674) took 2589 ms. Trace:
I20260709 13:07:12.639627 22253 rpcz_store.cc:276] 0709 13:07:10.049917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.063816 (+ 13899us) service_pool.cc:224] Handling call
0709 13:07:10.066226 (+  2410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.104840 (+ 38614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.104885 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.105458 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.730505 (+625047us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:10.730610 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.410456 (+679846us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:12.638818 (+1228362us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b54002cb0d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:12.638891 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.638971 (+    80us) raft_consensus.cc:1685] finished
0709 13:07:12.638990 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.639137 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101849600,"thread_start_us":520071,"threads_started":1,"wal-append.queue_time_us":965374}
I20260709 13:07:12.642691 25943 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:12.643388 25943 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:12.643728 25943 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:12.644095 25943 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.623979 26015 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.624112 25745 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:12.624778 25592 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:12.652956 25592 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.625818 25825 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.656490 25825 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:12.656622 25855 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.629506 25828 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.607506 25846 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:12.607013 26002 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.654476 25988 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.657897 26015 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.649158 26024 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.696888 22172 raft_consensus.cc:2393] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:12.702205 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:12.703305 22103 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.686539 25855 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:12.729458 22103 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:12.731071 22218 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:12.738394 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.751468 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.760367 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 131851us
I20260709 13:07:12.769461 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1905) took 1934 ms. Trace:
I20260709 13:07:12.769995 22177 rpcz_store.cc:276] 0709 13:07:10.834994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.835514 (+   520us) service_pool.cc:224] Handling call
0709 13:07:10.835841 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.176784 (+340943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.769177 (+1592393us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54003287d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:12.769384 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265214336}
W20260709 13:07:12.777472 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.760594 25970 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:12.782820 25970 raft_consensus.cc:697] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:12.784093 25970 consensus_queue.cc:237] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:12.758991 25734 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.749018 25855 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:12.940627 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.835495 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2026) took 1993 ms. Trace:
I20260709 13:07:12.953141 22255 rpcz_store.cc:276] 0709 13:07:10.842072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.138865 (+296793us) service_pool.cc:224] Handling call
0709 13:07:11.294567 (+155702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.294759 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.294793 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:11.294850 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:11.294897 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.294980 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.835248 (+1540268us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b540005d2d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:12.835413 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107874048}
I20260709 13:07:12.952564 22072 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:12.958135 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:12.968008 22246 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:12.824584 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.828558 25657 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.230s	user 0.011s	sys 0.014s
W20260709 13:07:12.835026 26018 log.cc:927] Time spent T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:07:12.971868 22098 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:12.875720 25860 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.975546 25855 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.875492 25419 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.971798 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:12.787420 26012 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:12.977793 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:12.978049 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.978590 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:12.985708 22252 raft_consensus.cc:2393] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 6: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:12.970446 25947 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.970316 26020 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.989790 22815 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:12.955196 25563 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:12.964042 25567 raft_consensus.cc:2764] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:12.862672 25846 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:12.984862 22255 raft_consensus.cc:2376] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8. Re-sending same reply.
I20260709 13:07:12.981472 22253 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.982013 25988 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:12.970237 26024 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:12.861573 26022 log.cc:927] Time spent T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:12.988345 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:13.017086 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.017917 22099 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:07:12.989338 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:12.956534 26002 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:12.992941 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:12.995689 22816 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:13.021003 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:07:12.996588 22807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35214 (request call id 672) took 2382 ms (client timeout 3040 ms). Trace:
I20260709 13:07:12.970036 25745 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:07:12.976872 25657 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.379s	user 0.011s	sys 0.019s
I20260709 13:07:13.000012 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:12.967183 25734 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.998989 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:12.983873 25895 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.047858 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:13.004750 22811 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:13.006465 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:12.987510 25958 consensus_queue.cc:1059] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:07:13.008965 25961 log.cc:927] Time spent T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 1.408s	user 0.000s	sys 0.007s
I20260709 13:07:13.015475 22104 raft_consensus.cc:1240] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:13.017956 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:13.002137 25483 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:13.018796 22248 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.055337 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:13.056144 22104 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:13.019625 22253 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:13.056437 22246 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:12.978634 25972 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:12.862335 25828 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.048066 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.003224 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:12.991314 25947 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:12.993934 26020 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:13.075795 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.076570 22106 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:13.046577 25657 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:13.081383 22104 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:12.983305 25860 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:12.988348 25419 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.052228 22255 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.048185 22098 raft_consensus.cc:1240] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:13.057394 22247 raft_consensus.cc:1240] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.019953 25583 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.135398 25583 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.137709 25583 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:13.140586 25984 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 1.313s	user 0.009s	sys 0.009s
I20260709 13:07:13.142259 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 670) took 3537 ms. Trace:
I20260709 13:07:12.989962 25592 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.144609 25592 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:13.082068 22099 raft_consensus.cc:1240] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:13.021816 22807 rpcz_store.cc:269] 0709 13:07:10.614233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.614358 (+   125us) service_pool.cc:224] Handling call
0709 13:07:12.996445 (+2382087us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54006225d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:12.996537 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339979520}
I20260709 13:07:13.084556 22248 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:13.145358 25657 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.085394 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.146534 22104 raft_consensus.cc:1813] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Handling vote request from an unknown peer 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:13.147284 22104 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:13.147832 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1899) took 2928 ms. Trace:
I20260709 13:07:13.148221 22178 rpcz_store.cc:276] 0709 13:07:10.219673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.222421 (+  2748us) service_pool.cc:224] Handling call
0709 13:07:10.222686 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.625808 (+403122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.147594 (+2521786us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b540045fbd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:13.147750 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925059456}
I20260709 13:07:13.149326 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:13.149605 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.151847 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.090797 25860 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:13.153551 22099 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:13.158535 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.093111 25419 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:13.094377 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:13.094952 25649 raft_consensus.cc:3055] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:13.100267 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:13.178287 22177 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:13.101017 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.142618 22254 rpcz_store.cc:276] 0709 13:07:09.605059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.605516 (+   457us) service_pool.cc:224] Handling call
0709 13:07:09.650948 (+ 45432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.652139 (+1001191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.652168 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.690692 (+ 38524us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.843234 (+152542us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:10.843287 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.843385 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.140001 (+2296616us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:13.141943 (+  1942us) raft_consensus.cc:1685] finished
0709 13:07:13.141965 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.142199 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31474,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":50,"spinlock_wait_cycles":6440192,"thread_start_us":1090744,"threads_started":2,"wal-append.queue_time_us":989382}
I20260709 13:07:13.101775 22218 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:13.102227 25967 log.cc:927] Time spent T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 1.503s	user 0.005s	sys 0.003s
W20260709 13:07:13.183490 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 81818.6us
I20260709 13:07:13.142760 25838 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:13.185979 25895 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:13.186110 22218 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:13.187909 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 520) took 3086 ms. Trace:
I20260709 13:07:13.188319 22174 rpcz_store.cc:276] 0709 13:07:10.101217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.101449 (+   232us) service_pool.cc:224] Handling call
0709 13:07:10.101812 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.102112 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.102135 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.102572 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.702095 (+599523us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:10.702136 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.702210 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.008363 (+2306153us) spinlock_profiling.cc:243] Waited 58.6 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:13.187617 (+179254us) raft_consensus.cc:1685] finished
0709 13:07:13.187641 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.187851 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134765952,"thread_start_us":543742,"threads_started":1,"wal-append.queue_time_us":1446808}
I20260709 13:07:13.189963 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.104671 25947 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:13.190575 22174 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:13.106285 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:13.106609 26005 raft_consensus.cc:3055] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:13.110965 25734 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:13.111147 25990 raft_consensus.cc:3055] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:13.112123 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.112396 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2030) took 1937 ms. Trace:
I20260709 13:07:13.204730 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.205981 22174 raft_consensus.cc:2410] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:13.205088 22175 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:13.206586 22071 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:13.112597 25828 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:13.116950 25846 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:13.119879 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.209857 22180 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:13.123332 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43362 (request call id 18) took 3311 ms. Trace:
I20260709 13:07:13.210580 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.124081 22815 raft_consensus.cc:2393] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:13.125831 25943 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.131906 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.250461 22071 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:13.134101 25987 log.cc:927] Time spent T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 1.535s	user 0.005s	sys 0.006s
I20260709 13:07:13.164090 22812 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
W20260709 13:07:13.258154 22779 connection.cc:256] RPC call timeout handler was delayed by -1.1621819839999716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 13:07:13.258703 22779 connection.cc:256] RPC call timeout handler was delayed by -1.1567819839999629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 13:07:13.075332 25949 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.176064 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.077004 25483 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.181453 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.182366 22176 raft_consensus.cc:2393] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 9: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:13.191426 25886 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.191722 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:13.191972 25885 consensus_queue.cc:1059] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:13.192364 26020 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:13.193094 22097 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:13.270540 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:13.105340 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:13.271688 22181 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.195885 22179 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:13.197476 22177 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:13.156504 22144 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:07:13.287223 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 130789us
I20260709 13:07:13.235955 25846 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.207734 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 576) took 1820 ms. Trace:
I20260709 13:07:13.293144 22102 rpcz_store.cc:276] 0709 13:07:11.387836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.388021 (+   185us) service_pool.cc:224] Handling call
0709 13:07:11.388425 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.887460 (+499035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.207501 (+1320041us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54002b9654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:13.207680 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083963776}
I20260709 13:07:13.205300 22250 rpcz_store.cc:276] 0709 13:07:11.181162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.012857 (+831695us) service_pool.cc:224] Handling call
0709 13:07:12.013090 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.498978 (+485888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.499009 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.499049 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:12.499083 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.112177 (+613094us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b54001cc5d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:13.112222 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.112338 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1142,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":1116564736}
I20260709 13:07:13.212615 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:13.199543 26005 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:13.209331 22781 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:13.297032 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 87789.6us
I20260709 13:07:13.223680 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.210801 22100 rpcz_store.cc:276] 0709 13:07:09.811635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.811793 (+   158us) service_pool.cc:224] Handling call
0709 13:07:13.123092 (+3311299us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540040fbd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f54735 00007f66acf14d29 00007f66a64931d4 00007f66a6493162 00007f66a6493091 00007f66a649300c 00007f66a64922c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:13.123244 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084340480}
I20260709 13:07:13.231083 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.177949 25649 raft_consensus.cc:740] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:13.240227 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:13.301376 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:13.205086 25946 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:13.204679 25990 raft_consensus.cc:740] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:13.211302 25895 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:13.252941 22255 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:07:13.218317 22178 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:07:13.257414 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:13.319228 22179 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:13.291740 25860 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:13.250147 25825 consensus_meta.cc:287] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.593s	user 0.006s	sys 0.012s
W20260709 13:07:13.268356 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 76721.2us
W20260709 13:07:13.250751 25979 consensus_meta.cc:287] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.008s
I20260709 13:07:13.289319 22103 raft_consensus.cc:1240] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:13.316634 25946 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:13.207185 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.343672 22220 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:13.297822 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:13.302489 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.263748 25563 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:13.345433 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.314428 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:13.347220 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.315291 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.317446 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.348016 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:13.348811 22255 raft_consensus.cc:2410] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:07:13.348673 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.318372 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:13.276016 25949 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.353188 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.260242 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:13.313316 25734 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:13.322657 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.327253 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:13.356401 22816 raft_consensus.cc:2393] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 11: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:13.328328 22181 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:13.327764 25990 consensus_queue.cc:260] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.361325 22248 raft_consensus.cc:1240] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:13.329025 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:13.362129 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:13.362860 22175 raft_consensus.cc:2368] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:13.321705 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.329303 25649 consensus_queue.cc:260] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.378386 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.379263 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:13.379618 25943 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:13.380477 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:13.380945 22175 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:13.382170 22175 raft_consensus.cc:1240] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:13.382892 25949 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:13.380184 22174 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:13.384536 22174 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:13.384773 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:13.385972 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:13.386513 22815 raft_consensus.cc:2376] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9. Re-sending same reply.
I20260709 13:07:13.386600 22174 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:13.290364 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:13.393016 22174 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:13.334587 22072 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:13.378312 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:13.338639 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.311695 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:13.305831 26000 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:13.396009 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:13.364212 22179 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:13.399382 22252 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.400039 22174 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:13.363428 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:13.401464 22248 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:07:13.401717 22174 raft_consensus.cc:1275] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:13.332434 25895 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:13.359063 22249 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:13.403621 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:13.404363 22247 raft_consensus.cc:1240] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:13.402868 22179 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:13.340543 25970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.004s	sys 0.009s
I20260709 13:07:13.346756 25946 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.415441 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:13.416273 22253 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 6.
I20260709 13:07:13.339741 25838 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.364778 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:13.367197 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:13.368228 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 381916us
I20260709 13:07:13.368391 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1870) took 2789 ms. Trace:
I20260709 13:07:13.370355 25846 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:13.346988 25979 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.371675 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.373070 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:13.373247 25483 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:13.373816 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:13.375218 25990 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.340407 26034 consensus_queue.cc:1059] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:07:13.355333 25734 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:13.355530 25885 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:13.375981 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:13.376936 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:13.377617 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:13.377730 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:13.378026 26015 consensus_meta.cc:287] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.681s	user 0.010s	sys 0.002s
I20260709 13:07:13.448536 26015 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.449740 22106 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:13.378517 25649 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.359920 26005 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.315078 22144 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:13.453390 22779 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:13.335598 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.389367 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:13.394562 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 60083.2us
I20260709 13:07:13.462847 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:13.464171 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:13.464974 22246 raft_consensus.cc:2410] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:13.395445 22101 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.321528 22071 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:13.397691 22177 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:13.397847 22782 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:13.393308 22781 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:13.401935 22248 pending_rounds.cc:85] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 8
I20260709 13:07:13.467358 22248 pending_rounds.cc:107] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:07:13.467639 22248 raft_consensus.cc:2889] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.350742 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:13.402441 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.351879 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:13.468991 22809 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.406699 22179 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:13.414041 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:13.420280 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:13.353681 25654 consensus_queue.cc:1059] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:07:13.405125 25563 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:13.421125 25838 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.422060 22254 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:13.423465 22069 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:13.424338 22103 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:13.424705 25849 consensus_queue.cc:1059] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:13.411265 25895 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:13.411500 25970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.005s	sys 0.010s
I20260709 13:07:13.353818 25419 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:07:13.432346 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:13.433611 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:13.461544 25821 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:13.419000 22105 rpcz_store.cc:276] 0709 13:07:10.578977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.581451 (+  2474us) service_pool.cc:224] Handling call
0709 13:07:10.581819 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.894957 (+313138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.895020 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.895691 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 13:07:11.260335 (+364644us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:11.396483 (+136148us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.470804 (+ 74321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.470945 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.133537 (+1662592us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:13.367966 (+234429us) raft_consensus.cc:1685] finished
0709 13:07:13.368086 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.368279 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73789,"prepare.queue_time_us":135458,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":229261,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":47075,"spinlock_wait_cycles":139412352,"thread_start_us":617646,"threads_started":2,"wal-append.queue_time_us":663557}
I20260709 13:07:13.398699 26000 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.437958 22252 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:13.452248 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:13.456058 22104 raft_consensus.cc:2393] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:07:13.471154 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 73408.8us
I20260709 13:07:13.508438 22247 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:13.457719 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:13.508937 22782 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:13.458988 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:13.459774 22218 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:13.457587 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 142746us
I20260709 13:07:13.474576 22815 raft_consensus.cc:2393] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 10: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:13.509895 22249 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:13.511231 22807 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
W20260709 13:07:13.475713 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 82486.9us
I20260709 13:07:13.451784 25734 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:13.515056 25456 consensus_queue.cc:1059] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:13.515362 22782 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:13.515604 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:13.516125 25456 raft_consensus.cc:3055] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:13.516476 25456 raft_consensus.cc:740] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:13.516732 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:13.517143 25783 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:13.517714 25881 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:13.517297 25456 consensus_queue.cc:260] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.518535 25456 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.518723 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:13.519721 26000 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.478526 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:13.480522 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 159061us
I20260709 13:07:13.520558 22246 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:13.520713 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 61025us
I20260709 13:07:13.456424 25567 raft_consensus.cc:3055] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:13.522505 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:13.524441 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:13.457342 25837 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:07:13.451035 26015 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:13.486306 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:13.491453 22100 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:13.490062 25943 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.341657 25825 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.531616 25943 raft_consensus.cc:697] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:13.532558 25943 consensus_queue.cc:237] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.533011 25825 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:13.502377 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 79009.2us
I20260709 13:07:13.535238 22069 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:13.535888 25979 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:13.536381 25874 consensus_queue.cc:1059] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:13.536670 22816 raft_consensus.cc:2393] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 11: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:13.504572 22809 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:13.509146 22808 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:13.496162 25563 raft_consensus.cc:697] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:13.537458 25874 raft_consensus.cc:3055] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:13.540865 25874 raft_consensus.cc:740] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:13.540356 25563 consensus_queue.cc:237] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.541055 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:13.541720 22248 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:13.541636 25874 consensus_queue.cc:260] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.536398 22069 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:13.460602 22779 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:13.489883 26005 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:13.472875 22072 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:13.564007 22816 raft_consensus.cc:1240] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:13.562196 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 101675us
I20260709 13:07:13.522817 25567 raft_consensus.cc:740] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:13.451176 25885 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:13.523973 25419 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:13.583087 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 110299us
I20260709 13:07:13.457110 25944 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:13.524871 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:13.587388 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.557340 22248 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:13.588049 22097 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:13.479578 25846 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.511438 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:13.589161 22248 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:07:13.589284 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 77929.2us
I20260709 13:07:13.525625 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:13.525908 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.484184 25754 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:13.484094 25890 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:13.525326 25889 raft_consensus.cc:3055] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:13.512683 22781 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:13.537405 26027 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.545697 22253 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:07:13.547262 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:13.585325 22072 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:13.545374 26034 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.591645 25419 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.607046 25483 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:07:13.628226 25419 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.603641 25825 consensus_queue.cc:1059] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:07:13.630334 25825 raft_consensus.cc:3055] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:13.611323 25815 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:13.631414 25890 raft_consensus.cc:697] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:13.608170 25849 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:13.591471 25885 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.631949 25946 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:13.592175 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.593346 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:13.593423 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.634536 26015 consensus_queue.cc:1059] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:13.635406 26015 raft_consensus.cc:3055] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:13.635473 22181 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:13.635639 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.635993 26015 raft_consensus.cc:740] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:13.582074 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:13.636945 26015 consensus_queue.cc:260] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.637182 22808 raft_consensus.cc:2393] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
W20260709 13:07:13.638024 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 125417us
I20260709 13:07:13.638290 26015 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.639086 26012 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:13.640190 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:13.581646 25821 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:13.641734 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:13.642704 25821 raft_consensus.cc:697] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:13.643167 22252 raft_consensus.cc:2393] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:13.643414 25745 raft_consensus.cc:3055] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:13.643852 25745 raft_consensus.cc:740] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:13.643729 25821 consensus_queue.cc:237] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.644305 22252 raft_consensus.cc:1240] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.644686 25745 consensus_queue.cc:260] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.645736 25745 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.638907 25944 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:13.626457 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:13.639008 22253 pending_rounds.cc:85] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 5
I20260709 13:07:13.648072 22253 pending_rounds.cc:107] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:13.648402 22253 raft_consensus.cc:2889] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:13.627419 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet 0232d828f8664f348df823432990379b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:13.650699 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.606335 22218 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:13.651947 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 45687.9us
W20260709 13:07:13.637166 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 51907.2us
I20260709 13:07:13.654533 22072 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:13.626353 22247 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:13.658952 22177 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:13.661072 22101 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:13.662046 22097 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:13.565322 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:13.548398 25838 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:13.602855 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 76099.9us
I20260709 13:07:13.524719 25592 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.631502 25815 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:13.632612 25890 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.589987 22144 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:13.600415 22246 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:13.597168 22248 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:13.627271 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:13.688448 22104 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:13.689330 22808 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:07:13.690992 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 101086us
I20260709 13:07:13.667405 22250 raft_consensus.cc:1240] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:13.598652 22779 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:13.594695 25846 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:13.693601 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 94996.2us
I20260709 13:07:13.630726 25825 raft_consensus.cc:740] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:13.627684 25889 raft_consensus.cc:740] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:13.536597 25979 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.151s
I20260709 13:07:13.606691 25970 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:13.695766 25947 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:13.694789 22779 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:13.642156 25654 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:13.639178 26038 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.120s	user 0.003s	sys 0.000s
I20260709 13:07:13.646737 25944 raft_consensus.cc:697] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:13.710867 22220 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:13.667639 25949 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:13.542886 25874 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:13.700032 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 45622.8us
I20260709 13:07:13.664453 25649 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.726737 25649 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.727244 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:13.604024 25754 raft_consensus.cc:697] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:13.717458 22218 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:13.677263 25815 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:13.699595 25846 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.721721 25972 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:13.620335 25567 consensus_queue.cc:260] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.677534 25849 raft_consensus.cc:697] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:13.723035 22002 catalog_manager.cc:5697] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:13.610819 25895 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.723973 25889 consensus_queue.cc:260] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.724752 25944 consensus_queue.cc:237] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.743424 25656 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:13.767400 25656 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.767855 25656 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:13.676631 25860 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.769407 25860 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.718861 25654 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.771620 25860 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:13.728801 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 343822us
I20260709 13:07:13.772565 25654 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:13.733582 25592 consensus_queue.cc:1059] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:07:13.772742 25838 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:13.773392 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.773773 25838 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.567459 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:07:13.732671 22004 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40934 (request call id 284) took 37872 ms (client timeout 15000 ms). Trace:
W20260709 13:07:13.741335 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 46638.1us
I20260709 13:07:13.708488 25981 consensus_queue.cc:1059] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:07:13.729915 25949 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.728484 25942 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:13.797749 25942 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.798134 25942 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.719488 25990 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:13.775817 22072 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:13.738389 22220 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:13.713677 25657 consensus_queue.cc:1059] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:07:13.776986 22002 catalog_manager.cc:5697] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 6 to 9, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 9 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:13.780150 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 44490.3us
I20260709 13:07:13.718954 26002 consensus_queue.cc:1059] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:07:13.713110 25970 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.792224 25828 consensus_queue.cc:1059] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:13.744590 25410 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:07:13.739421 26012 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:07:13.793677 25849 consensus_queue.cc:237] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.794629 25419 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.795691 25754 consensus_queue.cc:237] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.797176 25649 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:13.803907 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 65644.5us
I20260709 13:07:13.778419 22069 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:13.803566 25734 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.879490 25734 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:13.881137 22807 raft_consensus.cc:1240] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:13.794710 25567 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.883642 25649 consensus_queue.cc:1059] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:13.885640 26039 log.cc:927] Time spent T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 13:07:13.819224 22099 raft_consensus.cc:2393] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 12: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:07:13.784543 26027 consensus_queue.cc:1175] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "765d912bde9e48959e50d9efec3c26b6" responder_term: 8 status { last_received { term: 7 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:07:13.774813 22004 rpcz_store.cc:269] 0709 13:06:35.847505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.847659 (+   154us) service_pool.cc:224] Handling call
0709 13:07:13.720118 (+37872459us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:07.280612 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:07.456151 (+175539us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:07.456204 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:07:07.456223 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:07.457328 (+  1105us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:07.457416 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:07.457447 (+    31us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:07:07.458457 (+  1010us) tablet.cc:701] Row locks acquired
0709 13:07:07.458512 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:07:07.458734 (+   222us) write_op.cc:270] Start()
0709 13:07:07.458905 (+   171us) write_op.cc:276] Timestamp: P: 1783602427458663 usec, L: 0
0709 13:07:07.521000 (+ 62095us) op_driver.cc:348] REPLICATION: starting
0709 13:07:07.521767 (+   767us) log.cc:844] Serialized 3622 byte log entry
0709 13:07:08.437718 (+915951us) op_driver.cc:464] REPLICATION: finished
0709 13:07:08.615474 (+177756us) write_op.cc:301] APPLY: starting
0709 13:07:08.615598 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:08.615859 (+   261us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:08.615993 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:08.620511 (+  4518us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:08.624671 (+  4160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:07:08.624724 (+    53us) write_op.cc:312] APPLY: finished
0709 13:07:08.626317 (+  1593us) log.cc:844] Serialized 71 byte log entry
0709 13:07:08.626589 (+   272us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:08.626717 (+   128us) write_op.cc:454] Released schema lock
0709 13:07:08.626785 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:08.634497 (+  7712us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:08.634537 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":302214,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":177463,"apply.run_cpu_time_us":3531,"apply.run_wall_time_us":19015,"num_ops":9,"prepare.queue_time_us":525914,"prepare.run_cpu_time_us":85250,"prepare.run_wall_time_us":452770,"raft.queue_time_us":593706,"raft.run_cpu_time_us":1874,"raft.run_wall_time_us":27006,"replication_time_us":916559,"thread_start_us":870401,"threads_started":4,"wal-append.queue_time_us":280245,"wal-append.run_cpu_time_us":27999,"wal-append.run_wall_time_us":1841951}]]}
I20260709 13:07:13.888159 25825 consensus_queue.cc:260] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.804611 25949 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:13.808211 25654 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:13.876863 22220 leader_election.cc:400] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:13.815804 25946 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:13.899169 22102 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:13.802683 25656 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:13.839017 22002 catalog_manager.cc:5697] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 5 to 7, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 7 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } }
I20260709 13:07:13.903205 22220 leader_election.cc:403] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:13.909214 25885 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:13.909993 25419 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:13.910640 25419 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:13.815212 25583 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:13.804433 25889 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.913918 22220 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:13.784392 26023 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:13.897187 26038 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:07:13.918663 22251 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:13.928447 22220 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:13.929723 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 412980us
I20260709 13:07:13.926951 22002 catalog_manager.cc:5697] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:13.961624 22782 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:13.924832 25825 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.967254 22002 catalog_manager.cc:5697] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 4 to 6, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 6 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:13.996578 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 68240.5us
I20260709 13:07:13.944746 25946 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.003350 22177 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:14.004550 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:14.005409 22179 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:14.006577 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:13.889914 25942 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:14.011310 22002 catalog_manager.cc:5697] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 6, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 6 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:14.028045 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:13.933066 25583 raft_consensus.cc:697] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:14.038051 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:14.038823 22180 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:14.040678 22253 raft_consensus.cc:2393] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:14.042809 22181 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:14.042826 22250 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:13.959820 25783 raft_consensus.cc:697] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:13.925652 25990 consensus_queue.cc:1048] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:07:14.042516 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:13.963323 26023 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:14.041859 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:14.050174 22177 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:14.025647 26000 consensus_meta.cc:287] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 13:07:14.048199 22176 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:14.024227 25886 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:14.051846 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.038949 22220 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:13.996166 25881 raft_consensus.cc:697] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:13.993479 25885 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:14.047441 22002 catalog_manager.cc:5697] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 6 to 7, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 7 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:14.087602 22180 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:14.114157 22177 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:14.024567 25860 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
W20260709 13:07:14.124009 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 387354us
W20260709 13:07:14.130124 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.121409 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 343084us
I20260709 13:07:14.122432 22002 catalog_manager.cc:5697] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 5, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 5 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:14.139015 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:14.153347 22101 raft_consensus.cc:1240] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:14.155507 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:14.156359 22101 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
W20260709 13:07:14.160084 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.128623 25456 consensus_meta.cc:287] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.003s
I20260709 13:07:14.114260 25895 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:14.166879 22002 catalog_manager.cc:5697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 5 to 7, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 7 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:14.178295 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.191960 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:14.192710 22104 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:14.129858 25838 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:14.129420 25913 raft_consensus.cc:3055] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:14.196244 22173 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:14.197921 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:14.198493 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 159777us
I20260709 13:07:14.198669 25885 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:14.111873 25828 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 13:07:14.201438 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.211062 25947 raft_consensus.cc:697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:14.099642 26000 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:14.212491 25947 consensus_queue.cc:237] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:14.213380 26000 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:14.214092 22175 raft_consensus.cc:1240] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:14.096491 25886 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:14.203568 22178 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:14.203984 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:14.215405 22180 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:14.205719 22177 raft_consensus.cc:2393] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:14.199786 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:14.210319 22002 catalog_manager.cc:5697] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:14.209542 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:14.224920 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:14.225658 22177 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:14.231820 22002 catalog_manager.cc:5697] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 3 to 7, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 7 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:14.200534 25972 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.257273 25657 raft_consensus.cc:3055] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:14.231251 25895 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.200711 25914 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:14.210937 25885 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.137434 26046 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:07:14.183667 25583 consensus_queue.cc:237] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:14.210232 25846 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:14.221024 25981 raft_consensus.cc:3055] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:14.199903 25970 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:14.204819 25913 raft_consensus.cc:740] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:07:14.270834 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 64657.3us
I20260709 13:07:14.270509 25942 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:14.395138 22220 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:14.271785 22002 catalog_manager.cc:5697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 6 to 8, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 8 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:14.288189 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1908) took 1169 ms. Trace:
I20260709 13:07:14.292289 22147 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:14.268934 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:14.334352 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2262) took 1153 ms. Trace:
I20260709 13:07:14.234902 22218 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:14.336302 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 362366us
I20260709 13:07:14.397802 22104 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:14.325071 25815 consensus_meta.cc:287] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.000s
I20260709 13:07:14.361099 22177 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
W20260709 13:07:14.353441 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 214097us
I20260709 13:07:14.407824 22251 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:14.288341 26067 raft_consensus.cc:3055] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:14.292830 25734 raft_consensus.cc:3055] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:14.262818 25410 consensus_queue.cc:1059] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.133s
I20260709 13:07:14.291029 25649 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:07:14.330681 25657 raft_consensus.cc:740] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:14.288609 25656 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:14.396677 22175 rpcz_store.cc:276] 0709 13:07:13.119232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.391094 (+271862us) service_pool.cc:224] Handling call
0709 13:07:13.391395 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.214463 (+823068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.287905 (+ 73442us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b540031bfd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:14.288123 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891509120}
I20260709 13:07:14.406158 22220 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:14.397794 22174 rpcz_store.cc:276] 0709 13:07:13.181450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.405774 (+224324us) service_pool.cc:224] Handling call
0709 13:07:13.406013 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.406200 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:13.912425 (+506225us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.330229 (+417804us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.330298 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:14.330358 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.330441 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.334286 (+  3845us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78605,"prepare.queue_time_us":513228,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"thread_start_us":835201,"threads_started":2}
W20260709 13:07:14.408156 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 115950us
W20260709 13:07:14.409222 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 174378us
I20260709 13:07:14.355216 25885 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:14.334121 26015 consensus_meta.cc:287] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.695s	user 0.009s	sys 0.005s
I20260709 13:07:14.261878 25838 raft_consensus.cc:697] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:14.269407 25828 consensus_queue.cc:1059] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.126s
I20260709 13:07:14.270991 25483 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 13:07:14.334946 25972 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:14.391480 25981 raft_consensus.cc:740] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:14.428572 22002 catalog_manager.cc:5697] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 4 to 8, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 8 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:14.231884 25881 consensus_queue.cc:237] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:14.485625 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 326328us
I20260709 13:07:14.419314 25734 raft_consensus.cc:740] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:14.488040 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 81975us
I20260709 13:07:14.341727 25895 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:14.491854 22071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.008s	sys 0.009s
W20260709 13:07:14.606585 22071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.008s	sys 0.017s
I20260709 13:07:14.419871 25654 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:14.550119 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 141711us
W20260709 13:07:14.552687 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 62855.1us
I20260709 13:07:14.483824 22147 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:14.217594 25783 consensus_queue.cc:237] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:14.551584 25946 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:14.623646 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.577087 22101 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:14.583323 22002 catalog_manager.cc:5697] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 4 to 5, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 5 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:14.429138 25970 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:14.627563 22814 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.020s	sys 0.027s
W20260709 13:07:14.627781 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.627969 22814 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.021s	sys 0.027s
I20260709 13:07:14.630179 22814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 548) took 1294 ms. Trace:
I20260709 13:07:14.630666 22814 rpcz_store.cc:276] 0709 13:07:13.336315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.336512 (+   197us) service_pool.cc:224] Handling call
0709 13:07:13.336914 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.337167 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:13.734339 (+397172us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.629682 (+895343us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.629763 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:14.629830 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.629927 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.630103 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":652772,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":11024,"thread_start_us":1273309,"threads_started":2}
I20260709 13:07:14.624045 25838 consensus_queue.cc:237] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:14.649065 25946 raft_consensus.cc:697] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:14.658499 22002 catalog_manager.cc:5697] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:14.660038 25654 raft_consensus.cc:697] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:14.560940 26015 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:14.660945 22002 catalog_manager.cc:5697] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 6, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 6 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:14.419932 25815 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:14.486151 22104 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
W20260709 13:07:14.609018 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 799172us
W20260709 13:07:14.614882 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 131119us
W20260709 13:07:14.677410 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.679217 22147 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:14.413332 26067 raft_consensus.cc:740] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:14.684929 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:14.687242 22002 catalog_manager.cc:5697] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 4 to 7, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 7 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:14.691771 22176 consensus_meta.cc:287] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.001s
I20260709 13:07:14.697299 22147 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:14.637221 25970 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.713249 22176 raft_consensus.cc:2410] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:14.739429 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:14.614838 26051 consensus_queue.cc:1059] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.152s
I20260709 13:07:14.561208 26062 consensus_queue.cc:1059] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.160s
W20260709 13:07:14.753037 22172 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.030s	sys 0.063s
W20260709 13:07:14.769522 22172 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.030s	sys 0.063s
W20260709 13:07:14.770308 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 73126.4us
I20260709 13:07:14.770624 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 540) took 1453 ms. Trace:
I20260709 13:07:14.771148 22147 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:14.753931 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:14.771366 22172 rpcz_store.cc:276] 0709 13:07:13.317083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.411343 (+ 94260us) service_pool.cc:224] Handling call
0709 13:07:13.411690 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.411950 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:13.750455 (+338505us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.770141 (+1019686us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.770219 (+    78us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:14.770285 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.770375 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.770552 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16739,"prepare.queue_time_us":581936,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":3395,"raft.queue_time_us":435880,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7263,"thread_start_us":1330716,"threads_started":2}
W20260709 13:07:14.758508 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.704053 25567 consensus_meta.cc:287] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.821s	user 0.009s	sys 0.003s
I20260709 13:07:14.660533 25456 consensus_queue.cc:1059] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
W20260709 13:07:14.778751 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 84063.4us
I20260709 13:07:14.779706 22002 catalog_manager.cc:5697] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:14.781401 22002 catalog_manager.cc:5697] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:14.784384 22002 catalog_manager.cc:5697] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 2 to 6, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 6 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:14.786449 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 213568us
I20260709 13:07:14.788041 22002 catalog_manager.cc:5697] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 2 to 7, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 7 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:14.792820 22147 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:14.585469 25913 consensus_queue.cc:260] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:14.725629 25970 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:14.750316 26072 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:07:14.866206 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 78768.4us
W20260709 13:07:14.852787 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 227923us
I20260709 13:07:14.868497 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:14.869134 22816 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:14.740056 26076 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.150s
W20260709 13:07:14.869979 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.871320 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:14.695070 26015 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:14.872848 22814 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:14.869976 22144 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:14.873593 22002 catalog_manager.cc:5697] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 3 to 8, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 8 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:14.710177 25656 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
W20260709 13:07:14.897573 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 283599us
I20260709 13:07:14.794641 26002 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:14.902976 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:14.901559 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:14.902884 22218 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:14.924388 22002 catalog_manager.cc:5697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 5 to 8, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 8 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:14.957477 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:14.961338 22816 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:14.944327 22002 catalog_manager.cc:5697] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 5 to 7, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 7 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:14.972679 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 179942us
I20260709 13:07:14.973641 22104 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:14.945415 22097 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:14.979628 22147 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:14.778345 25654 consensus_queue.cc:237] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:14.914127 25889 consensus_meta.cc:287] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.984s	user 0.012s	sys 0.000s
I20260709 13:07:14.900346 25456 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:15.068725 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 89176.6us
I20260709 13:07:15.083256 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:14.740995 25734 consensus_queue.cc:260] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:14.791864 25946 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:15.099458 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 196638us
I20260709 13:07:15.100200 22002 catalog_manager.cc:5697] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:14.914572 25483 consensus_queue.cc:1059] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.177s
I20260709 13:07:15.062955 26002 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:14.912961 26062 consensus_queue.cc:1059] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.181s
I20260709 13:07:14.947005 26046 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.180s
I20260709 13:07:15.119289 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:15.052160 25846 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:15.132758 22002 catalog_manager.cc:5697] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 4 to 5, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 5 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.106829 26063 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:15.139858 26081 log.cc:927] Time spent T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:07:15.105190 26078 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:15.119719 25649 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:15.098737 26058 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:15.185930 22002 catalog_manager.cc:5697] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:07:15.188505 26073 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.580s	user 0.001s	sys 0.001s
I20260709 13:07:15.213327 22002 catalog_manager.cc:5697] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 7 to 8, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 8 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:14.979481 26067 consensus_queue.cc:260] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:15.158987 26104 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:15.195760 25656 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.247246 26062 raft_consensus.cc:3055] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:15.305414 26062 raft_consensus.cc:740] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:15.248553 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.262337 21993 maintenance_manager.cc:419] P 7bace290edae4f6bba4eb0d6a5b7d8c9: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033366
I20260709 13:07:15.227438 25815 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:15.208302 25483 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.225978 22002 catalog_manager.cc:5697] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 3 to 5, now has a pending config: VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65), VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66), VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67), NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 5 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:07:15.229748 26085 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:15.239797 25656 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:15.239594 26079 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
W20260709 13:07:15.241479 26057 log.cc:927] Time spent T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.338s	user 0.000s	sys 0.000s
I20260709 13:07:15.376617 25970 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:15.331141 25846 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.195293 26063 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:15.241323 26052 raft_consensus.cc:3055] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:15.240778 26005 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:15.244331 25914 raft_consensus.cc:3055] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:15.232964 25990 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:15.210707 25972 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:15.236093 26093 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 13:07:15.223016 26002 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:15.375682 26085 raft_consensus.cc:697] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:15.231921 26067 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:15.227073 26098 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:15.225791 25895 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:15.378261 25874 consensus_meta.cc:287] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.644s	user 0.014s	sys 0.000s
W20260709 13:07:15.390439 25949 consensus_meta.cc:287] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 1.465s	user 0.010s	sys 0.003s
I20260709 13:07:15.466589 22002 catalog_manager.cc:5697] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 5, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 5 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:15.397342 26052 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:15.388026 25947 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.012s	sys 0.001s
I20260709 13:07:15.485004 25649 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:15.485615 26062 consensus_queue.cc:260] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:15.480763 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1786) took 1295 ms. Trace:
W20260709 13:07:15.490639 22779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.088s	sys 0.136s
W20260709 13:07:15.495671 22144 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.080s	sys 0.218s
W20260709 13:07:15.498817 25947 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.012s	sys 0.004s
I20260709 13:07:15.499490 26062 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:15.402771 25914 raft_consensus.cc:740] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:07:15.502467 22779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.088s	sys 0.136s
W20260709 13:07:15.502810 22144 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.081s	sys 0.218s
I20260709 13:07:15.367177 25483 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:15.519630 26052 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:15.521371 25483 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:15.522061 26063 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:15.500032 22098 rpcz_store.cc:276] 0709 13:07:14.185331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.185495 (+   164us) service_pool.cc:224] Handling call
0709 13:07:14.185913 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.186203 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.186239 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.186820 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.418111 (+231291us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:14.418163 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.418253 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.480405 (+1062152us) raft_consensus.cc:1685] finished
0709 13:07:15.480436 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.480672 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":230950,"threads_started":1,"wal-append.queue_time_us":678422}
W20260709 13:07:15.506969 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 601699us
I20260709 13:07:15.398896 25846 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:15.479882 26015 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:15.508935 25914 consensus_queue.cc:260] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:15.508144 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.210328 26078 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:15.510690 22808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 980) took 1760 ms. Trace:
I20260709 13:07:15.501685 25949 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:15.577962 22808 rpcz_store.cc:276] 0709 13:07:13.750485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.750969 (+   484us) service_pool.cc:224] Handling call
0709 13:07:13.775323 (+ 24354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:13.775639 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.775667 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:13.804140 (+ 28473us) log.cc:844] Serialized 52 byte log entry
0709 13:07:14.125631 (+321491us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:14.125672 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.125740 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.510432 (+1384692us) raft_consensus.cc:1685] finished
0709 13:07:15.510457 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.510624 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4876,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":8161,"thread_start_us":308291,"threads_started":1,"wal-append.queue_time_us":1623308}
I20260709 13:07:15.438252 26005 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:15.582392 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 334413us
I20260709 13:07:15.516212 25656 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:15.587726 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:15.468161 25990 raft_consensus.cc:697] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:15.516786 26096 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:15.516824 25970 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:15.518878 25885 consensus_meta.cc:287] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.976s	user 0.010s	sys 0.000s
W20260709 13:07:15.526134 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 425791us
W20260709 13:07:15.529201 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 447564us
W20260709 13:07:15.554322 22219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.005s	sys 0.020s
W20260709 13:07:15.596088 22219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.005s	sys 0.020s
W20260709 13:07:15.596891 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.554862 22220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.006s	sys 0.019s
W20260709 13:07:15.584292 26094 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:07:15.489553 26002 raft_consensus.cc:697] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:15.586681 22144 connection.cc:256] RPC call timeout handler was delayed by -1.5889922809999462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30400000000000005s for a response
W20260709 13:07:15.590143 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.597451 22220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.006s	sys 0.019s
W20260709 13:07:15.548642 25825 consensus_meta.cc:287] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 1.521s	user 0.009s	sys 0.004s
I20260709 13:07:15.599632 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:15.650947 26107 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:15.647197 26100 consensus_queue.cc:1059] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:07:15.651842 26100 consensus_queue.cc:1243] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer c0694f6572bf406a92d55f1f2ab46ef2 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:15.651690 26107 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:15.652448 26100 raft_consensus.cc:3055] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:15.652834 26100 raft_consensus.cc:740] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:15.653131 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 596) took 1511 ms. Trace:
W20260709 13:07:15.654171 26108 log.cc:927] Time spent T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:15.653787 26100 consensus_queue.cc:260] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:15.596516 25885 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:15.655658 26049 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
I20260709 13:07:15.657760 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2048) took 2142 ms. Trace:
I20260709 13:07:15.657516 25981 consensus_queue.cc:260] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:15.650681 25990 consensus_queue.cc:237] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:15.599699 25656 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:07:15.664268 25734 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:15.658790 25981 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.666800 26083 raft_consensus.cc:3055] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:15.667268 26083 raft_consensus.cc:740] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:15.596999 25754 consensus_queue.cc:1059] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:07:15.669891 25754 raft_consensus.cc:3055] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:15.670244 25754 raft_consensus.cc:740] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:15.670428 26078 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:15.671367 26100 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:15.671511 25970 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.672106 25970 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:15.673678 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 597) took 1532 ms. Trace:
I20260709 13:07:15.603644 25947 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 13:07:15.678719 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 68319.4us
I20260709 13:07:15.679303 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:15.679692 22220 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:15.681937 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:15.682847 22250 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:15.658114 22254 rpcz_store.cc:276] 0709 13:07:13.515147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.520857 (+  5710us) service_pool.cc:224] Handling call
0709 13:07:13.521185 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:13.537939 (+ 16754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.537968 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:13.538493 (+   525us) log.cc:844] Serialized 52 byte log entry
0709 13:07:13.958399 (+419906us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:14.041757 (+ 83358us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.197726 (+155969us) spinlock_profiling.cc:243] Waited 944 us on lock 0x7b1800404ce0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4ddbc0a 00007f66ae51b219 00007f66a4e63a40 00007f66a4e5e4e4 00007f66a4e5e455 00007f66a7f46060 00007f66a7f58716 00007f66a7f69287 00007f66a7f69208
0709 13:07:14.199186 (+  1460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.199257 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.657420 (+1458163us) raft_consensus.cc:1685] finished
0709 13:07:15.657539 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.657699 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18136,"prepare.queue_time_us":83711,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":169601,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":175,"spinlock_wait_cycles":2170624,"thread_start_us":419495,"threads_started":1,"wal-append.queue_time_us":1815905}
W20260709 13:07:15.690971 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.693339 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 1.01606e+06us
I20260709 13:07:15.694144 22071 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:15.497303 26098 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:15.702601 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:15.698501 22097 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:15.653532 22102 rpcz_store.cc:276] 0709 13:07:14.141349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.141526 (+   177us) service_pool.cc:224] Handling call
0709 13:07:14.141984 (+   458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:14.142428 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.142466 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:14.145152 (+  2686us) log.cc:844] Serialized 52 byte log entry
0709 13:07:14.612783 (+467631us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:14.612839 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.613085 (+   246us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.652762 (+1039677us) raft_consensus.cc:1685] finished
0709 13:07:15.652781 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.653043 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2965,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":25007,"thread_start_us":395468,"threads_started":1,"wal-append.queue_time_us":1457527}
I20260709 13:07:15.701834 25943 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.702045 25563 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.702816 22103 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:15.674099 22099 rpcz_store.cc:276] 0709 13:07:14.141777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.141968 (+   191us) service_pool.cc:224] Handling call
0709 13:07:14.142324 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.187330 (+ 45006us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:14.199551 (+ 12221us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.571958 (+372407us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.572133 (+   175us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.610011 (+ 37878us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.610313 (+   302us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:14.613802 (+  3489us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.851542 (+237740us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b18004ac020. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e61522 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:07:15.383863 (+532321us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b18004ac020. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e61557 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:07:15.660816 (+276953us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b18004ac020. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:07:15.673158 (+ 12342us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b18004ac020. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4ddbc0a 00007f66ae51b219 00007f66a4e63a40 00007f66a4e5e4e4 00007f66a4e5e455 00007f66a7f46060 00007f66a7f58716 00007f66a7f69287 00007f66a7f69208
0709 13:07:15.673334 (+   176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.673421 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.673461 (+    40us) raft_consensus.cc:1685] finished
0709 13:07:15.673474 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.673620 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1053845,"prepare.queue_time_us":38159,"prepare.run_cpu_time_us":169,"prepare.run_wall_time_us":16211,"raft.queue_time_us":1078692,"raft.run_cpu_time_us":506,"raft.run_wall_time_us":39342,"spinlock_wait_cycles":202269440,"thread_start_us":313361,"threads_started":1,"wal-append.queue_time_us":637772}
I20260709 13:07:15.703024 25654 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:15.703138 25656 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.703581 26099 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.718607 25656 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:15.718817 26099 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:15.720408 22098 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:15.703724 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:15.704483 26034 raft_consensus.cc:3055] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:15.705353 25745 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:15.705957 26052 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:15.706404 25972 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.708765 25949 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:15.709676 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 600) took 1134 ms. Trace:
I20260709 13:07:15.710045 26111 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:15.708711 22220 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:15.648257 25649 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:07:15.715233 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:15.734786 22097 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:15.690137 25922 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.715914 26024 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:15.688856 25947 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.719568 25943 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:15.693034 26093 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:15.731693 22100 rpcz_store.cc:276] 0709 13:07:14.575503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.575658 (+   155us) service_pool.cc:224] Handling call
0709 13:07:14.621682 (+ 46024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.621898 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:14.914864 (+292966us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.709337 (+794473us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.709387 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:15.709432 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.709506 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.709619 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":768533,"prepare.queue_time_us":40974,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":51,"raft.queue_time_us":764615,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":9888,"thread_start_us":287294,"threads_started":1}
I20260709 13:07:15.761404 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:15.647503 25914 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:15.744740 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:15.763940 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:15.746649 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:15.746804 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:15.746939 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:15.746341 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.749055 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.726986 26034 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:15.738169 25886 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:15.758044 22097 raft_consensus.cc:2410] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:15.728368 25946 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:15.760244 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:15.761124 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet ebf4c9a0fe314a8db203637fffd1dc52: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:15.717178 25860 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:07:15.826936 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 132875us
I20260709 13:07:15.827883 22071 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:15.829026 22071 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:15.829902 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 60659.6us
I20260709 13:07:15.830143 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:15.830749 22106 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:15.762217 22102 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:15.791786 22179 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:15.602564 26096 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:15.763784 22098 raft_consensus.cc:1240] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:15.826089 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.723966 25563 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:15.830433 22071 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:15.844270 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:15.749643 26116 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:07:15.749660 25583 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.728768 25654 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:15.838299 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:15.845723 22248 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:15.850126 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:15.839474 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.839802 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:15.789891 22180 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:15.845413 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:15.853451 22181 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:15.731894 25972 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:15.850200 22105 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:15.850745 22179 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:15.847571 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:15.842800 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:15.761735 25874 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.881028 22172 raft_consensus.cc:2393] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 10: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:15.854070 22072 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:15.874369 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:15.882138 22100 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:15.884865 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:15.840554 22174 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:07:15.875087 22144 connection.cc:256] RPC call timeout handler was delayed by -1.1375677639999822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
I20260709 13:07:15.956468 22174 raft_consensus.cc:1240] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.956772 22144 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:15.945389 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:15.764349 26111 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:15.768457 26103 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:15.844977 26012 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:15.967119 22106 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:15.848201 26064 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:15.950649 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 66630.1us
I20260709 13:07:15.953856 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:15.954140 22102 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:15.976140 22181 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:15.959769 22255 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:15.960248 22098 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:15.944674 22103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:07:15.951951 25949 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.964818 22172 raft_consensus.cc:1240] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:07:15.854432 25886 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:16.029315 26099 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:16.029978 26099 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.762437 25981 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 13:07:15.952610 22254 raft_consensus.cc:2393] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:16.029323 26088 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:16.032580 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:16.033324 22254 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
W20260709 13:07:16.034119 26062 consensus_meta.cc:287] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.001s
I20260709 13:07:15.948882 25583 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:16.040213 25583 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:16.040856 22099 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:15.736042 25754 consensus_queue.cc:260] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:15.971592 22144 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:15.839439 25849 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.973106 22249 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.742138 26002 consensus_queue.cc:237] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:15.837985 26105 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:15.825332 26068 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.977264 22103 raft_consensus.cc:606] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:15.978161 22102 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:15.660553 26085 consensus_queue.cc:237] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:15.884282 25567 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:15.763356 25947 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.024717 25846 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:16.028072 25979 raft_consensus.cc:3055] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:15.948257 25410 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:16.029779 25886 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:15.962564 25874 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:16.029829 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 53599.9us
I20260709 13:07:16.061578 25583 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.034665 22254 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:15.825474 26000 raft_consensus.cc:3055] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:16.065419 25885 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:15.854617 25895 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:15.758880 26024 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:15.954712 25592 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:15.885310 25483 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:15.960973 25745 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:15.847677 25946 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:15.979197 26069 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.029342 26104 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.075436 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 230102us
W20260709 13:07:16.027511 26087 log.cc:927] Time spent T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 13:07:15.973214 26070 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:16.056910 26103 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.724210 26083 consensus_queue.cc:260] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:16.101023 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.109851 22254 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:16.064555 25849 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.110684 22249 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:07:15.885051 26077 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.779088 26093 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.113582 26097 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:15.750165 25922 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:15.958279 26111 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.114781 26096 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.075430 26068 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.066437 26105 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.030836 26099 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.041740 26064 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.158586 26098 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.046159 25949 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.090487 25979 raft_consensus.cc:740] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:15.979838 25657 consensus_queue.cc:260] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:16.283249 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 429053us
I20260709 13:07:16.285290 22097 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:16.066741 22100 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:16.063995 22103 raft_consensus.cc:614] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:16.296180 22101 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:16.060189 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 88704.9us
W20260709 13:07:16.303855 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.399057 25895 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:16.026469 22172 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:16.088975 22181 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:16.096874 22220 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:16.405511 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.405548 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:16.406073 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 315062us
W20260709 13:07:16.311687 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 174666us
I20260709 13:07:16.316545 22254 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:16.407863 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.408501 25846 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.381785 25745 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.409375 22181 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:16.409261 25846 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.332198 25563 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.409626 25745 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:16.331342 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.336064 25656 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.336839 25886 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:16.341949 25849 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:16.095944 25410 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.411667 25654 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:16.413228 22782 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:16.138841 25483 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.217212 25913 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.128895 25592 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.117165 25874 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.217643 25972 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:16.063647 26012 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:16.110380 26000 raft_consensus.cc:740] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:16.128129 26024 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:15.972714 26034 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.149737 26069 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.159515 26077 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.164750 26083 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.233422 26093 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:16.241293 26101 log.cc:927] Time spent T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.534s	user 0.000s	sys 0.002s
W20260709 13:07:16.221592 26102 log.cc:927] Time spent T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.514s	user 0.007s	sys 0.009s
I20260709 13:07:16.483366 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 708) took 2081 ms. Trace:
I20260709 13:07:16.485754 25947 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:16.483880 22253 rpcz_store.cc:276] 0709 13:07:14.401955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.403788 (+  1833us) service_pool.cc:224] Handling call
0709 13:07:14.474256 (+ 70468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.474668 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.474694 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.475221 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.065265 (+590044us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:15.065318 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.065400 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.240527 (+1175127us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:16.482567 (+242040us) raft_consensus.cc:1685] finished
0709 13:07:16.482617 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.483104 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":64288,"spinlock_wait_cycles":7974784,"thread_start_us":454096,"threads_started":1,"wal-append.queue_time_us":1203273}
I20260709 13:07:16.216743 26099 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:16.232481 26100 consensus_meta.cc:287] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.002s
I20260709 13:07:16.487960 25943 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.156901 26103 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.234345 26107 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:16.232708 26111 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:16.242275 26112 log.cc:927] Time spent T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.521s	user 0.002s	sys 0.000s
I20260709 13:07:16.143745 26104 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.232991 26105 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:16.216800 26106 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:16.240983 26117 log.cc:927] Time spent T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.533s	user 0.000s	sys 0.002s
W20260709 13:07:16.218178 26119 log.cc:927] Time spent T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
W20260709 13:07:16.216703 26120 log.cc:927] Time spent T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:07:16.348181 26098 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.377451 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 93217.6us
I20260709 13:07:16.370671 25979 consensus_queue.cc:260] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.388880 26127 consensus_queue.cc:1059] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:16.389667 26064 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:16.414665 25410 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:16.407806 22218 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:16.329845 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.123795 25583 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.528283 25874 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.529137 25874 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.529898 25583 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.409271 26113 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:16.333580 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.533289 26068 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.410941 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.535321 22181 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:16.536679 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.537858 25944 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:16.538687 26127 raft_consensus.cc:3055] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:16.539363 26127 raft_consensus.cc:740] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:16.538908 25944 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.540730 26127 consensus_queue.cc:260] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.543072 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:16.543543 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:16.544304 26137 log.cc:927] Time spent T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.313s	user 0.003s	sys 0.000s
I20260709 13:07:16.544998 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.459167 26023 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.459765 26034 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:16.461257 25745 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:16.463440 26075 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.754s	user 0.003s	sys 0.000s
I20260709 13:07:16.465824 25592 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:16.418150 25949 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.473752 25483 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:16.477146 26000 consensus_queue.cc:260] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.492190 26103 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:16.507320 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 85853.5us
I20260709 13:07:16.507365 25970 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.520285 22144 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:16.512187 26098 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.521219 25946 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:16.400107 25895 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.514225 26012 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:16.545749 26145 log.cc:927] Time spent T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:07:16.406598 22172 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:16.546674 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:16.499426 26106 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.516098 25979 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.542016 25944 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:16.525449 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 110520us
W20260709 13:07:16.497692 26134 log.cc:927] Time spent T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:07:16.414698 26074 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:16.573294 22072 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:16.575893 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 168329us
I20260709 13:07:16.582592 26098 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:16.582904 26005 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.562273 25889 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:16.583374 26104 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:16.590852 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.578162 26074 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:16.596096 26074 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:16.598265 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 183012us
I20260709 13:07:16.599994 22814 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:16.547504 26128 consensus_queue.cc:1175] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "79683575881f4334bd4dc6d9bdbb45c3" responder_term: 11 status { last_received { term: 6 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11. Ops: [8.8-10.9]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:07:16.583587 25734 consensus_meta.cc:287] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.919s	user 0.019s	sys 0.002s
I20260709 13:07:16.610652 22807 raft_consensus.cc:1240] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:07:16.610525 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 211770us
I20260709 13:07:16.614152 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:16.615377 22218 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:16.616263 22144 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:16.590895 25846 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:16.584115 25947 raft_consensus.cc:2764] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:07:16.620734 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.606485 25483 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:16.619282 26000 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.624500 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.626784 26093 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:16.623560 25821 consensus_queue.cc:1059] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:07:16.626780 25592 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:16.583105 26023 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.635232 22181 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:16.629123 25483 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.627617 26106 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:16.632829 22071 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:16.640941 25592 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.643886 25483 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:16.658685 26077 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:16.647178 26012 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.654686 25592 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.653839 25874 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:16.670329 22220 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:16.711562 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 60375.4us
I20260709 13:07:16.712642 26098 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:16.713112 26098 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.713516 26098 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:16.714422 26133 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.497s	user 0.002s	sys 0.000s
W20260709 13:07:16.716135 26089 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.995s	user 0.001s	sys 0.003s
I20260709 13:07:16.671974 25410 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:16.717051 25410 raft_consensus.cc:697] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:16.718237 25410 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.673321 26002 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.676256 25922 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:16.679827 25889 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:07:16.683230 26135 log.cc:927] Time spent T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.444s	user 0.000s	sys 0.003s
I20260709 13:07:16.722368 25889 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.687213 26100 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:16.687904 22253 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:16.691589 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:16.695040 25419 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:16.727255 25419 raft_consensus.cc:697] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:16.728497 25419 consensus_queue.cc:237] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.729076 25657 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:16.696014 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.731808 25922 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:07:16.678643 25914 consensus_meta.cc:287] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.853s	user 0.015s	sys 0.009s
I20260709 13:07:16.703305 26106 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:16.678678 26069 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.737902 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:16.708320 26143 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:07:16.721745 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:16.699407 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 77078us
W20260709 13:07:16.737391 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.738111 26149 log.cc:927] Time spent T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:07:16.738430 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.704911 25837 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.742970 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:16.745227 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 129154us
I20260709 13:07:16.745157 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:16.755041 22179 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.755297 22247 raft_consensus.cc:2410] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:16.759526 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:16.761534 22144 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:16.761860 26069 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:16.759636 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:16.775780 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:16.777550 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:16.778537 26093 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.753680 25483 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.783329 26085 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:16.783596 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:16.784133 26085 raft_consensus.cc:697] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:16.785291 25483 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:16.785413 26085 consensus_queue.cc:237] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.749305 26012 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:16.787925 26012 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.790163 26012 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:16.791553 22178 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:16.792162 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:16.793285 22071 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:16.794188 22071 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:16.794961 25874 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:16.795189 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:16.795361 25874 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.795805 25874 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:16.796015 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.796536 26052 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.753337 26113 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:16.797088 26052 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.798062 25754 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.753436 26106 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.799165 25821 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:16.799388 26052 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:16.799504 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:16.800637 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:16.800894 26106 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:16.802543 26023 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.805631 25895 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.807497 25734 raft_consensus.cc:3055] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:16.754828 25837 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:16.838999 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 177241us
W20260709 13:07:16.840231 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.840598 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.841073 25837 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:16.808012 26128 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:16.841602 25837 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.841922 26128 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.842413 26128 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.842089 25837 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.843196 22807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47484
I20260709 13:07:16.844028 22807 raft_consensus.cc:606] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
W20260709 13:07:16.844239 26152 log.cc:927] Time spent T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260709 13:07:16.810688 25947 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:16.844748 26098 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.845534 25947 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:16.846006 25947 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.846292 22781 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:16.810974 26127 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.849293 26083 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:16.849620 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.849843 26083 raft_consensus.cc:697] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:16.850283 22181 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:16.851249 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.813699 22816 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:16.762789 26069 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:16.814385 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:16.817865 22147 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:16.818115 25889 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:16.820531 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 51435us
I20260709 13:07:16.820881 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.822285 22177 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:16.823478 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.821269 25874 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:16.891510 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 45312.5us
I20260709 13:07:16.824631 22071 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:16.835572 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.835244 26077 consensus_queue.cc:1059] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:16.829425 25734 raft_consensus.cc:740] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:16.850859 26083 consensus_queue.cc:237] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.812018 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:16.852533 22808 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:16.822365 25592 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.888152 22181 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:16.896469 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.912240 22179 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
W20260709 13:07:16.913796 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 89300us
I20260709 13:07:16.915086 22071 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:16.916770 25745 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:16.917186 25745 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.917538 25745 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.919158 26012 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:16.919708 26012 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:16.920136 26012 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.925815 25889 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.928217 26077 raft_consensus.cc:3055] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:16.928694 26077 raft_consensus.cc:740] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:16.929338 25837 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:16.929628 26077 consensus_queue.cc:260] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.931177 22180 raft_consensus.cc:2393] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 7: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:07:16.931099 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 113494us
I20260709 13:07:16.932065 26069 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:16.932614 26069 raft_consensus.cc:697] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:16.933569 26069 consensus_queue.cc:237] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:16.889437 26093 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:16.935304 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.936698 26106 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.937309 26106 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:16.938272 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 126349us
I20260709 13:07:16.939363 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:16.939910 22144 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:16.941073 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:16.941571 25592 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.943413 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:16.943763 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.944108 22249 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:16.941002 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:16.945642 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.947105 22246 raft_consensus.cc:2410] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:07:16.949311 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:16.949647 26104 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:16.950147 22251 raft_consensus.cc:2393] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 10: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:16.951216 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.950076 26104 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:16.895785 26098 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:16.958261 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.965485 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.961905 26104 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.948282 25889 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:16.960377 26077 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:16.987807 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:16.994745 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 54895.4us
I20260709 13:07:16.947633 26074 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:16.988749 22246 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
I20260709 13:07:16.965545 26000 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:17.000888 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:17.004997 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:16.980584 26023 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:16.976444 25914 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:07:16.998257 25990 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.016s	sys 0.016s
I20260709 13:07:17.016965 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:17.021927 25990 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.017s	sys 0.016s
I20260709 13:07:17.022363 22251 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:17.034413 22097 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:17.047351 22174 raft_consensus.cc:1275] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:16.969059 25734 consensus_queue.cc:260] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.047397 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:17.054944 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.056473 25838 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:17.057435 22781 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:17.059366 26052 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:17.059813 22248 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:17.055014 25860 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.060983 25860 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:17.039894 22177 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:17.065200 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.066068 22101 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 7.
I20260709 13:07:17.068017 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:17.074899 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 79129.3us
I20260709 13:07:17.025213 26106 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:17.058444 25838 consensus_queue.cc:1059] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:17.088518 22104 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:17.089041 26074 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:17.086853 25914 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.097853 25745 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.100487 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:17.101749 22100 raft_consensus.cc:1240] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:17.102499 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.103456 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.106304 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:17.107038 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:17.107088 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:17.107940 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:17.108443 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:17.108659 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:17.116935 22105 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:17.048362 25874 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:17.094349 26012 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:17.109618 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:17.110567 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:17.016149 25889 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.109162 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:17.127626 22176 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:17.049834 26023 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:17.119153 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 71243.4us
I20260709 13:07:17.132190 26074 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.132717 22813 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:17.118790 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:17.125447 22807 raft_consensus.cc:2393] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 10: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:17.135437 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.138991 22101 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:17.137905 22103 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:17.138229 22106 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:07:17.141234 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:17.141645 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:17.143100 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.143342 22098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:07:17.143774 22106 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:17.143882 25889 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:17.144807 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:17.118465 26127 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.146093 26127 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.147878 26023 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:17.148293 26127 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:17.148821 22102 raft_consensus.cc:2410] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:07:17.144847 22179 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:17.141247 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:17.135454 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.143931 22098 raft_consensus.cc:606] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:17.150305 22808 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:17.137905 26074 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.193137 22250 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:07:17.127702 25838 consensus_queue.cc:1243] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:17.194217 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:17.196548 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:17.189692 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.201608 22100 raft_consensus.cc:2393] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:17.205951 22181 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:17.209445 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:17.209779 22105 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:17.210717 22179 raft_consensus.cc:3055] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:17.211129 22179 raft_consensus.cc:740] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:17.212219 22179 consensus_queue.cc:260] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:17.213613 22179 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:17.216090 26106 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:17.216447 26012 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:17.216816 26106 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.219092 25838 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:17.219511 26104 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.200533 26000 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.223145 25922 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:17.223333 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.222798 26000 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:17.227083 22106 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:17.233628 22103 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:17.236989 22218 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:17.240357 22097 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:17.239605 22247 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:17.233021 26106 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:17.194682 26128 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.226323 25922 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.242043 26155 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.253s
I20260709 13:07:17.355744 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:17.585770 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.262794 22099 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:07:17.359223 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.552243 22181 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
W20260709 13:07:17.594638 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 357705us
I20260709 13:07:17.376713 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.599643 22103 raft_consensus.cc:2393] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:17.398578 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.284768 22779 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:17.601411 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 544025us
I20260709 13:07:17.596160 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.332441 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:17.579944 26166 log.cc:927] Time spent T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
W20260709 13:07:17.511478 26143 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:17.611158 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.608896 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.626561 22100 raft_consensus.cc:2393] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 9: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:07:17.446333 26162 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
W20260709 13:07:17.392819 25947 consensus_meta.cc:287] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.533s	user 0.012s	sys 0.000s
I20260709 13:07:17.618568 22098 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
W20260709 13:07:17.629755 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 346822us
I20260709 13:07:17.285686 25745 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:17.541859 25860 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:17.604224 26052 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:17.276983 25821 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.343612 26104 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:17.277987 26128 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:17.252621 26012 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:17.597117 26000 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:17.278139 26127 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:17.613556 26160 log.cc:927] Time spent T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.376s	user 0.001s	sys 0.001s
I20260709 13:07:17.636677 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.674829 22072 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:17.653555 25942 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:17.604017 26023 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.262571 25914 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:17.610003 26092 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.647971 22218 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:17.653293 26002 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:17.653484 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.666349 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.647657 26074 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:17.680097 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 347754us
I20260709 13:07:17.374475 26106 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.696847 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:17.697167 26165 log.cc:927] Time spent T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:17.641016 25947 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:17.686316 26173 log.cc:927] Time spent T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:07:17.681318 26171 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:17.692528 26128 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:17.697443 26051 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:17.678375 26154 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:07:17.672708 26012 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:17.729868 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:17.732867 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.661202 25821 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.736511 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:17.690105 26023 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.723204 26128 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:17.744997 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:17.727341 26051 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:17.743673 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 107927us
I20260709 13:07:17.706563 26106 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:17.749347 22181 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 6.
I20260709 13:07:17.703636 26092 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.748322 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:17.753433 22180 raft_consensus.cc:2410] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:17.738772 25914 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:17.711377 26127 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:17.693753 25942 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.750872 22106 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:17.751322 22179 raft_consensus.cc:2410] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:17.746434 22101 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 6.
I20260709 13:07:17.722635 26000 consensus_queue.cc:1059] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:07:17.764529 26023 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:17.765599 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.747062 26128 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:17.747423 26051 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.773841 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.775121 22104 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:17.785176 22098 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:17.764940 25922 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:17.787281 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:17.795812 22176 consensus_meta.cc:287] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.646s	user 0.009s	sys 0.001s
I20260709 13:07:17.796240 22176 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:17.742769 26171 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.774187 26000 consensus_queue.cc:1243] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer c0694f6572bf406a92d55f1f2ab46ef2 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:17.801024 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.801452 22181 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:17.801656 22106 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:17.777509 26023 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:17.808925 26169 log.cc:927] Time spent T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:07:17.810313 26069 raft_consensus.cc:3055] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:17.812665 25947 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:17.813552 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.814877 22102 raft_consensus.cc:2410] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:17.788956 26103 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:17.836537 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:17.844458 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.810858 26069 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:17.848762 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 215542us
I20260709 13:07:17.840233 22220 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:17.856884 26178 consensus_queue.cc:1059] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:17.831120 25874 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.856874 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:17.875391 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:17.879285 22779 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:17.882154 25860 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:17.883761 22144 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:17.883455 26069 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:17.884994 26069 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:17.885141 22144 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:17.892515 26002 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:17.897727 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 57632.4us
I20260709 13:07:17.899166 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:17.848412 26023 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:17.902096 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:17.899868 22248 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:17.886349 26085 raft_consensus.cc:3055] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:17.905813 26188 consensus_queue.cc:1059] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:07:17.906833 26170 log.cc:927] Time spent T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:07:17.905861 25942 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:17.908490 25942 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:17.909072 25942 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:17.910310 26012 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:17.910905 26012 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.911444 26012 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:17.913552 22071 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:17.913688 26012 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:17.868155 25922 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:07:17.918490 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:17.889775 26178 raft_consensus.cc:2764] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:17.893082 26002 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.870147 26083 consensus_queue.cc:1059] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:07:17.899343 26100 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:17.901566 26093 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:17.930584 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.902197 26106 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:17.930194 25947 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:17.926785 26092 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:17.931267 26093 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.935649 26093 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:17.932216 22098 raft_consensus.cc:2393] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:17.893502 25874 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:17.945564 26104 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:17.946353 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1944) took 2201 ms. Trace:
I20260709 13:07:17.916281 26085 raft_consensus.cc:740] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:17.923511 26181 raft_consensus.cc:3055] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:17.955226 25947 raft_consensus.cc:697] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:17.955582 26085 consensus_queue.cc:260] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:17.956815 26085 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:17.956557 25947 consensus_queue.cc:237] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.956532 22175 rpcz_store.cc:276] 0709 13:07:15.744821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.744952 (+   131us) service_pool.cc:224] Handling call
0709 13:07:15.745341 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.745791 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.745828 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:15.746278 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.704418 (+958140us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b180046a3e0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee0d1 00007f66a7f09a0f
0709 13:07:17.007625 (+303207us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:17.908260 (+900635us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b180046a3e0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a7af64bc 00007f66a4e4448b 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e5e455 00007f66ab9463c7 00007f66a7f589a7 00007f66a7f680bf
0709 13:07:17.908401 (+   141us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.945374 (+ 36973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.945894 (+   520us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.945928 (+    34us) raft_consensus.cc:1685] finished
0709 13:07:17.945958 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.946201 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53072,"prepare.queue_time_us":207976,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":38536,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":63320,"spinlock_wait_cycles":23256832,"thread_start_us":485321,"threads_started":3,"wal-append.queue_time_us":1305829}
I20260709 13:07:17.956261 26195 raft_consensus.cc:993] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:07:17.955595 26181 raft_consensus.cc:740] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:17.961035 26198 raft_consensus.cc:1081] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Signalling peer 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:07:17.961171 22071 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:17.962267 26198 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:17.962766 26198 raft_consensus.cc:697] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:07:17.934809 26077 consensus_meta.cc:287] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.936s	user 0.004s	sys 0.008s
I20260709 13:07:17.963881 26104 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:17.927079 26002 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:17.928944 26100 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.930958 26012 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:17.979519 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:17.932049 26127 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:17.968056 25821 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:17.968277 26000 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:07:17.970114 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:17.983355 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:17.924220 25860 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:07:17.987423 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:17.987927 22098 raft_consensus.cc:2393] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:17.988004 22102 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:17.988973 25942 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:17.989454 22100 raft_consensus.cc:1240] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:17.993283 25838 raft_consensus.cc:993] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: : Instructing follower 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:07:17.993865 25838 raft_consensus.cc:1081] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Signalling peer 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:07:17.994709 26023 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:17.985605 26181 consensus_queue.cc:260] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:17.999985 26181 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.000931 26171 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:18.004729 25874 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:18.005054 22099 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:18.005641 26198 consensus_queue.cc:237] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.008265 22104 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13. Ops: [7.4-12.7]
I20260709 13:07:17.983999 26012 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.011300 26012 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.016657 22254 raft_consensus.cc:1275] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:17.988384 22248 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
W20260709 13:07:18.027987 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.029785 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.029943 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.031062 22255 raft_consensus.cc:2410] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:18.031867 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:17.984567 26100 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.029842 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.030082 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.038669 22246 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
W20260709 13:07:18.040459 26167 log.cc:927] Time spent T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.628s	user 0.002s	sys 0.000s
I20260709 13:07:18.027478 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:18.062378 26192 log.cc:927] Time spent T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:07:18.065474 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.067481 22254 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:18.067703 22100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:07:18.068444 26191 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.069252 22144 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:18.069521 26191 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.072135 26191 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:18.068498 22100 raft_consensus.cc:606] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:18.072677 22100 raft_consensus.cc:614] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:18.075032 26197 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:18.080681 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.081311 22251 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:18.080067 22102 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:18.084115 22249 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
W20260709 13:07:18.085399 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 167831us
I20260709 13:07:18.086076 22220 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:18.086625 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1971) took 1070 ms. Trace:
I20260709 13:07:18.067020 25914 raft_consensus.cc:697] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:18.088316 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.054279 26128 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.077031 26093 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.102394 22172 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:18.102726 22220 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:18.100843 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:18.140983 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.189421 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 86780.4us
W20260709 13:07:18.277556 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 208348us
I20260709 13:07:18.278820 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:18.089615 26197 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:18.280642 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:18.281487 22179 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:07:18.279641 22180 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.087033 22173 rpcz_store.cc:276] 0709 13:07:17.014138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.014264 (+   126us) service_pool.cc:224] Handling call
0709 13:07:17.028848 (+ 14584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.041947 (+ 13099us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:17.967109 (+925162us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b180008b7e0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a7af64bc 00007f66a4e4448b 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e5e455 00007f66ab9463c7 00007f66a7f589a7 00007f66a7f680bf
0709 13:07:17.967280 (+   171us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.083259 (+115979us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.083314 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:18.084541 (+  1227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.084588 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.084661 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43214,"prepare.queue_time_us":247859,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":26177,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":117,"spinlock_wait_cycles":45225984,"thread_start_us":309134,"threads_started":2}
I20260709 13:07:18.091641 25889 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:18.085007 26002 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:18.288805 22220 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:18.296272 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:18.299530 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:18.300001 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 109655us
I20260709 13:07:18.300859 22249 raft_consensus.cc:2368] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11.
I20260709 13:07:18.302846 22178 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:18.304756 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:18.305583 22178 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:18.307459 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:18.309628 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:18.309780 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:18.310977 22173 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.311174 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2273) took 2356 ms. Trace:
I20260709 13:07:18.312573 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:18.313885 22178 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:18.289417 26191 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.299010 26000 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.188259 26077 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.316812 22174 rpcz_store.cc:276] 0709 13:07:15.954684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.957315 (+  2631us) service_pool.cc:224] Handling call
0709 13:07:15.957576 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.076383 (+1118807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.294732 (+1218349us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400069354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:18.311022 (+ 16290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2315019392}
I20260709 13:07:18.313653 25914 consensus_queue.cc:237] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:18.315279 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.314898 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.315804 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:18.316181 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:18.317322 22100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:07:18.325229 22071 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:18.315824 22255 raft_consensus.cc:1240] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:18.320951 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:18.326650 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.324898 22173 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:18.319423 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:18.338356 22172 raft_consensus.cc:2410] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:18.336656 22100 raft_consensus.cc:606] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:18.338752 22100 raft_consensus.cc:614] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:18.334851 22180 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:18.344308 22252 raft_consensus.cc:2393] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 11: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:18.344498 22175 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:07:18.345016 22175 pending_rounds.cc:85] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 7
I20260709 13:07:18.293030 25889 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:18.320292 26183 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.509s	user 0.001s	sys 0.001s
I20260709 13:07:18.316843 22179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:07:18.417809 22179 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:18.418255 22179 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.319851 26002 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:18.345356 22175 pending_rounds.cc:107] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:07:18.207010 26051 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.420281 22175 raft_consensus.cc:2889] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:18.425022 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 76696.3us
I20260709 13:07:18.427801 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.431079 26204 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:18.431635 26204 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:18.432107 26204 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.432166 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 732) took 1301 ms. Trace:
I20260709 13:07:18.432721 22253 rpcz_store.cc:276] 0709 13:07:17.131096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.138592 (+  7496us) service_pool.cc:224] Handling call
0709 13:07:17.138959 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.199983 (+ 61024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.200027 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.225731 (+ 25704us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.712077 (+486346us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:17.712127 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.712256 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.319524 (+607268us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:18.431761 (+112237us) raft_consensus.cc:1685] finished
0709 13:07:18.431799 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.432085 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24496,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5845,"spinlock_wait_cycles":10700544,"thread_start_us":455705,"threads_started":1,"wal-append.queue_time_us":540039}
I20260709 13:07:18.434958 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:18.435304 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.436201 22248 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:18.436492 22253 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:18.333660 25874 consensus_queue.cc:1059] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:07:18.327642 26000 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:18.440235 26000 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:18.440899 26201 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:18.420837 25860 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:07:18.427750 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.445438 22252 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:18.448401 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.449453 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.450340 22248 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:18.451488 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.452770 22247 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 6.
I20260709 13:07:18.418378 25889 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.348829 26198 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:18.355312 25419 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:18.459681 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.461930 22253 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:18.320346 26191 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:18.466858 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.420291 26085 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.419685 26202 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.471868 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:18.467187 22072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.839s (SENT) [suppressed 9 similar messages]
I20260709 13:07:18.422876 26077 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.501905 26077 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:18.479748 25419 raft_consensus.cc:697] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:18.480547 26093 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:18.481472 26128 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:18.471433 26198 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.484239 26191 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:18.484186 26103 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:18.484766 22782 leader_election.cc:400] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11.
I20260709 13:07:18.518460 22782 leader_election.cc:403] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:18.485020 22249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:45738
I20260709 13:07:18.519259 22249 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:18.519730 22249 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:18.485365 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:18.520699 22178 raft_consensus.cc:2368] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11.
I20260709 13:07:18.486307 22181 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:18.489205 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.522542 22246 raft_consensus.cc:2410] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:18.453223 26104 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:18.476081 26000 consensus_queue.cc:1059] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:07:18.490195 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.490859 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:18.482844 22147 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:18.495124 22179 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.497731 26012 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:18.498577 26202 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:18.525743 22248 raft_consensus.cc:2410] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:18.444748 26027 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:07:18.346469 26100 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.526160 22247 raft_consensus.cc:2393] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 13: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:07:18.527174 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 53955.2us
I20260709 13:07:18.525851 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:18.531446 22100 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.532727 26092 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.532953 22179 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:18.533885 26051 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:18.535369 26000 raft_consensus.cc:3055] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:18.535851 26000 raft_consensus.cc:740] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:18.536702 26000 consensus_queue.cc:260] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.537993 26000 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.539440 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:18.539462 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:18.542598 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:18.542950 26201 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:18.543182 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 60433.4us
I20260709 13:07:18.513530 26085 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.544152 22147 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:18.545473 26085 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:18.546095 26085 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:18.542634 26197 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.547072 25889 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:18.547308 25419 consensus_queue.cc:237] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:18.547839 26197 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.549365 25889 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:18.550249 26197 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:18.516535 26198 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.551041 26209 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:18.551640 26209 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.554056 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:18.554687 26012 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:18.555555 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:18.556139 22105 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:18.543308 22098 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:18.559327 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:18.559947 22097 raft_consensus.cc:1813] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Handling vote request from an unknown peer 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:18.560513 22097 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:18.523934 26103 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.546775 22147 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:18.564630 26100 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:18.565099 22147 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:18.558359 22249 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.565783 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:18.567451 22782 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:18.569540 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.546257 26204 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.600173 22144 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:18.601794 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 77776.2us
I20260709 13:07:18.603024 22249 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:18.602375 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:18.607390 22099 raft_consensus.cc:3055] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:18.606074 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 305356us
I20260709 13:07:18.607795 22099 raft_consensus.cc:740] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:07:18.608238 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 261635us
I20260709 13:07:18.610574 22071 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:18.586386 25657 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:18.545485 26202 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:18.613062 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:18.613549 22246 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:18.622613 22807 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.610468 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:18.609460 22097 pending_rounds.cc:85] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 4
I20260709 13:07:18.600915 26051 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:18.625917 22248 raft_consensus.cc:1240] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:18.623438 22253 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.623454 22097 pending_rounds.cc:107] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:07:18.614437 22099 consensus_queue.cc:260] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.627489 22097 raft_consensus.cc:2889] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:18.628000 22099 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.624670 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:18.626700 22071 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:18.605597 26201 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:18.607604 26196 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:18.626195 26077 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.636880 26012 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:18.638209 22218 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:18.638607 26190 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:18.626180 26051 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.643602 22220 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:18.644225 26085 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.670758 26085 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:18.672910 25837 raft_consensus.cc:3055] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:18.673336 25837 raft_consensus.cc:740] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:18.673575 26085 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:18.674381 26210 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:18.644629 26197 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:18.647897 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:18.675338 26197 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:18.678021 22218 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:18.679279 22815 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:18.679451 25889 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:18.634730 26201 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:18.680289 26201 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.680505 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:18.681777 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:18.648711 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2072) took 1711 ms. Trace:
I20260709 13:07:18.674890 26210 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:18.683805 26210 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.644661 22069 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:18.682627 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:18.688020 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:18.688223 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:18.689270 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:18.689493 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:18.690239 22810 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.651683 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:18.691318 22808 raft_consensus.cc:2368] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10.
I20260709 13:07:18.691833 26128 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:18.693496 26128 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.693858 26128 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.695143 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:18.695940 22103 raft_consensus.cc:2393] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 9: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:18.696797 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:18.697562 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:18.697849 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:18.698410 22179 raft_consensus.cc:2410] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:18.698649 22103 raft_consensus.cc:2393] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:18.651935 26196 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.752137 26196 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:18.752351 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:18.753719 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:18.669616 26077 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.695291 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:18.674182 25837 consensus_queue.cc:260] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.679296 22218 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:18.699508 26209 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:18.663988 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.761698 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.665722 26106 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:18.703208 22178 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:18.706027 22102 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:18.659260 26181 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.661514 26012 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:18.711045 22098 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:18.711509 26051 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.712414 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:18.712548 25734 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:18.713583 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.714617 22220 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:18.716986 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:18.717716 22176 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:18.718858 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:18.798406 22173 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:18.683151 22250 rpcz_store.cc:276] 0709 13:07:16.937197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.940592 (+  3395us) service_pool.cc:224] Handling call
0709 13:07:16.944014 (+  3422us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5800111698. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:07:16.944178 (+   164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.201415 (+257237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.648420 (+1447005us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54002292d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:18.648645 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":574561280}
I20260709 13:07:18.663722 26190 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.719907 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:18.800060 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 120827us
I20260709 13:07:18.721807 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:18.800972 22175 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:18.801043 22218 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:18.722678 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:18.726446 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:18.802358 22181 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.796914 22174 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:18.727406 26204 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:18.728169 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:18.729076 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:18.739450 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:07:18.811918 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 97412.3us
I20260709 13:07:18.678256 26197 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:18.653718 22807 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:18.682833 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:18.814638 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:18.754848 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:18.761930 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 294777us
I20260709 13:07:18.816843 22069 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:18.763319 22144 leader_election.cc:336] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Timed out: RequestConsensusVote RPC to 127.20.130.68:35973 timed out after 1.532s (SENT)
I20260709 13:07:18.818354 22144 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:18.658874 22105 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
W20260709 13:07:18.781997 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.783926 22253 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:18.792948 22099 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:18.759214 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:18.752365 26092 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11.
I20260709 13:07:18.817885 22813 raft_consensus.cc:2393] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:18.720041 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:18.817417 26106 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:18.822204 22104 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:07:18.822389 22103 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:18.823426 22815 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:18.823808 22218 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:18.824764 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:18.825557 22178 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.792197 26012 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.762184 26155 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:07:18.796288 25837 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:18.830735 22105 raft_consensus.cc:1240] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:18.761915 26179 consensus_queue.cc:1059] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:07:18.790160 26209 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:18.839423 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:18.810875 26190 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:18.834378 22812 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:18.846782 22815 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:18.843681 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:18.842960 22811 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:18.849274 22176 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:07:18.846686 22071 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:18.788651 26198 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.792465 26181 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:18.860001 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.840145 25874 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:18.834597 26106 raft_consensus.cc:697] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:07:18.867089 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 103812us
I20260709 13:07:18.868988 22072 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:18.871886 22779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.013s	sys 0.013s
W20260709 13:07:18.872437 22779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.013s	sys 0.013s
I20260709 13:07:18.896202 22782 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:18.898406 22181 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:18.904767 22072 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:18.852203 25889 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:18.909063 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 43526.3us
I20260709 13:07:18.913103 22781 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:18.904976 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:18.911567 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:18.911669 22808 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
W20260709 13:07:18.910807 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 134178us
I20260709 13:07:18.914350 22811 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.919500 22781 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:18.862097 25860 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:18.855155 26208 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:18.832741 26210 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:18.924512 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:18.847709 26195 consensus_queue.cc:1048] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:07:18.906528 25942 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:18.924870 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:18.925247 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:18.959365 22144 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:18.867676 26127 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:18.930545 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:18.974129 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 88861.8us
W20260709 13:07:18.985165 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 149636us
W20260709 13:07:18.975041 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 121874us
I20260709 13:07:18.994065 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:18.913760 26000 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:18.991998 22218 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:18.931088 26128 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:18.931861 25860 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:18.943101 26208 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.948450 26202 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:18.945169 25657 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:18.991926 25942 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:18.933646 26077 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:19.055617 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:19.045979 22144 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:19.009218 25846 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:19.098862 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.913452 26103 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:19.114306 26104 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.114784 26228 log.cc:927] Time spent T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:07:19.054206 25860 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.069867 25821 consensus_queue.cc:1059] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.083s
W20260709 13:07:19.190773 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 198882us
I20260709 13:07:19.119771 22106 raft_consensus.cc:2368] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:19.183187 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:19.200743 22815 raft_consensus.cc:1813] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Handling vote request from an unknown peer 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:19.201493 22815 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:19.180372 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:19.205057 22812 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:19.099323 26085 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:19.070127 26208 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:19.099752 26179 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:19.105110 25942 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:19.238641 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 319501us
I20260709 13:07:19.182016 26002 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.131726 26204 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.152751 26100 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:19.244750 22781 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:19.183176 26210 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:19.183629 26178 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:19.247682 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:19.143646 25657 raft_consensus.cc:697] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:19.115587 26093 consensus_queue.cc:1059] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.137s
I20260709 13:07:19.254467 22181 raft_consensus.cc:1240] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:19.255544 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:19.171481 26227 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:19.063556 26000 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:19.259503 22811 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:19.210752 26198 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:19.262771 22781 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:19.223037 26085 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.267683 22808 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:19.246851 22218 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:18.931874 22000 catalog_manager.cc:5697] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 7 to 8, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 8 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:19.269927 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:19.277354 22810 consensus_meta.cc:287] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.007s
I20260709 13:07:19.238518 26191 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:19.212128 26104 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:19.261152 26195 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:19.304244 22810 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:19.221256 26027 consensus_queue.cc:1048] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:07:19.300096 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:19.144285 26106 consensus_queue.cc:237] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:19.310518 22177 raft_consensus.cc:2393] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:19.293176 25846 raft_consensus.cc:697] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:19.259423 26179 raft_consensus.cc:697] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:19.353240 22815 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:19.320474 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:19.309054 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:19.315537 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 401841us
I20260709 13:07:19.366067 22246 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:07:19.366492 22246 pending_rounds.cc:85] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 5
I20260709 13:07:19.366714 22246 pending_rounds.cc:107] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:19.265081 26233 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:07:19.354952 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:19.369715 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:19.355738 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:19.300884 26128 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:19.221124 25745 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
W20260709 13:07:19.358850 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 117805us
I20260709 13:07:19.240301 26201 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:19.298200 26181 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:19.368129 22246 raft_consensus.cc:2889] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.372363 22247 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:19.372331 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:19.261899 26002 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:19.378233 22175 raft_consensus.cc:2368] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:19.309618 26085 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:19.382228 22250 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:19.314956 25874 raft_consensus.cc:697] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:07:19.459980 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.421456 22100 consensus_meta.cc:287] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.889s	user 0.016s	sys 0.004s
I20260709 13:07:19.421233 22248 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:19.452235 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 738) took 1261 ms. Trace:
W20260709 13:07:19.447093 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 69369us
I20260709 13:07:19.310832 26197 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:19.450804 22180 raft_consensus.cc:1240] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.451431 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:19.470362 22100 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
W20260709 13:07:19.421411 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 51429us
I20260709 13:07:19.472949 22247 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:19.446573 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:19.474439 22255 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:19.470064 22254 rpcz_store.cc:276] 0709 13:07:18.190709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.190867 (+   158us) service_pool.cc:224] Handling call
0709 13:07:18.290292 (+ 99425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.459834 (+169542us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:18.778410 (+318576us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.931130 (+152720us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.931668 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.932335 (+   667us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:18.932376 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.932447 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.451993 (+519546us) raft_consensus.cc:1685] finished
0709 13:07:19.452016 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.452161 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18898,"prepare.queue_time_us":50302,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":66978,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":26153,"thread_start_us":483283,"threads_started":4,"wal-append.queue_time_us":204494}
I20260709 13:07:19.403713 26093 raft_consensus.cc:3055] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:19.476364 26093 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:19.477540 26093 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:19.367772 26127 raft_consensus.cc:697] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:19.383713 22815 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:19.456813 22181 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:19.395797 22177 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:07:19.479775 22177 pending_rounds.cc:85] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 6
I20260709 13:07:19.480087 22177 pending_rounds.cc:107] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:07:19.480355 22177 raft_consensus.cc:2889] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.404565 26234 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:19.374228 26229 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:19.311910 26069 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:19.488176 22218 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:19.354668 26023 raft_consensus.cc:3055] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:19.319787 26195 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:19.507575 22071 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:19.510200 22181 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:19.364840 26100 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:19.521458 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:19.443500 26220 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 13:07:19.551736 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.505125 26093 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:19.556811 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 68700.9us
I20260709 13:07:19.448716 26201 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:19.546438 22072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.004s	sys 0.007s
W20260709 13:07:19.562354 22072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.005s	sys 0.007s
I20260709 13:07:19.562480 22253 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:19.501272 26002 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:19.506000 26023 raft_consensus.cc:740] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:19.558638 22218 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:19.563021 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 632515us
I20260709 13:07:19.559661 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:19.567436 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:19.572854 22246 raft_consensus.cc:1813] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Handling vote request from an unknown peer 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:19.573498 22246 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:19.573451 22072 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:19.563917 22782 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.014s	sys 0.002s
I20260709 13:07:19.523152 26052 raft_consensus.cc:3055] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:19.511317 26195 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:19.574378 22782 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.014s	sys 0.002s
I20260709 13:07:19.501523 26085 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:19.546640 26209 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:19.552817 26198 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:19.541603 26128 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:07:19.497184 26069 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:19.602054 22218 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:19.603547 25889 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:19.521914 25657 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:19.604051 22218 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:19.584779 26179 consensus_queue.cc:237] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:19.602454 26069 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:19.604431 26237 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:19.605441 22175 pending_rounds.cc:85] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 5
I20260709 13:07:19.605765 22175 pending_rounds.cc:107] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:07:19.605988 22175 raft_consensus.cc:2889] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.607028 26245 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:19.607455 26245 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:19.487998 26127 consensus_queue.cc:237] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:19.607823 26245 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:19.596591 26223 log.cc:927] Time spent T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 13:07:19.599260 26216 log.cc:927] Time spent T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.673s	user 0.002s	sys 0.002s
I20260709 13:07:19.599985 26023 consensus_queue.cc:260] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:19.584868 26209 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:19.578843 26244 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.604123 25889 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:19.578996 26052 raft_consensus.cc:740] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:19.611490 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.596303 26214 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:07:19.612581 22253 raft_consensus.cc:1275] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:07:19.588977 26243 log.cc:927] Time spent T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260709 13:07:19.615057 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 569112us
I20260709 13:07:19.618379 26209 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.618759 22172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 563) took 1137 ms. Trace:
I20260709 13:07:19.619166 25745 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:19.620141 26240 log.cc:927] Time spent T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:19.620409 25860 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:19.576210 25846 consensus_queue.cc:237] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:19.622637 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 359934us
W20260709 13:07:19.627164 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 53772.8us
I20260709 13:07:19.618837 26198 raft_consensus.cc:697] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:19.636243 22255 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:19.652805 22172 rpcz_store.cc:276] 0709 13:07:18.481545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.486679 (+  5134us) service_pool.cc:224] Handling call
0709 13:07:18.487000 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.526380 (+ 39380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.526409 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.552859 (+ 26450us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.871535 (+318676us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:18.871589 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.871682 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.618541 (+746859us) raft_consensus.cc:1685] finished
0709 13:07:19.618561 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.618705 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31005,"raft.queue_time_us":39128,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":34269,"thread_start_us":318286,"threads_started":1,"wal-append.queue_time_us":620756}
I20260709 13:07:19.677798 26000 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:19.638157 22808 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:19.655385 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:19.615350 26237 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:19.662549 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:19.664798 22178 consensus_meta.cc:287] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.832s	user 0.009s	sys 0.009s
I20260709 13:07:19.496030 25874 consensus_queue.cc:237] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:19.633033 22218 connection.cc:256] RPC call timeout handler was delayed by -1.0303590070000155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
I20260709 13:07:19.729990 22250 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:19.730286 22218 connection.cc:256] RPC call timeout handler was delayed by -1.0201365429999214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
I20260709 13:07:19.666692 22072 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:19.732856 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 66238.7us
I20260709 13:07:19.680227 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:19.689766 22172 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:19.691407 22097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1948) took 1103 ms. Trace:
I20260709 13:07:19.679016 26251 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:19.735868 22097 rpcz_store.cc:276] 0709 13:07:18.587590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.588433 (+   843us) service_pool.cc:224] Handling call
0709 13:07:18.609245 (+ 20812us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.628195 (+ 18950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.628236 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.628739 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.945143 (+316404us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:18.945310 (+   167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.945570 (+   260us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.691141 (+745571us) raft_consensus.cc:1685] finished
0709 13:07:19.691164 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.691306 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":306889,"threads_started":1,"wal-append.queue_time_us":628165}
W20260709 13:07:19.642204 22814 consensus_meta.cc:287] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.828s	user 0.013s	sys 0.009s
I20260709 13:07:19.694168 26052 consensus_queue.cc:260] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:19.695120 25860 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:19.695956 26012 consensus_meta.cc:287] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.850s	user 0.014s	sys 0.005s
I20260709 13:07:19.755255 26012 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:19.756382 26250 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:19.757489 26012 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:19.695921 26202 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:19.696501 26104 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:19.700035 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:19.762604 22247 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:19.702814 22248 raft_consensus.cc:1240] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:19.704155 26085 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:19.704499 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1826) took 1015 ms. Trace:
I20260709 13:07:19.703146 26209 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:19.708273 22000 catalog_manager.cc:5697] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 8 to 11, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 11 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:19.669696 22144 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:19.717553 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 736) took 1527 ms. Trace:
I20260709 13:07:19.728037 26237 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:19.686973 25889 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:19.658206 25745 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:19.720245 22781 leader_election.cc:400] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11.
W20260709 13:07:19.778620 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 59782.5us
I20260709 13:07:19.780051 22781 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:19.728685 22178 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:19.738786 22072 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:19.729210 26023 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:19.762146 26202 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.628166 26244 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:19.729014 26000 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.649331 26229 consensus_queue.cc:1059] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:07:19.770076 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:19.750677 22814 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
W20260709 13:07:19.770730 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 101117us
I20260709 13:07:19.671275 25821 consensus_queue.cc:1059] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:07:19.781255 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57856 (request call id 573) took 1060 ms. Trace:
I20260709 13:07:19.798844 22178 rpcz_store.cc:276] 0709 13:07:18.721155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.802187 (+ 81032us) service_pool.cc:224] Handling call
0709 13:07:19.781173 (+978986us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.782682 22782 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:19.759320 26128 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:19.787729 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 49070.9us
I20260709 13:07:19.813010 22072 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:19.763748 22106 rpcz_store.cc:276] 0709 13:07:18.689522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.695019 (+  5497us) service_pool.cc:224] Handling call
0709 13:07:19.704307 (+1009288us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b5400215554. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:19.704443 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808063872}
I20260709 13:07:19.814621 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:19.815359 22100 raft_consensus.cc:2368] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:19.790326 22781 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:19.768378 22251 rpcz_store.cc:276] 0709 13:07:18.189967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.190971 (+  1004us) service_pool.cc:224] Handling call
0709 13:07:18.289821 (+ 98850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.329337 (+ 39516us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:18.346318 (+ 16981us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.706953 (+1360635us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b18000d0a80. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a7af64bc 00007f66a4e4448b 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e5e455 00007f66a7f46060 00007f66a7f58716 00007f66a7f69287
0709 13:07:19.717220 (+ 10267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.717273 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:19.717314 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.717380 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.717494 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4330,"prepare.queue_time_us":16858,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":11252,"raft.queue_time_us":53162,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":15747,"spinlock_wait_cycles":73636352,"thread_start_us":491856,"threads_started":2,"wal-append.queue_time_us":844680}
I20260709 13:07:19.770999 26052 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:19.801648 22144 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:19.823545 22105 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:19.777347 26237 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.812649 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:19.826901 22072 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:19.776753 26104 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:19.828130 22247 raft_consensus.cc:1240] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.832526 22069 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:19.833328 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:19.794816 26012 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:19.843070 25657 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:19.843624 25657 raft_consensus.cc:697] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:19.844640 26244 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:19.844530 25657 consensus_queue.cc:237] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:19.845216 26238 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:19.845677 26238 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:19.845824 26209 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:19.846149 26238 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.800129 26234 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:19.830574 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:19.786052 25745 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.837687 22144 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:19.828263 22781 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:19.841190 26235 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:07:19.848629 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:19.874815 22097 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:19.849502 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:19.829648 26179 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:19.855099 22072 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:19.882463 22072 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:19.803484 22814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 568) took 1258 ms (client timeout 1631 ms). Trace:
I20260709 13:07:19.857236 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:19.771517 26227 consensus_queue.cc:1059] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:07:19.862730 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:19.869936 22253 raft_consensus.cc:2393] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 11: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:19.838227 25821 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:19.875751 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:19.837514 26085 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:19.894234 22251 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.876127 22102 raft_consensus.cc:2393] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:19.850265 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:19.895740 22098 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:19.791508 26250 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:07:19.835091 26127 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:19.864403 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:19.832233 26104 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:19.889351 22808 raft_consensus.cc:2393] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
W20260709 13:07:19.883427 22814 rpcz_store.cc:269] 0709 13:07:18.538695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.540734 (+  2039us) service_pool.cc:224] Handling call
0709 13:07:18.728058 (+187324us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29eee 0000000000375939 00007f66ace9d1e0 00007f66acf660c4 00007f66acf66131 00007f66acf140a0 00007f66acf13984 00007f66a648e6d4 00007f66a648e662
0709 13:07:19.796876 (+1068818us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5888896}
I20260709 13:07:19.890725 22072 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:19.874148 26051 consensus_meta.cc:287] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 1.058s	user 0.020s	sys 0.003s
I20260709 13:07:19.858952 26234 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.893525 26244 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:19.807147 26000 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:19.894033 25821 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.917752 26250 consensus_queue.cc:1059] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:19.791865 26198 consensus_queue.cc:237] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:19.919838 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:19.921964 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:19.888985 26179 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.920009 26100 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:19.900223 26219 log.cc:927] Time spent T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.156s	user 0.000s	sys 0.002s
W20260709 13:07:19.900354 25837 consensus_meta.cc:287] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 1.056s	user 0.010s	sys 0.010s
I20260709 13:07:19.925271 22072 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:19.867589 26211 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:19.926545 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:19.928783 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 197834us
W20260709 13:07:19.916210 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.869524 26012 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:07:19.937992 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:19.949926 22253 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:19.921265 26104 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:19.880327 25846 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:19.923846 26251 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:19.996004 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:19.927340 26244 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:19.879647 26245 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:19.976365 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 51193.3us
W20260709 13:07:19.978662 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.939122 25821 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:19.931766 26256 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.931684 26127 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:19.994123 22813 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:07:20.030253 22813 pending_rounds.cc:85] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Aborting all ops after (but not including) 9
I20260709 13:07:19.989920 26085 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.957504 26179 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:19.972121 25734 consensus_meta.cc:287] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 1.161s	user 0.012s	sys 0.010s
I20260709 13:07:19.996791 22246 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:19.960729 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 94906.4us
I20260709 13:07:19.996938 26211 raft_consensus.cc:697] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:19.999358 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:20.014762 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:20.018862 22072 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:19.989117 26195 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.021268 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:20.020735 26204 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.993512 26196 consensus_meta.cc:287] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 1.241s	user 0.013s	sys 0.011s
W20260709 13:07:20.000133 26155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.157s	user 0.008s	sys 0.031s
I20260709 13:07:20.030489 25837 raft_consensus.cc:3055] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:19.993175 26233 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:20.030676 22813 pending_rounds.cc:107] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:07:20.094225 22813 raft_consensus.cc:2889] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:20.062852 26262 log.cc:927] Time spent T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
W20260709 13:07:20.038731 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.992944 25846 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:07:19.922899 26190 consensus_meta.cc:287] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 1.066s	user 0.010s	sys 0.014s
I20260709 13:07:20.015676 26244 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.999605 26231 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:20.059402 22781 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:19.996582 26251 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:20.029192 26208 consensus_meta.cc:287] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.768s	user 0.006s	sys 0.005s
W20260709 13:07:20.065718 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 48426.5us
I20260709 13:07:20.122579 22072 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:19.923458 26051 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.057863 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:20.123559 22247 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
W20260709 13:07:20.123920 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 64637.6us
I20260709 13:07:20.067227 25754 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.071533 26258 log.cc:927] Time spent T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 13:07:20.076869 26222 log.cc:927] Time spent T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.765s	user 0.003s	sys 0.000s
I20260709 13:07:20.136615 22816 raft_consensus.cc:2368] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10.
I20260709 13:07:20.137760 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1943) took 1586 ms. Trace:
I20260709 13:07:20.138108 22101 rpcz_store.cc:276] 0709 13:07:18.550978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.565042 (+ 14064us) service_pool.cc:224] Handling call
0709 13:07:18.565438 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.602644 (+ 37206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.602676 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.615816 (+ 13140us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.864531 (+248715us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:18.864586 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.864834 (+   248us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.076298 (+1211464us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:20.137479 (+ 61181us) raft_consensus.cc:1685] finished
0709 13:07:20.137499 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.137704 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14336,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4042,"spinlock_wait_cycles":12017536,"thread_start_us":227428,"threads_started":1,"wal-append.queue_time_us":550691}
I20260709 13:07:20.139194 26254 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:20.139997 26254 raft_consensus.cc:697] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:20.142956 26233 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:20.142287 26254 consensus_queue.cc:237] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.144202 26100 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:20.094132 25837 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:20.146741 25837 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.147219 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:20.148020 25837 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:20.148358 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:07:20.149886 26264 log.cc:927] Time spent T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:07:20.076697 22144 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:20.154778 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 78160.5us
I20260709 13:07:20.077852 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:20.080226 22098 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:20.082574 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:20.041826 26256 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.084038 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:20.084125 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:20.159811 26256 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:20.044960 25942 consensus_meta.cc:287] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.784s	user 0.011s	sys 0.000s
I20260709 13:07:20.030107 26127 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:19.995033 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:20.091423 26155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.249s	user 0.009s	sys 0.032s
I20260709 13:07:20.095719 22220 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:19.926879 26234 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:20.114147 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 115980us
W20260709 13:07:20.087826 26093 consensus_meta.cc:287] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.001s
I20260709 13:07:20.118868 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:20.068363 25874 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:20.059352 26085 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.096428 26229 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:20.130355 22072 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:20.118682 26190 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:20.134629 26268 log.cc:927] Time spent T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:07:20.135008 25754 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.135979 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:20.133662 26000 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:20.156193 26242 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:20.114655 25846 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:20.163832 22246 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:20.165675 22251 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:20.124969 26251 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:20.186339 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 90700.1us
W20260709 13:07:20.191531 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 61293.3us
I20260709 13:07:20.091357 26196 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:20.220882 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 64767.3us
I20260709 13:07:20.112970 26204 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.136328 26051 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:20.173439 26127 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.129120 26208 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:20.195125 25860 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:20.241233 22173 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 12: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:20.232280 22105 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:20.214851 26023 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:20.173873 25942 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:20.237571 22220 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:20.118448 26231 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.234030 26233 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.974856 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:20.258888 22249 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:20.226439 26242 raft_consensus.cc:697] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:20.222604 26106 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:07:20.209458 26211 consensus_queue.cc:237] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:20.281840 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.258505 26103 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:20.315656 22811 raft_consensus.cc:3055] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:20.316277 22811 raft_consensus.cc:740] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:20.323601 26231 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:20.267848 26233 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.329028 26233 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:20.335127 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 97664.6us
W20260709 13:07:20.337697 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 155244us
I20260709 13:07:20.280290 26245 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:20.339207 22218 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:20.305580 26229 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:20.352355 26208 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:20.352883 26256 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:20.359828 26204 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:20.359984 26276 log.cc:927] Time spent T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:07:20.361078 26279 log.cc:927] Time spent T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:07:20.362183 26103 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:20.277740 25889 consensus_queue.cc:1059] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:07:20.368166 26238 consensus_meta.cc:287] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.000s
I20260709 13:07:20.376019 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:20.426004 22251 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.340174 22811 consensus_queue.cc:260] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.351056 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:20.395186 26242 consensus_queue.cc:237] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:20.398198 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:20.403683 26196 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:20.404104 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:20.489159 22808 raft_consensus.cc:2410] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:07:20.404932 26256 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:20.409492 22807 raft_consensus.cc:3055] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:20.411754 26190 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:20.412642 26260 log.cc:927] Time spent T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.472s	user 0.001s	sys 0.000s
I20260709 13:07:20.492785 22807 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:20.414120 26244 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.414778 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2083) took 1100 ms. Trace:
I20260709 13:07:20.341909 26195 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:20.427589 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.370707 25745 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:20.487435 22811 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:20.398535 25821 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:20.503105 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 63817.6us
W20260709 13:07:20.494042 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 143094us
I20260709 13:07:20.377874 26231 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:07:20.496417 22099 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:20.497044 22249 rpcz_store.cc:276] 0709 13:07:19.314718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.317111 (+  2393us) service_pool.cc:224] Handling call
0709 13:07:19.317494 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.262008 (+944514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.414460 (+152452us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b54002cbad4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:20.414709 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2164517760}
I20260709 13:07:20.425048 26103 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.415661 26085 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:20.509372 22251 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:20.511255 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:20.511497 22782 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:20.509166 22807 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.514643 22218 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:20.515841 22807 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:20.516047 22220 leader_election.cc:400] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:20.516419 22220 leader_election.cc:403] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:20.517271 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:20.519949 22072 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:20.522495 22811 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:20.525300 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:20.525950 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:20.530107 22811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 708) took 1210 ms. Trace:
I20260709 13:07:20.530522 22099 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:20.532601 22181 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:20.510241 25860 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:20.507409 26245 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:20.554242 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:20.538057 22178 raft_consensus.cc:1240] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:20.539880 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 1988) took 1229 ms. Trace:
I20260709 13:07:20.527724 26211 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:20.555202 22175 rpcz_store.cc:276] 0709 13:07:19.310850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.509258 (+198408us) service_pool.cc:224] Handling call
0709 13:07:19.548889 (+ 39631us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.606777 (+ 57888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.606809 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.607363 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.774180 (+166817us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:19.774216 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.402286 (+628070us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b5400176bd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:20.402335 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.411747 (+  9412us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:20.539680 (+127933us) raft_consensus.cc:1685] finished
0709 13:07:20.539699 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.539825 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145615488,"thread_start_us":166460,"threads_started":1,"wal-append.queue_time_us":284881}
I20260709 13:07:20.530434 22811 rpcz_store.cc:276] 0709 13:07:19.313158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.313328 (+   170us) service_pool.cc:224] Handling call
0709 13:07:19.313679 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.315511 (+1001832us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b5400692420. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7ec5dc0 00007f66a7f501c0 00007f66a7f51231 00007f66a7f4dd8f 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c
0709 13:07:20.522842 (+207331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.523099 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5854592}
I20260709 13:07:20.540869 25860 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:20.542106 26275 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:20.542547 26210 raft_consensus.cc:3055] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:20.543233 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:20.517613 26196 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:07:20.547080 26225 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 13:07:20.549733 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.489127 26238 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:20.552490 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:20.509166 26103 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:20.553546 22807 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:20.559034 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:20.546703 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:20.525492 26085 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.524565 25889 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:20.529628 26104 consensus_meta.cc:287] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.000s
I20260709 13:07:20.523433 26285 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:20.582677 22176 raft_consensus.cc:2410] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 10 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:20.581772 22174 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:20.523310 26287 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:20.554598 26245 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:20.600899 22179 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:20.601363 22218 leader_election.cc:400] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
W20260709 13:07:20.580631 26237 consensus_meta.cc:287] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.726s	user 0.010s	sys 0.001s
I20260709 13:07:20.603201 22102 raft_consensus.cc:1240] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:20.566221 26210 raft_consensus.cc:740] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:20.582165 25942 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:20.525385 26288 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:07:20.613519 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:20.614837 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:20.585408 26275 raft_consensus.cc:697] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:20.614279 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 95235.8us
I20260709 13:07:20.603987 26245 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.620513 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2313) took 1923 ms. Trace:
I20260709 13:07:20.620985 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:20.622911 22180 rpcz_store.cc:276] 0709 13:07:18.696635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.707306 (+ 10671us) service_pool.cc:224] Handling call
0709 13:07:18.707668 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.472349 (+764681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.620270 (+1147921us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54000019d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:20.620444 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708520704}
I20260709 13:07:20.584718 26196 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.629595 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:20.631283 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.599063 26085 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:20.628571 22220 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:20.598774 26104 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:20.633092 26052 consensus_meta.cc:287] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.798s	user 0.005s	sys 0.007s
I20260709 13:07:20.641305 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:20.612805 26237 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.629518 25889 raft_consensus.cc:697] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:20.648241 22812 raft_consensus.cc:1240] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:20.651834 22812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 702) took 1765 ms. Trace:
I20260709 13:07:20.652361 22812 rpcz_store.cc:276] 0709 13:07:18.886363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.219976 (+333613us) service_pool.cc:224] Handling call
0709 13:07:20.646054 (+1426078us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:07:20.646326 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.651611 (+  5285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.651758 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4946688}
I20260709 13:07:20.652379 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:20.655309 22810 raft_consensus.cc:2410] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:07:20.663321 26256 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:20.665160 26179 consensus_meta.cc:287] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 13:07:20.665659 26179 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:20.667801 26202 consensus_meta.cc:287] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.841s	user 0.011s	sys 0.000s
I20260709 13:07:20.668120 22815 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 11: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:20.668251 26202 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:20.675508 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.677743 22255 raft_consensus.cc:1240] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:20.676021 22249 raft_consensus.cc:2393] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 11: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:20.676386 22254 raft_consensus.cc:1240] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:20.680379 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:20.680492 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:20.681005 26202 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:20.681198 26196 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:20.681370 22812 raft_consensus.cc:2410] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:20.654426 26288 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:20.683346 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:20.683724 22069 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:20.684386 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.683938 22103 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.629732 25846 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:20.688278 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.688251 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:20.691907 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:20.694410 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:07:20.672176 26290 log.cc:927] Time spent T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:07:20.703785 22249 raft_consensus.cc:1240] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:20.689224 26232 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:20.646253 26210 consensus_queue.cc:260] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:20.705528 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:20.676990 25942 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.686641 26191 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.645812 26275 consensus_queue.cc:237] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.689109 26292 consensus_queue.cc:1059] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:07:20.671919 26294 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:07:20.724381 26093 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:07:20.703534 26288 raft_consensus.cc:697] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:07:20.728294 26251 consensus_meta.cc:287] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:07:20.657155 26127 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:20.721537 26238 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:20.724728 25942 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.695176 26244 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:20.662900 26234 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.726030 22144 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:20.729869 25846 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:20.709591 26196 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.723315 26289 log.cc:927] Time spent T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:07:20.754070 26292 consensus_queue.cc:1243] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:20.773715 26179 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:20.777791 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:20.785049 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 59109us
I20260709 13:07:20.761852 22097 raft_consensus.cc:2393] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:20.786379 26244 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.786908 26244 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:20.787314 26127 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:20.788204 22248 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:20.789031 26244 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:20.734568 22103 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:20.767788 22106 raft_consensus.cc:1240] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:20.789513 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:20.763223 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:20.785687 26282 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:20.757086 26251 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.739394 25889 consensus_queue.cc:237] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.800796 22809 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:07:20.801373 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:20.802135 22103 raft_consensus.cc:2393] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:20.790102 26196 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:20.807842 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:20.811811 22218 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:20.813177 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 1982) took 1554 ms. Trace:
I20260709 13:07:20.822980 22173 rpcz_store.cc:276] 0709 13:07:19.253061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.255209 (+  2148us) service_pool.cc:224] Handling call
0709 13:07:20.807250 (+1552041us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b540013e054. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:20.807367 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2180960640}
W20260709 13:07:20.814298 26213 log.cc:927] Time spent T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 1.457s	user 0.002s	sys 0.003s
I20260709 13:07:20.815896 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:20.826570 26296 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:20.802567 26272 consensus_queue.cc:1059] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:07:20.827490 26296 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.827912 26296 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:20.828992 25942 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:20.829499 26251 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:20.826828 22103 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:20.830415 26288 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.833107 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1836) took 1017 ms. Trace:
I20260709 13:07:20.833493 22100 rpcz_store.cc:276] 0709 13:07:19.815902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.816024 (+   122us) service_pool.cc:224] Handling call
0709 13:07:19.851171 (+ 35147us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.864074 (+ 12903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.864119 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:20.654152 (+790033us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b2c00000658. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6857372 00007f66a7f89a01 00007f66a7f4e43a 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2
0709 13:07:20.662007 (+  7855us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.687595 (+ 25588us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:20.687635 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.687717 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.832799 (+145082us) raft_consensus.cc:1685] finished
0709 13:07:20.832816 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.833038 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10263,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":7679,"spinlock_wait_cycles":23360256,"thread_start_us":25031,"threads_started":1,"wal-append.queue_time_us":132035}
I20260709 13:07:20.830793 26196 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:20.835083 26237 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:20.835629 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:20.836401 22100 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:20.837371 22248 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:07:20.838960 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:20.839775 22810 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:20.823467 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:20.849649 22103 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:20.843216 22069 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:20.851639 22144 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:20.856217 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:20.824626 26093 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:20.859423 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:07:20.859264 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 121349us
I20260709 13:07:20.868371 22220 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:20.871765 22218 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:20.850494 26237 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:20.873565 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:20.874303 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.875941 22103 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:20.909062 22144 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:20.856072 26198 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:20.909899 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:20.921657 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:20.868574 26197 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:20.875272 26233 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.911791 22103 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:20.870637 26085 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:20.875661 26237 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:20.967978 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:20.984227 22103 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.982759 26233 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:20.912930 26198 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:21.001099 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 129453us
W20260709 13:07:21.001451 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.923218 26256 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:20.983111 26270 log.cc:927] Time spent T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:07:21.008803 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:20.874059 26093 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.018311 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:21.027838 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:21.030788 22807 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:21.033218 22813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 1010) took 2205 ms. Trace:
I20260709 13:07:20.989434 26237 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.982759 26244 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:20.992900 26197 raft_consensus.cc:697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:20.992205 26198 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:21.127821 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 259514us
I20260709 13:07:21.095284 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:21.117365 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:21.128643 22218 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:21.053951 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:07:21.088785 22815 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35198 (request call id 1012) took 1277 ms (client timeout 1507 ms). Trace:
I20260709 13:07:21.083734 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 759) took 1317 ms. Trace:
W20260709 13:07:21.176270 22815 rpcz_store.cc:269] 0709 13:07:19.811779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.812324 (+   545us) service_pool.cc:224] Handling call
0709 13:07:21.088510 (+1276186us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b5400780354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:21.088707 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938226048}
I20260709 13:07:21.044232 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:21.176398 22254 rpcz_store.cc:276] 0709 13:07:19.766012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.766904 (+   892us) service_pool.cc:224] Handling call
0709 13:07:19.782040 (+ 15136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.679331 (+897291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.083470 (+404139us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b540005cdd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:21.083653 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2040248064}
I20260709 13:07:21.174188 22220 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:21.060961 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.177639 22812 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:21.110802 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:21.144284 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:21.092630 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:21.180333 22175 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:21.180835 22808 raft_consensus.cc:2410] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:07:21.033767 22813 rpcz_store.cc:276] 0709 13:07:18.808528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.852399 (+ 43871us) service_pool.cc:224] Handling call
0709 13:07:18.866382 (+ 13983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.111161 (+1244779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.006082 (+894921us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54005b40d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:21.014113 (+  8031us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2584819072}
W20260709 13:07:21.181113 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.103649 22147 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:21.005443 26256 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:21.182484 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 78970.5us
I20260709 13:07:21.174455 22811 raft_consensus.cc:2410] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:21.152527 22103 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:21.184163 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:21.185490 26093 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:21.013828 26282 raft_consensus.cc:697] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:21.189561 22813 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:21.190896 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:21.113941 26234 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:21.120122 26196 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.085893 26233 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:21.220808 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:21.218291 22103 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:21.234956 26301 log.cc:927] Time spent T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:07:21.192541 26256 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.222126 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:21.183276 26244 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.072470 25745 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:21.113343 26284 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:21.090704 25754 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:21.231855 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:21.221283 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.242352 22103 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:21.248230 22069 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:21.248783 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:21.254276 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:21.258817 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:21.260251 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:21.261690 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:21.269878 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:21.269762 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:21.271981 22103 raft_consensus.cc:2393] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 9: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:07:21.262691 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 166097us
I20260709 13:07:21.273543 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:21.274271 22103 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:21.278003 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 50404.3us
I20260709 13:07:21.278793 22147 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:21.282066 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:21.282064 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:21.284459 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:21.285480 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:21.286492 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:21.286720 22103 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:21.287928 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:21.288858 22100 raft_consensus.cc:2368] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:21.293498 22813 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:07:21.294891 26244 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:21.240456 26305 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:21.304754 26244 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:21.245337 26085 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:07:21.237313 26196 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.246271 26093 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:07:21.312474 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 621) took 1086 ms. Trace:
I20260709 13:07:21.317487 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:21.328648 22072 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:21.309388 26103 consensus_meta.cc:287] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.704s	user 0.009s	sys 0.003s
I20260709 13:07:21.332442 22072 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:21.332594 22100 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:21.333544 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 623) took 1102 ms. Trace:
I20260709 13:07:21.333953 22100 rpcz_store.cc:276] 0709 13:07:20.231102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.308266 (+1077164us) service_pool.cc:224] Handling call
0709 13:07:21.332409 (+ 24143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.333225 (+   816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.333464 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:21.310245 22816 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35230 (request call id 573) took 2671 ms (client timeout 1901 ms). Trace:
I20260709 13:07:21.335800 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:21.263494 26191 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:07:21.336939 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:21.268448 26296 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.330713 22103 rpcz_store.cc:276] 0709 13:07:20.225624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.295817 (+1070193us) service_pool.cc:224] Handling call
0709 13:07:21.311991 (+ 16174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.312184 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.312207 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.312245 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:21.312272 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.312320 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.312417 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:21.296679 26302 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.335355 22816 rpcz_store.cc:269] 0709 13:07:18.634264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.689007 (+ 54743us) service_pool.cc:224] Handling call
0709 13:07:21.301288 (+2612281us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54005bfed4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:21.305853 (+  4565us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3326944000}
I20260709 13:07:21.269724 26284 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.316931 26244 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:21.347417 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 66452.6us
I20260709 13:07:21.348456 22176 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:21.360977 22147 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:21.282019 26282 consensus_queue.cc:237] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.352011 22100 raft_consensus.cc:1240] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:21.331897 26103 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.371766 22103 raft_consensus.cc:1240] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:21.375082 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:21.375854 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 627) took 1143 ms. Trace:
I20260709 13:07:21.376274 22175 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:21.376371 22103 rpcz_store.cc:276] 0709 13:07:20.232224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.344123 (+1111899us) service_pool.cc:224] Handling call
0709 13:07:21.371426 (+ 27303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.375515 (+  4089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.375783 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:21.341722 26251 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:21.282481 26197 consensus_queue.cc:237] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:21.378428 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 88158.6us
I20260709 13:07:21.382184 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:21.381695 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 626) took 1142 ms. Trace:
I20260709 13:07:21.383396 22100 rpcz_store.cc:276] 0709 13:07:20.231882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.334828 (+1102946us) service_pool.cc:224] Handling call
0709 13:07:21.351679 (+ 16851us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.374292 (+ 22613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.374708 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:21.370707 26244 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:21.387138 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:21.389263 22172 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:07:21.354077 26302 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.389921 22103 raft_consensus.cc:1240] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:21.393170 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 60795.6us
I20260709 13:07:21.347819 26127 consensus_queue.cc:1059] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:07:21.395892 22172 pending_rounds.cc:85] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 9
I20260709 13:07:21.396317 22172 pending_rounds.cc:107] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:07:21.396443 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 628) took 1157 ms. Trace:
I20260709 13:07:21.396456 22072 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:21.396644 22172 raft_consensus.cc:2889] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.397176 22103 rpcz_store.cc:276] 0709 13:07:20.238613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.377575 (+1138962us) service_pool.cc:224] Handling call
0709 13:07:21.389492 (+ 11917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.396185 (+  6693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.396382 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:21.387033 25754 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.380553 26315 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.403297 22100 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:07:21.399951 22103 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:21.403990 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 629) took 1165 ms. Trace:
I20260709 13:07:21.404138 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 631) took 1164 ms. Trace:
I20260709 13:07:21.404379 22100 rpcz_store.cc:276] 0709 13:07:20.238951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.393101 (+1154150us) service_pool.cc:224] Handling call
0709 13:07:21.403090 (+  9989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.403743 (+   653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.403940 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:21.387794 26233 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.402676 25754 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.404654 22071 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:21.404732 22103 rpcz_store.cc:276] 0709 13:07:20.239528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.398047 (+1158519us) service_pool.cc:224] Handling call
0709 13:07:21.399668 (+  1621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.403849 (+  4181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.404070 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:21.373021 26313 consensus_queue.cc:1048] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:07:21.391234 26305 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.390196 26234 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.411270 22103 raft_consensus.cc:1240] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:21.434599 22816 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:07:21.435251 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 50369us
I20260709 13:07:21.394694 26320 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:21.423856 26309 log.cc:927] Time spent T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:07:21.424508 26302 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:21.447093 25754 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:21.425879 26225 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:21.448009 26225 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.449635 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 752) took 1751 ms. Trace:
I20260709 13:07:21.450400 26225 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:21.428802 26322 raft_consensus.cc:3055] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:21.450137 22255 rpcz_store.cc:276] 0709 13:07:19.698316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.703977 (+  5661us) service_pool.cc:224] Handling call
0709 13:07:19.704233 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.678297 (+974064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.449400 (+771103us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b54002dc654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:21.449571 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2238317440}
W20260709 13:07:21.451429 26311 log.cc:927] Time spent T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:21.451893 26324 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.452476 26310 log.cc:927] Time spent T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:21.452603 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1955) took 1378 ms. Trace:
I20260709 13:07:21.453002 22102 rpcz_store.cc:276] 0709 13:07:20.074370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.076380 (+  2010us) service_pool.cc:224] Handling call
0709 13:07:20.076770 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.604972 (+528202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.452356 (+847384us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b5400022454. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:21.452550 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1210278272}
I20260709 13:07:21.456425 26085 consensus_queue.cc:1059] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:07:21.456820 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.457557 26302 raft_consensus.cc:3055] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:21.457952 26302 raft_consensus.cc:740] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:21.459368 26302 consensus_queue.cc:260] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.460048 26196 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:21.460908 26302 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.463501 26198 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.465730 26198 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:21.470112 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:21.470839 22813 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:21.408620 26315 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.472724 22174 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:21.436276 22147 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:21.473428 22099 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:21.438076 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 634) took 1180 ms. Trace:
W20260709 13:07:21.422979 26318 log.cc:927] Time spent T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:07:21.482313 22102 raft_consensus.cc:1240] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:21.440654 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 632) took 1198 ms. Trace:
I20260709 13:07:21.439955 26233 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:21.445372 26103 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:21.446198 26106 raft_consensus.cc:3055] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:21.446029 26317 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:21.437745 26127 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:21.451337 26322 raft_consensus.cc:740] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:21.429031 22071 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:21.456712 26284 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:21.472795 22811 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:21.395053 26251 consensus_queue.cc:1059] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:07:21.506345 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 77440.6us
I20260709 13:07:21.507395 22071 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:21.507486 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 111100us
I20260709 13:07:21.508481 22072 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:21.475163 22147 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:21.485123 22100 rpcz_store.cc:276] 0709 13:07:20.242790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.405670 (+1162880us) service_pool.cc:224] Handling call
0709 13:07:21.439682 (+ 34012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.439907 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.439933 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.440282 (+   349us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:21.440342 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.440420 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.440563 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:21.474715 22103 rpcz_store.cc:276] 0709 13:07:20.257351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.410590 (+1153239us) service_pool.cc:224] Handling call
0709 13:07:21.411040 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.435188 (+ 24148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.437989 (+  2801us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:21.486014 26245 consensus_meta.cc:287] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.854s	user 0.010s	sys 0.003s
I20260709 13:07:21.486670 26321 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:21.523255 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 48185.4us
I20260709 13:07:21.502270 26296 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:21.523416 22072 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:21.493664 26106 raft_consensus.cc:740] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:21.440877 26234 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.525306 22147 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:21.516203 26320 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:21.535204 26315 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:21.535377 22098 raft_consensus.cc:1240] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:21.537789 22098 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:21.539500 26322 consensus_queue.cc:260] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.540267 25860 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:21.540623 26322 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.541198 26325 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:21.540408 26234 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:21.542490 22098 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:07:21.544023 26204 raft_consensus.cc:3055] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:21.544457 26204 raft_consensus.cc:740] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:21.518426 26191 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:21.545454 22098 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:21.545264 26204 consensus_queue.cc:260] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.547176 22098 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:21.547128 26313 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:21.548909 22098 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.486519 26237 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.452513 26324 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.533975 22147 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:21.550858 22100 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:21.524372 26238 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.546746 26204 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.557168 22147 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:21.524714 26321 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:21.578229 26321 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:21.547227 26250 raft_consensus.cc:3055] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:21.587232 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:21.587452 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:21.588028 22178 raft_consensus.cc:2393] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 13: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:21.588165 22173 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:21.589818 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:21.521275 26245 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.584357 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:21.560778 26211 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.549516 26197 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.591725 22813 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:21.592736 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1967) took 1260 ms. Trace:
I20260709 13:07:21.527462 26233 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:07:21.571600 26155 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.593938 22072 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:21.596643 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:21.600666 22176 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:21.585785 26315 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.583480 26325 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:21.599260 22781 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:21.598419 22103 rpcz_store.cc:276] 0709 13:07:20.332215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.512163 (+1179948us) service_pool.cc:224] Handling call
0709 13:07:21.512548 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.512796 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:21.519775 (+  6979us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.592298 (+ 72523us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.592376 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:21.592443 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.592520 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.592635 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7810,"prepare.queue_time_us":6808,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":8876,"thread_start_us":64302,"threads_started":1}
I20260709 13:07:21.573108 26251 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:21.557294 26313 consensus_queue.cc:1059] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:07:21.601774 22246 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.589219 26196 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:21.589012 26305 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.587399 26250 raft_consensus.cc:740] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:21.610970 26259 log.cc:927] Time spent T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 1.618s	user 0.007s	sys 0.000s
I20260709 13:07:21.596385 26127 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.602890 26155 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.616405 22069 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:21.606985 26251 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.639907 26237 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:21.641539 26250 consensus_queue.cc:260] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.643167 26250 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.623680 22103 raft_consensus.cc:1240] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:21.602902 26320 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:21.656287 22098 raft_consensus.cc:1275] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:21.658815 22246 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:21.630174 26299 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:21.597007 26106 consensus_queue.cc:260] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.648090 26251 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.608326 26315 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.635377 26325 raft_consensus.cc:697] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:21.699703 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 571149us
W20260709 13:07:21.702827 22144 leader_election.cc:336] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Timed out: RequestConsensusVote RPC to 127.20.130.68:35973 timed out after 1.797s (SENT)
I20260709 13:07:21.628295 26196 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.651885 26307 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:21.703333 22218 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:21.669288 26299 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:21.630303 26305 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:21.706221 22105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1963) took 1618 ms (client timeout 2057 ms). Trace:
W20260709 13:07:21.710705 22105 rpcz_store.cc:269] 0709 13:07:20.083359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.083876 (+   517us) service_pool.cc:224] Handling call
0709 13:07:21.701955 (+1618079us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b540040f6d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:21.702120 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167818624}
I20260709 13:07:21.703336 22144 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:21.655203 26197 consensus_queue.cc:1059] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:07:21.670531 26231 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:21.719520 26231 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.721720 26231 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:21.699355 25821 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:21.712627 26299 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:21.688149 26288 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:21.724152 26288 raft_consensus.cc:697] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:21.717693 26314 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:21.718293 22218 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:21.718885 26307 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:21.708449 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 534290us
I20260709 13:07:21.706172 26237 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:21.729918 22218 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:21.740571 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:21.741509 22218 leader_election.cc:400] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
W20260709 13:07:21.718406 26330 log.cc:927] Time spent T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:07:21.749284 22173 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:21.715212 26233 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:21.742337 26231 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.752512 26340 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:21.759413 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:21.744374 26314 raft_consensus.cc:697] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:21.772653 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:21.773005 26314 consensus_queue.cc:237] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.773903 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:21.761145 22841 heartbeater.cc:646] Failed to heartbeat to 127.20.130.126:34457 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.130.126:34457 timed out after 15.000s (SENT)
I20260709 13:07:21.775453 26324 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:21.778963 22175 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:21.779240 26325 consensus_queue.cc:237] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.763121 26292 consensus_queue.cc:1059] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:07:21.763434 26332 log.cc:927] Time spent T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:07:21.763970 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:21.783716 22098 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 12: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:21.764619 22176 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:07:21.784593 22176 pending_rounds.cc:85] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 5
I20260709 13:07:21.784904 22176 pending_rounds.cc:107] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:07:21.785169 22176 raft_consensus.cc:2889] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.764683 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:07:21.765766 26328 log.cc:927] Time spent T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:07:21.765992 26237 consensus_queue.cc:1059] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:21.766793 26333 log.cc:927] Time spent T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:21.766748 26307 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:21.810316 26305 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:21.781432 26285 consensus_queue.cc:1175] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "79683575881f4334bd4dc6d9bdbb45c3" responder_term: 9 status { last_received { term: 8 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:21.788578 26245 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:21.813189 26315 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:21.814705 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:21.815541 22254 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 12: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:21.816459 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:21.817556 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:21.818487 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:21.731892 26256 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.819804 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 637) took 1546 ms. Trace:
I20260709 13:07:21.767786 26342 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:21.821622 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:21.768168 26331 log.cc:927] Time spent T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:07:21.822726 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:21.823832 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:21.824396 22248 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:21.825213 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:21.825739 22248 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:21.825641 26324 consensus_queue.cc:1059] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:21.767139 26244 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.742785 25889 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:21.826953 22097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 630) took 1587 ms (client timeout 1570 ms). Trace:
I20260709 13:07:21.826773 26127 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:21.827441 25889 raft_consensus.cc:697] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:21.828076 26232 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:21.828377 26127 raft_consensus.cc:3055] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:21.788381 26204 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:21.826627 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 635) took 1554 ms. Trace:
I20260709 13:07:21.828804 26127 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:21.829221 22102 rpcz_store.cc:276] 0709 13:07:20.272238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.453849 (+1181611us) service_pool.cc:224] Handling call
0709 13:07:21.454148 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.482972 (+ 28824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.810910 (+327938us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b5400021f54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:21.826572 (+ 15662us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64177920}
I20260709 13:07:21.829839 26127 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.826642 26324 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:07:21.784204 22252 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:21.826695 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:21.832940 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:21.768323 26288 consensus_queue.cc:237] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.788057 22172 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:21.841900 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:21.789873 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:21.744048 26197 raft_consensus.cc:3055] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:21.842700 22252 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.843613 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:21.791836 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:21.792166 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:21.792500 26104 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:21.792833 26292 raft_consensus.cc:3055] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:21.789769 26340 raft_consensus.cc:697] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:07:21.795321 22246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 2266) took 1166 ms (client timeout 1507 ms). Trace:
I20260709 13:07:21.795521 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:21.854094 22255 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:21.855563 22249 raft_consensus.cc:2393] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:21.856752 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:21.795822 26196 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:21.796164 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1958) took 1718 ms. Trace:
I20260709 13:07:21.782769 26233 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.796658 26341 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:21.853245 22246 rpcz_store.cc:269] 0709 13:07:20.629059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.629230 (+   171us) service_pool.cc:224] Handling call
0709 13:07:21.795144 (+1165914us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b540005dcd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:21.795237 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2231971072}
I20260709 13:07:21.802011 26238 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:21.796244 26231 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:21.806720 26155 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:21.819904 22181 raft_consensus.cc:2368] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11.
I20260709 13:07:21.820943 26256 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:21.739867 26313 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.820235 22100 rpcz_store.cc:276] 0709 13:07:20.278189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.511834 (+1233645us) service_pool.cc:224] Handling call
0709 13:07:21.523580 (+ 11746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.555726 (+ 32146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.819592 (+263866us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b540008ded4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:21.819750 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62155008}
I20260709 13:07:21.836360 22220 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:21.827437 22097 rpcz_store.cc:269] 0709 13:07:20.239235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.672687 (+433452us) service_pool.cc:224] Handling call
0709 13:07:21.826743 (+1154056us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b54002b9654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:21.826866 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139011968}
I20260709 13:07:21.787774 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:21.806113 26321 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.844682 22098 raft_consensus.cc:2368] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
W20260709 13:07:21.847085 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 101978us
I20260709 13:07:21.851955 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:21.851184 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 90567us
I20260709 13:07:21.875437 22147 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:21.852607 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:21.876879 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:21.876374 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:21.858896 22106 rpcz_store.cc:276] 0709 13:07:20.077522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.078670 (+  1148us) service_pool.cc:224] Handling call
0709 13:07:20.078964 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.790033 (+711069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.795915 (+1005882us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b54000b8e54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:21.796090 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1577908096}
I20260709 13:07:21.798038 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:21.878525 22104 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:21.860638 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:21.878969 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:21.878630 22177 raft_consensus.cc:1240] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:21.857573 22249 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 7.
I20260709 13:07:21.865579 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:21.880776 22254 raft_consensus.cc:2393] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 7: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:21.867502 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:21.881359 22246 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 12: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:21.880796 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:21.883709 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 145182us
I20260709 13:07:21.851636 26197 raft_consensus.cc:740] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:21.852909 26292 raft_consensus.cc:740] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:21.883745 22249 raft_consensus.cc:2393] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 12: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:21.885265 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:21.885984 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:21.886576 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:21.887298 22254 raft_consensus.cc:2393] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 10: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:21.888753 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:21.889874 22254 raft_consensus.cc:2410] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:21.892050 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:21.893353 22100 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:07:21.884505 26196 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:21.891871 26282 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.851866 26103 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:21.918467 26103 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.828487 25889 consensus_queue.cc:237] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.919272 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:21.919279 26282 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.920133 22104 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
I20260709 13:07:21.872146 26127 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:21.896911 22176 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:21.897138 22218 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:21.885984 22098 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:21.900691 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:21.887063 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 50773.8us
I20260709 13:07:21.898977 22249 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:21.829247 26204 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.896322 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:21.868489 26231 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.900691 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:21.931784 22106 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:21.903321 26340 consensus_queue.cc:237] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.905637 26244 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:21.863046 25846 consensus_queue.cc:1059] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:07:21.914592 26344 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:21.864961 26341 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:21.915663 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2275) took 1145 ms. Trace:
I20260709 13:07:21.915549 26197 consensus_queue.cc:260] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:21.926505 22252 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
W20260709 13:07:21.976069 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 50431us
I20260709 13:07:21.989589 22000 catalog_manager.cc:5697] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:21.978020 22247 rpcz_store.cc:276] 0709 13:07:20.770049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.775974 (+  5925us) service_pool.cc:224] Handling call
0709 13:07:20.776438 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.776908 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:20.863210 (+ 86302us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.789153 (+925943us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.809258 (+ 20105us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b4800240258. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66ace77aa1 00007f66ace6eb37 00007f66ace6e9ca 00007f66acf6626f 00007f66acf65f37 00007f66acf7a55c 00007f66acf7a508 00007f66acf7a488 00007f66acf7a443 00007f66acf796ec 00007f66abea3a96
0709 13:07:21.853174 (+ 43916us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.853347 (+   173us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:21.853619 (+   272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.853687 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.915315 (+ 61628us) raft_consensus.cc:1685] finished
0709 13:07:21.915459 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.915603 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":631267,"prepare.queue_time_us":135293,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":680116,"raft.run_cpu_time_us":2192,"raft.run_wall_time_us":128020,"spinlock_wait_cycles":5883264,"thread_start_us":318617,"threads_started":3,"wal-append.queue_time_us":386972}
I20260709 13:07:21.997315 22248 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:21.990599 22249 raft_consensus.cc:1240] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:21.885885 26256 consensus_queue.cc:1059] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:07:21.996959 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:21.993059 26092 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:07:22.009771 22253 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:22.010465 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 113394us
I20260709 13:07:22.016258 22218 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:22.016624 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 185025us
W20260709 13:07:22.018410 22779 connection.cc:256] RPC call timeout handler was delayed by -1.2325338960000636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 13:07:22.017006 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.019533 22779 connection.cc:256] RPC call timeout handler was delayed by -1.0885338960000581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
I20260709 13:07:21.929282 26342 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:07:21.914582 26251 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:22.023919 22247 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:22.023809 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:22.027262 22809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 1013) took 2215 ms. Trace:
I20260709 13:07:22.030187 22809 rpcz_store.cc:276] 0709 13:07:19.812146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.829971 (+ 17825us) service_pool.cc:224] Handling call
0709 13:07:19.860845 (+ 30874us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.801233 (+940388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.026990 (+1225757us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b54005c0b54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:22.027202 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2144912640}
I20260709 13:07:22.032506 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:22.047853 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:21.994463 26104 consensus_queue.cc:1059] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:07:22.008846 26339 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.994624 26315 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:07:21.978757 26307 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:07:21.989565 26343 consensus_queue.cc:1059] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:07:22.057132 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:22.058218 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:22.064841 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:22.068645 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:22.069432 22103 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.072160 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:22.047467 26321 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:22.022171 26294 consensus_queue.cc:1059] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:07:21.923076 26292 consensus_queue.cc:260] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:22.050331 26237 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:22.080791 22099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1966) took 1995 ms (client timeout 1711 ms). Trace:
W20260709 13:07:22.081352 22099 rpcz_store.cc:269] 0709 13:07:20.084989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.553946 (+468957us) service_pool.cc:224] Handling call
0709 13:07:22.080518 (+1526572us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b540001ed54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:22.080693 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2112234880}
I20260709 13:07:22.085284 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:22.063772 26307 consensus_queue.cc:1243] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:22.086544 22102 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:22.050747 26299 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:22.098593 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:22.097005 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 80856.4us
I20260709 13:07:22.100782 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:22.114454 22218 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:22.101928 22253 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:22.107949 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:22.098330 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:22.121285 22099 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:22.108935 22103 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:22.124085 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:22.111567 26335 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.247s	user 0.001s	sys 0.001s
I20260709 13:07:22.149202 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:22.154733 22103 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:22.157123 22099 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:22.157685 22099 pending_rounds.cc:85] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 7
I20260709 13:07:22.157960 22099 pending_rounds.cc:107] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:22.158254 22099 raft_consensus.cc:2889] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:22.123303 26296 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.166174 22102 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:22.168495 22147 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:22.171609 26352 log.cc:927] Time spent T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:22.175578 22175 raft_consensus.cc:1275] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:22.142413 26204 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:22.193441 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 79091.3us
I20260709 13:07:22.520588 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:22.519323 22103 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:22.287045 26356 log.cc:927] Time spent T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 13:07:22.474659 26350 log.cc:927] Time spent T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.351s	user 0.003s	sys 0.007s
W20260709 13:07:22.518096 26313 consensus_meta.cc:287] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.638s	user 0.009s	sys 0.001s
W20260709 13:07:22.568250 26357 log.cc:927] Time spent T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.280s	user 0.000s	sys 0.000s
W20260709 13:07:22.569666 26360 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:07:22.197599 26231 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:22.711105 26251 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:22.428166 22172 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.021s
W20260709 13:07:22.709578 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 541112us
I20260709 13:07:22.444012 26293 raft_consensus.cc:3055] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:22.710750 26307 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.538108 26321 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:22.711308 26359 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.215705 26232 consensus_queue.cc:1048] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.376s
W20260709 13:07:22.712981 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 192438us
W20260709 13:07:22.727025 22172 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.026s	sys 0.036s
I20260709 13:07:22.727385 22147 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:22.742660 26231 consensus_queue.cc:1059] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:22.743332 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:22.744477 26209 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.746086 26210 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.746225 26251 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:22.746696 26251 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.747093 26251 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.724094 26313 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:22.752979 26106 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:22.737309 26307 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:22.756105 26299 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:22.773099 22103 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 13:07:22.772989 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:22.757201 26307 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:22.757486 26341 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:22.765213 26196 raft_consensus.cc:3055] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:22.776125 22218 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:22.713415 26371 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.778698 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:22.775698 26209 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:22.779603 26209 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:22.780267 26305 raft_consensus.cc:3055] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:22.780725 26305 raft_consensus.cc:740] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:22.781066 26196 raft_consensus.cc:740] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:22.781183 22102 raft_consensus.cc:1240] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:22.778861 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:22.781651 26305 consensus_queue.cc:260] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:22.781932 26196 consensus_queue.cc:260] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:22.782582 22103 raft_consensus.cc:2393] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:22.731196 26293 raft_consensus.cc:740] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:22.790268 22251 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:22.792943 22218 leader_election.cc:400] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:22.793406 22218 leader_election.cc:403] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:22.796231 22218 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:22.781687 26209 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:22.798453 26197 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:22.798686 26209 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:22.799119 26209 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:22.795625 26341 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:22.799501 26344 consensus_queue.cc:1059] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:22.785229 26305 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:22.800938 26341 raft_consensus.cc:3055] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:22.801486 26341 raft_consensus.cc:740] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:22.775585 26363 consensus_queue.cc:1059] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:07:22.803293 26284 raft_consensus.cc:3055] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:22.799503 26209 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:22.803747 26284 raft_consensus.cc:740] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:22.806048 26284 consensus_queue.cc:260] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:22.807065 26210 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:22.807242 26284 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.793972 26196 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.807566 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:22.802569 26341 consensus_queue.cc:260] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:22.809790 26341 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.812906 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:22.817905 22102 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:07:22.822376 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.833811 26208 raft_consensus.cc:3055] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:22.834389 26208 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:07:22.835466 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.836072 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.789494 26371 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:22.841398 26362 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:22.836921 26210 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:07:22.859179 22098 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:22.861539 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 772) took 1042 ms. Trace:
I20260709 13:07:22.862084 22246 rpcz_store.cc:276] 0709 13:07:21.818911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.971288 (+152377us) service_pool.cc:224] Handling call
0709 13:07:21.971630 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.994635 (+ 23005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.994674 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.994720 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:21.994775 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.861231 (+866456us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b54002cb5d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:22.861296 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.861462 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52397824}
I20260709 13:07:22.863458 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 2336) took 1610 ms. Trace:
W20260709 13:07:22.857390 26329 log.cc:927] Time spent T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:07:22.863866 22181 rpcz_store.cc:276] 0709 13:07:21.253349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.284199 (+ 30850us) service_pool.cc:224] Handling call
0709 13:07:22.862233 (+1578034us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b5400120054. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:22.863396 (+  1163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1229616896}
I20260709 13:07:22.846349 26251 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:22.891803 26251 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:22.892680 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 1975) took 1006 ms. Trace:
I20260709 13:07:22.893210 22100 rpcz_store.cc:276] 0709 13:07:21.885815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.130460 (+244645us) service_pool.cc:224] Handling call
0709 13:07:22.151231 (+ 20771us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.151738 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:22.151980 (+   242us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.714754 (+562774us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.852280 (+137526us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:22.852321 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.852398 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.892435 (+ 40037us) raft_consensus.cc:1685] finished
0709 13:07:22.892453 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.892608 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":209,"raft.queue_time_us":2356,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"thread_start_us":123914,"threads_started":1,"wal-append.queue_time_us":153922}
W20260709 13:07:22.876760 26366 log.cc:927] Time spent T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:22.853636 26293 consensus_queue.cc:260] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:22.887327 26365 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:07:22.887988 26369 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:07:22.885444 26371 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:22.875974 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1852) took 1114 ms. Trace:
I20260709 13:07:22.903242 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:22.914227 22105 rpcz_store.cc:276] 0709 13:07:21.761757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.763194 (+  1437us) service_pool.cc:224] Handling call
0709 13:07:21.763500 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.876601 (+113101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.876628 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.876668 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:21.876701 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.875726 (+999025us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540008e3d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:22.875773 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.875911 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259662080}
W20260709 13:07:22.905910 26364 log.cc:927] Time spent T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.091s	user 0.003s	sys 0.000s
I20260709 13:07:22.858206 26362 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:22.873972 26342 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:22.907816 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.923317 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.908183 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 1.30889e+06us
W20260709 13:07:22.924619 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.910252 26293 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.911168 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2350) took 1040 ms. Trace:
I20260709 13:07:22.925282 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:22.925599 22173 rpcz_store.cc:276] 0709 13:07:21.871068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.912505 (+ 41437us) service_pool.cc:224] Handling call
0709 13:07:21.912856 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.913318 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:21.913619 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.896863 (+983244us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b180004a320. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a7af64bc 00007f66a4e4448b 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee23a
0709 13:07:22.897086 (+   223us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.897591 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.897749 (+   158us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:22.897787 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.897855 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.910719 (+ 12864us) raft_consensus.cc:1685] finished
0709 13:07:22.910856 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.911073 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7310,"prepare.queue_time_us":101208,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":5825,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":3401,"spinlock_wait_cycles":6431616,"thread_start_us":101268,"threads_started":1,"wal-append.queue_time_us":160750}
I20260709 13:07:22.845161 26208 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:22.912822 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.905259 22071 leader_election.cc:400] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11.
I20260709 13:07:22.928077 22071 leader_election.cc:403] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:22.928233 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.928615 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.928836 26387 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11.
I20260709 13:07:22.930130 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:22.930780 22812 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:22.930260 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:22.935848 22813 raft_consensus.cc:2410] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:07:22.905138 26127 consensus_meta.cc:287] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.984s	user 0.020s	sys 0.005s
I20260709 13:07:22.954480 26362 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:22.936662 25821 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:22.955343 25821 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.955802 25821 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:22.939620 26342 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:22.957788 26342 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:22.959861 22097 raft_consensus.cc:2410] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:07:22.936277 26329 log.cc:927] Time spent T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:07:22.963267 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 1.13886e+06us
I20260709 13:07:23.019469 26209 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:23.023146 26155 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.029953 26155 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:23.025193 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 60320.8us
I20260709 13:07:23.029031 26209 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:23.029155 26233 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:23.044037 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:23.037765 22812 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:23.044898 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:23.045970 22814 raft_consensus.cc:2368] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:23.044953 22813 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.055570 22814 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:07:23.058014 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 59781.9us
I20260709 13:07:23.058254 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:23.039059 26254 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.062875 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:23.032404 26155 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:23.049957 26368 log.cc:927] Time spent T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:23.069267 22807 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:23.069038 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:23.067759 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2125) took 1256 ms. Trace:
I20260709 13:07:23.078029 22813 raft_consensus.cc:2410] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:23.053675 26225 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:07:23.040904 26385 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.073504 22255 rpcz_store.cc:276] 0709 13:07:21.811626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.971218 (+159592us) service_pool.cc:224] Handling call
0709 13:07:21.998537 (+ 27319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.087090 (+ 88553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.087119 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.087542 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.161752 (+ 74210us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:22.356633 (+194881us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.356828 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.356902 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.067404 (+710502us) raft_consensus.cc:1685] finished
0709 13:07:23.067427 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.067669 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27064,"prepare.queue_time_us":145228,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":67,"raft.queue_time_us":97133,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":6301,"thread_start_us":120862,"threads_started":2,"wal-append.queue_time_us":629550}
I20260709 13:07:23.094714 22781 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:23.080215 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2346) took 1245 ms. Trace:
I20260709 13:07:23.098745 22218 leader_election.cc:400] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11.
I20260709 13:07:23.099997 22811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 1025) took 1556 ms. Trace:
I20260709 13:07:23.099923 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:23.100749 22173 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
I20260709 13:07:23.100468 22811 rpcz_store.cc:276] 0709 13:07:21.543344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.543485 (+   141us) service_pool.cc:224] Handling call
0709 13:07:21.543919 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.544361 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:21.584504 (+ 40143us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.639445 (+1054941us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b18000fcf40. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee23a 00007f66a7f58a2a
0709 13:07:23.097089 (+457644us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.097872 (+   783us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.098314 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.099565 (+  1251us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:23.099606 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.099667 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.099809 (+   142us) raft_consensus.cc:1685] finished
0709 13:07:23.099822 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.099945 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":191327,"prepare.queue_time_us":122038,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":199534,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":198,"spinlock_wait_cycles":6581120,"thread_start_us":185843,"threads_started":2,"wal-append.queue_time_us":1256720}
I20260709 13:07:23.095896 22177 rpcz_store.cc:276] 0709 13:07:21.834847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.836032 (+  1185us) service_pool.cc:224] Handling call
0709 13:07:21.836326 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.879646 (+ 43320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.079982 (+1200336us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b54000019d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:23.080152 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96817536}
I20260709 13:07:23.102325 26209 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:07:23.112064 22218 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:23.113948 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 54892us
I20260709 13:07:23.095419 26093 raft_consensus.cc:3055] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:23.061380 26181 consensus_queue.cc:1059] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:07:23.061301 26092 consensus_queue.cc:1059] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:07:23.115955 22816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 1022) took 1657 ms. Trace:
I20260709 13:07:23.114732 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:23.081851 26254 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:23.057718 25821 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:23.116896 22816 rpcz_store.cc:276] 0709 13:07:21.458893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.459082 (+   189us) service_pool.cc:224] Handling call
0709 13:07:21.459431 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.459773 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:21.460024 (+   251us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.524517 (+ 64493us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.525174 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.525306 (+   132us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:21.584092 (+ 58786us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.622314 (+1038222us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b180044b240. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:07:22.905427 (+283113us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b180044b240. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4ddbc0a 00007f66ae51b219 00007f66a4e63a40 00007f66a4e5e4e4 00007f66a4e5e455 00007f66a7f46060 00007f66a7f58716 00007f66a7f69287 00007f66a7f69208
0709 13:07:22.905626 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.905700 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.115756 (+210056us) raft_consensus.cc:1685] finished
0709 13:07:23.115775 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.115903 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15219,"prepare.queue_time_us":28231,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":1327666,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":4931,"spinlock_wait_cycles":14623872,"thread_start_us":118590,"threads_started":2,"wal-append.queue_time_us":122939}
I20260709 13:07:23.118674 22218 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:23.125217 22781 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:23.128943 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.129681 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.114876 26210 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:23.115056 26100 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:23.114966 26093 raft_consensus.cc:740] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:23.123356 26341 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:23.108945 26385 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:23.132649 26231 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:23.144881 26100 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.150549 26092 consensus_queue.cc:1059] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:07:23.126885 26229 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:07:23.166141 26155 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:23.180259 26155 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.180737 26155 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:23.181738 26389 log.cc:927] Time spent T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:07:23.132205 26397 consensus_queue.cc:1059] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:07:23.165514 26272 consensus_queue.cc:1059] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:07:23.185658 26385 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:23.168927 25821 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:23.164155 26100 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.187243 26247 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.159477 26093 consensus_queue.cc:260] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:23.187840 26247 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:23.188941 26092 consensus_queue.cc:1059] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:23.189945 26155 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:23.159857 26282 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:23.191150 22779 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:23.191340 26247 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:23.176823 26292 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.192015 22779 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:23.192276 26155 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:23.192866 26155 consensus_queue.cc:1059] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:23.178313 26254 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:23.194495 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:23.201069 22816 raft_consensus.cc:2410] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:07:23.188196 26093 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:23.178589 26384 log.cc:927] Time spent T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.074s	user 0.001s	sys 0.001s
W20260709 13:07:23.194437 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.213135 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.205494 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:23.214268 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:23.215047 22179 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:23.193883 26155 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:07:23.200353 26225 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:23.207998 26272 consensus_queue.cc:1243] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer c0694f6572bf406a92d55f1f2ab46ef2 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:23.208483 25821 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:23.232807 25821 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.233222 25821 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.215586 22181 raft_consensus.cc:1217] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 5.2->[6.3-13.6]   Dedup: 7.4->[11.5-13.6]
I20260709 13:07:23.234527 22181 pending_rounds.cc:85] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 4
I20260709 13:07:23.189972 26092 raft_consensus.cc:3055] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:23.216230 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:23.235539 26092 raft_consensus.cc:740] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:23.235210 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:23.236603 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:23.236428 26092 consensus_queue.cc:260] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:23.237210 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:23.237659 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:23.234776 22181 pending_rounds.cc:107] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:07:23.241601 22181 raft_consensus.cc:2889] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.242383 22069 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:23.216068 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:23.216905 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.216835 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:07:23.245793 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.245911 22813 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 11: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:23.214761 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:23.219835 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.218323 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet c42ecdbc6a0d4ed88048a3ea9bc6b893: Illegal state: Replica 765d912bde9e48959e50d9efec3c26b6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:23.244824 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:23.231894 22808 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:23.231668 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:23.218894 26225 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.215279 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:23.253153 22808 raft_consensus.cc:1240] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:23.254276 22246 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:23.254612 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:23.255452 22254 raft_consensus.cc:1240] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:23.269086 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:23.273470 22255 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.270516 22175 pending_rounds.cc:85] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 10
I20260709 13:07:23.275028 22175 pending_rounds.cc:107] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:07:23.275388 22175 raft_consensus.cc:2889] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.277495 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:23.277843 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:23.256846 22173 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:23.256150 22253 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:23.249938 26232 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:23.255496 22807 raft_consensus.cc:2393] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 13: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:23.279616 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:23.282503 22246 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:23.251703 26225 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.285991 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:23.286087 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:23.286772 22254 raft_consensus.cc:1275] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:23.286885 22253 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.286855 22246 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:23.237610 26092 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.288398 22254 raft_consensus.cc:1275] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:23.288875 22246 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:23.289783 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 246460us
I20260709 13:07:23.289724 22254 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:23.292599 22782 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:23.294090 22179 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:23.251113 26305 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.295838 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:23.295955 26305 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:23.296617 22816 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:23.298296 22251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 2264) took 2684 ms (client timeout 1913 ms). Trace:
I20260709 13:07:23.270678 26398 raft_consensus.cc:3055] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:23.299027 26398 raft_consensus.cc:740] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:23.299549 22252 raft_consensus.cc:1275] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:23.299901 26398 consensus_queue.cc:260] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:23.301138 26398 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.302482 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2284) took 1464 ms. Trace:
I20260709 13:07:23.304039 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 769) took 1485 ms. Trace:
I20260709 13:07:23.304497 22249 rpcz_store.cc:276] 0709 13:07:21.818137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.972147 (+154010us) service_pool.cc:224] Handling call
0709 13:07:21.990349 (+ 18202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.998710 (+  8361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.303821 (+1305111us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b54002cabd0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:23.303974 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40978688}
I20260709 13:07:23.308327 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1850) took 2441 ms. Trace:
I20260709 13:07:23.311429 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:23.298681 22251 rpcz_store.cc:269] 0709 13:07:20.613387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.613517 (+   130us) service_pool.cc:224] Handling call
0709 13:07:23.298026 (+2684509us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b5400073ad4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:23.298187 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4983773056}
I20260709 13:07:23.298621 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:23.313971 22144 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:23.315374 22808 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:23.308854 22101 rpcz_store.cc:276] 0709 13:07:20.867392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.625040 (+757648us) service_pool.cc:224] Handling call
0709 13:07:22.080668 (+455628us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:07:22.081093 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:22.095084 (+ 13991us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.333372 (+238288us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:07:22.356268 (+ 22896us) log.cc:844] Serialized 104 byte log entry
0709 13:07:22.356447 (+   179us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:22.356674 (+   227us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.357009 (+   335us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.866846 (+509837us) spinlock_profiling.cc:243] Waited 88.5 ms on lock 0x7b180031bf40. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e5e455 00007f66a7f46060 00007f66a7f58716 00007f66a7f69287 00007f66a7f69208
0709 13:07:22.962337 (+ 95491us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.962660 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.962812 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.962853 (+    41us) raft_consensus.cc:1685] finished
0709 13:07:22.962864 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.308110 (+345246us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b540001ed50. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:23.308254 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5896,"prepare.queue_time_us":14818,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":191984,"raft.run_cpu_time_us":634,"raft.run_wall_time_us":31820,"spinlock_wait_cycles":1217990400,"thread_start_us":306627,"threads_started":2,"wal-append.queue_time_us":600340}
I20260709 13:07:23.302887 22252 rpcz_store.cc:276] 0709 13:07:21.837592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.997944 (+160352us) service_pool.cc:224] Handling call
0709 13:07:23.299237 (+1301293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.299926 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.302221 (+  2295us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400073ad0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:23.302403 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2992010496}
I20260709 13:07:23.327348 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:23.327505 22782 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:23.328151 22813 raft_consensus.cc:2393] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 14: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:23.328261 22253 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:23.332417 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:23.335035 26247 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:23.351558 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet ebf4c9a0fe314a8db203637fffd1dc52: Illegal state: Replica 79683575881f4334bd4dc6d9bdbb45c3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:23.353379 26209 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.354211 26281 raft_consensus.cc:3055] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:23.354004 26209 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:23.354597 26281 raft_consensus.cc:740] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:23.356114 26209 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:23.335152 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:23.336263 26155 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:23.326349 26359 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.369992 22102 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:23.298571 26305 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:23.358979 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 75563.8us
I20260709 13:07:23.361380 26379 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:24.497994 26379 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:24.498888 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1873) took 1133 ms. Trace:
I20260709 13:07:24.499320 22102 rpcz_store.cc:276] 0709 13:07:23.365208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.365524 (+   316us) service_pool.cc:224] Handling call
0709 13:07:23.365803 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.494811 (+1129008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.498824 (+  4013us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:24.500217 26379 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:23.363698 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.500450 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:24.502729 22102 raft_consensus.cc:2393] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 12: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:07:24.504456 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.325742 26232 raft_consensus.cc:697] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:24.523170 26023 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.335268 26402 log.cc:927] Time spent T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:07:24.523784 26023 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:24.523918 26232 consensus_queue.cc:237] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:24.524639 26426 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:24.525128 26426 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:23.366328 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:23.367156 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:23.366830 26281 consensus_queue.cc:260] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:23.368847 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:23.369321 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2344) took 1535 ms. Trace:
I20260709 13:07:23.372684 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:23.357704 22072 connection.cc:256] RPC call timeout handler was delayed by -1.3433894160000364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 13:07:24.526384 26023 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:23.387305 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.390332 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.336417 22097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 640) took 1461 ms. Trace:
I20260709 13:07:24.782840 22097 rpcz_store.cc:276] 0709 13:07:21.874960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.875089 (+   129us) service_pool.cc:224] Handling call
0709 13:07:23.336236 (+1461147us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540042bb54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:23.336363 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2453194496}
I20260709 13:07:23.544831 26419 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.786252 26419 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:24.788668 26419 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:24.101081 26414 log.cc:927] Time spent T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.485s	user 0.001s	sys 0.000s
W20260709 13:07:24.378099 26422 log.cc:927] Time spent T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:07:24.388896 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:24.409212 26425 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.791040 22178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 2004) took 3044 ms. Trace:
I20260709 13:07:24.791462 26425 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:24.793754 26425 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:24.794255 26425 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.343271 21992 maintenance_manager.cc:643] P 7bace290edae4f6bba4eb0d6a5b7d8c9: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.842s	user 0.247s	sys 0.066s Metrics: {"bytes_written":30616,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":203595,"dirs.run_cpu_time_us":562,"dirs.run_wall_time_us":39118,"drs_written":1,"lbm_read_time_us":1805,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":115145,"lbm_writes_10-100_ms":5,"lbm_writes_lt_1ms":28,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":138205,"threads_started":2,"update_count":30,"wal-append.queue_time_us":67724}
I20260709 13:07:24.451720 26430 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.468791 26431 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.795856 26431 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:24.795756 26430 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:24.797152 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 2021) took 1583 ms. Trace:
I20260709 13:07:24.798291 26431 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:24.504976 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:24.516688 22098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1864) took 1709 ms (client timeout 1789 ms). Trace:
I20260709 13:07:24.799049 22102 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:24.800943 21993 maintenance_manager.cc:419] P 7bace290edae4f6bba4eb0d6a5b7d8c9: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8778 bytes on disk
W20260709 13:07:24.799059 22098 rpcz_store.cc:269] 0709 13:07:22.807010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.807198 (+   188us) service_pool.cc:224] Handling call
0709 13:07:24.516475 (+1709277us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x7b54000b8954. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:24.516626 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116473088}
I20260709 13:07:24.791456 22178 rpcz_store.cc:276] 0709 13:07:21.746346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.746467 (+   121us) service_pool.cc:224] Handling call
0709 13:07:21.746759 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.861085 (+114326us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:21.902288 (+ 41203us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.554831 (+1652543us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b18000e5480. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a7af64bc 00007f66a4e4448b 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee23a
0709 13:07:23.555102 (+   271us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.555680 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.568758 (+ 13078us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:23.568806 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.569127 (+   321us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.790700 (+1221573us) raft_consensus.cc:1685] finished
0709 13:07:24.790807 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.790964 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154576,"prepare.queue_time_us":63741,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":118164,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":5838,"spinlock_wait_cycles":15943552,"thread_start_us":115279,"threads_started":2,"wal-append.queue_time_us":682627,"wal-append.run_cpu_time_us":2051,"wal-append.run_wall_time_us":1116433}
I20260709 13:07:24.517020 22100 raft_consensus.cc:1275] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:24.527549 22099 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:24.543061 22103 raft_consensus.cc:1275] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:24.539790 22072 connection.cc:256] RPC call timeout handler was delayed by -1.3253894160001209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 13:07:24.806332 21992 maintenance_manager.cc:643] P 7bace290edae4f6bba4eb0d6a5b7d8c9: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":336,"lbm_reads_lt_1ms":4}
I20260709 13:07:24.534789 26432 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.817014 26432 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:24.819849 26437 log.cc:927] Time spent T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.265s	user 0.003s	sys 0.000s
I20260709 13:07:24.571705 26436 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.821540 26436 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:24.823789 26436 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:24.582053 26434 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:24.824611 26434 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:24.572966 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:24.533424 22176 rpcz_store.cc:276] 0709 13:07:21.834228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.852376 (+ 18148us) service_pool.cc:224] Handling call
0709 13:07:21.852663 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.929897 (+ 77234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.369090 (+1439193us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b5400328cd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:23.369263 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101215104}
I20260709 13:07:24.508502 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.153488 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.154219 22250 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:24.507632 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:25.157249 22252 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.461973 22255 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
W20260709 13:07:25.160049 22255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 2129) took 1906 ms (client timeout 1599 ms). Trace:
W20260709 13:07:25.160460 22255 rpcz_store.cc:269] 0709 13:07:23.253245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.255609 (+  2364us) service_pool.cc:224] Handling call
0709 13:07:25.159966 (+1904357us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:24.521917 22220 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:25.164037 26453 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:25.164173 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 642307us
I20260709 13:07:25.164578 26453 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:25.165066 26453 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:25.165477 22220 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:23.363930 22144 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:23.531651 22172 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
W20260709 13:07:25.168382 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 1.80437e+06us
I20260709 13:07:25.169102 22144 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:25.169335 22172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 2017) took 1956 ms (client timeout 1718 ms). Trace:
I20260709 13:07:25.169643 22782 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:25.169693 22172 rpcz_store.cc:269] 0709 13:07:23.213102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.215005 (+  1903us) service_pool.cc:224] Handling call
0709 13:07:25.169151 (+1954146us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b5400080054. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:25.169259 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650149120}
I20260709 13:07:24.576807 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:23.585575 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.541088 22147 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.988s (SENT) [suppressed 23 similar messages]
I20260709 13:07:24.528178 22246 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
W20260709 13:07:25.177968 22246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 2295) took 1812 ms (client timeout 1937 ms). Trace:
I20260709 13:07:25.178203 22250 raft_consensus.cc:1240] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:25.178516 22246 rpcz_store.cc:269] 0709 13:07:23.365389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.368593 (+  3204us) service_pool.cc:224] Handling call
0709 13:07:25.177892 (+1809299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.179535 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.179983 22250 raft_consensus.cc:1240] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:25.180155 22246 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
W20260709 13:07:24.414875 22248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 2123) took 2603 ms (client timeout 1988 ms). Trace:
I20260709 13:07:24.537590 22251 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:25.191691 26457 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.192014 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 2293) took 1827 ms. Trace:
I20260709 13:07:24.527444 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 2290) took 1163 ms. Trace:
I20260709 13:07:25.193466 22249 rpcz_store.cc:276] 0709 13:07:23.364015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.366038 (+  2023us) service_pool.cc:224] Handling call
0709 13:07:24.527391 (+1161353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:24.527546 22254 raft_consensus.cc:2376] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11. Re-sending same reply.
W20260709 13:07:25.196204 22254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 2291) took 1831 ms (client timeout 1507 ms). Trace:
W20260709 13:07:25.196683 22254 rpcz_store.cc:269] 0709 13:07:23.364300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.366887 (+  2587us) service_pool.cc:224] Handling call
0709 13:07:25.196115 (+1829228us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:23.629736 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.199996 26460 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:25.200603 26460 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:23.375113 22779 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:23.469252 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 344056us
I20260709 13:07:24.574292 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.213613 22809 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:24.169948 22812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 603) took 1114 ms. Trace:
I20260709 13:07:25.215765 22812 rpcz_store.cc:276] 0709 13:07:23.055855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.059782 (+  3927us) service_pool.cc:224] Handling call
0709 13:07:23.060204 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.550852 (+490648us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b180040b400. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a7af64bc 00007f66a4e4448b 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e5e455 00007f66a7f46060 00007f66a7f46bfb 00007f66a7f5164b
0709 13:07:23.551086 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.551127 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.577010 (+ 25883us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.039099 (+462089us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.039155 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.039232 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.169513 (+130281us) raft_consensus.cc:1685] finished
0709 13:07:24.169557 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.169856 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53068,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":2439424,"thread_start_us":513316,"threads_started":2,"wal-append.queue_time_us":574329,"wal-append.run_cpu_time_us":2342,"wal-append.run_wall_time_us":1015590}
I20260709 13:07:23.373893 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:23.578959 25821 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:24.384609 25942 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.225795 25942 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.227186 22811 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:24.486248 26181 raft_consensus.cc:3055] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:23.468739 26196 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:25.241477 26196 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:24.171753 26208 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.333062 26225 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.250001 26225 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:24.437070 26234 raft_consensus.cc:3055] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:24.429046 26242 raft_consensus.cc:3055] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:23.343044 26272 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:24.016230 26287 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.531141 26100 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:23.501327 26247 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:24.569782 26320 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.540329 26023 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.127260 26371 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.542069 26256 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.385439 26387 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:23.496833 26275 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:24.383875 26312 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:24.528318 26314 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.458727 26359 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:23.559084 26399 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:23.486490 26403 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:07:24.643702 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 64757.3us
W20260709 13:07:24.686972 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 104728us
I20260709 13:07:24.719798 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:24.780465 26439 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.798800 26430 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:24.797535 22181 rpcz_store.cc:276] 0709 13:07:23.214148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.214986 (+   838us) service_pool.cc:224] Handling call
0709 13:07:23.215382 (+   396us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:07:23.242243 (+ 26861us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:23.268708 (+ 26465us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.361730 (+ 93022us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b1800477760. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee23a 00007f66a7f58a2a
0709 13:07:23.517898 (+156168us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.584274 (+ 66376us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:23.584995 (+   721us) log.cc:844] Serialized 52 byte log entry
0709 13:07:23.585174 (+   179us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:23.585206 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.585269 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.459823 (+874554us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b1800477760. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:07:24.796890 (+337067us) raft_consensus.cc:1685] finished
0709 13:07:24.796911 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.797049 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":970107,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":3056,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":11962,"spinlock_wait_cycles":74901888,"thread_start_us":221211,"threads_started":2,"wal-append.queue_time_us":271370}
I20260709 13:07:24.528931 26426 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:24.529820 26433 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.813565 26449 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:24.819613 26432 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:24.558735 26438 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:24.827082 26434 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:24.794695 26425 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:24.791493 26448 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.835317 22104 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.871143 26431 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:24.807147 22072 leader_election.cc:336] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.913s (SENT)
I20260709 13:07:25.062129 26281 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.097082 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2287) took 3258 ms. Trace:
I20260709 13:07:25.108031 26452 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:25.115319 22175 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:25.122287 22000 catalog_manager.cc:5697] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 6 to 8, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 8 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:25.134344 26250 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:25.135473 26419 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.136312 25889 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:07:25.136839 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.141013 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:25.167979 26454 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:25.171103 26251 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.171406 26308 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.171757 26363 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:25.171859 26451 consensus_queue.cc:1059] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:25.180948 26453 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.181669 22144 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:25.182173 22246 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:25.182175 26344 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.166780 22220 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:25.189193 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.189404 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 648297us
I20260709 13:07:25.189718 26362 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:25.192485 26405 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:25.192215 26457 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.197257 26456 consensus_queue.cc:1059] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:25.192366 22251 rpcz_store.cc:276] 0709 13:07:23.364889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.372394 (+  7505us) service_pool.cc:224] Handling call
0709 13:07:25.191956 (+1819562us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.203756 22782 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:25.203151 26442 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.190881 22248 rpcz_store.cc:269] 0709 13:07:21.811029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.826468 (+ 15439us) service_pool.cc:224] Handling call
0709 13:07:24.414616 (+2588148us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b540019bc54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:24.414795 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378029824}
I20260709 13:07:25.206766 22252 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:25.343866 26438 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:25.207811 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 1.83279e+06us
I20260709 13:07:25.343858 26371 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.346271 26442 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.346861 22101 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:25.348225 26438 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.230273 25821 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:25.348871 26438 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:25.349313 25821 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:07:25.349548 22779 connection.cc:256] RPC call timeout handler was delayed by -1.6228040349999446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
I20260709 13:07:25.349424 26438 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.351336 26251 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:25.352146 26439 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.353744 22255 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:25.353888 26425 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:25.354009 26442 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.355792 26452 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.355664 26275 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.356570 25821 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:25.357126 25821 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.358229 26452 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:25.359103 26419 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.345741 26453 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:25.359280 26275 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.360275 26275 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.344030 26287 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.360528 26256 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:25.360809 26275 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.361236 26419 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.362358 26287 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:25.362721 26275 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.348891 26371 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.362944 26320 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.367873 26449 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.369411 26320 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.363484 26242 raft_consensus.cc:740] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:25.363622 26405 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.364017 26181 raft_consensus.cc:740] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:25.364436 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 557295us
I20260709 13:07:25.364094 26403 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.364964 26448 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.365864 26431 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.366957 26451 raft_consensus.cc:3055] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:25.366847 26387 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.228823 26461 consensus_queue.cc:1059] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:25.202845 26460 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.367462 22247 rpcz_store.cc:276] 0709 13:07:21.838279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.197971 (+359692us) service_pool.cc:224] Handling call
0709 13:07:24.414780 (+2216809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.415033 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.415061 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:24.415090 (+    29us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:24.415110 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.415150 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.096865 (+681715us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b540019bc50. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:25.096993 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4891172224}
I20260709 13:07:25.409085 25821 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.480919 26430 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.370901 26405 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:25.390048 26380 consensus_queue.cc:1059] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:07:25.354776 26250 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.482223 26430 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.484889 26250 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:25.485570 26430 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.481520 26461 consensus_queue.cc:1243] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:25.250845 26225 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:25.486253 26362 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:25.487346 22072 connection.cc:256] RPC call timeout handler was delayed by -1.1741894160001038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
I20260709 13:07:25.488497 26362 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.488147 26399 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.489658 26308 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.296411 26196 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.492128 26451 raft_consensus.cc:740] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:25.492319 26314 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.493068 26451 consensus_queue.cc:260] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.494303 26451 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:25.495081 26344 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.496675 26181 consensus_queue.cc:260] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.498409 26181 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:25.500772 22072 connection.cc:256] RPC call timeout handler was delayed by -1.0850894160000735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 13:07:25.501508 22072 connection.cc:256] RPC call timeout handler was delayed by -1.0616894160001493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 13:07:25.502660 26312 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.505508 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.436762 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:25.485828 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.370693 26242 consensus_queue.cc:260] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:25.491325 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 324606us
I20260709 13:07:25.395913 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.439208 25942 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.399286 22811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 720) took 2157 ms. Trace:
I20260709 13:07:25.495371 26314 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.393671 22000 catalog_manager.cc:5697] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 6 to 7, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 7 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:25.497665 26344 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:25.507884 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.506711 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:25.535678 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.536010 22175 raft_consensus.cc:2410] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:25.508783 22220 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:25.510955 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45738 (request call id 778) took 1008 ms. Trace:
I20260709 13:07:25.538589 22252 rpcz_store.cc:276] 0709 13:07:24.502076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.507312 (+  5236us) service_pool.cc:224] Handling call
0709 13:07:25.510864 (+1003552us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:25.541128 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.531069 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:25.517259 22807 raft_consensus.cc:2393] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 10: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:25.547091 22220 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:25.519011 22104 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:25.370651 26449 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:25.520900 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 317193us
I20260709 13:07:25.529217 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 785) took 1025 ms. Trace:
I20260709 13:07:25.508829 22172 raft_consensus.cc:2393] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 11: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:25.552731 22246 rpcz_store.cc:276] 0709 13:07:24.503882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.181701 (+677819us) service_pool.cc:224] Handling call
0709 13:07:25.182000 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.528870 (+346870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.529139 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.554136 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:25.506389 22181 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:25.517123 22071 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:25.555222 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.518978 22811 rpcz_store.cc:276] 0709 13:07:23.241874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.250759 (+  8885us) service_pool.cc:224] Handling call
0709 13:07:23.269316 (+ 18557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.227754 (+1958438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.238648 (+ 10894us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b5400740254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:25.399202 (+160554us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4502085376}
I20260709 13:07:25.549746 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:25.556152 22253 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:25.559232 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35214 (request call id 729) took 2261 ms. Trace:
I20260709 13:07:25.558957 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.568361 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 1995) took 1182 ms. Trace:
I20260709 13:07:25.362732 26256 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
W20260709 13:07:25.576275 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 62707.2us
I20260709 13:07:25.559629 22807 rpcz_store.cc:276] 0709 13:07:23.298267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.298374 (+   107us) service_pool.cc:224] Handling call
0709 13:07:25.559045 (+2260671us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b5400736c54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:25.559171 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5060479232}
I20260709 13:07:25.578895 22811 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:25.568962 22104 rpcz_store.cc:276] 0709 13:07:24.386279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.386438 (+   159us) service_pool.cc:224] Handling call
0709 13:07:25.568147 (+1181709us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b540040f6d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:25.568285 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101922048}
I20260709 13:07:25.582170 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.583235 22172 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:25.575707 22220 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:25.442608 26439 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.536722 25821 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:25.594666 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:25.595571 22172 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:25.589074 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.513062 26457 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.536855 26460 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.505955 26312 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.591172 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.507992 26242 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:25.606515 22248 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:25.511750 26403 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.536943 26430 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.591032 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.597353 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.591456 26320 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:25.608633 26320 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.509094 26234 raft_consensus.cc:740] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:25.543021 26196 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.543123 26434 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.622309 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 440721us
I20260709 13:07:25.622776 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.574210 26314 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:25.599934 22807 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:07:25.517325 26443 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.510736 26308 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:25.601570 22181 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:25.602463 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.602738 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.601027 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.603812 22809 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:07:25.559785 26442 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.509016 26431 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.608311 26430 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.557546 26380 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.606351 22000 catalog_manager.cc:5697] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:25.546356 26344 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:25.609000 26320 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:25.662472 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.663257 22810 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:25.604494 26439 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:07:25.575133 26452 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:25.558427 26435 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:25.491351 26454 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:25.624156 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:25.624931 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.594835 25821 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.710136 25821 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.713303 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.714906 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.716254 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.717033 22173 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:25.717947 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.718307 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.513247 26023 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.675385 26380 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.721244 26380 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.511193 25889 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.721244 26023 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.628752 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.724526 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 786) took 1220 ms. Trace:
I20260709 13:07:25.724735 26023 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.724960 22249 rpcz_store.cc:276] 0709 13:07:24.504162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.194174 (+690012us) service_pool.cc:224] Handling call
0709 13:07:25.194493 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.723692 (+529199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.723722 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:25.723761 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:25.723791 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.724313 (+   522us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54002cb5d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:25.724359 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.724471 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216615680}
I20260709 13:07:25.725387 26023 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:25.637980 22779 leader_election.cc:336] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Timed out: RequestConsensusVote RPC to 127.20.130.65:33421 timed out after 1.570s (SENT)
I20260709 13:07:25.638270 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.610664 26100 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:25.637491 22127 debug-util.cc:398] Leaking SignalData structure 0x7b08001bd320 after lost signal to thread 21004
W20260709 13:07:25.728945 22127 debug-util.cc:398] Leaking SignalData structure 0x7b08000b44e0 after lost signal to thread 22038
W20260709 13:07:25.729794 22127 debug-util.cc:398] Leaking SignalData structure 0x7b08000b46e0 after lost signal to thread 22052
I20260709 13:07:25.646438 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:25.622278 26312 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:25.687422 26431 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.740612 22127 debug-util.cc:398] Leaking SignalData structure 0x7b080009bde0 after lost signal to thread 22130
I20260709 13:07:25.622445 26462 raft_consensus.cc:2764] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:25.666819 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:25.646422 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:25.610239 26460 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.530105 26433 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.677646 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.771888 22248 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
W20260709 13:07:25.751780 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 175431us
I20260709 13:07:25.680750 22104 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:25.680866 22253 raft_consensus.cc:1240] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:25.621281 26399 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:25.692806 22177 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:25.775846 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.693871 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.777412 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:25.687604 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 63555us
I20260709 13:07:25.778429 22144 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:25.703729 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:25.780825 22100 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:07:25.706132 26430 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:25.782955 22218 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:25.706758 26435 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.647203 26234 consensus_queue.cc:260] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.809940 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.635492 26443 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.709646 26457 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:25.625525 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:25.819555 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:25.727427 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 89477.7us
W20260709 13:07:25.820942 22779 leader_election.cc:336] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Timed out: RequestConsensusVote RPC to 127.20.130.65:33421 timed out after 1.705s (SENT)
W20260709 13:07:25.821832 22779 leader_election.cc:336] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Timed out: RequestConsensusVote RPC to 127.20.130.65:33421 timed out after 1.728s (SENT)
I20260709 13:07:25.822182 22779 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:25.727654 26438 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:25.620345 26455 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.820204 22176 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:25.727725 22181 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:25.730263 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.591521 26425 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:07:25.731135 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.731205 22220 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:25.834996 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.724988 22807 raft_consensus.cc:2393] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 14: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:25.732626 26387 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.846015 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:25.846668 22104 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:25.847193 22178 raft_consensus.cc:2393] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 10: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:25.733135 26023 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.716251 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.733660 26359 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:25.734988 22172 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 14.
I20260709 13:07:25.854285 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.854668 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.855062 22181 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:25.855305 22172 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:25.855403 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.848134 22246 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:25.737839 22250 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:25.729214 25942 raft_consensus.cc:3055] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:25.564888 26371 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:07:25.741776 22127 debug-util.cc:398] Leaking SignalData structure 0x7b080035b2e0 after lost signal to thread 22205
I20260709 13:07:25.741987 22000 catalog_manager.cc:5697] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 6 to 9, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 9 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:25.744357 22101 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:25.744423 22106 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:25.676142 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.744680 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.751120 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:25.740772 26312 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.742103 25821 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.629101 26434 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.741181 22252 consensus_queue.cc:237] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:25.873176 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.873379 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.627974 26196 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.632066 26314 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.781883 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.785951 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.787808 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.724575 25889 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.883543 22815 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
W20260709 13:07:25.835121 26403 consensus_queue.cc:1175] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "79683575881f4334bd4dc6d9bdbb45c3" responder_term: 11 status { last_received { term: 11 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 11 index: 9 } }
I20260709 13:07:25.826606 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:25.858888 26447 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.827208 22251 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:25.681833 26448 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.684214 26344 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:25.866971 26281 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:25.893369 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:25.836341 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.900158 22104 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:25.839463 22811 raft_consensus.cc:2410] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:07:25.848798 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 117662us
I20260709 13:07:25.856094 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.903229 22181 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:25.726753 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:25.863003 22103 raft_consensus.cc:2393] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 9: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:25.867718 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:25.868186 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 259318us
I20260709 13:07:25.863175 22105 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
W20260709 13:07:25.865821 22144 connection.cc:256] RPC call timeout handler was delayed by -2.3630305970000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260709 13:07:25.904919 22144 connection.cc:256] RPC call timeout handler was delayed by -2.3531305970000176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
I20260709 13:07:25.868860 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:25.866361 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:25.862427 22127 debug-util.cc:398] Leaking SignalData structure 0x7b080036aee0 after lost signal to thread 22279
W20260709 13:07:25.905303 22144 connection.cc:256] RPC call timeout handler was delayed by -2.3476119570000265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 13:07:25.907725 22144 connection.cc:256] RPC call timeout handler was delayed by -2.2901305970000294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 13:07:25.908252 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.908484 22127 debug-util.cc:398] Leaking SignalData structure 0x7b080033e860 after lost signal to thread 22840
I20260709 13:07:25.818475 26457 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:25.911644 22782 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:25.836853 26208 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:25.859543 26455 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.879252 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:25.879462 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:25.873996 22173 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
W20260709 13:07:25.880903 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 303641us
I20260709 13:07:25.812927 22175 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:25.854333 26451 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:25.936726 26451 consensus_queue.cc:1059] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:25.937135 26443 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.938383 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:25.911576 26448 consensus_queue.cc:1059] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:07:25.939572 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:25.940233 26256 raft_consensus.cc:3055] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:25.893224 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.940681 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:25.863076 26419 raft_consensus.cc:3055] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:25.810420 26362 consensus_queue.cc:1059] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:07:25.883214 22177 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:25.895843 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.863528 26432 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:25.950112 22104 raft_consensus.cc:2410] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:25.897220 22254 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:25.897769 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.861009 25942 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:07:25.908591 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.910075 22127 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7de0 after lost signal to thread 26383
W20260709 13:07:25.970484 22144 connection.cc:256] RPC call timeout handler was delayed by -2.1830574300000762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
W20260709 13:07:25.971036 22144 connection.cc:256] RPC call timeout handler was delayed by -2.10653059699996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
W20260709 13:07:25.971407 22144 connection.cc:256] RPC call timeout handler was delayed by -1.9535305970000536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260709 13:07:25.971777 22144 connection.cc:256] RPC call timeout handler was delayed by -1.9229305970000041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
W20260709 13:07:25.972141 22144 connection.cc:256] RPC call timeout handler was delayed by -1.8941305969999576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 13:07:25.973439 22144 connection.cc:256] RPC call timeout handler was delayed by -1.2089834000000792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
I20260709 13:07:25.910296 22220 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:25.974300 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 64063.8us
I20260709 13:07:25.906322 22172 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 7.
I20260709 13:07:25.873871 22812 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:25.913739 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:25.878649 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:25.916319 22782 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:25.977710 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 61466.5us
W20260709 13:07:25.978242 22144 connection.cc:256] RPC call timeout handler was delayed by -1.1516305970000076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3049s for a response
I20260709 13:07:25.917825 26387 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.919261 26460 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.920657 26312 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.874344 26023 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:07:25.992126 26455 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.885892 26247 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:07:25.902277 26447 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:25.923887 26435 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.924465 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:25.913488 26457 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:25.947973 26256 raft_consensus.cc:740] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:25.906533 26225 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.925194 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:25.926491 25821 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.926644 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:25.858095 26430 consensus_queue.cc:1059] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:07:26.060374 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.061321 22098 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:25.863638 26399 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:07:25.940389 26434 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:25.929455 26344 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:25.941262 22100 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:25.932420 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 100438us
I20260709 13:07:25.836272 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.942533 22071 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:25.897360 22814 raft_consensus.cc:2393] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:25.905123 26471 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.941352 26419 raft_consensus.cc:740] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:25.952092 26448 raft_consensus.cc:3055] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:25.940254 26314 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.954175 26433 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.949426 26432 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.964118 22810 raft_consensus.cc:2410] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:25.964778 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:25.751768 26431 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:25.978929 22144 connection.cc:256] RPC call timeout handler was delayed by -1.1387834000000794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 13:07:25.981940 22072 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:25.982712 22000 catalog_manager.cc:5697] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 5 to 6, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 6 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:25.913225 26208 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.990679 26425 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:25.922557 26196 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:25.999341 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:25.999933 22808 raft_consensus.cc:2410] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:26.000509 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:26.159057 22812 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:26.000923 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:26.002090 22782 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:26.161330 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 159356us
I20260709 13:07:26.161437 26250 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:26.161891 26250 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:26.162283 26250 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.042177 22103 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:26.163693 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.164373 22103 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:26.164142 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:26.165412 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.165603 22252 raft_consensus.cc:2393] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 10: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:25.876652 26371 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.167344 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:26.168344 22249 raft_consensus.cc:2376] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12. Re-sending same reply.
I20260709 13:07:26.168970 26371 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:25.912899 26456 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.094s
W20260709 13:07:26.063354 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 67068.4us
I20260709 13:07:26.060313 22101 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:25.930940 26463 consensus_queue.cc:1059] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:07:26.171612 26463 raft_consensus.cc:3055] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:26.171525 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.172207 26463 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:26.070901 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 191891us
I20260709 13:07:26.003371 26100 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:26.005903 26247 consensus_queue.cc:1243] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:07:26.075464 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 133019us
I20260709 13:07:26.173614 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.079499 26448 raft_consensus.cc:740] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:26.077536 22218 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:26.178376 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 100910us
W20260709 13:07:26.008281 26181 consensus_meta.cc:287] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.002s
I20260709 13:07:25.996506 26362 consensus_queue.cc:1243] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer a07ca3d1b5b84f4bbcb907f709a69275 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:26.140043 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:26.006987 26387 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:26.148656 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 166801us
I20260709 13:07:26.187821 22072 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:26.144515 22144 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:26.142989 26432 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.152144 22175 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:26.079471 26453 raft_consensus.cc:3055] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:26.080911 26023 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:26.201035 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:26.155323 22100 raft_consensus.cc:2410] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:07:26.179483 22218 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:26.201668 22254 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.179245 22782 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:26.166623 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.202646 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:26.180063 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:26.181388 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:26.181777 22172 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:07:26.005131 26320 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.073118 26225 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.197314 26453 raft_consensus.cc:740] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:26.205628 22807 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:26.190384 22815 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:26.146231 26281 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:26.193259 22072 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:26.195149 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:26.157827 26435 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:26.153561 26208 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.187441 26466 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:26.152961 26425 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.203804 22172 pending_rounds.cc:85] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 10
I20260709 13:07:26.217998 22102 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.218366 22172 pending_rounds.cc:107] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:07:26.218766 22172 raft_consensus.cc:2889] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:26.203195 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:26.221244 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:26.206998 22177 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
W20260709 13:07:26.207165 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 62742.3us
I20260709 13:07:26.222451 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.197971 26443 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:26.209794 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.211146 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.211462 22072 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:26.227414 22100 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:26.212800 22099 raft_consensus.cc:2393] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:26.087705 26439 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:07:26.230547 26387 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:26.231009 26320 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:26.237617 22072 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:26.214279 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:26.080150 26471 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.215032 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:26.214847 26455 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:26.187178 26433 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.223451 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:26.230554 26439 raft_consensus.cc:3055] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:26.206369 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:26.224495 22103 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:26.200620 26023 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.227451 22105 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
W20260709 13:07:26.276810 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 53434.3us
W20260709 13:07:26.212528 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.238662 22249 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:26.285430 22144 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:26.284832 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:26.216694 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.240330 22072 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:26.227044 26443 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:26.215022 26449 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:26.244642 26320 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:26.305382 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 99089us
I20260709 13:07:26.215456 26314 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.243039 22254 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:26.160503 25942 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:26.221568 26425 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.239246 22252 raft_consensus.cc:2376] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13. Re-sending same reply.
I20260709 13:07:26.295729 22102 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:26.296718 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:26.299099 22106 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:26.302826 26443 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.317447 26250 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.318229 22810 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:07:26.305871 26371 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:26.319365 25942 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.322981 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:26.323329 22071 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:26.323762 22177 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:26.299767 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:26.299878 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:26.301258 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 61010.8us
I20260709 13:07:26.293853 26455 raft_consensus.cc:697] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:26.325661 22072 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:26.293231 26439 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:26.222313 26466 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.303188 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.245826 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.304363 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:26.224341 26362 consensus_queue.cc:1048] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:07:26.244757 26234 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:26.285547 26242 consensus_meta.cc:287] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.004s
I20260709 13:07:26.308480 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:26.358534 22811 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:26.244851 26433 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:26.242831 26485 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:26.283864 26023 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.365443 26457 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.367400 22254 raft_consensus.cc:1240] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:26.368208 26457 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:26.242158 26473 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:07:26.197266 26256 consensus_queue.cc:260] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:26.301342 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:26.241907 26312 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:26.303620 26405 consensus_meta.cc:287] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.821s	user 0.007s	sys 0.005s
I20260709 13:07:26.327236 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:26.327932 22071 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:26.383409 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 55577.3us
W20260709 13:07:26.330193 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.224530 22220 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:26.385674 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 161219us
I20260709 13:07:26.334438 22072 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:26.334869 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.354821 22181 raft_consensus.cc:2410] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:26.315518 26483 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.314545 26430 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:26.301903 26491 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:26.356506 22176 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:07:26.408826 22177 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.410482 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.411157 22103 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:26.360320 22782 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:26.413533 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 53303.5us
I20260709 13:07:26.414412 22782 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:26.415431 26456 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:26.364640 26484 log.cc:927] Time spent T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:07:26.415923 26456 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.372300 22172 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:26.365406 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:26.333712 26320 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:26.374732 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.416567 26403 consensus_queue.cc:1059] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:26.417372 26320 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:26.417989 26320 raft_consensus.cc:697] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:26.419107 26320 consensus_queue.cc:237] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:26.377652 22178 raft_consensus.cc:2410] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:26.355973 26371 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:26.378008 26487 log.cc:927] Time spent T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:26.396238 22069 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:26.421530 26371 raft_consensus.cc:697] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:26.398463 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:26.422799 26371 consensus_queue.cc:237] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.424295 22177 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
I20260709 13:07:26.394532 22810 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:26.378800 26466 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:26.405301 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 104036us
I20260709 13:07:26.333592 26314 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:07:26.357404 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.449632 22098 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:26.276108 26448 consensus_queue.cc:260] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:26.416002 26181 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:26.416538 26456 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.401578 26483 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.406059 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:26.362308 26433 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.371798 26431 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:26.427979 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:26.400018 26244 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:26.425926 22144 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:26.371526 26477 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:07:26.495620 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:26.453271 26475 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:26.482223 22815 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.425609 26242 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:26.404677 26430 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.399446 26405 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.468290 26256 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.510628 22254 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:26.546121 26430 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.467845 26455 consensus_queue.cc:237] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.553236 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:26.554396 22782 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:26.548768 26405 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:26.555836 22813 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 12: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:26.516743 26447 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:26.512338 26475 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.514083 26247 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:26.491431 26181 raft_consensus.cc:697] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:26.482753 26483 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.490449 26244 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:26.500716 26250 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:26.519644 26426 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:26.500164 26431 consensus_queue.cc:1059] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:07:26.564289 26475 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.563217 26461 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:26.452392 26439 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.564213 26247 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:26.596053 26247 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.596800 26100 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.596974 26208 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:26.597566 26100 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.600667 26463 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.601660 26430 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.603086 26419 consensus_queue.cc:260] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.604632 26419 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.584126 26426 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:26.607172 26426 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.595557 26439 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.579222 26244 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.612527 26023 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:26.771929 26181 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:26.691562 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 295121us
I20260709 13:07:26.776916 22069 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:26.692313 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 306860us
I20260709 13:07:26.483526 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.696255 22100 raft_consensus.cc:2410] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:26.697471 22104 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
W20260709 13:07:26.491145 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 65333.8us
I20260709 13:07:26.804688 26497 consensus_queue.cc:1059] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:26.805697 26208 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:26.475680 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 302326us
W20260709 13:07:26.701751 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 367219us
I20260709 13:07:26.711030 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:26.711601 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 303071us
I20260709 13:07:26.718286 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.728478 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:26.730533 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:26.735562 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 349124us
I20260709 13:07:26.741582 22099 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:26.751088 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.760459 22000 catalog_manager.cc:5697] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 7 to 8, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 8 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.765067 22816 raft_consensus.cc:2410] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:26.629416 26225 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:26.642637 26432 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.635942 26443 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:26.632827 26453 consensus_queue.cc:260] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.630228 26461 raft_consensus.cc:697] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:26.635062 26460 raft_consensus.cc:3055] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:26.615139 26471 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:26.781060 22813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35214 (request call id 731) took 3405 ms (client timeout 2399 ms). Trace:
I20260709 13:07:26.781723 22101 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:26.653366 26475 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:26.796995 26483 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.799451 26430 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:26.800980 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.620270 26456 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.803509 26498 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.811393 22071 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:26.806833 22144 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:26.840299 26100 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.817013 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:26.828243 26281 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.851336 26281 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.851871 22180 raft_consensus.cc:2393] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 9: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:26.853389 22816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35198 (request call id 1036) took 1252 ms. Trace:
I20260709 13:07:26.854137 26456 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:26.853932 26461 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.855454 26362 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:26.856886 22147 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:26.857529 26475 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:26.835544 22813 rpcz_store.cc:269] 0709 13:07:23.373561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.373683 (+   122us) service_pool.cc:224] Handling call
0709 13:07:26.778157 (+3404474us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54005d1454. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:26.778500 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3071583104}
I20260709 13:07:26.859351 26463 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.859742 22098 raft_consensus.cc:2393] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 8: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:26.861079 22000 catalog_manager.cc:5697] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 6 to 8, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 8 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.862226 26483 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:26.863664 26496 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:26.864421 22099 raft_consensus.cc:1217] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[8.8-11.9]   Dedup: 8.8->[11.9-11.9]
I20260709 13:07:26.864790 26432 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:26.865105 22099 raft_consensus.cc:1240] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 11. Current term is 12. Ops: [8.8-11.9]
I20260709 13:07:26.844791 26460 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:26.863711 22255 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 12: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:26.807101 26387 raft_consensus.cc:3055] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:26.838141 26498 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.815285 26023 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:26.853804 22816 rpcz_store.cc:276] 0709 13:07:25.600523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.600800 (+   277us) service_pool.cc:224] Handling call
0709 13:07:26.853103 (+1252303us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400476654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:26.853295 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2600331520}
I20260709 13:07:26.866770 26453 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.871356 26483 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:26.871582 22102 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:26.872124 26483 raft_consensus.cc:697] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:26.866791 26496 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:26.874343 22072 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:26.869522 26435 consensus_queue.cc:1048] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:26.870553 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 64096.7us
W20260709 13:07:26.876736 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 65624.2us
I20260709 13:07:26.886557 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 652) took 1002 ms. Trace:
W20260709 13:07:26.889786 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.877526 26500 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:26.891379 26448 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:26.892119 26425 consensus_meta.cc:287] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.004s
I20260709 13:07:26.876811 26483 consensus_queue.cc:237] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:26.908975 26425 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:26.909435 22072 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:26.910410 26435 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:26.892699 22220 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:26.912317 22220 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:26.912647 26439 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:26.913960 26430 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:26.914815 26430 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.913856 26439 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.893668 22218 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:26.918128 25889 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:26.918237 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:26.888289 22103 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:26.918643 25889 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.919126 25889 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.919363 22106 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:26.920404 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 651) took 1054 ms. Trace:
I20260709 13:07:26.920755 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2003) took 1004 ms. Trace:
I20260709 13:07:26.920800 22104 rpcz_store.cc:276] 0709 13:07:25.865568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.836333 (+970765us) service_pool.cc:224] Handling call
0709 13:07:26.886809 (+ 50476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.920058 (+ 33249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.920091 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:26.920135 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:26.920173 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.920221 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.920341 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.921247 22106 rpcz_store.cc:276] 0709 13:07:25.916346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.875169 (+958823us) service_pool.cc:224] Handling call
0709 13:07:26.919031 (+ 43862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.919768 (+   737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.920553 (+   785us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b540001e850. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:26.920705 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99698944}
I20260709 13:07:26.894867 26500 raft_consensus.cc:697] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:26.922725 26475 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:26.923692 26500 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:26.895299 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.871416 26460 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.867700 26387 raft_consensus.cc:740] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:26.907724 26380 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.928169 26380 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.928836 26380 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.907725 26244 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:26.908456 22249 raft_consensus.cc:2410] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:07:26.915309 26430 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.892828 26100 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:26.913405 22002 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40946 (request call id 277) took 31111 ms (client timeout 15000 ms). Trace:
I20260709 13:07:26.911221 22072 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:26.887028 22099 rpcz_store.cc:276] 0709 13:07:25.865719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.843953 (+978234us) service_pool.cc:224] Handling call
0709 13:07:26.864140 (+ 20187us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:26.868418 (+  4278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.868585 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14080}
I20260709 13:07:26.927140 22220 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:26.876034 26498 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.944115 26460 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.858772 26443 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:26.875074 26496 raft_consensus.cc:697] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:26.949563 22069 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:26.949818 22071 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:26.959441 26312 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:26.960481 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 49408.3us
W20260709 13:07:26.963377 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 341846us
I20260709 13:07:26.947039 22000 catalog_manager.cc:5697] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.967558 26425 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:26.968318 22144 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:26.968160 26433 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.974630 22100 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:26.978758 26497 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.981434 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:26.981958 26405 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.982194 22177 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.982620 26405 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:26.983449 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:26.985064 26405 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:26.986331 22252 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:26.986498 22105 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:26.988018 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:26.940433 22002 rpcz_store.cc:269] 0709 13:06:55.801972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.802356 (+   384us) service_pool.cc:224] Handling call
0709 13:07:26.913116 (+31110760us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:16.123697 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:16.225390 (+101693us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:16.226233 (+   843us) write_op.cc:435] Acquired schema lock
0709 13:07:16.227253 (+  1020us) tablet.cc:662] Decoding operations
0709 13:07:16.238090 (+ 10837us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:16.238153 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:16.238180 (+    27us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:07:16.240304 (+  2124us) tablet.cc:701] Row locks acquired
0709 13:07:16.240326 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:07:16.240505 (+   179us) write_op.cc:270] Start()
0709 13:07:16.240643 (+   138us) write_op.cc:276] Timestamp: P: 1783602436240438 usec, L: 0
0709 13:07:16.240663 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:07:16.241509 (+   846us) log.cc:844] Serialized 11981 byte log entry
0709 13:07:16.475711 (+234202us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a4e440ac 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b
0709 13:07:17.099313 (+623602us) op_driver.cc:464] REPLICATION: finished
0709 13:07:17.713801 (+614488us) write_op.cc:301] APPLY: starting
0709 13:07:17.737954 (+ 24153us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:17.808890 (+ 70936us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:17.808932 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:17.836624 (+ 27692us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:17.837114 (+   490us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=60
0709 13:07:17.837166 (+    52us) write_op.cc:312] APPLY: finished
0709 13:07:17.837965 (+   799us) log.cc:844] Serialized 200 byte log entry
0709 13:07:17.838347 (+   382us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:17.838769 (+   422us) write_op.cc:454] Released schema lock
0709 13:07:17.838862 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:17.847094 (+  8232us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:17.847776 (+   682us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":349932,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":584769,"apply.run_cpu_time_us":9193,"apply.run_wall_time_us":145377,"num_ops":30,"prepare.queue_time_us":220478,"prepare.run_cpu_time_us":20897,"prepare.run_wall_time_us":513548,"raft.queue_time_us":294226,"raft.run_cpu_time_us":12582,"raft.run_wall_time_us":496625,"replication_time_us":858421,"spinlock_wait_cycles":318669824,"thread_start_us":1145362,"threads_started":4,"wal-append.queue_time_us":392878,"wal-append.run_cpu_time_us":50969,"wal-append.run_wall_time_us":2212308}]]}
I20260709 13:07:26.993251 26433 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:26.996511 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:26.997336 22255 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.999192 26244 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:26.999439 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:27.000178 22254 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.974586 22249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:07:27.003387 22249 raft_consensus.cc:606] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:27.004024 22249 raft_consensus.cc:614] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:27.006438 26362 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:26.977447 26312 raft_consensus.cc:697] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:26.977532 22000 catalog_manager.cc:5697] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:26.997345 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 140762us
I20260709 13:07:27.008342 26312 consensus_queue.cc:237] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.008476 22000 catalog_manager.cc:5697] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 8 to 9, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 9 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.009495 22147 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.000044 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:26.938670 26439 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:27.014708 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 88081.4us
I20260709 13:07:27.016374 22175 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.016870 22249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:07:27.016579 22000 catalog_manager.cc:5697] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 4 to 7, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 7 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:27.017596 22249 raft_consensus.cc:606] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:26.929037 26387 consensus_queue.cc:260] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.014743 26405 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.025585 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:27.042052 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.042240 22000 catalog_manager.cc:5697] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 7 to 8, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 8 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:27.024425 26362 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:27.048898 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 130888us
W20260709 13:07:27.068797 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 46748.2us
W20260709 13:07:27.071147 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.074784 22254 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:27.039358 25889 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:27.082937 26426 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.086275 26472 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:27.087247 25942 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:27.087888 25942 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.088361 25942 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.089640 26247 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:27.054140 26425 raft_consensus.cc:2764] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:27.091908 26449 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:27.092398 26449 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.092717 26449 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.096872 26387 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:27.097148 22218 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:27.103192 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 93799.2us
I20260709 13:07:27.103376 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.104454 22252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:07:27.105119 22252 raft_consensus.cc:606] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.104969 26380 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:27.108276 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.105525 22252 raft_consensus.cc:614] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:27.111080 22815 consensus_meta.cc:287] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.008s
I20260709 13:07:27.111572 22815 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
I20260709 13:07:27.112403 22252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:07:27.113050 22252 raft_consensus.cc:606] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.113405 22252 raft_consensus.cc:614] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:27.115121 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 45073.7us
I20260709 13:07:27.119835 22175 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:27.122895 26430 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:27.125329 26430 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:27.125150 26281 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.045904 26405 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.123277 22252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:07:27.129212 22252 raft_consensus.cc:606] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:27.086318 26426 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:27.129662 22252 raft_consensus.cc:614] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:27.131122 22147 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:27.133435 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 183979us
I20260709 13:07:27.136626 22255 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
W20260709 13:07:27.138137 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 82398.9us
I20260709 13:07:27.135603 22071 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:27.138972 22177 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:27.131343 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:27.142259 26451 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:27.142938 26451 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:27.144019 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 88484.8us
I20260709 13:07:27.145409 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:27.145787 26451 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:27.146020 22251 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:27.121249 26247 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:27.146126 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:27.159394 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 94241.5us
I20260709 13:07:27.154677 22782 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:27.130425 26405 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:27.161016 26500 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:27.171692 22782 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:27.181360 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:27.188624 22815 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.184567 26359 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:27.191442 26419 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:07:27.194087 26181 raft_consensus.cc:2804] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:27.190266 22071 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:27.187757 26362 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.195842 26443 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:27.196645 26443 raft_consensus.cc:697] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:27.197855 26443 consensus_queue.cc:237] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:27.200575 26497 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.171152 26496 consensus_queue.cc:237] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:27.213596 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 116559us
I20260709 13:07:27.190443 26500 raft_consensus.cc:697] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:27.182471 26380 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:27.222792 26256 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:27.220327 26181 raft_consensus.cc:697] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:27.223529 26256 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.224534 26181 consensus_queue.cc:237] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.225833 26256 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:27.217096 26419 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:27.230208 26281 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:27.230541 25889 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:27.221809 26451 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:27.232393 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:27.232700 26451 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.233134 26451 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.233187 22251 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:27.179240 26498 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:27.236428 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 90517.7us
I20260709 13:07:27.238575 22147 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:27.247722 22218 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:27.252234 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.238322 26419 raft_consensus.cc:697] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:27.255883 26514 log.cc:927] Time spent T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:07:27.256089 26419 consensus_queue.cc:237] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:27.255920 26516 log.cc:927] Time spent T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:07:27.272192 22101 raft_consensus.cc:1240] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 7. Current term is 9. Ops: []
W20260709 13:07:27.273264 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 45719.6us
I20260709 13:07:27.274479 22097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 656) took 1402 ms. Trace:
I20260709 13:07:27.279448 25889 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:27.279695 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 49978us
I20260709 13:07:27.279891 26498 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:27.280646 22218 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.281515 25889 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:27.281942 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:27.282716 25889 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:27.283171 25889 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:27.283370 22815 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:27.283684 22779 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:27.287348 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 65105.2us
I20260709 13:07:27.274899 22097 rpcz_store.cc:276] 0709 13:07:25.866317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.859245 (+992928us) service_pool.cc:224] Handling call
0709 13:07:26.859814 (+   569us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:26.876619 (+ 16805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.876659 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:26.894083 (+ 17424us) log.cc:844] Serialized 52 byte log entry
0709 13:07:27.010736 (+116653us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:27.010774 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.010843 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.268517 (+257674us) raft_consensus.cc:1685] finished
0709 13:07:27.268547 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.268764 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15947,"raft.queue_time_us":16458,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"thread_start_us":116212,"threads_started":1,"wal-append.queue_time_us":161269}
I20260709 13:07:27.293398 22218 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.297477 26451 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:27.301466 26455 raft_consensus.cc:2764] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:07:27.303653 22147 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:27.306339 26517 log.cc:927] Time spent T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:07:27.311780 22250 raft_consensus.cc:2410] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:27.317556 26100 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:27.319509 26449 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.321547 25942 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:27.285179 25889 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:27.344497 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 53360.3us
W20260709 13:07:27.348842 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 45374.1us
I20260709 13:07:27.347396 22251 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:27.278620 26460 raft_consensus.cc:2764] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:27.356338 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 660) took 1413 ms. Trace:
W20260709 13:07:27.357301 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.359053 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.356741 22101 rpcz_store.cc:276] 0709 13:07:25.943326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.851842 (+908516us) service_pool.cc:224] Handling call
0709 13:07:26.852316 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.274271 (+421955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.354669 (+ 80398us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b5400021f54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:27.356264 (+  1595us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":959284736}
I20260709 13:07:27.353245 26247 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:27.367353 22782 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:27.368491 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 55283.3us
I20260709 13:07:27.350085 26359 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:27.373656 22144 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:27.375872 22815 raft_consensus.cc:1240] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:27.379246 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 86690.3us
I20260709 13:07:27.379390 22069 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:27.370555 26362 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:27.335985 26500 consensus_queue.cc:237] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:27.385210 26443 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:27.399500 26443 raft_consensus.cc:697] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:27.400516 26443 consensus_queue.cc:237] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.403028 22178 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:27.390440 26449 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:27.391343 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:27.391744 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:27.391846 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:27.371246 26247 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.392549 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:27.396222 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:27.397279 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:27.397526 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:27.398291 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:27.410880 22814 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.377735 26455 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:27.414974 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 64482.3us
I20260709 13:07:27.414948 26242 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:27.419224 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:27.420900 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:27.413368 22106 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:27.427011 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.430850 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:27.437165 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.410589 26247 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:27.437584 22816 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:27.432228 22099 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:27.432093 26455 raft_consensus.cc:697] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:27.440189 22180 raft_consensus.cc:1240] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:27.439996 26455 consensus_queue.cc:237] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.441582 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.429623 26359 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.442875 26359 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.410291 26497 consensus_queue.cc:1059] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:07:27.444114 26497 consensus_queue.cc:1243] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer a07ca3d1b5b84f4bbcb907f709a69275 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:27.444691 26497 raft_consensus.cc:3055] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:27.445020 26497 raft_consensus.cc:740] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:27.447155 22104 raft_consensus.cc:2410] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:27.456650 22251 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:27.451611 22179 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:27.413153 26439 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:27.433787 26244 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:07:27.461992 22218 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:27.462733 22106 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:27.463788 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.464488 22178 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.429883 26242 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:27.457567 22250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 2152) took 1237 ms (client timeout 1624 ms). Trace:
W20260709 13:07:27.469105 22250 rpcz_store.cc:269] 0709 13:07:26.213975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.214655 (+   680us) service_pool.cc:224] Handling call
0709 13:07:27.427565 (+1212910us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540019b754. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:27.451780 (+ 24215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2444817152}
I20260709 13:07:27.446179 26497 consensus_queue.cc:260] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.465497 26449 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.460310 26439 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:27.485913 22781 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.480846 26256 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:07:27.493232 26448 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:27.493373 26497 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:27.493829 26448 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.494375 26448 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:27.499233 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.500604 22179 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:27.456488 26435 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:07:27.472905 26242 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:27.517452 26460 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:27.521737 25889 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:27.524062 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 70206.6us
I20260709 13:07:27.479807 26362 consensus_queue.cc:1048] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:07:27.525686 22178 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:27.533699 25889 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:27.535748 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.536568 22175 raft_consensus.cc:1240] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:27.544463 22177 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.536985 22180 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:27.537806 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.539561 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.539461 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:27.546007 22172 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:27.546015 22181 raft_consensus.cc:2393] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 12: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:27.515573 26100 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:27.541242 22252 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:27.542606 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:27.530483 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.545440 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:27.549897 22174 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.535604 26451 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:27.555907 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:27.554737 22179 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:27.511662 26461 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:07:27.553371 22173 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:27.555403 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.559865 22180 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:27.561034 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:27.561888 22255 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 12: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:27.516290 26449 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:27.565757 22250 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:27.566967 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:27.572275 22254 raft_consensus.cc:2393] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 11: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:27.572965 22781 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:27.574756 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.576726 22218 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.575410 22144 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.579447 25889 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:27.579797 26362 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:27.580350 22180 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 12: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:27.580469 22815 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:27.566641 26483 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.582010 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:27.582554 26483 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:27.582979 25889 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:27.583453 25889 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:27.583902 25889 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:27.584852 26483 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:27.587729 22144 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:27.589414 22144 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.590042 26483 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:27.590749 22181 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:27.592036 22252 raft_consensus.cc:1240] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:27.597963 26483 raft_consensus.cc:697] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:27.592991 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:27.593374 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:27.594537 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:27.599291 22218 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:27.595182 26432 consensus_queue.cc:1059] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:27.600423 26430 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:27.600778 26432 raft_consensus.cc:3055] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:27.600872 26430 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:27.601274 26432 raft_consensus.cc:740] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:27.600960 25889 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.600121 26497 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:07:27.588179 22779 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.601460 26430 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.603438 26419 consensus_queue.cc:1059] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:27.603631 25889 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:27.604314 26419 raft_consensus.cc:3055] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:27.604245 26100 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:27.604851 26419 raft_consensus.cc:740] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:27.605806 26419 consensus_queue.cc:260] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.602329 26432 consensus_queue.cc:260] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:27.609359 22779 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:27.600452 22218 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:27.619290 22177 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:27.615737 26100 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:27.624292 26449 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:27.624560 26359 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:27.590400 26247 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:27.636386 22779 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:27.641495 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 52150.7us
I20260709 13:07:27.615973 26419 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:27.614600 26362 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.644280 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:27.651681 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:27.651773 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.653439 22175 raft_consensus.cc:3060] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:27.655515 26320 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:07:27.656142 26432 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.625844 26455 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:27.630405 26100 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.663455 22218 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.663645 22815 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:27.669344 26461 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:27.662173 26532 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:07:27.618808 26448 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:27.599354 26483 consensus_queue.cc:237] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:27.649109 25889 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:27.681839 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 129143us
I20260709 13:07:27.663959 26247 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:27.661556 26359 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.686968 22181 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:27.672700 26100 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:27.660701 25942 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:27.694381 22254 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 13:07:27.687742 22144 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:27.668390 26455 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:27.683424 25889 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.694558 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:27.698307 22177 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:27.695889 22781 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:27.702376 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 75959.2us
I20260709 13:07:27.703274 22779 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.703950 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.704530 22173 raft_consensus.cc:2376] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12. Re-sending same reply.
I20260709 13:07:27.706770 22104 raft_consensus.cc:1240] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:27.709486 22101 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:27.683477 26500 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
W20260709 13:07:27.711899 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 48512.4us
W20260709 13:07:27.712801 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.701355 25889 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:27.729194 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.711105 26449 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:27.736937 22248 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:27.694062 26359 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:27.767104 22814 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
W20260709 13:07:27.767625 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.701145 26281 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:27.733825 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:27.733974 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 50115.8us
W20260709 13:07:27.734206 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 139259us
I20260709 13:07:27.733381 22175 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
I20260709 13:07:27.716054 26247 raft_consensus.cc:2764] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:07:27.715863 26181 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:07:27.715838 26456 consensus_queue.cc:1059] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:07:27.755335 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:27.756063 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:27.760004 26448 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:27.760766 26449 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.762311 22181 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:27.781201 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:27.762969 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.699349 26455 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.765504 22174 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:27.730225 26362 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.772524 22173 raft_consensus.cc:2376] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 14. Re-sending same reply.
I20260709 13:07:27.781962 22178 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:27.787242 22254 raft_consensus.cc:1240] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:27.730849 22179 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 14.
I20260709 13:07:27.791796 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.798836 22220 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:27.762712 26100 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:27.806806 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 74191us
W20260709 13:07:27.803125 22147 leader_election.cc:336] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.599s (SENT)
I20260709 13:07:27.803887 22069 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:27.808880 22220 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:27.810307 22179 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:27.811910 22147 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.776453 26405 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:07:27.810017 26242 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:27.817096 26425 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:27.817687 26425 raft_consensus.cc:697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:27.818773 26242 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:27.818625 26425 consensus_queue.cc:237] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.815555 26448 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:27.819859 26100 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:27.820132 26448 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.820523 26448 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.820647 26100 consensus_queue.cc:1059] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:27.788440 26449 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.810158 26463 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:27.823931 22218 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.825723 22176 raft_consensus.cc:2393] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 11: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:27.827257 22220 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:27.844800 26449 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:27.846256 22181 raft_consensus.cc:1275] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:27.810750 26362 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.802286 26430 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.849098 26430 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:27.849350 26362 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:27.842990 26453 consensus_queue.cc:1059] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:07:27.815878 26496 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:07:27.854728 26539 log.cc:927] Time spent T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:07:27.856462 22144 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.857520 22251 raft_consensus.cc:1240] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:27.859328 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 73875.9us
I20260709 13:07:27.814083 26320 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:27.878175 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:27.883807 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 78676.4us
W20260709 13:07:27.884155 22147 leader_election.cc:336] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.624s (SENT)
I20260709 13:07:27.870398 26362 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:27.889945 22251 raft_consensus.cc:1275] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:27.872116 26449 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:27.872390 26430 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.876936 26320 raft_consensus.cc:697] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:27.872416 26483 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:07:27.906756 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 79555.3us
I20260709 13:07:27.895300 26439 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.909274 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 133651us
I20260709 13:07:27.912091 26511 consensus_queue.cc:1059] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:27.911176 22220 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:27.894838 26449 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.879362 26448 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.896900 26405 raft_consensus.cc:3055] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:27.913846 22220 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:27.924659 22812 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:27.926345 22147 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:27.905961 26453 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.912696 26312 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.915477 26449 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:27.944450 22781 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:27.951651 26320 consensus_queue.cc:237] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.953186 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:27.923403 26405 raft_consensus.cc:740] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:27.952445 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:27.952479 26432 raft_consensus.cc:3055] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:27.956131 26405 consensus_queue.cc:260] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.956759 26432 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:27.957244 26405 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:27.957624 26432 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:27.959100 26443 consensus_queue.cc:1048] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:27.958871 26432 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:27.970167 22106 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:27.976464 26456 consensus_queue.cc:1059] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:27.978487 26456 raft_consensus.cc:3055] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:27.936822 26362 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:27.982538 26362 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:27.983110 26362 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.979538 26281 raft_consensus.cc:3055] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:27.910694 26439 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:27.979974 22781 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:27.981487 26461 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:27.977665 26463 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 13:07:27.994467 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 62750us
W20260709 13:07:28.008805 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.962365 26449 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:28.027333 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 113519us
I20260709 13:07:28.030740 22220 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:27.987489 26456 raft_consensus.cc:740] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:28.037575 22181 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:27.994611 26281 raft_consensus.cc:740] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:28.045871 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 66045.1us
I20260709 13:07:28.056936 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:28.058378 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:28.059561 26449 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:28.060698 26362 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:28.063325 22101 raft_consensus.cc:1240] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:28.063915 26281 consensus_queue.cc:260] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.065137 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:28.065459 26281 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.968905 25942 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:07:28.027801 26359 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:28.032392 26426 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.032651 26554 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.086217 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:28.046927 26432 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:28.074671 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 282010us
I20260709 13:07:28.087508 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:28.093235 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:28.077101 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:28.077292 22781 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:28.094404 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:28.095088 22101 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.079279 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:28.090634 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 266803us
I20260709 13:07:28.096603 22179 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 14.
I20260709 13:07:28.072359 22106 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:28.084030 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:27.968669 26312 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.044049 26430 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.093875 22102 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:28.101112 22251 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:28.103366 22098 raft_consensus.cc:1240] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:28.112627 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:28.105420 22099 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:28.105660 22103 raft_consensus.cc:1275] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:28.106012 26461 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.032718 26453 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:28.106420 26362 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:28.107014 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:28.107729 26448 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:28.108143 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:28.090201 26426 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.108480 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:28.108985 26558 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:28.076504 26449 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:28.103957 22097 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:28.118541 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:07:28.120668 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 43495.1us
I20260709 13:07:28.121698 22247 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:28.126783 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:28.129422 22813 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:07:28.130360 22816 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:28.131699 22807 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:28.084929 26557 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:28.137432 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 105385us
I20260709 13:07:28.088841 26451 consensus_queue.cc:1059] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:07:28.143640 22106 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:28.088565 26242 consensus_queue.cc:1059] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:07:28.128325 26100 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:28.120777 26432 raft_consensus.cc:697] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:28.151844 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:28.156774 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.132210 26425 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:28.174011 22106 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
I20260709 13:07:28.111234 26456 consensus_queue.cc:260] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.184172 26560 consensus_queue.cc:1059] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:07:28.185283 26560 raft_consensus.cc:3055] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:28.185647 26560 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:28.185972 22781 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:28.186985 26100 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:28.187400 26549 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:28.187928 26549 raft_consensus.cc:697] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:28.126894 26461 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.190505 22781 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:28.183775 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 59698.4us
I20260709 13:07:28.194698 22106 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:28.195374 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:28.124248 26554 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.196043 22144 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:28.165176 26449 raft_consensus.cc:697] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:28.177374 26387 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.161123 26511 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:07:28.219790 22781 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:28.219445 26449 consensus_queue.cc:237] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.192764 26242 consensus_queue.cc:1243] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:28.218129 22106 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:07:28.223089 22106 pending_rounds.cc:85] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 10
I20260709 13:07:28.158377 26557 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.231021 22144 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:28.212285 26405 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:28.258827 22099 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:28.246606 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:28.213938 26425 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:28.252076 22808 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:28.252336 26453 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:28.224319 26455 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.229642 26242 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:28.186497 26560 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.223978 22106 pending_rounds.cc:107] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:07:28.290169 22106 raft_consensus.cc:2889] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:28.287726 22218 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:28.189002 26549 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.286881 22102 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
W20260709 13:07:28.255918 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.265003 26558 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:28.260185 22779 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:28.229460 26439 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:28.254980 26557 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:28.306682 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.265231 26563 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:28.236347 26387 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:28.292225 26496 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.289429 26312 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:28.292471 26242 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:07:28.348294 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 107768us
I20260709 13:07:28.231073 26432 consensus_queue.cc:237] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:28.352646 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:28.353778 22251 raft_consensus.cc:2393] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 13: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
W20260709 13:07:28.354604 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 97927us
I20260709 13:07:28.372834 26387 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:28.377596 26579 consensus_queue.cc:1059] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:07:28.366623 22101 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
W20260709 13:07:28.379354 26559 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:07:28.301751 26100 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:07:28.318142 26557 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:28.317005 26439 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:28.319175 26497 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:28.417418 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 184564us
I20260709 13:07:28.357097 26242 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:28.351747 26563 raft_consensus.cc:697] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 14 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:28.448285 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:28.452425 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.455096 22255 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:28.460990 22181 raft_consensus.cc:2393] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 8: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:28.319854 26555 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:07:28.463516 22144 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:28.480221 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:28.480221 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:28.480958 22178 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:28.481185 22172 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:28.481696 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:28.481916 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:28.482311 22252 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.483173 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:28.483736 22249 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
W20260709 13:07:28.484591 26562 log.cc:927] Time spent T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:07:28.484858 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 265162us
I20260709 13:07:28.489228 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:28.492574 22252 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:28.492404 26405 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:28.495180 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:28.496038 22253 raft_consensus.cc:1813] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Handling vote request from an unknown peer 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:28.496639 22253 raft_consensus.cc:2368] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12.
I20260709 13:07:28.497699 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:28.498703 22248 raft_consensus.cc:2393] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 11: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:28.500465 22251 raft_consensus.cc:1275] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:07:28.502252 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 74000.6us
I20260709 13:07:28.513290 26554 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:28.514218 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:28.505002 26570 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:07:28.506218 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:28.508293 26591 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:28.515141 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 357140us
I20260709 13:07:28.389879 26439 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:28.515939 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 52508.2us
I20260709 13:07:28.516705 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:28.519563 26455 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:28.519851 26461 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:28.520191 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:28.520613 26563 consensus_queue.cc:237] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:28.524693 22220 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:28.525697 22255 raft_consensus.cc:2393] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 12: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:28.459645 26557 raft_consensus.cc:697] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:28.529368 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:28.530725 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:28.530395 22220 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:28.534591 22246 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:28.517809 26426 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:28.544130 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:28.529979 22812 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:28.536791 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:28.535477 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:28.524042 26439 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:28.522554 26405 consensus_queue.cc:1048] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:07:28.531010 26359 raft_consensus.cc:2764] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:28.556828 26453 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:28.579385 26453 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.579842 26453 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:28.458654 26497 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.564941 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:28.556277 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:28.562681 22104 raft_consensus.cc:1240] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:28.570601 22180 raft_consensus.cc:3055] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:28.562553 22255 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:28.587062 22069 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:28.583225 22180 raft_consensus.cc:740] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:28.637328 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:28.551137 22147 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:28.638835 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 71783us
W20260709 13:07:28.567013 25889 consensus_meta.cc:287] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.791s	user 0.013s	sys 0.000s
I20260709 13:07:28.534674 26561 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:28.655654 22177 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:28.656342 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:28.654101 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:28.661644 22173 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:28.661571 22174 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
I20260709 13:07:28.663399 22816 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 12: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:28.654028 26461 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:28.664062 26359 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:28.655905 26586 log.cc:927] Time spent T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:07:28.664887 26579 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:28.568321 26281 consensus_meta.cc:287] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.502s	user 0.012s	sys 0.003s
I20260709 13:07:28.664467 26461 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.662000 22172 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
W20260709 13:07:28.663592 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 112521us
I20260709 13:07:28.680975 22147 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:28.559433 26425 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:28.639592 26426 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:28.580417 26557 consensus_queue.cc:237] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.687870 22100 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:28.692605 22147 leader_election.cc:400] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12.
I20260709 13:07:28.692914 22147 leader_election.cc:403] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:28.687884 22809 raft_consensus.cc:2410] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:28.690856 22172 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:28.663237 26561 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.684372 22220 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:28.662703 22180 consensus_queue.cc:260] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.667842 26483 raft_consensus.cc:3055] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:28.694865 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:28.696698 22144 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:28.667326 26579 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.701042 22180 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:28.708957 22246 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:28.687554 26362 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:28.646829 26242 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.647244 26511 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:07:28.689657 26426 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.666874 25889 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:28.711335 26579 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:28.729209 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:28.729628 22178 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:28.697791 26483 raft_consensus.cc:740] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:28.697594 26561 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:28.730163 22816 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
I20260709 13:07:28.733631 22218 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:28.734182 26242 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:28.734668 26567 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:28.735267 26567 raft_consensus.cc:697] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:28.736227 26567 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.720062 26425 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:07:28.739172 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:28.723909 26426 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:28.745551 22247 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:28.749939 22173 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
I20260709 13:07:28.749667 22071 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:28.729974 26497 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:28.759378 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 76922.9us
I20260709 13:07:28.767493 22147 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:28.736235 25889 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:28.755396 26242 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:28.778379 26380 consensus_queue.cc:1059] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:07:28.755424 26554 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:28.792855 26380 raft_consensus.cc:3055] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:28.776479 26587 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:28.791142 26359 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:28.786690 26560 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:28.813006 22247 raft_consensus.cc:1240] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:28.813822 22781 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:28.799630 26461 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:28.803346 26380 raft_consensus.cc:740] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:28.825002 22781 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:28.815596 26593 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.819223 26561 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:28.821588 22180 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:28.829752 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:28.831763 22248 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:07:28.832284 22248 pending_rounds.cc:85] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 6
I20260709 13:07:28.832217 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:28.832827 22248 pending_rounds.cc:107] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:07:28.833204 22248 raft_consensus.cc:2889] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:28.833281 22180 raft_consensus.cc:2393] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 13: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:28.806291 26453 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:28.837895 26242 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12.
I20260709 13:07:28.836438 26256 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:28.840445 22254 raft_consensus.cc:1240] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:28.876883 22246 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: [11.7-13.8]
W20260709 13:07:28.856652 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.841231 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:28.914572 22180 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:28.810360 26587 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:28.870548 26496 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:07:28.827349 26558 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:28.838477 26561 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:28.924794 26587 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:28.937630 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:28.835078 26557 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.834720 26425 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:07:28.919201 26362 raft_consensus.cc:697] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:28.921846 26453 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:28.922467 26432 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.807647 26483 consensus_queue.cc:260] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:28.875914 26570 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:07:28.952579 22180 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
W20260709 13:07:29.000581 26605 log.cc:927] Time spent T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:07:29.026701 22815 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:07:28.927448 26593 consensus_queue.cc:1059] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:07:28.999863 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 303276us
I20260709 13:07:29.051880 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:29.026484 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:28.999805 26600 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:29.000370 26583 log.cc:927] Time spent T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:07:28.956488 26584 log.cc:927] Time spent T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:07:29.046852 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:28.938553 26426 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.061628 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:07:29.072242 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 240140us
I20260709 13:07:29.074069 22815 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 12: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
W20260709 13:07:29.040019 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 98201.5us
I20260709 13:07:29.058893 26247 raft_consensus.cc:3055] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:29.076915 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:29.084897 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:29.085717 22815 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:29.089457 22101 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 13. Ops: []
I20260709 13:07:29.073097 26593 consensus_queue.cc:1243] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:29.073943 26432 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:29.084012 26256 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:29.074229 26483 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:29.083850 26247 raft_consensus.cc:740] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:29.131608 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.955607 26380 consensus_queue.cc:260] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:29.150045 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 64191.6us
I20260709 13:07:29.099335 26362 consensus_queue.cc:237] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:29.144474 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 55855.6us
I20260709 13:07:29.134310 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.155221 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:29.156872 26587 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.159310 26380 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.160954 26587 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:29.161275 22815 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:29.161800 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.162582 22100 raft_consensus.cc:2393] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 12: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:29.157912 22144 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:29.149058 26439 consensus_meta.cc:287] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.002s
I20260709 13:07:29.168597 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:29.168843 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.176730 22180 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:29.177789 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:29.186707 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.187846 22105 raft_consensus.cc:2393] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 11: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:29.188016 26432 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:29.198477 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.093492 26600 raft_consensus.cc:697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:29.166610 26558 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:29.220031 22105 raft_consensus.cc:1240] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:29.157079 26591 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:07:29.225248 22815 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:29.225961 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.224399 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:29.227403 22246 raft_consensus.cc:2368] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 12. Current term is 13.
I20260709 13:07:29.228251 22180 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 15.
I20260709 13:07:29.210443 26432 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.231902 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:29.234578 22255 raft_consensus.cc:2393] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 14: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:29.211927 26606 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:29.235554 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:29.238404 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:29.238958 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:29.240222 22246 raft_consensus.cc:2410] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:29.155543 26602 consensus_queue.cc:1059] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:07:29.200232 26439 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:29.243414 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.239995 22809 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:29.244561 22098 raft_consensus.cc:2368] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10.
I20260709 13:07:29.225265 26256 raft_consensus.cc:697] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:29.249414 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:29.248997 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 91199.3us
I20260709 13:07:29.252907 22144 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:29.266798 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.267727 22098 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:29.231911 26611 consensus_queue.cc:1059] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:07:29.279000 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:29.279312 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:29.280441 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:29.282043 22807 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:29.282430 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:29.283046 22810 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:29.283277 26557 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.283821 26557 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.284204 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:29.284991 22814 raft_consensus.cc:2410] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:29.285533 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:29.281976 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:29.286727 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.287721 22100 raft_consensus.cc:2393] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 12: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:29.288342 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.289054 22102 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.295095 22250 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:29.297313 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.297690 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.297935 22105 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.307533 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:29.305238 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:29.308272 22816 raft_consensus.cc:2410] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:29.308727 22809 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:29.307641 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.304658 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.308696 22099 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:29.309697 22104 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:29.309666 22097 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:29.310621 22246 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 11: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:29.312834 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:29.312834 22106 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:29.319195 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:29.318692 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:29.301762 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:29.323849 22102 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
W20260709 13:07:29.298835 26608 log.cc:927] Time spent T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:07:29.297236 26557 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:29.330456 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 166736us
I20260709 13:07:29.307204 26619 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:29.331965 22144 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:29.252652 26432 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:29.333416 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.333622 22812 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:29.298671 26242 consensus_queue.cc:1059] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:07:29.343693 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.347764 22098 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 14.
I20260709 13:07:29.348528 22100 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:29.349004 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:29.349669 22814 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:29.349156 22106 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:29.352732 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:29.353199 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.354247 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:29.355520 22812 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:29.358171 26591 consensus_queue.cc:1059] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:07:29.364656 26591 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:29.365238 26591 raft_consensus.cc:697] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:29.353257 26579 consensus_meta.cc:287] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.001s
I20260709 13:07:29.326238 26606 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:07:29.370862 22814 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 15.
I20260709 13:07:29.372665 22106 raft_consensus.cc:2468] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:29.342213 26426 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:29.378472 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:29.369746 22812 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:29.386193 22069 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:29.399868 22097 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:29.374339 22105 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:29.415541 26312 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:29.416213 26312 raft_consensus.cc:697] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:29.417157 26312 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.420081 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:29.420917 22248 raft_consensus.cc:2393] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:29.421859 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:29.423041 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:29.423830 22247 raft_consensus.cc:2393] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:29.331676 26256 consensus_queue.cc:237] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.415563 22069 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:29.427363 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:29.430406 22251 raft_consensus.cc:2393] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 11: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:29.431438 22100 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:29.434877 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:29.437067 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:29.438262 22246 raft_consensus.cc:2410] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:29.445341 26244 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:29.445456 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:29.445943 26244 raft_consensus.cc:697] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:29.446327 22249 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 11: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:29.447353 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:29.447906 26456 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.447263 26244 consensus_queue.cc:237] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.426702 25889 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:29.448254 22254 raft_consensus.cc:2393] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 11: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:29.441648 22220 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:29.377002 26579 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:29.455912 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 124015us
I20260709 13:07:29.460402 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:29.462098 22255 raft_consensus.cc:2410] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:29.415567 26606 raft_consensus.cc:3055] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:29.461959 22144 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:07:29.463258 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.467512 22180 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:29.469641 22180 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:29.472256 26463 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:29.472985 26549 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:29.474386 26549 raft_consensus.cc:3055] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:29.480022 22104 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:29.500922 22181 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 13: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:29.512765 22180 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:29.463889 26606 raft_consensus.cc:740] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:29.451263 25889 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:29.366113 26591 consensus_queue.cc:237] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:29.305753 26600 consensus_queue.cc:237] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:29.474879 26549 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:29.517305 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:29.499878 26439 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:29.516431 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 60981us
I20260709 13:07:29.520550 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:29.516677 26554 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:29.515879 26579 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:29.542017 22100 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: [8.6-11.7]
I20260709 13:07:29.542832 22105 raft_consensus.cc:1240] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:29.518169 26622 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:29.545118 26617 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:07:29.546227 22104 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:29.531831 26460 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:29.543551 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.549115 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:29.552906 22813 raft_consensus.cc:1240] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:29.553331 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:29.572202 22097 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 13: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:29.557928 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:29.529767 26582 consensus_queue.cc:1059] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:07:29.583230 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:29.557420 26554 raft_consensus.cc:697] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:29.591445 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:29.571166 26432 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:29.592207 22254 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:29.541819 26626 consensus_queue.cc:1059] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:07:29.582340 26628 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.597370 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:29.600518 22254 raft_consensus.cc:2393] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 12: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:29.603525 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:29.586244 26622 raft_consensus.cc:697] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:29.579912 26439 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:07:29.578784 26460 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:29.611099 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:29.613015 22254 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 13: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:29.616200 26624 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:29.618355 22248 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8.
I20260709 13:07:29.618835 26624 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:29.620591 26623 consensus_queue.cc:1059] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:29.621212 22248 raft_consensus.cc:1240] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:29.622354 22248 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:29.623363 22248 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:29.624504 22248 raft_consensus.cc:1275] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:29.604604 26620 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:29.609434 26582 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.633494 22248 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:29.580101 26549 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.584196 26606 consensus_queue.cc:260] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:29.648064 22782 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.650372 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:29.651290 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:29.652220 22175 raft_consensus.cc:2410] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:07:29.653141 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2174) took 1170 ms. Trace:
I20260709 13:07:29.652944 26362 consensus_queue.cc:1059] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:29.653506 22250 rpcz_store.cc:276] 0709 13:07:28.477517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.477670 (+   153us) service_pool.cc:224] Handling call
0709 13:07:28.507367 (+ 29697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.295711 (+788344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.647502 (+351791us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b54001cc5d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:29.647696 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1810829696}
I20260709 13:07:29.654886 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:29.655053 26557 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:29.655781 26557 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.658336 26557 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:29.660888 22174 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:07:29.633533 26615 log.cc:927] Time spent T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.125s	user 0.001s	sys 0.001s
I20260709 13:07:29.609848 26579 consensus_queue.cc:1048] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:07:29.651593 22782 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:29.605720 26628 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:29.649554 26624 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:29.645457 26555 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.670742 26570 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:29.675864 26570 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:29.663327 26623 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:29.680083 22072 connection.cc:256] RPC call timeout handler was delayed by -1.058766531999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
I20260709 13:07:29.667738 26579 consensus_queue.cc:1243] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer a07ca3d1b5b84f4bbcb907f709a69275 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:29.682031 25889 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:29.679121 26555 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.643373 26620 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.691373 26555 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:29.670393 26554 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.672070 26557 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:29.645938 26582 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:29.678347 26570 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:29.705540 26247 consensus_queue.cc:260] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:29.706772 26247 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:29.718937 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.722827 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:29.723196 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 54841.3us
I20260709 13:07:29.725193 22248 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:07:29.725668 22248 pending_rounds.cc:85] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 6
I20260709 13:07:29.674587 26624 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:29.725922 22248 pending_rounds.cc:107] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 11.7
I20260709 13:07:29.700565 26557 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.758829 22248 raft_consensus.cc:2917] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Aborting config change with OpId 11.7: Aborted: Op aborted by new leader
I20260709 13:07:29.759282 26591 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:29.759894 26591 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:29.716356 26570 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:29.770377 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 45641.3us
I20260709 13:07:29.770550 22072 leader_election.cc:400] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 12. Current term is 13.
I20260709 13:07:29.771646 22072 leader_election.cc:403] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:29.772809 22072 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:29.775247 26471 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 12. Current term is 13.
I20260709 13:07:29.775983 26471 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:29.781224 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.782071 26242 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:29.782575 26242 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.784238 26582 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:29.784816 26621 log.cc:927] Time spent T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.244s	user 0.001s	sys 0.002s
I20260709 13:07:29.789316 22812 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:07:29.789726 22812 pending_rounds.cc:85] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting all ops after (but not including) 9
I20260709 13:07:29.789955 22812 pending_rounds.cc:107] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:07:29.790220 22812 raft_consensus.cc:2889] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:29.790534 26609 log.cc:927] Time spent T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.659s	user 0.002s	sys 0.001s
I20260709 13:07:29.696550 26623 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.793812 26570 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.674312 26622 consensus_queue.cc:237] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:29.768509 26620 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:29.763609 26557 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.805413 26570 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:29.807075 26555 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.807611 26555 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.809819 26555 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:29.814617 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.816699 26616 log.cc:927] Time spent T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.434s	user 0.002s	sys 0.000s
I20260709 13:07:29.817229 26593 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:29.821316 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:29.771808 26654 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:29.841475 26646 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:29.854439 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.860445 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 834) took 1358 ms. Trace:
I20260709 13:07:29.861490 22249 raft_consensus.cc:1240] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:29.832482 26593 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:29.865473 22815 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:29.870513 22253 rpcz_store.cc:276] 0709 13:07:28.502076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.522649 (+ 20573us) service_pool.cc:224] Handling call
0709 13:07:28.538078 (+ 15429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.579942 (+ 41864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.579972 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.580494 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.801494 (+221000us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:28.801522 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.859809 (+1058287us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b54002cabd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:29.859884 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.859955 (+    71us) raft_consensus.cc:1685] finished
0709 13:07:29.859992 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.860330 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17650,"raft.queue_time_us":11853,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":9194,"spinlock_wait_cycles":95416704,"thread_start_us":220597,"threads_started":1,"wal-append.queue_time_us":342240}
W20260709 13:07:29.879093 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.880987 22250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:07:29.881646 22250 raft_consensus.cc:606] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:29.881928 22250 raft_consensus.cc:614] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:29.884493 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:29.867962 26456 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.885910 22173 raft_consensus.cc:2393] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 14: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:29.872255 26558 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.897778 22218 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:29.905131 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 132393us
I20260709 13:07:29.883472 26623 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:29.912497 22218 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:29.914984 22072 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:29.916025 26570 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:29.916618 22072 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:29.917452 26570 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.918480 22072 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:29.919337 26570 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:29.919620 22072 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:29.925729 26557 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.910387 26453 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:29.906605 26558 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.874639 26646 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.933947 26557 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:29.935303 26646 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:29.872360 26654 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:29.937407 26624 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:29.937520 26654 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:29.939103 26439 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:29.939615 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51114 (request call id 2088) took 1018 ms. Trace:
I20260709 13:07:29.939982 22181 rpcz_store.cc:276] 0709 13:07:28.921086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.921268 (+   182us) service_pool.cc:224] Handling call
0709 13:07:29.939424 (+1018156us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b540045f6d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:29.939556 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280704768}
I20260709 13:07:29.942698 22218 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:29.945247 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:29.950541 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:29.951273 22811 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:29.953380 22250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:07:29.953766 26247 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.954033 22250 raft_consensus.cc:606] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:29.954305 26247 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:29.943352 26453 consensus_queue.cc:1059] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:29.955467 26453 consensus_queue.cc:1243] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer c0694f6572bf406a92d55f1f2ab46ef2 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:29.955950 26632 raft_consensus.cc:3055] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:29.956176 26453 raft_consensus.cc:3055] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:29.956841 26453 raft_consensus.cc:740] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:29.958250 26247 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:29.961061 26606 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.963125 22248 raft_consensus.cc:2889] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.963433 26631 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:29.964025 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:45734 (request call id 13) took 4287 ms. Trace:
I20260709 13:07:29.965025 26593 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:29.966095 22250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:07:29.966902 22250 raft_consensus.cc:606] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:29.967296 22250 raft_consensus.cc:614] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:29.959268 26453 consensus_queue.cc:260] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.967648 26242 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:29.969623 26628 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:29.941183 26656 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:29.971481 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:29.972774 22069 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:29.974074 26587 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:29.974483 26587 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.974829 26587 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:29.975023 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 622) took 1296 ms. Trace:
I20260709 13:07:29.975428 22177 rpcz_store.cc:276] 0709 13:07:28.679113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.679269 (+   156us) service_pool.cc:224] Handling call
0709 13:07:28.694669 (+ 15400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.132076 (+437407us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:29.132475 (+   399us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.425224 (+292749us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.455170 (+ 29946us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.455359 (+   189us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:29.458859 (+  3500us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.459093 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.974550 (+515457us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54000dc5d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:29.974600 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.974733 (+   133us) raft_consensus.cc:1685] finished
0709 13:07:29.974749 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.974902 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69141,"prepare.queue_time_us":3519,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":84,"raft.queue_time_us":52440,"raft.run_cpu_time_us":459,"raft.run_wall_time_us":47343,"spinlock_wait_cycles":953383680,"thread_start_us":275971,"threads_started":2,"wal-append.queue_time_us":208376}
I20260709 13:07:29.982795 26453 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.988583 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:29.989149 22816 raft_consensus.cc:1217] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 5.7->[6.8-10.10]   Dedup: 6.8->[7.9-10.10]
I20260709 13:07:29.990541 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:29.990677 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:29.992015 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.991832 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:29.992656 22814 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:29.992738 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:29.991705 22812 raft_consensus.cc:2368] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13.
I20260709 13:07:29.990906 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:29.903424 26456 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:29.994132 22813 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:29.991747 22147 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:30.000141 22811 raft_consensus.cc:1240] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:29.994453 22218 leader_election.cc:400] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10.
I20260709 13:07:29.995632 22179 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:29.989667 22816 pending_rounds.cc:85] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting all ops after (but not including) 8
I20260709 13:07:29.997527 22172 raft_consensus.cc:1275] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:30.002144 22816 pending_rounds.cc:107] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:07:30.002446 22816 raft_consensus.cc:2889] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.002672 22218 leader_election.cc:403] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:29.998273 22144 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:30.004489 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 55232.2us
I20260709 13:07:30.005509 22218 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:30.008387 26561 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:30.008667 26558 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:29.964653 22248 rpcz_store.cc:276] 0709 13:07:25.676233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.678382 (+  2149us) service_pool.cc:224] Handling call
0709 13:07:25.897086 (+218704us) log.cc:844] Serialized 506 byte log entry
0709 13:07:26.651358 (+754272us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x7b180048e740. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e2f2a6 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7eceb26 00007f66a7ec849a 00007f66a7ec7714
0709 13:07:26.651915 (+   557us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b540018e320. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7eceb26 00007f66a7ec849a 00007f66a7ec7714 00007f66a7ea7eaa 00007f66a7eaed53 00007f66a7eaecd9 00007f66a7eaec69 00007f66a7eaec31 00007f66a7eaddfd 000000000038f354
0709 13:07:26.850464 (+198549us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b540018e320. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7eceb26 00007f66a7ec849a 00007f66a7ec7714 00007f66a7ea7eaa 00007f66a7eaed53 00007f66a7eaecd9 00007f66a7eaec69 00007f66a7eaec31 00007f66a7eaddfd 000000000038f354
0709 13:07:29.963915 (+3113451us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6685,"raft.queue_time_us":17325,"raft.run_cpu_time_us":23867,"raft.run_wall_time_us":1494968,"spinlock_wait_cycles":182318464,"thread_start_us":148287,"threads_started":1,"wal-append.queue_time_us":285421,"wal-append.run_cpu_time_us":3039,"wal-append.run_wall_time_us":1230577}
I20260709 13:07:30.011924 22255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:07:30.013557 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:30.015316 22218 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:30.018635 22144 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:29.956383 26632 raft_consensus.cc:740] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:30.009635 26631 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10.
W20260709 13:07:30.020475 26599 log.cc:927] Time spent T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 1.090s	user 0.006s	sys 0.007s
I20260709 13:07:30.012969 26628 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:30.016038 26242 consensus_queue.cc:1059] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:07:30.020784 26561 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:30.021637 26471 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:30.022106 26624 consensus_queue.cc:1059] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:30.019306 26496 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:30.025084 26483 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:30.025934 22144 leader_election.cc:400] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13.
I20260709 13:07:30.050232 22144 leader_election.cc:403] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:30.031410 22255 raft_consensus.cc:606] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:30.051105 22255 raft_consensus.cc:614] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:30.032918 22250 raft_consensus.cc:1240] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:07:30.018910 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 99349.3us
I20260709 13:07:30.054842 22072 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:30.039956 22218 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:30.062415 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.062810 22218 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:30.065032 22218 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:30.066859 22253 raft_consensus.cc:2368] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13.
I20260709 13:07:30.067606 22218 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:30.069238 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.068593 22072 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:30.048925 26242 consensus_queue.cc:1243] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:30.067528 26471 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.071486 26448 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:30.065544 26619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.013s	sys 0.032s
I20260709 13:07:30.069269 26631 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:30.065690 26561 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:30.071715 26582 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.057503 26483 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:30.104986 22218 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:30.113370 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:30.106050 22072 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:30.107158 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 81390.2us
I20260709 13:07:30.112040 26448 raft_consensus.cc:697] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:30.114885 26242 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.115414 26448 consensus_queue.cc:237] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:30.115950 26626 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:30.116708 26626 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:30.071465 26496 raft_consensus.cc:3055] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:30.125676 22106 raft_consensus.cc:1240] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:30.120914 22249 raft_consensus.cc:1240] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.121241 22218 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:30.127637 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:30.128187 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.128831 22106 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:30.129251 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:30.110430 26619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.014s	sys 0.036s
I20260709 13:07:30.105619 26654 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:30.132814 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.108444 26456 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:30.178642 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.143657 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.186645 22246 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:30.112320 26561 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:30.190196 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 84218.9us
I20260709 13:07:30.191246 22104 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:30.195756 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.119812 26483 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:30.236285 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 108724us
I20260709 13:07:30.125308 26496 raft_consensus.cc:740] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:30.139489 26439 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:30.140275 26362 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:30.131608 25889 raft_consensus.cc:2804] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:30.249643 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.131589 26630 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:30.135661 26629 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:30.244455 22104 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: [8.6-11.7]
I20260709 13:07:30.066231 26632 consensus_queue.cc:260] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:30.182667 26619 raft_consensus.cc:697] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:30.261775 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.180874 26582 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:30.139765 26572 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.194377 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.251264 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:30.251992 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 60717.8us
I20260709 13:07:30.272079 22072 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:30.195343 26561 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:30.250136 26660 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:07:30.262115 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.248123 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.274605 22106 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:30.275974 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.255416 26631 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.280378 22144 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:30.252925 26626 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:30.255513 26439 raft_consensus.cc:697] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:30.261971 26630 raft_consensus.cc:697] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:30.298306 22144 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:30.303783 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:30.277515 26632 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.312234 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.283162 26647 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.316220 26435 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:30.321506 26460 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:30.321923 22104 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:30.323839 26460 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:30.329964 26242 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13.
I20260709 13:07:30.330807 26619 consensus_queue.cc:237] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:30.332312 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 72626.6us
I20260709 13:07:30.302410 26579 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:30.270705 26582 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:30.308036 26629 raft_consensus.cc:697] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:30.348517 22249 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:30.351501 26439 consensus_queue.cc:237] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:30.296976 26631 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:30.359373 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 55703.5us
I20260709 13:07:30.359726 26631 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:30.360536 26460 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.361049 26460 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:30.361256 22072 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:30.363293 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.364647 26498 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.365106 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.365741 22101 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:30.367506 22144 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:30.367977 26643 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:07:30.368429 26620 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:30.368817 26620 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.369179 26620 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:30.373106 26591 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:30.349608 22220 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:30.314169 26611 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:30.378252 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.378571 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.379231 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.387545 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.388320 22103 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
W20260709 13:07:30.389765 26661 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:07:30.392072 26664 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:07:30.397197 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.399621 26662 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:30.304840 26623 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:07:30.305962 26247 consensus_queue.cc:1059] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:07:30.404409 26582 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:30.411310 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.341218 26579 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.412483 26579 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.413002 26362 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:30.413676 26362 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:30.416064 22779 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.65:33421 timed out after 1.609s (SENT) [suppressed 16 similar messages]
W20260709 13:07:30.419502 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 70016.8us
I20260709 13:07:30.425473 22172 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:07:30.426961 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 48059.7us
I20260709 13:07:30.430675 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:30.431160 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:30.427493 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:30.428360 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.432945 22098 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:30.429214 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:30.439097 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:30.441246 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.442353 22172 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:30.468663 22781 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:30.379976 26611 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.293350 26496 consensus_queue.cc:260] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:30.483851 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 52816.1us
W20260709 13:07:30.485934 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 69906.3us
I20260709 13:07:30.421013 26582 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:30.484007 22220 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:30.380527 25889 raft_consensus.cc:697] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:30.498340 22816 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.499851 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:30.498791 26554 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:30.503114 22220 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:30.504770 22218 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:30.506363 26453 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:30.420710 26587 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:30.507201 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 87743.8us
I20260709 13:07:30.506711 25889 consensus_queue.cc:237] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:30.531347 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.533133 22815 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:30.537607 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.538312 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:30.538347 22098 raft_consensus.cc:1240] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.539063 22249 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.538574 22218 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:30.540221 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.538533 22255 raft_consensus.cc:2410] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:30.544535 22779 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:30.466444 26498 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.552258 22248 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:30.474231 26628 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.489135 26611 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:30.487214 26557 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:30.571303 22097 raft_consensus.cc:2368] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 13. Current term is 14.
I20260709 13:07:30.561252 22779 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:30.530974 26606 consensus_meta.cc:287] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.569s	user 0.012s	sys 0.001s
W20260709 13:07:30.520814 26641 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.788s	user 0.006s	sys 0.000s
I20260709 13:07:30.568338 22248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:07:30.515872 26451 raft_consensus.cc:3055] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:30.506865 26453 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.574769 22248 raft_consensus.cc:606] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:30.528415 26665 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:30.515192 26554 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:30.507110 26631 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:30.577720 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:30.586650 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 69642.3us
I20260709 13:07:30.501888 26359 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:07:30.574381 26557 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:30.592990 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.576632 26496 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.549168 26620 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:30.506943 26666 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:07:30.556936 26448 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:07:30.564541 26600 consensus_queue.cc:1059] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:07:30.577760 26451 raft_consensus.cc:740] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:30.566948 26498 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:30.604211 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2182) took 1185 ms. Trace:
I20260709 13:07:30.584306 26668 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:30.584444 26453 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.614156 22251 rpcz_store.cc:276] 0709 13:07:29.425041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.443404 (+ 18363us) service_pool.cc:224] Handling call
0709 13:07:29.443817 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.589229 (+145412us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:29.589282 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.589920 (+   638us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.650071 (+ 60151us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:29.650114 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.650178 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.519868 (+869690us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:30.603921 (+ 84053us) raft_consensus.cc:1685] finished
0709 13:07:30.603944 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.604146 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10873,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":36496,"spinlock_wait_cycles":8768896,"thread_start_us":179624,"threads_started":2,"wal-append.queue_time_us":75339}
I20260709 13:07:30.607183 22816 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:30.603896 26677 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:30.571132 26628 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:30.601734 26463 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:30.617977 26631 consensus_queue.cc:1048] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:07:30.644759 26628 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:30.646306 26668 raft_consensus.cc:697] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:30.647351 26668 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:30.547375 26630 consensus_queue.cc:237] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:30.618393 22180 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:30.590194 26426 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:07:30.570825 26244 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:07:30.598042 26557 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.584937 26667 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.642133 26498 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:30.619356 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 47845.3us
I20260709 13:07:30.660627 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:30.650784 22249 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:30.658311 22098 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:30.678023 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.670516 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.650424 26362 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:30.582672 26629 consensus_queue.cc:237] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:30.653201 26549 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:30.694805 22782 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:30.702520 26620 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:30.704303 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:30.653798 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet 7e0f44b43c1a477e9c7c66c034c8844a: Aborted: Op aborted by new leader
W20260709 13:07:30.697685 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 136548us
I20260709 13:07:30.712558 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.687479 26632 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.757906 22779 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:30.687302 26602 raft_consensus.cc:3055] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:30.795362 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.798913 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:30.805290 22815 raft_consensus.cc:2393] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
W20260709 13:07:30.816879 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 122174us
I20260709 13:07:30.818434 22811 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:07:30.819427 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 61595.6us
I20260709 13:07:30.820411 22779 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:30.821313 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:30.821841 22779 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:30.824719 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:30.826759 22816 raft_consensus.cc:1240] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:30.827666 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:30.833122 22103 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:30.836870 26425 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.837061 26312 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.837409 26425 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:30.839330 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.840389 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.840822 26677 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:30.841122 26448 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:30.841590 26677 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:30.841984 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:30.844033 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.844933 22246 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
I20260709 13:07:30.816998 26632 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:30.846328 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.847062 26663 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.139s
I20260709 13:07:30.841991 26677 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.848403 26677 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.849061 26463 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:30.849470 26463 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.849817 26463 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.847404 22255 raft_consensus.cc:2410] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:30.851517 26380 consensus_queue.cc:1059] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:30.853024 26426 raft_consensus.cc:3055] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:30.651360 26451 consensus_queue.cc:260] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:30.795809 26561 consensus_meta.cc:287] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.001s
I20260709 13:07:30.840510 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.837512 26312 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:30.854692 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:30.853153 22255 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:07:30.863672 22255 pending_rounds.cc:85] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 8
I20260709 13:07:30.864017 22255 pending_rounds.cc:107] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:07:30.864351 22255 raft_consensus.cc:2889] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.864991 22218 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:30.881631 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:30.795553 26602 raft_consensus.cc:740] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:30.918700 22253 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:30.916564 26359 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.925873 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:30.853371 26426 raft_consensus.cc:740] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:30.848204 26632 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:30.870247 26587 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:30.917863 26663 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:30.841615 26448 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:30.951821 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 130063us
W20260709 13:07:30.950168 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 241084us
W20260709 13:07:30.939388 26579 consensus_meta.cc:287] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
W20260709 13:07:30.960247 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.962339 22181 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:30.873759 26561 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:30.970319 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet dd0d86a3e0d843d0a468840a4f90cbf4: Illegal state: Replica 765d912bde9e48959e50d9efec3c26b6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:30.961706 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:30.972347 22098 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:30.869627 26667 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:07:30.947149 26588 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:30.989936 26362 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:30.992389 26453 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:30.994334 22249 raft_consensus.cc:2393] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 13: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:30.997676 26681 consensus_queue.cc:1059] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:07:30.998842 26632 raft_consensus.cc:3055] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:30.999374 26632 raft_consensus.cc:740] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:31.000461 26632 consensus_queue.cc:260] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:31.003167 26669 log.cc:927] Time spent T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
W20260709 13:07:31.004711 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.005306 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.006338 26471 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.006944 26471 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.009142 26471 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.016225 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:31.017143 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:31.017457 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:31.018090 22104 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:31.019359 26686 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:31.020153 22100 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:31.021895 26463 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:30.994747 26453 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:31.027784 26679 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.028374 26679 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.031190 26679 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.031908 26242 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:31.032469 26242 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.034586 26242 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:31.035614 22812 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:31.036211 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:31.036782 22815 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:31.039134 26663 consensus_queue.cc:1059] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:07:31.042186 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:30.983834 26500 consensus_queue.cc:1048] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:07:31.017791 22811 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:31.047758 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:31.027756 22098 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:07:31.063329 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:31.068210 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:31.069332 22814 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:31.069801 22815 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
I20260709 13:07:31.071373 22069 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:31.076639 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:31.074576 26456 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:31.081024 26456 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.082321 26448 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:31.048986 26471 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:07:30.985357 26587 consensus_queue.cc:1059] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 13:07:31.086998 26500 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:31.087567 26500 raft_consensus.cc:697] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:31.088640 26456 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.088465 26500 consensus_queue.cc:237] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.089870 26587 raft_consensus.cc:3055] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:31.090313 26587 raft_consensus.cc:740] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:31.091200 26587 consensus_queue.cc:260] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.092744 26587 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:31.100888 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:31.101300 26312 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.101608 26460 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.103255 26425 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:31.103353 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:31.104079 22251 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:31.049649 26426 consensus_queue.cc:260] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.112530 26426 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.965687 26579 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.117398 26579 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.118314 22176 raft_consensus.cc:1240] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:31.129247 22782 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:31.131481 26456 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:30.977046 26602 consensus_queue.cc:260] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.133312 26602 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:31.139598 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 94027.6us
I20260709 13:07:31.140640 22144 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:31.134024 26561 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:31.142573 26654 consensus_meta.cc:287] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.891s	user 0.003s	sys 0.008s
I20260709 13:07:31.049876 26588 raft_consensus.cc:697] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:30.987397 26600 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.168s
I20260709 13:07:31.145543 26242 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:31.143164 26456 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:07:31.157171 26483 consensus_meta.cc:287] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.908s	user 0.009s	sys 0.003s
I20260709 13:07:31.153501 26684 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.166154 22144 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:31.198995 26557 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.201133 26684 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.160877 26654 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.204061 22816 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:07:31.205544 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:31.163934 26425 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:31.173797 26456 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:31.209724 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 146890us
I20260709 13:07:31.211298 22101 raft_consensus.cc:1240] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: [8.6-11.7]
W20260709 13:07:31.212323 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.228991 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 216759us
I20260709 13:07:31.229585 22106 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:31.229761 22072 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:31.175115 26242 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.225611 22071 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:31.232955 22102 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:31.231305 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:31.234341 22104 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:31.236466 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 322397us
I20260709 13:07:31.227185 26579 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:31.178686 26619 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:31.204932 26557 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.270990 22104 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:31.247370 22218 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:31.252481 22072 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:31.253671 26498 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:31.248943 26688 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:31.254555 26690 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.178083 26483 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.232013 26242 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:31.208331 26606 consensus_queue.cc:1059] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:07:31.274507 22072 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:31.245664 26654 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.225732 26425 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.283367 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:31.285912 22072 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:31.287815 22779 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:31.233107 26677 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.289633 22218 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:31.247247 26460 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:07:31.273459 26561 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.292265 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:31.282706 26666 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.282109 26579 raft_consensus.cc:697] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:31.303720 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:31.273427 26619 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.312635 22814 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:31.306854 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:31.289143 26654 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.317237 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:31.293730 26611 consensus_meta.cc:287] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.713s	user 0.010s	sys 0.001s
I20260709 13:07:31.314024 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:31.296288 26693 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.291980 26698 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:31.292411 26630 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:07:31.327629 26691 log.cc:927] Time spent T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:31.283715 26690 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.331822 26451 raft_consensus.cc:3060] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:31.273938 26588 consensus_queue.cc:237] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.319483 22098 raft_consensus.cc:2393] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 9: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:31.320312 22104 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:31.292133 26695 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:31.299479 26498 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.324162 26579 consensus_queue.cc:237] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:31.326381 26549 consensus_meta.cc:287] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.532s	user 0.002s	sys 0.007s
I20260709 13:07:31.295861 26696 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:31.314042 26629 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.334890 22811 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:31.341077 22104 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:31.339334 22098 raft_consensus.cc:1275] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:31.343601 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:31.341274 26695 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.346748 22813 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:31.352411 26619 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.353116 26483 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:31.355949 26456 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.360697 26677 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:31.341550 26696 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:31.363607 26696 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:31.370139 22807 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:31.313129 26561 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.381099 26695 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:31.375100 26684 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.384992 26654 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.319380 26611 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.387970 26611 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.395888 22174 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:07:31.405234 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:31.407074 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:31.407989 22098 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:31.410441 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:31.400115 26677 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:07:31.411038 22106 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.411310 26677 consensus_queue.cc:1243] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer c0694f6572bf406a92d55f1f2ab46ef2 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:31.401849 26549 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:31.418587 26549 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.420382 22106 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:31.420797 26549 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:31.422416 26561 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:31.414662 26242 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.429618 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43368 (request call id 680) took 1066 ms. Trace:
I20260709 13:07:31.431147 26497 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:31.431721 26497 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.430207 22072 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:31.433792 26497 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:31.434227 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.435266 26656 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.435881 22097 raft_consensus.cc:1240] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:31.436348 26242 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.437654 26656 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:31.438848 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:31.439170 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:31.439499 22175 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 14.
I20260709 13:07:31.439831 22179 raft_consensus.cc:1275] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:31.442492 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:31.443238 22181 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:31.444142 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:31.446818 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:31.448333 22220 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:31.448424 26439 consensus_queue.cc:1059] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:31.449944 22220 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:31.451393 26359 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:31.451818 26359 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.452172 26359 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:31.455097 26693 raft_consensus.cc:3055] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:31.455621 26693 raft_consensus.cc:740] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:31.456504 26693 consensus_queue.cc:260] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.457794 26693 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.459445 22179 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:31.461117 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.468427 22181 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:31.469570 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:31.471180 22173 raft_consensus.cc:2410] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:31.430047 22102 rpcz_store.cc:276] 0709 13:07:30.362820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.363023 (+   203us) service_pool.cc:224] Handling call
0709 13:07:31.429395 (+1066372us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b5400215a54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:31.429510 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1998479104}
I20260709 13:07:31.483367 26460 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:31.488296 26460 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.491334 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:31.492836 26663 raft_consensus.cc:993] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: : Instructing follower 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:07:31.497032 26666 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:31.497721 26666 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:31.498337 26666 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.493835 26453 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:07:31.504899 26453 consensus_queue.cc:1243] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:31.507474 26683 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:31.508423 26683 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.484179 26684 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.511272 26684 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.500476 26681 consensus_queue.cc:1059] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:07:31.513345 26684 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.514650 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:31.521111 22816 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:31.525903 26705 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:31.527814 26611 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.527968 26663 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.528453 26611 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.528601 26663 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.530874 26663 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:31.532579 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:31.527833 22179 pending_rounds.cc:85] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 6
I20260709 13:07:31.533731 22179 pending_rounds.cc:107] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:07:31.533958 22179 raft_consensus.cc:2889] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:31.534173 26463 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.500820 26695 raft_consensus.cc:1081] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Signalling peer 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:07:31.542418 26696 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.545830 22099 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 14.
I20260709 13:07:31.548112 26696 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.534104 26683 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.520563 26244 consensus_queue.cc:1059] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:07:31.553746 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:31.554714 22173 raft_consensus.cc:2393] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 14: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:31.556619 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:31.557395 22248 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:07:31.557180 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.564548 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:31.562609 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:31.557301 22249 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:31.530789 26611 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.536221 26632 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.563499 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:31.531204 26460 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:31.576982 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:31.577514 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:31.578374 22255 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:31.579232 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:31.581354 26453 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:31.540567 26359 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.582646 26630 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.559408 26497 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:07:31.588214 26453 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:31.654217 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 333104us
I20260709 13:07:31.621101 26683 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.646250 26497 consensus_queue.cc:1243] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer a07ca3d1b5b84f4bbcb907f709a69275 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:31.682711 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:31.683456 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:31.640789 26630 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.718739 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:31.719626 22248 raft_consensus.cc:2393] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 12: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:31.719200 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:31.722613 22254 raft_consensus.cc:2376] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 8. Re-sending same reply.
I20260709 13:07:31.724241 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:31.725167 22254 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:31.726316 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:31.730370 22254 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:31.732661 22248 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:31.680264 26683 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.747677 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:31.748423 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:31.752310 26707 log.cc:927] Time spent T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:31.762506 22255 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:31.763697 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:31.768420 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:31.769441 22816 raft_consensus.cc:1240] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:31.769553 22105 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:31.769569 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:31.771169 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:31.775383 26681 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:31.777976 22218 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:31.778810 26681 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:31.780715 26681 consensus_queue.cc:1048] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:31.781610 26666 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.784723 26630 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:31.785980 22252 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:31.786459 26683 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.783228 26681 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:07:31.788357 26453 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:31.788717 26666 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:31.789960 22250 raft_consensus.cc:2410] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:31.790223 26693 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:31.792610 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:31.794209 26600 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.795944 22173 raft_consensus.cc:3055] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:31.796373 22173 raft_consensus.cc:740] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:31.794977 26600 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:31.796216 26693 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:31.797170 22173 consensus_queue.cc:260] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:31.798178 22173 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:31.804129 26600 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:31.811869 26666 raft_consensus.cc:3055] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:31.812597 26666 raft_consensus.cc:740] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:31.813555 26666 consensus_queue.cc:260] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:31.974552 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.093492 22173 pending_rounds.cc:85] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 10
I20260709 13:07:32.093928 22173 pending_rounds.cc:107] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:07:32.094236 22173 raft_consensus.cc:2889] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:32.154808 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.232695 26600 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:32.233516 26600 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:32.237816 26646 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.238517 26646 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:32.241887 26646 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:32.258530 26600 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:32.261763 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:32.311707 22175 raft_consensus.cc:2410] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:07:32.528825 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.621592 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.945852 26727 log.cc:927] Time spent T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 13:07:33.078383 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.090468 22173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.009s	sys 0.000s
W20260709 13:07:33.091581 22173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.009s	sys 0.000s
I20260709 13:07:33.098973 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2509) took 1006 ms. Trace:
I20260709 13:07:33.099428 22173 rpcz_store.cc:276] 0709 13:07:32.092426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.092834 (+   408us) service_pool.cc:224] Handling call
0709 13:07:32.093262 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.094819 (+  1557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.094857 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.127846 (+ 32989us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.092058 (+964212us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:33.092109 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.092223 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.098696 (+  6473us) raft_consensus.cc:1685] finished
0709 13:07:33.098718 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.098883 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":963795,"threads_started":1,"wal-append.queue_time_us":967004}
I20260709 13:07:33.104087 26731 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:33.105062 26731 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.108055 26731 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.109505 26730 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:33.110044 26730 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:33.110759 22072 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:33.111953 22072 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:33.112272 26730 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:33.112850 26730 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:33.115716 26733 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.116580 26733 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.119598 26733 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.113492 26730 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.125533 26730 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.126464 26731 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:33.126909 22252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 2207) took 1565 ms (client timeout 1915 ms). Trace:
I20260709 13:07:33.129698 26730 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:33.129917 22252 rpcz_store.cc:269] 0709 13:07:31.561376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.561519 (+   143us) service_pool.cc:224] Handling call
0709 13:07:33.126557 (+1565038us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54002283d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:33.126820 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478543616}
I20260709 13:07:33.130597 26730 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.132043 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:33.133097 22252 raft_consensus.cc:2368] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 14. Current term is 15.
I20260709 13:07:33.133529 26730 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:33.133671 22252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51872 (request call id 2348) took 1368 ms (client timeout 1816 ms). Trace:
W20260709 13:07:33.134447 22252 rpcz_store.cc:269] 0709 13:07:31.765688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.131646 (+1365958us) service_pool.cc:224] Handling call
0709 13:07:33.133592 (+  1946us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:33.136269 26733 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:33.137415 26733 raft_consensus.cc:697] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:33.140256 26734 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:33.141000 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.141325 26734 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.138450 26733 consensus_queue.cc:237] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.141870 26734 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.127276 26731 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:33.144595 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.146508 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.146649 26731 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.147137 22173 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:33.149570 22173 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:33.152027 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:32.754614 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:33.157892 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.158535 22175 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:33.160594 22071 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:33.163673 22071 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:33.160727 26734 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.170325 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:33.173115 26730 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:33.174225 26730 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:33.174795 26730 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.178344 26312 consensus_queue.cc:1059] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:33.179757 26312 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:33.180117 26312 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:33.180455 26312 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.185120 26730 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.187902 26734 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.188544 26734 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:33.189055 26734 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.189850 26312 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.191207 26734 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.191812 26734 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:33.192358 26734 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.195307 26730 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:33.196318 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 84440.6us
I20260709 13:07:33.197103 22072 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:33.198215 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:33.198561 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:33.198994 26730 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:33.199219 22173 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.199683 26730 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:33.200208 22072 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:33.201894 22072 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:33.203907 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.204187 26451 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:33.204759 26451 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.202023 26730 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:33.207257 26730 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:33.207301 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:33.207953 22105 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.207921 26730 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:33.208562 26730 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.210486 22173 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
I20260709 13:07:33.210603 26730 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.198359 26735 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:33.211216 26730 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:33.211500 26735 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.211654 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.211728 26730 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.212386 22101 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:33.213825 26730 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.206861 26451 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.217545 26735 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.221165 22105 raft_consensus.cc:2468] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:33.225492 26735 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.228679 26735 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.230994 26451 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:33.231595 26451 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.233167 22071 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:33.234063 26735 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:33.234573 26735 raft_consensus.cc:697] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:33.235525 26735 consensus_queue.cc:237] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:33.246758 22099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1945) took 1942 ms (client timeout 1781 ms). Trace:
I20260709 13:07:33.251677 26451 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:33.249392 22099 rpcz_store.cc:269] 0709 13:07:31.303938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.313507 (+  9569us) service_pool.cc:224] Handling call
0709 13:07:33.246532 (+1933025us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540012fa54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:33.246677 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518604544}
I20260709 13:07:33.253682 26451 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.254271 26451 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.258649 26451 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:33.265413 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 1.47282e+06us
I20260709 13:07:33.269248 22072 leader_election.cc:400] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 14. Current term is 15.
I20260709 13:07:33.269634 22072 leader_election.cc:403] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:07:33.271071 26646 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:33.272348 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.273052 22103 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:33.283629 26646 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 14. Current term is 15.
I20260709 13:07:33.284940 25889 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.298455 26742 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.299364 26742 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:33.289732 25889 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.299994 26456 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.303896 25889 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:33.306370 25889 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:33.306974 25889 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.309991 25889 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.310602 25889 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:33.311167 25889 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.312552 26690 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.313344 25889 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:33.314806 25889 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:33.315336 25889 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.317236 25889 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:33.318441 25889 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.318989 25889 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.321595 26448 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:33.321828 25889 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.322395 25889 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.322184 26448 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.322865 25889 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.324532 26448 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.324819 25889 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:33.326627 26742 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:33.339932 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2201) took 2661 ms. Trace:
I20260709 13:07:33.344125 22253 rpcz_store.cc:276] 0709 13:07:30.678177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.678276 (+    99us) service_pool.cc:224] Handling call
0709 13:07:30.695876 (+ 17600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.919321 (+223445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.339623 (+2420302us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54003bd654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:33.339839 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511541632}
W20260709 13:07:33.342903 22250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 2208) took 1781 ms (client timeout 2189 ms). Trace:
W20260709 13:07:33.345456 22250 rpcz_store.cc:269] 0709 13:07:31.561670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.563084 (+  1414us) service_pool.cc:224] Handling call
0709 13:07:33.342694 (+1779610us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540023ad54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:33.342840 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482377984}
I20260709 13:07:33.347360 26744 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:33.347925 26744 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.349150 26742 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:33.349680 26742 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.350284 26744 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.351660 26742 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.352404 26742 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:33.354862 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.353608 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.355268 26742 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.355576 22247 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:33.355854 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.361541 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:33.361855 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.362107 22247 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.362957 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.363521 22252 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:33.364419 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.365025 22252 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
W20260709 13:07:33.365751 26362 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:07:33.365852 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.356180 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:33.366608 25889 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.367069 26743 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:33.367321 26448 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.367789 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.367909 26448 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.368554 22246 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:33.358806 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.369395 22253 raft_consensus.cc:2410] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:33.369333 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:33.369951 22246 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.370230 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.370404 26448 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:33.370950 22253 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 13: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:33.366669 22252 raft_consensus.cc:2393] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 12: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:33.373193 25889 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.367734 26743 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.374490 26742 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:33.376072 22072 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:33.376545 25889 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:33.376557 26743 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:33.374142 26744 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.377372 26426 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:33.377497 26744 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.377923 26426 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:33.378600 26426 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.379719 26744 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:33.386958 26426 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:33.395920 26426 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:33.405682 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 2105) took 2726 ms. Trace:
I20260709 13:07:33.406148 22174 rpcz_store.cc:276] 0709 13:07:30.679239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.679433 (+   194us) service_pool.cc:224] Handling call
0709 13:07:30.686789 (+  7356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.396999 (+710210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.386876 (+1989877us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b5400328cd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:33.405567 (+ 18691us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1616427392}
I20260709 13:07:33.394495 26425 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:33.390126 22255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.607s	user 0.006s	sys 0.010s
W20260709 13:07:33.408735 22255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.626s	user 0.008s	sys 0.011s
I20260709 13:07:33.390938 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:33.410465 22072 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:33.410754 26570 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.411283 26570 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.412113 22072 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:33.413343 26570 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.414073 22072 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:33.414816 26732 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:33.415239 26732 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:33.415611 26732 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.416316 26570 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:33.416771 26570 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:33.417201 26570 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.417652 26698 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:33.419097 26698 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:33.419260 26646 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.419502 26698 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.419866 26646 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.422372 26646 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.418066 26688 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:33.430397 22103 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:33.431423 26730 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.431625 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.432248 22099 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:33.432864 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:33.433140 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:33.433452 22097 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:33.433588 22179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.898s	user 0.008s	sys 0.019s
W20260709 13:07:33.434216 22179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.899s	user 0.008s	sys 0.019s
I20260709 13:07:33.434485 22101 raft_consensus.cc:1240] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:33.435184 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 2119) took 1908 ms. Trace:
I20260709 13:07:33.435735 22179 rpcz_store.cc:276] 0709 13:07:31.527139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.527315 (+   176us) service_pool.cc:224] Handling call
0709 13:07:31.527645 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:31.534637 (+  6992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.534672 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:31.535190 (+   518us) log.cc:844] Serialized 52 byte log entry
0709 13:07:33.434709 (+1899519us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:33.434766 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.434859 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.434940 (+    81us) raft_consensus.cc:1685] finished
0709 13:07:33.434958 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.435115 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":990,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":6290,"thread_start_us":1899154,"threads_started":1,"wal-append.queue_time_us":228764,"wal-append.run_cpu_time_us":1450,"wal-append.run_wall_time_us":1001490}
I20260709 13:07:33.442291 26362 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:33.443068 26362 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.445081 22097 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:33.431968 26730 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.445858 26362 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.437606 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:33.435323 26735 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.447372 26730 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.447131 26735 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.449137 22102 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:33.457340 26623 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.458105 26623 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.460305 22101 raft_consensus.cc:1217] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Deduplicated request from leader. Original: 12.10->[13.11-13.11]   Dedup: 13.11->[]
I20260709 13:07:33.460860 22101 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:07:33.437531 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:33.461222 26623 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.461865 26623 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:33.462334 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.463039 22252 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:33.463157 26620 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:33.463853 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.463795 26620 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.464972 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:33.465458 22252 raft_consensus.cc:3060] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.466153 26620 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.467275 26425 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.467787 26425 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.470130 26425 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.462368 26623 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.473248 26623 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.467275 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.476356 22097 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
W20260709 13:07:33.485057 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.485814 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.487071 26570 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.488946 22246 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:33.489272 26570 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.490151 26698 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.492239 26698 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.493402 22247 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
I20260709 13:07:33.490156 26732 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.494565 26451 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:33.495251 26451 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.495780 26732 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.497740 26451 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.498284 26451 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:33.500735 22252 raft_consensus.cc:2468] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
W20260709 13:07:33.504303 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 49012.3us
I20260709 13:07:33.505662 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:33.506213 22247 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.508828 22072 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:33.509290 26312 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.509613 26689 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:33.511471 26734 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.512455 22072 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:33.512784 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.518868 22100 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:33.536625 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2054) took 2617 ms. Trace:
I20260709 13:07:33.536954 22100 rpcz_store.cc:276] 0709 13:07:30.919212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.022181 (+102969us) service_pool.cc:224] Handling call
0709 13:07:33.518335 (+2496154us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b5800003398. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:07:33.518615 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.536336 (+ 17721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.536539 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58460544}
I20260709 13:07:33.520608 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:33.521430 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:33.538820 22250 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.539085 22252 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:33.540987 22254 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.778s	user 0.041s	sys 0.058s
W20260709 13:07:33.541343 22254 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.778s	user 0.042s	sys 0.058s
I20260709 13:07:33.524349 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:33.525013 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.543375 22175 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:33.543515 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2340) took 1824 ms. Trace:
I20260709 13:07:33.524042 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:33.527297 26242 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:33.544694 26242 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.546684 26242 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.527413 26496 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:33.528053 26689 raft_consensus.cc:697] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:33.547523 26496 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.530064 26734 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:33.548786 26734 raft_consensus.cc:697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:33.531854 22251 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:33.549696 26496 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.549644 26734 consensus_queue.cc:237] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.521937 22246 raft_consensus.cc:1240] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:33.551110 22072 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:33.551818 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:33.551928 26497 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:33.548072 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.552434 26497 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.552529 22246 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 13: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:33.552897 26497 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.548023 26689 consensus_queue.cc:237] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.555459 22172 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:33.521548 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:33.550103 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.557377 22251 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:33.498734 26451 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.561005 26451 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.561362 26439 consensus_queue.cc:1059] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:33.562134 22072 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:33.563068 22172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:51114
I20260709 13:07:33.563238 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.563715 22172 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:33.564100 22172 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.564615 26425 raft_consensus.cc:3055] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:33.565017 26425 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:33.565846 26425 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.567632 26312 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:33.568084 26312 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:33.568455 26312 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.569366 22147 leader_election.cc:400] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13.
I20260709 13:07:33.524259 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.573990 26572 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:33.574172 26685 log.cc:927] Time spent T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 2.424s	user 0.001s	sys 0.014s
I20260709 13:07:33.574338 22102 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:07:33.531363 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.575239 22180 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:33.576078 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.576843 22180 raft_consensus.cc:2393] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 12: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:33.466724 26620 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.577634 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:33.578065 26620 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.579226 22181 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:33.576722 26735 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.574538 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.584270 22174 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:33.584905 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.585570 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:33.530682 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:33.586822 22253 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.528767 22247 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:33.587918 26359 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:33.590512 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:33.591655 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.592597 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.593101 22178 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:33.593851 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.596659 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.594748 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:33.598197 22178 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:33.598322 22253 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:33.578629 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.600256 22177 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:33.601326 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.601769 22252 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:33.602346 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.605654 22250 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:33.564656 22179 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:33.607240 22147 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:33.608053 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:33.610054 22103 raft_consensus.cc:1240] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:07:33.612617 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.630349 22147 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:33.599376 22180 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:33.632174 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.633026 22180 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:33.634176 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.543875 22254 rpcz_store.cc:276] 0709 13:07:31.719270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.731588 (+ 12318us) service_pool.cc:224] Handling call
0709 13:07:31.731937 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.732268 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.732296 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.741991 (+  9695us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.541724 (+1799733us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:33.542034 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.543232 (+  1198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.543301 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.543339 (+    38us) raft_consensus.cc:1685] finished
0709 13:07:33.543350 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.543465 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":983,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":7337,"thread_start_us":1778211,"threads_started":1,"wal-append.queue_time_us":983683}
I20260709 13:07:33.517694 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2347) took 1752 ms. Trace:
I20260709 13:07:33.604524 22172 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.637552 22147 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:33.638690 22173 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:33.613350 22072 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:33.618175 26359 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.639765 26359 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.640635 22072 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:33.641518 26443 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:33.642144 26443 raft_consensus.cc:697] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:33.618862 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.620090 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.620967 22105 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:07:33.621100 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.645097 22177 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 8.
I20260709 13:07:33.635782 22255 rpcz_store.cc:276] 0709 13:07:31.765293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.779041 (+ 13748us) service_pool.cc:224] Handling call
0709 13:07:31.781569 (+  2528us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.781952 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.781982 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.782470 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.409133 (+1626663us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:33.516674 (+107541us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.517239 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.517348 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.517405 (+    57us) raft_consensus.cc:1685] finished
0709 13:07:33.517423 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.517612 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":106890,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":245,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":211,"thread_start_us":1733406,"threads_started":2,"wal-append.queue_time_us":1322972}
I20260709 13:07:33.649518 22172 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.647333 22072 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:33.649560 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.651535 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:33.658006 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.659888 22177 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:33.663434 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.652135 22174 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:33.665867 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.666572 22177 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:33.671377 26443 consensus_queue.cc:237] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:33.672818 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.643477 26362 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:33.676787 26497 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.704109 22178 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
I20260709 13:07:33.707442 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.708621 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.656934 26646 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:33.688053 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.699553 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.616804 26623 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:07:33.668504 26460 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:33.675333 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.643317 26451 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:33.700331 22099 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
I20260709 13:07:33.718163 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.701166 22098 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:33.701298 22147 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:33.719117 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.720206 22147 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:33.703964 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:33.664563 26570 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:33.703213 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.672691 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:33.703332 26733 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:33.723690 22105 raft_consensus.cc:2393] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 9: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:33.709547 22178 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
W20260709 13:07:33.712055 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.667975 26496 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:33.712236 22177 raft_consensus.cc:2393] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 15: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:33.679292 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.722121 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.723836 22106 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 13: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:33.574529 26572 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.727119 22172 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:33.724820 22220 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:33.728865 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.729691 22098 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
W20260709 13:07:33.731299 22202 debug-util.cc:398] Leaking SignalData structure 0x7b08001f7140 after lost signal to thread 21004
I20260709 13:07:33.732620 26497 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.733136 26362 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:33.733919 26362 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:33.735425 26620 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.738971 26572 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.742707 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.743788 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:33.728721 26242 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:33.744557 26646 raft_consensus.cc:697] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:33.745630 26646 consensus_queue.cc:237] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.747094 26570 raft_consensus.cc:697] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:33.747220 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:33.747690 22220 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:33.748059 22255 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
I20260709 13:07:33.748220 26570 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.749570 22220 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:33.746798 26312 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.752760 22071 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:33.754045 26656 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:33.754426 26656 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.754794 26656 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.755280 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.730623 26743 consensus_queue.cc:1059] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:07:33.757411 22103 raft_consensus.cc:2393] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:07:33.758229 22202 debug-util.cc:398] Leaking SignalData structure 0x7b08001f71c0 after lost signal to thread 22038
I20260709 13:07:33.759367 22071 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:33.744272 22251 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.764758 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.765323 22098 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:33.765759 22071 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:33.771880 26497 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:33.772357 26497 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.764473 26742 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:33.772730 26497 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.772917 26742 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:33.773826 26742 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.775266 25889 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:33.775635 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.775717 25889 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.776268 22098 raft_consensus.cc:2376] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15. Re-sending same reply.
I20260709 13:07:33.776314 25889 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.775983 22071 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:33.779623 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.780582 22098 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:07:33.775331 26732 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.795887 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.764673 26733 raft_consensus.cc:697] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:33.779358 26572 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.798861 22251 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:33.800261 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:33.803537 22218 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:33.805466 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 84477.7us
I20260709 13:07:33.806591 22173 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:33.792088 26689 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:33.807014 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:33.807274 26689 raft_consensus.cc:697] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:33.805488 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:33.808751 22172 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.809623 22218 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:33.813894 22147 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:33.791679 26744 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:07:33.816941 22147 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:33.815137 26496 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:33.819989 26496 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:33.820513 26496 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.825560 26696 raft_consensus.cc:3055] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:33.826089 26696 raft_consensus.cc:740] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:33.806216 26572 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.804149 26448 raft_consensus.cc:2764] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:33.830468 22098 raft_consensus.cc:1240] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:33.841401 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 2.12474e+06us
I20260709 13:07:33.843552 22779 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:33.836685 22814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 654) took 2519 ms. Trace:
I20260709 13:07:33.832000 22147 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:33.846733 25889 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.844163 22814 rpcz_store.cc:276] 0709 13:07:31.317058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.317374 (+   316us) service_pool.cc:224] Handling call
0709 13:07:31.317655 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.525271 (+207616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.525317 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.542203 (+ 16886us) log.cc:844] Serialized 26 byte log entry
0709 13:07:31.679083 (+136880us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:31.689965 (+ 10882us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.835556 (+2145591us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b180017f1a0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4ddbc0a 00007f66ae51b219 00007f66a4e63a40 00007f66a4e5e4e4 00007f66a4e5e455 00007f66a7f46060 00007f66a7f58716 00007f66a7f69287 00007f66a7f69208
0709 13:07:33.835780 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.836361 (+   581us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b54005d1454. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:33.836405 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.836447 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:33.836458 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.836599 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26014,"prepare.queue_time_us":10696,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":1932,"raft.queue_time_us":2209219,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":6490,"spinlock_wait_cycles":44523520,"thread_start_us":275111,"threads_started":2,"wal-append.queue_time_us":140675,"wal-append.run_cpu_time_us":2163,"wal-append.run_wall_time_us":1043153}
I20260709 13:07:33.835762 26762 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:33.853073 26242 raft_consensus.cc:2804] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:33.855780 26242 raft_consensus.cc:697] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:33.856799 26242 consensus_queue.cc:237] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.859553 26623 consensus_queue.cc:1059] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:07:33.861637 26460 raft_consensus.cc:3055] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:33.862263 26460 raft_consensus.cc:740] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:33.863801 26460 consensus_queue.cc:260] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.854679 25889 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:33.854847 26762 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:33.867167 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:33.852674 22807 pending_rounds.cc:85] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting all ops after (but not including) 10
I20260709 13:07:33.882252 22816 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:33.882809 22807 pending_rounds.cc:107] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:07:33.884641 22807 raft_consensus.cc:2889] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:33.832369 26602 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:33.899658 26602 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.900096 26602 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:33.956383 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.866401 26460 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.899142 26733 consensus_queue.cc:237] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.833158 26629 consensus_queue.cc:1059] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:07:33.949709 22810 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:33.830821 26696 consensus_queue.cc:260] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:33.842700 26689 consensus_queue.cc:237] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.969877 22172 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:33.972254 26572 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:33.982975 26497 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:33.968089 26732 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:33.988858 26497 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:33.989897 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:33.991077 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:33.992210 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:33.995296 26742 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:33.996264 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 235548us
I20260709 13:07:33.993654 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:34.002481 22220 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:33.980295 26762 raft_consensus.cc:3055] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:34.004776 22220 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:34.011039 22220 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:34.014348 25889 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:34.015038 25889 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:34.005527 26762 raft_consensus.cc:740] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:34.022945 26762 consensus_queue.cc:260] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.023517 25889 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:34.023962 22069 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:34.024713 26762 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.016788 22220 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:34.032331 26765 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:34.032855 26765 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.033226 26765 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:34.036682 26425 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:33.996053 26656 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:34.029295 22220 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:34.045862 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:34.022064 26743 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:34.052167 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 242601us
I20260709 13:07:34.006537 26761 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:34.054913 22218 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:34.028739 26500 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:34.005327 26629 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:07:34.068755 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 43747.6us
I20260709 13:07:34.064110 26761 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.073239 26761 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.074795 26629 consensus_queue.cc:1059] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:34.076004 26629 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:34.049259 26448 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:34.081359 26448 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.084962 26448 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.087771 26742 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:34.089012 26668 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.326s	user 0.030s	sys 0.044s
W20260709 13:07:34.089409 26668 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.335s	user 0.030s	sys 0.045s
I20260709 13:07:34.089452 26496 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.065917 26500 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:34.091250 26500 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.092015 26656 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:34.069448 26775 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:07:34.105722 26582 raft_consensus.cc:3055] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:34.106233 26582 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:34.107168 26582 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.108484 26582 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:34.118018 26500 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.120671 26500 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:34.122604 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:34.123164 22246 raft_consensus.cc:2410] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:07:34.123225 22810 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.135248 26743 raft_consensus.cc:697] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:34.138083 26602 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:34.095201 26646 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:07:34.138707 26743 consensus_queue.cc:237] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:34.142632 26602 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:34.148548 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 78379.7us
I20260709 13:07:34.150607 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:34.151218 22172 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:34.153220 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.153250 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:34.154068 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.154050 22181 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:34.162407 22172 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
W20260709 13:07:34.162407 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 107574us
I20260709 13:07:34.171156 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.172032 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.173714 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.173997 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.174453 26765 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:34.175671 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.175946 22810 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:34.176376 22255 raft_consensus.cc:2393] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 13: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:34.176923 22069 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:34.158459 26496 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:34.178985 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.179387 26448 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.180365 26689 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:34.180517 26776 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.180641 26668 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:34.182257 26765 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:34.183215 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.183418 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.184165 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:34.185037 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.185182 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:34.186034 22247 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:34.187242 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.188673 22253 raft_consensus.cc:2368] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13.
I20260709 13:07:34.192502 22181 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:34.194058 22218 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:34.273605 22220 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:34.262079 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:34.215161 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.287670 22248 raft_consensus.cc:2393] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 10: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:34.276360 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:34.288751 22172 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 14: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:34.248073 26765 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.273290 26666 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:34.274449 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:34.194029 26742 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:34.198246 26776 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.198437 26689 raft_consensus.cc:697] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:34.287045 22220 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:34.260619 26778 log.cc:927] Time spent T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:07:34.293633 22218 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:34.295239 22202 debug-util.cc:398] Leaking SignalData structure 0x7b0800043640 after lost signal to thread 22130
W20260709 13:07:34.313697 22202 debug-util.cc:398] Leaking SignalData structure 0x7b08000438a0 after lost signal to thread 22131
I20260709 13:07:34.294828 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.314783 26631 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:34.315218 22248 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 12: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:34.316356 26631 raft_consensus.cc:697] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:34.316936 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:34.317896 22248 raft_consensus.cc:2393] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 14: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:34.317342 26631 consensus_queue.cc:237] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.292567 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:34.293932 26735 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.319169 26663 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.319437 26735 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.321789 26735 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:34.321907 22218 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:34.298676 22252 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:34.294538 26582 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:34.300158 26761 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:34.323505 26675 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.323770 26582 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:34.294538 26668 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:34.312705 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:34.324265 22250 raft_consensus.cc:2393] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:34.324852 26668 raft_consensus.cc:697] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:34.325704 26761 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:34.287189 26312 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:34.325764 26668 consensus_queue.cc:237] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:34.327162 26582 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.327309 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.328146 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:34.328608 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.328819 22812 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:34.329355 22250 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 10: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:34.330439 22250 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:07:34.320022 26689 consensus_queue.cc:237] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.333484 22250 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 13:07:34.335529 22247 raft_consensus.cc:2368] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10.
I20260709 13:07:34.337013 22247 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:34.340093 22255 raft_consensus.cc:2410] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:34.323177 22218 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:34.313637 26742 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:34.318702 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.344889 22246 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 13:07:34.345585 26742 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:34.346629 22246 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:34.344696 26570 consensus_queue.cc:1059] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:34.349140 22255 raft_consensus.cc:1240] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:34.352303 26582 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.361140 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:34.363363 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:34.365849 22147 leader_election.cc:400] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13.
I20260709 13:07:34.366398 22147 leader_election.cc:403] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:34.368727 22175 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:34.368130 22071 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:34.371411 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:34.371862 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:34.372042 22173 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:34.372408 22175 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.373463 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:34.374276 22176 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.374434 22147 leader_election.cc:400] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10.
I20260709 13:07:34.375020 22147 leader_election.cc:403] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:34.376332 22180 raft_consensus.cc:2393] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 10: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:34.378268 22218 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:34.380128 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:34.321735 26776 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:34.382139 22250 raft_consensus.cc:1240] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:34.353531 26741 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:34.375988 26362 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13.
W20260709 13:07:34.392729 22202 debug-util.cc:398] Leaking SignalData structure 0x7b0800082820 after lost signal to thread 22205
I20260709 13:07:34.383054 26646 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:34.393167 22202 debug-util.cc:398] Leaking SignalData structure 0x7b080028b100 after lost signal to thread 22206
I20260709 13:07:34.393374 26646 raft_consensus.cc:697] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:34.394218 26646 consensus_queue.cc:237] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:34.396056 26439 raft_consensus.cc:3055] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:34.384030 26765 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:34.396497 26439 raft_consensus.cc:740] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:34.383814 26759 consensus_queue.cc:1059] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:07:34.397457 26439 consensus_queue.cc:260] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:34.398568 26242 raft_consensus.cc:3055] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:34.398958 26242 raft_consensus.cc:740] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:34.399230 22144 connection.cc:256] RPC call timeout handler was delayed by -1.7527261290000524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 13:07:34.399609 22144 connection.cc:256] RPC call timeout handler was delayed by -1.4918654599999854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 13:07:34.399966 22144 connection.cc:256] RPC call timeout handler was delayed by -1.4788611740000306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
I20260709 13:07:34.399744 26242 consensus_queue.cc:260] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:34.401068 26242 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:34.401350 26460 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:07:34.400301 22144 connection.cc:256] RPC call timeout handler was delayed by -1.4585654600000453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
W20260709 13:07:34.402034 22144 connection.cc:256] RPC call timeout handler was delayed by -1.212649478000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
W20260709 13:07:34.402356 22144 connection.cc:256] RPC call timeout handler was delayed by -1.1159283010000536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
W20260709 13:07:34.394229 22202 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce880 after lost signal to thread 22279
I20260709 13:07:34.400959 22100 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:07:34.402696 22144 connection.cc:256] RPC call timeout handler was delayed by -1.0286283010000261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
W20260709 13:07:34.402815 22202 debug-util.cc:398] Leaking SignalData structure 0x7b08003eecc0 after lost signal to thread 22280
W20260709 13:07:34.403105 22144 connection.cc:256] RPC call timeout handler was delayed by -1.0286283010000261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
W20260709 13:07:34.404369 22202 debug-util.cc:398] Leaking SignalData structure 0x7b08002f1d20 after lost signal to thread 22840
W20260709 13:07:34.404716 22202 debug-util.cc:398] Leaking SignalData structure 0x7b08003108a0 after lost signal to thread 22841
W20260709 13:07:34.405375 22202 debug-util.cc:398] Leaking SignalData structure 0x7b08000b39c0 after lost signal to thread 26463
I20260709 13:07:34.405910 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:34.406677 22099 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 14: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:34.407228 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:34.408492 22103 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:34.410730 22102 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:34.410008 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:34.414002 22218 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:34.418515 22175 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:34.421200 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:34.370015 26579 consensus_queue.cc:1059] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:07:34.424101 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:34.425529 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:34.425652 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.427621 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:34.377470 26600 consensus_queue.cc:1059] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:07:34.377424 26496 consensus_queue.cc:1059] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:07:34.430052 22254 raft_consensus.cc:2393] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 10: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:34.443387 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:34.444000 22254 raft_consensus.cc:1240] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:34.430591 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 45536us
I20260709 13:07:34.431928 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:34.444730 22220 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:34.442142 22144 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:34.445621 22172 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:07:34.451573 22172 pending_rounds.cc:85] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 7
I20260709 13:07:34.451938 22172 pending_rounds.cc:107] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:07:34.452242 22172 raft_consensus.cc:2889] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.427821 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:34.436789 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:34.429522 26629 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.442166 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:34.358784 22247 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:34.428530 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:34.447094 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:34.448504 22248 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:34.447520 26582 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:34.443502 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:34.422667 26602 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10.
I20260709 13:07:34.459919 22220 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:34.430028 26554 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.461467 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:34.412887 26460 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.476951 22255 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:34.426676 26631 consensus_queue.cc:1059] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:07:34.481865 22255 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:34.469822 26741 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:34.484478 22255 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:34.489801 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.475549 26779 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.470685 26743 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:34.488345 26312 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:07:34.492787 22248 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:34.459977 26629 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:34.495190 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 53149.1us
I20260709 13:07:34.479678 26600 raft_consensus.cc:2764] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:07:34.495450 22248 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:34.497737 26600 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:34.498342 26600 consensus_queue.cc:1243] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:34.502019 22248 pending_rounds.cc:85] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 6
I20260709 13:07:34.502350 22248 pending_rounds.cc:107] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:07:34.502578 22248 raft_consensus.cc:2889] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.502708 22144 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:34.503386 22176 raft_consensus.cc:2468] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:34.490482 26741 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.504405 22180 raft_consensus.cc:1240] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:34.491838 26631 consensus_queue.cc:1243] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Peer c0694f6572bf406a92d55f1f2ab46ef2 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:34.506808 26312 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:07:34.501379 26743 raft_consensus.cc:697] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:34.507046 26741 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:34.495553 26779 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.523356 26460 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:34.534862 22102 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:34.536131 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:34.537276 22104 raft_consensus.cc:1275] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:34.520319 26600 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:34.539201 26439 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:34.542243 26743 consensus_queue.cc:237] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.543196 26791 consensus_queue.cc:1059] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:07:34.561962 26312 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.576683 26312 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.578965 26312 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:34.579407 26759 raft_consensus.cc:3055] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:34.579788 26759 raft_consensus.cc:740] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:34.569208 26629 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:34.569613 26600 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:34.571166 26675 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:34.543722 26646 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.580566 26759 consensus_queue.cc:260] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:34.581238 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:34.581278 26646 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.581928 26759 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.582446 22181 raft_consensus.cc:2410] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:34.583356 22246 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:34.584115 26646 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:34.585165 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.586107 22255 raft_consensus.cc:2410] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:34.586781 26362 raft_consensus.cc:3055] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:34.586388 26600 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:34.573056 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.571797 26741 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.587183 26362 raft_consensus.cc:740] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:34.603395 22147 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:34.661692 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.674543 26793 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:34.678030 26793 raft_consensus.cc:697] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:34.679039 26793 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:34.701323 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.720597 22175 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:07:34.721063 22175 pending_rounds.cc:85] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 7
I20260709 13:07:34.721362 22175 pending_rounds.cc:107] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:07:34.721639 22175 raft_consensus.cc:2889] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.674763 26362 consensus_queue.cc:260] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:34.724248 26362 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.726608 22251 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:34.729084 26741 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:34.724356 26779 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:34.795926 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 293257us
I20260709 13:07:34.797719 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:34.802366 22172 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:34.799551 26570 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.839278 26570 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.842474 26570 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:34.812288 26799 consensus_queue.cc:1059] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:07:34.873018 22144 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:07:34.872000 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 182652us
I20260709 13:07:34.879509 22179 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:07:34.883858 22202 debug-util.cc:398] Leaking SignalData structure 0x7b080009dfe0 after lost signal to thread 26681
I20260709 13:07:34.878634 26600 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:34.889227 26683 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:34.890053 26683 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:34.891453 22202 debug-util.cc:398] Leaking SignalData structure 0x7b08003c7220 after lost signal to thread 26705
I20260709 13:07:34.896982 26705 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:34.897045 26703 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:34.897668 26705 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.897856 26703 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.897686 26572 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:34.900332 26703 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:34.901388 26705 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:34.902456 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.903105 22252 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
W20260709 13:07:34.905051 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 1.06149e+06us
I20260709 13:07:34.906303 26714 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:34.906363 22779 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:34.906893 26714 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.907253 26588 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:34.908320 22781 connection.cc:256] RPC call timeout handler was delayed by -1.6870965170001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 13:07:34.911089 22782 connection.cc:256] RPC call timeout handler was delayed by -1.6572467490000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 13:07:34.913676 22782 connection.cc:256] RPC call timeout handler was delayed by -1.4418259540000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
I20260709 13:07:34.913743 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:34.914060 22782 connection.cc:256] RPC call timeout handler was delayed by -1.2185164529998929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
I20260709 13:07:34.915740 22069 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:34.918709 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.919915 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:34.920689 22255 raft_consensus.cc:2368] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13.
I20260709 13:07:34.921787 22176 raft_consensus.cc:3055] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:34.922245 22176 raft_consensus.cc:740] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:34.924386 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:34.924974 22814 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
W20260709 13:07:34.913296 22781 connection.cc:256] RPC call timeout handler was delayed by -1.5410500930000808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 13:07:34.925921 22781 connection.cc:256] RPC call timeout handler was delayed by -1.2907805160000407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
I20260709 13:07:34.912469 22812 raft_consensus.cc:3055] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:34.927081 22812 raft_consensus.cc:740] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:34.929105 22180 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:34.921684 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:34.939927 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:34.942890 22247 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:34.941896 22779 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:34.923048 22176 consensus_queue.cc:260] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:34.927897 22812 consensus_queue.cc:260] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.949468 22812 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.949373 22176 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:34.911520 26511 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:34.903708 26683 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:34.966043 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 50454.6us
I20260709 13:07:34.966643 22813 raft_consensus.cc:1240] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:07:34.967223 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.967458 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:34.961513 26463 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:34.965127 22779 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:34.969256 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:34.931489 26714 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.972044 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:34.965195 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:34.973007 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 49120.7us
I20260709 13:07:34.974279 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:34.972970 22813 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:34.971379 22779 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:34.977129 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.977808 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:34.976500 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:34.981235 22176 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:34.983122 22101 raft_consensus.cc:1217] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[8.8-13.10]   Dedup: 8.8->[11.9-13.10]
I20260709 13:07:34.983812 22101 pending_rounds.cc:85] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 8
I20260709 13:07:34.984087 22101 pending_rounds.cc:107] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:07:34.984370 22101 raft_consensus.cc:2889] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.985860 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:34.987475 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:34.966323 26511 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.990078 22813 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:34.991429 22808 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:34.992338 26710 raft_consensus.cc:2764] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:07:34.993292 26511 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:34.993103 26668 consensus_queue.cc:1059] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:34.994100 26439 raft_consensus.cc:3055] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:34.994499 26439 raft_consensus.cc:740] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:34.997730 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:34.970244 26703 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:34.972047 26570 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:35.002585 22816 raft_consensus.cc:3055] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:35.009351 22816 raft_consensus.cc:740] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:35.008461 22097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1974) took 1315 ms (client timeout 1590 ms). Trace:
W20260709 13:07:35.011953 22097 rpcz_store.cc:269] 0709 13:07:33.693150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.718857 (+ 25707us) service_pool.cc:224] Handling call
0709 13:07:35.008185 (+1289328us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b540001e354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:35.008379 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554042112}
I20260709 13:07:34.980041 26683 raft_consensus.cc:2804] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:34.964435 26744 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:07:34.946834 26588 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.964121 26779 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:07:34.979460 26463 raft_consensus.cc:697] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:35.021224 22069 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:34.979199 26686 consensus_queue.cc:1059] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:07:35.022686 26560 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.010442 22816 consensus_queue.cc:260] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.039508 22816 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.008687 26703 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:35.040194 26686 raft_consensus.cc:3055] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:35.009157 26570 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:35.041574 26560 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:34.995419 26439 consensus_queue.cc:260] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.032450 26683 raft_consensus.cc:697] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:35.074697 26570 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.080729 26683 consensus_queue.cc:237] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.042670 26448 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:35.019784 22812 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:35.083227 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:35.084417 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:35.043785 26799 raft_consensus.cc:3055] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:35.044672 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.044515 26463 consensus_queue.cc:237] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.047740 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:35.048828 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 248981us
I20260709 13:07:35.029804 26744 consensus_queue.cc:1243] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer a07ca3d1b5b84f4bbcb907f709a69275 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:35.050467 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:35.051667 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:35.090883 26579 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:07:35.091892 22172 raft_consensus.cc:2393] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 12: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:35.049069 26791 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:07:35.092870 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.052152 22176 raft_consensus.cc:1240] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:35.053305 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:35.094380 22220 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:35.058331 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:35.095960 22178 raft_consensus.cc:2393] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 12: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:35.096822 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:35.097841 22220 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:35.095005 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:35.099669 22181 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.066360 26703 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.103005 26696 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.103487 26679 consensus_queue.cc:1059] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:35.104704 26705 raft_consensus.cc:3055] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:35.098431 22178 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:35.105101 26705 raft_consensus.cc:740] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:35.105998 26705 consensus_queue.cc:260] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.107990 22178 raft_consensus.cc:1275] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:35.109732 26714 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.093823 26799 raft_consensus.cc:740] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:35.111341 26799 consensus_queue.cc:260] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.112569 26799 raft_consensus.cc:3060] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.062317 22069 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:35.056612 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:35.095026 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:35.113612 26741 raft_consensus.cc:2804] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:35.114444 22781 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:35.097239 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:35.115685 22172 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
W20260709 13:07:35.117177 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 83070.5us
I20260709 13:07:35.119031 22180 raft_consensus.cc:1275] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:35.119225 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:35.119664 22809 raft_consensus.cc:2393] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 12: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:35.121996 22172 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:35.066702 26686 raft_consensus.cc:740] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:35.127254 22178 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:35.137154 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:35.103042 26600 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:35.119709 26312 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:35.121965 26679 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:35.124675 26675 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:35.125265 26744 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:35.138890 26439 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.125494 26741 raft_consensus.cc:697] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:07:35.153829 22000 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40410 (request call id 196) took 28641 ms (client timeout 15000 ms). Trace:
I20260709 13:07:35.159134 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:35.160409 22815 raft_consensus.cc:2410] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:07:35.145125 26705 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.134277 22181 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:35.172138 22220 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:35.173791 22102 raft_consensus.cc:1240] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:35.197124 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.145728 26802 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:35.136657 26587 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:07:35.150235 26312 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.157845 26675 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.202325 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:35.143198 26730 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:07:35.138120 26554 consensus_queue.cc:1059] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:07:35.211760 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:35.233364 22104 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:35.242631 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:35.245918 22816 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 13: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:35.246188 22808 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:35.246793 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:35.231792 22176 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:35.214218 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 1953) took 1609 ms. Trace:
I20260709 13:07:35.250602 22100 rpcz_store.cc:276] 0709 13:07:33.595056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.596080 (+  1024us) service_pool.cc:224] Handling call
0709 13:07:34.400750 (+804670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.402982 (+  2232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.195451 (+792469us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b540009f1d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:35.203926 (+  8475us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1849890688}
I20260709 13:07:35.254237 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:35.255786 22072 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:35.257236 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:35.260284 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:35.263166 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:35.265729 22218 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:35.271363 22098 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:35.272562 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:35.195720 26779 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:35.281435 22813 raft_consensus.cc:1217] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 12.10->[13.11-13.11]   Dedup: 13.11->[]
I20260709 13:07:35.276264 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:35.282570 22098 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.279407 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:35.284054 22097 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:35.211891 26443 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:07:35.286518 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:35.201263 26448 consensus_queue.cc:1048] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:07:35.233852 26629 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:07:35.289623 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:35.290685 22105 raft_consensus.cc:2393] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:35.291561 26560 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:35.297238 26570 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.178606 26743 consensus_queue.cc:1048] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:07:35.299896 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:35.300956 22100 raft_consensus.cc:2393] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 15: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:07:35.157063 22000 rpcz_store.cc:269] 0709 13:07:06.512291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.514599 (+  2308us) service_pool.cc:224] Handling call
0709 13:07:35.153748 (+28639149us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:27.446241 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:27.458486 (+ 12245us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:27.458548 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:07:27.458575 (+    27us) tablet.cc:662] Decoding operations
0709 13:07:27.487918 (+ 29343us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:27.507439 (+ 19521us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:27.510158 (+  2719us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:07:27.561982 (+ 51824us) tablet.cc:701] Row locks acquired
0709 13:07:27.562042 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:07:27.562207 (+   165us) write_op.cc:270] Start()
0709 13:07:27.562357 (+   150us) write_op.cc:276] Timestamp: P: 1783602447562143 usec, L: 0
0709 13:07:27.562376 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:07:27.580027 (+ 17651us) log.cc:844] Serialized 5895 byte log entry
0709 13:07:27.888303 (+308276us) op_driver.cc:464] REPLICATION: finished
0709 13:07:28.188383 (+300080us) write_op.cc:301] APPLY: starting
0709 13:07:28.188486 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:28.790506 (+602020us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:28.790626 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:29.365696 (+575070us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b1800072820. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a7c8d0ec 00007f66a7cd9c0a 00007f66a7cd94f7 00007f66a7cd9490 00007f66a7c90f48 00007f66ab9a51bb 00007f66ab9ec5d4 00007f66ab8988da 00007f66ab89b3cb
0709 13:07:29.789880 (+424184us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:29.790252 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:07:29.790306 (+    54us) write_op.cc:312] APPLY: finished
0709 13:07:29.790714 (+   408us) log.cc:844] Serialized 139 byte log entry
0709 13:07:30.019042 (+228328us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:30.035329 (+ 16287us) write_op.cc:454] Released schema lock
0709 13:07:30.053720 (+ 18391us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:30.105522 (+ 51802us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:30.106689 (+  1167us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6490004,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":293700,"apply.run_cpu_time_us":99104,"apply.run_wall_time_us":1916258,"cfile_cache_hit":58,"cfile_cache_hit_bytes":60523,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6214,"cfile_init":2,"lbm_read_time_us":29948,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":9,"num_ops":15,"prepare.queue_time_us":178178,"prepare.run_cpu_time_us":12792,"prepare.run_wall_time_us":228575,"raft.queue_time_us":121899,"raft.run_cpu_time_us":14084,"raft.run_wall_time_us":322450,"replication_time_us":307605,"spinlock_wait_cycles":8940928,"thread_start_us":690008,"threads_started":5,"wal-append.queue_time_us":382441,"wal-append.run_cpu_time_us":16065,"wal-append.run_wall_time_us":2153663}]]}
I20260709 13:07:35.302348 22100 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:07:35.303318 26714 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:35.304188 26741 consensus_queue.cc:237] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:35.304747 22100 raft_consensus.cc:1275] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:35.306432 22100 raft_consensus.cc:1275] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:35.308837 26572 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:35.309329 26572 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.309723 26572 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:35.172457 26744 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.311321 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:35.312449 26733 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:35.313091 22100 raft_consensus.cc:1240] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:35.313211 26733 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:35.313709 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:35.314203 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 1120) took 1081 ms. Trace:
I20260709 13:07:35.178516 26686 consensus_queue.cc:260] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:35.312510 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:35.317193 22813 raft_consensus.cc:1240] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:07:35.214843 26312 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.323108 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:35.323830 22815 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:35.324831 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:35.213495 26675 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.229528 26359 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:35.314674 22810 rpcz_store.cc:276] 0709 13:07:34.199756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.200058 (+   302us) service_pool.cc:224] Handling call
0709 13:07:34.200471 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.907042 (+706571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.907073 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:34.907524 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.946304 (+ 38780us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:35.280767 (+334463us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.280995 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.281069 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.281110 (+    41us) raft_consensus.cc:1685] finished
0709 13:07:35.281121 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.281253 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":706083,"raft.queue_time_us":713178,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":246,"thread_start_us":337780,"threads_started":2,"wal-append.queue_time_us":124540}
I20260709 13:07:35.325413 22815 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:35.211339 26802 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:35.331741 26744 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:35.322592 26686 raft_consensus.cc:3060] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.337797 22814 raft_consensus.cc:1240] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:35.230604 26735 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:07:35.338310 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:35.347081 22809 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 9: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
W20260709 13:07:35.347793 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 82178.1us
I20260709 13:07:35.347925 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:35.348416 22809 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.338681 22779 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:35.340420 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:35.351156 22810 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.281124 26779 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.337239 22098 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:35.344430 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:35.358831 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 267301us
I20260709 13:07:35.368580 22144 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:35.328507 26716 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:35.375157 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.383394 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:35.372294 26242 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:35.384465 22815 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
W20260709 13:07:35.388140 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.359301 26744 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:35.399093 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 277285us
I20260709 13:07:35.399655 22144 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:35.400146 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.371111 26779 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:35.359097 26714 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:35.348990 22218 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:35.457698 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 108756us
I20260709 13:07:35.402347 22810 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:35.386703 26359 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.369755 26791 raft_consensus.cc:697] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:35.411168 26362 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:35.413688 26796 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.416545 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:35.418296 26793 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.419302 26570 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:35.421240 26802 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:35.421128 26703 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.485620 26793 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:35.487689 26703 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:35.399042 22815 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:07:35.480922 26359 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:35.490379 22815 pending_rounds.cc:85] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting all ops after (but not including) 10
W20260709 13:07:35.491041 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.425693 22144 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:35.491778 22811 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:07:35.490680 22815 pending_rounds.cc:107] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:07:35.492301 22815 raft_consensus.cc:2889] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:35.492520 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 66898.6us
I20260709 13:07:35.493840 22144 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:35.427016 22809 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:35.399935 26744 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:35.408038 26602 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:35.391168 26716 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:35.446136 22782 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.031s
W20260709 13:07:35.553164 22782 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.000s	sys 0.031s
W20260709 13:07:35.553514 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 637317us
W20260709 13:07:35.554028 22782 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.618s (SENT) [suppressed 18 similar messages]
I20260709 13:07:35.483240 26733 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:35.455971 22816 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:35.451642 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 1103) took 1600 ms. Trace:
I20260709 13:07:35.459863 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:35.557459 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 97670.3us
I20260709 13:07:35.558135 22218 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:35.559721 22218 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:35.438954 26425 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.485392 22812 raft_consensus.cc:1240] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:35.525885 22813 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:35.517704 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.530270 22144 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:35.461745 26554 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.490685 26359 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:35.542742 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:35.547575 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:35.527094 26744 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.499118 26579 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:35.540422 26796 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:35.565614 22144 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:35.573078 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 317350us
I20260709 13:07:35.497763 26793 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:35.516860 26741 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.556049 22807 rpcz_store.cc:276] 0709 13:07:33.850729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.852080 (+  1351us) service_pool.cc:224] Handling call
0709 13:07:33.852449 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:34.906214 (+1053765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.906261 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:34.906797 (+   536us) log.cc:844] Serialized 52 byte log entry
0709 13:07:35.031235 (+124438us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:35.438350 (+407115us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.439844 (+  1494us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.450955 (+ 11111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.451110 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.451223 (+   113us) raft_consensus.cc:1685] finished
0709 13:07:35.451241 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.451540 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1029258,"prepare.queue_time_us":523938,"raft.queue_time_us":1045360,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":22526,"spinlock_wait_cycles":6138240,"thread_start_us":527313,"threads_started":2,"wal-append.queue_time_us":272071}
I20260709 13:07:35.581461 22782 leader_election.cc:400] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13.
I20260709 13:07:35.600965 22782 leader_election.cc:403] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:07:35.581605 22072 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:35.579249 26359 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:35.571802 26425 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:35.567214 26743 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:35.586779 26242 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:35.588064 26799 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:35.597570 22175 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:35.566149 26668 raft_consensus.cc:2764] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:35.571943 26362 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:35.629235 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.614727 22782 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:35.618852 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 438903us
I20260709 13:07:35.599632 26600 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:35.641785 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:35.648571 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:35.614296 26705 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13.
I20260709 13:07:35.600021 26679 consensus_queue.cc:1059] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:07:35.625455 26731 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:35.678067 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 47375.4us
I20260709 13:07:35.680001 26588 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:35.681414 26779 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.682179 26679 raft_consensus.cc:3055] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:35.682705 26679 raft_consensus.cc:740] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:35.683753 26679 consensus_queue.cc:260] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.685428 26679 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.641554 26703 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:35.600255 26791 consensus_queue.cc:237] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:35.678773 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 46744.8us
I20260709 13:07:35.695242 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:35.695552 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:35.696177 22173 raft_consensus.cc:2410] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:35.696430 22177 raft_consensus.cc:2368] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13.
I20260709 13:07:35.695626 22072 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:35.697513 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:35.697731 22072 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:35.698300 22180 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 10: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:35.699285 26497 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.699317 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:35.699139 26802 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:35.701375 22781 leader_election.cc:400] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13.
I20260709 13:07:35.703567 26779 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:35.704983 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2235) took 1203 ms. Trace:
I20260709 13:07:35.629917 26709 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:07:35.707434 26709 consensus_queue.cc:1243] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:35.710388 26425 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:35.710791 22179 pending_rounds.cc:85] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 7
I20260709 13:07:35.711103 22179 pending_rounds.cc:107] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:07:35.711357 22179 raft_consensus.cc:2889] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:35.708880 22072 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:35.628145 26359 raft_consensus.cc:697] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:35.705490 22248 rpcz_store.cc:276] 0709 13:07:34.501339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.501491 (+   152us) service_pool.cc:224] Handling call
0709 13:07:34.501813 (+   322us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:34.505106 (+  3293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.505125 (+    19us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:35.354385 (+849260us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b2c000ad588. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6857372 00007f66a7f89a01 00007f66a7f4e43a 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2
0709 13:07:35.355001 (+   616us) log.cc:844] Serialized 78 byte log entry
0709 13:07:35.499283 (+144282us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:35.499322 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.499393 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.704616 (+205223us) raft_consensus.cc:1685] finished
0709 13:07:35.704635 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.704907 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1869,"raft.queue_time_us":1973,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":4945,"spinlock_wait_cycles":4300032,"thread_start_us":100194,"threads_started":1,"wal-append.queue_time_us":240906}
I20260709 13:07:35.721740 22072 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:35.613227 26741 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.666433 26773 consensus_queue.cc:1059] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:07:35.666929 26743 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:07:35.719348 26802 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:35.731742 26656 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:35.675367 26822 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
W20260709 13:07:35.759723 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 179460us
I20260709 13:07:35.761668 22144 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:35.764112 22144 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:35.774008 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:35.775228 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:35.785359 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 170836us
I20260709 13:07:35.786233 22782 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:35.787703 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:35.789364 22144 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:35.787554 26242 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:35.795857 26460 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:35.769863 26796 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:35.772488 26359 consensus_queue.cc:237] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.788125 26793 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:35.801620 26793 raft_consensus.cc:697] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:35.802642 26793 consensus_queue.cc:237] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.803530 26744 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.804088 22097 raft_consensus.cc:1240] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:35.806030 26744 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:35.810683 26602 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:35.810858 26588 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:35.795954 26362 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:35.821528 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:35.822180 22253 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
I20260709 13:07:35.811324 26497 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:35.811931 26579 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:35.812009 26560 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:35.814453 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:35.815184 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:35.816762 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:35.817842 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:35.828948 22249 raft_consensus.cc:2393] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 12: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:35.830228 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:35.843235 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:35.818725 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:35.820050 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:35.823745 26572 consensus_meta.cc:287] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.004s
I20260709 13:07:35.845590 22247 raft_consensus.cc:2410] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:35.824945 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:35.848459 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:35.849237 22247 raft_consensus.cc:2410] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:35.850062 22250 raft_consensus.cc:2393] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 13: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:35.855464 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:35.862123 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:35.864097 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:35.865835 22247 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:35.865984 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:35.867950 22250 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.870653 22144 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:35.876223 26312 consensus_meta.cc:287] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.003s
I20260709 13:07:35.878248 26312 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:35.880970 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:35.880425 26312 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:35.877353 22782 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:35.889556 22782 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:35.890311 26498 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:35.890702 22782 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:35.897421 26463 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:35.897883 26773 raft_consensus.cc:3055] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:35.898289 26773 raft_consensus.cc:740] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:35.899111 26773 consensus_queue.cc:260] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:35.875274 26579 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:35.896317 26683 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:35.905066 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 148139us
I20260709 13:07:35.908110 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:35.903730 26683 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:35.909178 26683 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:35.911777 26802 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.912330 26802 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:35.916317 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:35.900400 26773 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:35.874337 22181 raft_consensus.cc:1275] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:35.929080 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:35.932125 22250 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:07:35.932492 22250 pending_rounds.cc:85] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 9
I20260709 13:07:35.932717 22250 pending_rounds.cc:107] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:07:35.932964 22250 raft_consensus.cc:2889] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:35.932788 26668 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.931784 22782 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:35.853307 26572 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:35.939165 22782 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:35.936066 22173 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:35.944648 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 383443us
W20260709 13:07:35.959074 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.872781 26835 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:35.875586 26602 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:35.975944 22782 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:35.874444 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:35.982736 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 108496us
I20260709 13:07:35.983934 22144 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:35.896034 26759 raft_consensus.cc:3055] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:35.930522 26802 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:35.934237 26709 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:35.996166 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:36.008589 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 50727.3us
W20260709 13:07:36.006762 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.941287 26714 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:36.024506 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:35.985836 26448 raft_consensus.cc:3055] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:35.987190 26799 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:35.991484 26600 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:35.990348 26741 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:36.000654 26703 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:35.999445 26439 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:35.992472 26759 raft_consensus.cc:740] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:36.000818 26841 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:36.059433 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:36.074038 22181 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 15.
I20260709 13:07:35.951821 26668 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:36.042116 26817 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:07:36.066354 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 318555us
I20260709 13:07:36.024628 26716 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:36.041055 26560 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:36.030503 26602 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.030776 26448 raft_consensus.cc:740] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:07:36.090705 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 76891.6us
I20260709 13:07:36.046523 26600 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:36.099817 22071 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:36.019243 26821 consensus_queue.cc:1048] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:07:36.024103 26629 consensus_queue.cc:1059] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:07:36.094517 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 702) took 1113 ms. Trace:
I20260709 13:07:36.043219 26743 consensus_queue.cc:1059] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:07:36.090342 22808 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:36.096727 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:36.060185 26242 consensus_queue.cc:1059] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:07:36.105525 22101 rpcz_store.cc:276] 0709 13:07:34.981207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.982354 (+  1147us) service_pool.cc:224] Handling call
0709 13:07:34.982840 (+   486us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:34.985270 (+  2430us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:35.463105 (+477835us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.722239 (+259134us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:35.722772 (+   533us) log.cc:844] Serialized 52 byte log entry
0709 13:07:35.722897 (+   125us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:35.723195 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.733999 (+ 10804us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.884271 (+150272us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b180043c7e0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4ddbc0a 00007f66ae51b219 00007f66a4e63a40 00007f66a4e5e4e4 00007f66a4e5e455 00007f66a7f46060 00007f66a7f58716 00007f66a7f69287 00007f66a7f69208
0709 13:07:36.093867 (+209596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.094166 (+   299us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.094228 (+    62us) raft_consensus.cc:1685] finished
0709 13:07:36.094248 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.094441 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":169633,"prepare.queue_time_us":105835,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":2388,"raft.queue_time_us":172326,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":5046,"spinlock_wait_cycles":4988032,"thread_start_us":837555,"threads_started":3,"wal-append.queue_time_us":321796}
I20260709 13:07:36.059924 26791 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:07:36.118187 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:36.120743 22101 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.121122 22099 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:07:36.064162 26683 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:36.103927 26600 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:36.096365 26689 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:36.119472 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.072851 26439 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.126531 22105 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:36.118340 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.118345 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:36.133596 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 64184.2us
I20260709 13:07:36.135648 22097 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:36.135530 22144 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:36.140228 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:36.112125 26359 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:36.116933 26744 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:36.162176 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 62436.7us
W20260709 13:07:36.096020 26675 consensus_meta.cc:287] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.752s	user 0.009s	sys 0.009s
I20260709 13:07:36.087435 26841 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.104342 26602 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:36.106091 26838 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:07:36.324759 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:36.326041 22101 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
W20260709 13:07:36.327088 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 316465us
I20260709 13:07:36.160132 26835 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:36.164041 26242 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:36.245002 26732 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:07:36.303896 26686 consensus_meta.cc:287] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.953s	user 0.010s	sys 0.003s
W20260709 13:07:36.379247 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 266073us
I20260709 13:07:36.381424 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:36.493625 22251 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:36.117111 26741 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:36.141458 26793 consensus_queue.cc:1059] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.188s
I20260709 13:07:36.319177 26743 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.450296 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 338517us
I20260709 13:07:36.246578 26359 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.397729 26629 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.501187 22106 raft_consensus.cc:2410] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:36.397475 26572 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:36.505936 26852 log.cc:927] Time spent T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:07:36.505672 26629 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.508816 26743 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.460218 26835 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:36.490784 26732 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:36.533279 26851 log.cc:927] Time spent T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:07:36.506692 26828 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:07:36.548146 26836 log.cc:927] Time spent T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 13:07:36.487710 26837 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:36.550153 26679 consensus_meta.cc:287] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.864s	user 0.008s	sys 0.006s
I20260709 13:07:36.552160 26554 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.552917 26668 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:36.554356 26841 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:36.460001 26463 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:36.558033 26439 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:36.558521 26773 consensus_meta.cc:287] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.622s	user 0.010s	sys 0.000s
I20260709 13:07:36.622098 26362 raft_consensus.cc:3055] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:36.614364 26600 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:36.624781 26600 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:36.496344 26705 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:07:36.455559 26709 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:36.569906 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 454256us
I20260709 13:07:36.630187 26744 raft_consensus.cc:3055] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:36.630064 26709 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:36.630628 26744 raft_consensus.cc:740] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:36.631492 26744 consensus_queue.cc:260] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:36.581457 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:36.639854 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet ea960f06fa1940d49afea738c7cd0e94: Illegal state: Replica 79683575881f4334bd4dc6d9bdbb45c3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:36.622627 26362 raft_consensus.cc:740] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:36.646232 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:36.647850 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:36.648631 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:36.649526 22180 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:36.650266 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:36.583452 22815 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.012s	sys 0.000s
W20260709 13:07:36.587585 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 82653.5us
I20260709 13:07:36.455596 26675 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.652141 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:36.652729 22815 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.013s	sys 0.000s
W20260709 13:07:36.570405 26856 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 13:07:36.578454 26844 log.cc:927] Time spent T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.477s	user 0.001s	sys 0.001s
I20260709 13:07:36.655687 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:36.578821 26843 log.cc:927] Time spent T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.418s	user 0.000s	sys 0.001s
I20260709 13:07:36.460879 26849 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
W20260709 13:07:36.589215 26845 log.cc:927] Time spent T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
W20260709 13:07:36.589067 26846 log.cc:927] Time spent T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.469s	user 0.000s	sys 0.001s
I20260709 13:07:36.504484 26741 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.586597 26835 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.586477 26732 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:36.587111 26838 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:36.602780 26463 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:36.607699 26602 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:36.609040 22810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 682) took 1279 ms. Trace:
I20260709 13:07:36.636978 26759 consensus_queue.cc:260] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.612036 26629 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:36.616163 26359 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:36.598857 26554 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.692061 26554 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:36.590725 26730 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:07:36.595983 26837 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:36.697554 26837 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:36.632701 26744 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.679086 26838 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:36.654212 22780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.000s	sys 0.006s
W20260709 13:07:36.654512 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 515768us
W20260709 13:07:36.700058 22780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.000s	sys 0.007s
I20260709 13:07:36.700700 22144 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:07:36.701287 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.702533 26741 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:36.598562 26683 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:36.652920 26668 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:36.703512 26668 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.705761 26668 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:36.642691 26362 consensus_queue.cc:260] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:36.708223 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:36.708860 22251 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:36.709374 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:36.709558 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:07:36.654083 26460 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.000s	sys 0.006s
I20260709 13:07:36.709939 22811 raft_consensus.cc:1813] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Handling vote request from an unknown peer 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:36.666393 26840 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.007s	sys 0.010s
I20260709 13:07:36.676213 22810 rpcz_store.cc:276] 0709 13:07:35.329351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.472181 (+142830us) service_pool.cc:224] Handling call
0709 13:07:35.472776 (+   595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.473218 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.473269 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.596637 (+123368us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b18002c1880. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e2f2a6 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6857372 00007f66a7f89a01 00007f66a7f4e43a
0709 13:07:35.597091 (+   454us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b2c00048118. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6857372 00007f66a7f89a01 00007f66a7f4e43a 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2
0709 13:07:35.597574 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.755934 (+158360us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:35.762264 (+  6330us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.805904 (+ 43640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.805976 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.107924 (+301948us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b18002c1880. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:07:36.608826 (+500902us) raft_consensus.cc:1685] finished
0709 13:07:36.608850 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.608980 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43384,"prepare.queue_time_us":6013,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":53323,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":12404,"spinlock_wait_cycles":58179968,"thread_start_us":157954,"threads_started":1,"wal-append.queue_time_us":197397}
I20260709 13:07:36.610659 26743 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:36.688732 26675 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:36.700784 26838 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:36.668555 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:36.710580 22811 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:36.710565 22812 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:36.655433 26821 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:36.756094 22815 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:36.729651 22104 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:36.751463 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:36.710002 22782 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:36.757560 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 1989) took 1491 ms. Trace:
I20260709 13:07:36.664814 26862 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.752483 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:07:36.757927 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 48014us
I20260709 13:07:36.720149 26362 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.758721 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:36.758160 22106 rpcz_store.cc:276] 0709 13:07:35.266340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.266460 (+   120us) service_pool.cc:224] Handling call
0709 13:07:36.757382 (+1490922us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000b9354. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:36.757501 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2790963584}
W20260709 13:07:36.763790 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 156895us
I20260709 13:07:36.723380 26759 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:36.727432 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 75742.5us
I20260709 13:07:36.729707 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.792246 22101 raft_consensus.cc:1813] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Handling vote request from an unknown peer 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:36.773926 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:36.803121 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.804229 22098 raft_consensus.cc:2393] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:36.804499 22099 raft_consensus.cc:1275] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:07:36.765121 22250 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:36.805014 22099 pending_rounds.cc:85] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 5
I20260709 13:07:36.805374 22099 pending_rounds.cc:107] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:07:36.805683 22099 raft_consensus.cc:2889] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:36.792312 22072 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:36.720577 26460 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.000s	sys 0.007s
W20260709 13:07:36.767151 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.801962 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.802408 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.803462 22810 raft_consensus.cc:2393] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 14: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:36.803277 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.826766 22105 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
I20260709 13:07:36.827140 22250 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 14.
I20260709 13:07:36.827740 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.827881 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.793231 22101 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:36.809178 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.809492 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.810194 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.829310 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.829473 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:36.810442 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.830082 22101 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:36.830101 22105 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:36.831537 22782 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:36.835322 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.811697 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.839668 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.724005 26868 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:36.785498 26242 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:07:36.785977 26793 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:36.813678 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:36.813704 26380 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.814265 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.816332 26696 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.816789 26826 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:36.817914 22072 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:36.764905 26862 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.725256 26796 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.841306 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.765519 26716 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:36.762929 26600 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:36.813256 26443 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:36.763104 26735 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:07:36.854394 26572 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:36.720492 26579 consensus_queue.cc:1175] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" responder_term: 11 status { last_received { term: 10 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:36.861464 26497 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:36.862248 26809 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:36.864800 22779 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:36.875283 26796 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:36.879349 22100 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:07:36.891222 22097 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:36.918069 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:36.918970 26683 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:36.919862 26683 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:36.892269 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:36.892657 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:36.893628 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.893639 22102 raft_consensus.cc:1275] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:36.871742 26716 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:36.852461 26837 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:36.763950 26821 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.901134 26572 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.852834 26380 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.950219 22246 raft_consensus.cc:1240] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:36.924376 26560 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:36.922649 26683 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:36.938200 22250 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:36.940475 22252 raft_consensus.cc:1275] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:36.963452 22247 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:07:36.965754 22247 pending_rounds.cc:85] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 8
I20260709 13:07:36.966130 22247 pending_rounds.cc:107] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:07:36.872984 26793 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.931282 26716 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.890076 26443 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.964843 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:36.982321 22248 raft_consensus.cc:1813] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Handling vote request from an unknown peer 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:36.983230 22248 raft_consensus.cc:2410] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 13 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:36.976356 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:36.906854 26848 consensus_queue.cc:1059] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:07:36.966495 22247 raft_consensus.cc:2889] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:36.965785 22246 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:36.887504 26600 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:36.948369 26572 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:36.964107 26560 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:36.948076 26837 raft_consensus.cc:697] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:37.000312 26868 raft_consensus.cc:697] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:37.001688 26868 consensus_queue.cc:237] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.007745 26463 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:37.020581 26600 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:36.947834 26854 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:07:37.025421 26380 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.026919 26837 consensus_queue.cc:237] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.035722 26443 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:36.992733 26560 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.037410 26793 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:36.999527 26460 raft_consensus.cc:3055] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:37.038156 26460 raft_consensus.cc:740] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:37.038993 26460 consensus_queue.cc:260] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.039932 26460 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:37.047761 26796 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:36.983546 26359 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:07:37.058880 26696 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.061116 26560 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.066772 26732 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.059141 26835 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.064141 26560 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:37.069106 26732 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.071998 26647 raft_consensus.cc:3055] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:37.072616 26647 raft_consensus.cc:740] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:37.073770 26716 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.073709 26647 consensus_queue.cc:260] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.076211 26716 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.080150 26572 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.083214 26709 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:37.096457 26873 log.cc:927] Time spent T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.181s	user 0.000s	sys 0.002s
I20260709 13:07:37.097962 26821 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:37.099200 26862 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:37.148761 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.904510 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:36.899756 22101 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:37.162961 22103 raft_consensus.cc:2410] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
W20260709 13:07:37.163311 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.170710 22147 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:37.177623 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.179533 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.180958 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.182274 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.185647 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.187193 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.188675 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:37.195793 22173 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.189522 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:37.200126 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.200739 22175 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:37.202577 22175 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:37.189857 22174 raft_consensus.cc:1240] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:37.192317 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:37.204001 22176 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:37.212194 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.222512 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:37.212646 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.227396 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:37.230314 22251 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.232013 22105 raft_consensus.cc:1240] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:37.234349 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:37.235327 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:37.236598 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:37.226500 22218 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:37.239792 22144 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:37.229004 22172 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:37.248101 26448 consensus_queue.cc:260] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.250404 26425 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.251499 26425 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.252638 26835 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.253847 26835 consensus_queue.cc:1048] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:37.214959 22106 consensus_queue.cc:237] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:37.296583 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.298194 22176 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 16.
I20260709 13:07:37.299207 26572 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:37.303503 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:37.304409 26425 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:37.305672 22104 raft_consensus.cc:2368] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13.
I20260709 13:07:37.309008 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:37.310077 22816 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
W20260709 13:07:37.317019 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.318774 26791 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:37.321331 26791 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:37.323406 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:37.324928 26579 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:37.327152 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 63872.5us
I20260709 13:07:37.328689 26837 consensus_queue.cc:1048] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:37.332504 26744 consensus_queue.cc:1059] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:37.327292 26675 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.304590 22172 raft_consensus.cc:2393] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 12: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:37.328923 22220 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:37.337205 22173 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:37.340296 26759 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:37.340739 22071 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:37.341050 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:37.342366 26821 consensus_queue.cc:1059] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:37.327333 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:37.343531 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:37.347098 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.349094 22251 raft_consensus.cc:2468] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:37.350241 26647 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:37.351078 26600 consensus_queue.cc:1059] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:07:37.351931 26741 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:37.352149 26679 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.352648 26460 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:37.352909 26679 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.351123 22175 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:07:37.355489 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 112588us
I20260709 13:07:37.356325 26629 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.357124 26629 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } }
I20260709 13:07:37.351414 26840 raft_consensus.cc:3055] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:37.360227 26840 raft_consensus.cc:740] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:37.361445 26840 consensus_queue.cc:260] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:37.364183 26901 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:07:37.367122 26679 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.369143 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:37.369971 22249 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:37.371752 22782 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:37.375154 26840 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.351286 26675 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.381963 22101 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:37.382879 26362 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.338683 26570 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.342731 26448 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:37.354576 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 60332.5us
I20260709 13:07:37.342404 26572 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:07:37.397014 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 68295.9us
I20260709 13:07:37.393725 26679 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:37.398362 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 387230us
I20260709 13:07:37.400166 26743 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:37.399014 26587 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:37.401373 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 113024us
I20260709 13:07:37.405400 26570 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.411834 26587 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.413100 26629 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:37.409166 22782 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:37.399503 26675 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:37.421139 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 110693us
I20260709 13:07:37.421088 26890 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:37.422451 22779 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:37.406553 26743 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.423025 26572 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:37.423353 26743 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.424576 26572 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.427394 26560 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:37.416373 26668 consensus_queue.cc:1059] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:07:37.404414 26679 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.428393 26560 raft_consensus.cc:2804] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:37.424413 22779 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:37.437252 26242 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:37.437595 26705 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:37.438010 26242 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.438297 26705 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.442144 26705 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.410595 26362 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.444166 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:37.444864 26460 raft_consensus.cc:3055] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:37.434705 26679 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.445474 26460 raft_consensus.cc:740] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:37.423053 26891 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.444928 22249 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:37.447255 26463 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:37.447419 26891 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.448012 26463 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.448809 22782 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:37.450079 26837 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:37.450453 26837 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:37.450951 26837 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.446779 26709 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:37.451845 26709 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.452525 22003 catalog_manager.cc:5697] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 7 to 8, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 8 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:37.455688 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:37.456669 22251 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:37.457702 26560 raft_consensus.cc:697] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:37.458992 26560 consensus_queue.cc:237] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.463266 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.464999 22218 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:37.465732 26570 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:37.454317 22003 catalog_manager.cc:5697] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 7 to 8, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 8 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:37.471678 26741 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:37.475422 26891 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:37.475541 26841 raft_consensus.cc:3055] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:37.476423 26841 raft_consensus.cc:740] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:37.479316 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:37.480123 22101 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:37.480913 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 56682.5us
I20260709 13:07:37.482316 26362 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.483916 26679 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.478082 26841 consensus_queue.cc:260] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.486181 26841 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:37.486414 26683 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.483342 22779 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:37.503544 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:37.503587 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:37.486639 26679 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.507908 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:37.508690 22251 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.506069 22105 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:37.510891 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:37.507791 22103 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:37.512633 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:37.450444 26463 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.514842 22101 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:37.487310 26855 consensus_queue.cc:1059] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:07:37.454317 26709 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:37.513249 22249 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:37.513393 22246 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:37.513177 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:37.518661 22144 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:37.520978 22144 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:37.513422 26587 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:37.524982 26716 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:37.524433 26380 raft_consensus.cc:2955] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:07:37.525009 22782 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:37.535846 26602 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:37.536788 26602 raft_consensus.cc:697] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:37.539340 26683 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:37.540146 26683 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.539670 22172 raft_consensus.cc:2955] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:07:37.543103 26716 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:37.528837 26463 raft_consensus.cc:3055] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:37.543618 26716 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:37.543946 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.544407 26500 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.544855 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:37.544977 26500 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.545598 22098 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:37.544158 26716 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.530999 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:37.543524 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.521010 26791 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:37.542696 26683 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:37.527022 26891 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:37.563535 26905 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.241s	user 0.001s	sys 0.001s
I20260709 13:07:37.551853 26791 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.538187 26602 consensus_queue.cc:237] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.543967 26463 raft_consensus.cc:740] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:37.568789 26463 consensus_queue.cc:260] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.570508 26463 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.571293 26891 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.575248 22251 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
I20260709 13:07:37.576498 22782 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:37.579406 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:37.581465 26242 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:37.582273 26909 log.cc:927] Time spent T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:07:37.586071 22144 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:37.588022 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 120289us
I20260709 13:07:37.592180 22218 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:37.577248 26891 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:37.595851 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:37.596930 22248 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:37.564582 26791 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.599390 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:37.599407 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.605830 22147 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:37.606990 26675 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:37.611150 26741 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:37.618338 22176 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:37.618932 22178 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
I20260709 13:07:37.620015 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.620520 22179 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:37.622022 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.625358 26242 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.626296 22147 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:37.627671 26759 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:37.628137 26759 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:37.626230 26242 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.628556 26759 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.630337 26242 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.631680 26242 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:37.632066 26242 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:37.632512 26242 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.609105 26675 consensus_queue.cc:1048] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 13:07:37.640235 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 157008us
I20260709 13:07:37.618499 22003 catalog_manager.cc:5697] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:37.586534 26683 raft_consensus.cc:2804] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:37.647047 22779 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:37.643910 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 94072.6us
I20260709 13:07:37.656643 22071 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:37.663228 26855 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:37.663739 22098 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:37.663990 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:37.664896 22101 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:37.657486 26683 raft_consensus.cc:697] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:37.668154 26683 consensus_queue.cc:237] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:37.669766 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.652633 26835 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:37.547600 26460 consensus_queue.cc:260] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.677980 22779 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:37.661638 26500 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.683537 22144 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:37.685559 26362 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:37.684130 22003 catalog_manager.cc:5697] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 3 to 6, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 6 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:37.674614 26835 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:37.691536 26847 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:37.692044 26847 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.692376 26847 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:37.693172 26791 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.699499 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.705806 22181 raft_consensus.cc:2393] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 13: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:37.708907 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:37.709508 22101 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.705603 26855 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:37.712191 26868 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:37.712781 26868 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.713217 26868 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:37.707484 22220 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:37.695387 26835 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.707394 22218 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:37.688936 26840 consensus_queue.cc:1059] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 13:07:37.737372 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 59435us
I20260709 13:07:37.745268 26759 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.747586 26668 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.747843 22173 raft_consensus.cc:1240] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:37.748276 26668 consensus_queue.cc:1059] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:37.749181 26668 raft_consensus.cc:3055] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:37.749508 26668 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:37.729377 26741 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:37.751281 26741 raft_consensus.cc:697] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:37.752254 26741 consensus_queue.cc:237] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:37.755388 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.756558 26448 consensus_queue.cc:1059] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:37.758489 26448 raft_consensus.cc:3055] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:37.747100 22779 leader_election.cc:400] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13.
I20260709 13:07:37.762701 22779 leader_election.cc:403] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:07:37.762907 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:37.763387 26679 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.758867 26448 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:37.765795 26448 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.767148 26448 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:37.767829 22779 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:37.768910 26855 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:37.769457 26855 raft_consensus.cc:697] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:37.770645 22252 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:37.770385 26855 consensus_queue.cc:237] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.723788 22003 catalog_manager.cc:5697] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 6 to 7, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 7 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.788548 22250 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:37.794225 26629 raft_consensus.cc:3055] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:37.794651 26629 raft_consensus.cc:740] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:37.795650 26629 consensus_queue.cc:260] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.796941 26629 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.797411 26743 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.750451 26668 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.800398 26668 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:37.740657 26460 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:37.815394 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 115974us
I20260709 13:07:37.816425 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:37.817463 26841 raft_consensus.cc:2764] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:07:37.816944 26716 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.819523 26709 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:07:37.820405 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 52672.7us
I20260709 13:07:37.820143 26709 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.820191 22003 catalog_manager.cc:5697] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 5 to 6, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 6 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.822520 26709 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.823395 26793 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:37.825263 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.826120 22181 raft_consensus.cc:2393] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 14: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:37.827157 26560 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:37.827273 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:37.827847 26560 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.828914 26714 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:37.829452 26714 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.831300 26560 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.831878 26714 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.835722 22816 raft_consensus.cc:1240] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:37.836171 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:37.838943 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.839939 26696 consensus_queue.cc:1059] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:37.840600 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.841359 22177 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:37.842831 22781 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:37.842905 26312 raft_consensus.cc:3055] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:37.843592 26312 raft_consensus.cc:740] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:37.844240 22781 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:37.845101 26560 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:37.844857 26312 consensus_queue.cc:260] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.845553 26705 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:37.845885 26560 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.846061 26705 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:37.846204 26312 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.846599 26705 raft_consensus.cc:3060] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.846572 26560 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.849143 26560 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.851022 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:37.851399 26380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43362 (request call id 19) took 1057 ms. Trace:
I20260709 13:07:37.851962 26380 rpcz_store.cc:276] 0709 13:07:36.800655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.803039 (+  2384us) service_pool.cc:224] Handling call
0709 13:07:37.189624 (+386585us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b2c00000658. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6856a0a 00007f66a6856693 00007f66a6856631 00007f66a7f89902 00007f66a7f896dd 00007f66a7f54f3f 00007f66a7f546b3 00007f66acf14d29 00007f66a64931d4 00007f66a6493162
0709 13:07:37.317922 (+128298us) log.cc:844] Serialized 506 byte log entry
0709 13:07:37.851233 (+533311us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":947,"raft.queue_time_us":2287,"raft.run_cpu_time_us":2276,"raft.run_wall_time_us":2275,"spinlock_wait_cycles":3271424}
I20260709 13:07:37.854288 26791 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:37.835589 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:37.855628 22247 raft_consensus.cc:2393] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:37.857100 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:37.854363 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.865129 22781 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:37.865240 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:37.866128 22247 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.866103 26759 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.866973 26714 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:37.822230 22249 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:37.822312 22003 catalog_manager.cc:5697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 8 to 9, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 9 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:37.810077 22101 raft_consensus.cc:2468] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
W20260709 13:07:37.879053 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 53214.6us
I20260709 13:07:37.820241 26242 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.893222 26242 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.894889 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:37.895167 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:37.895670 22248 raft_consensus.cc:3060] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.901914 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:37.902673 22103 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:37.909632 26837 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.911932 26679 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421) with higher term. Message: Invalid argument: T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13.
I20260709 13:07:37.912139 26891 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.878165 26716 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.915654 22144 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:37.917606 26602 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:37.918054 26602 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:37.918473 26602 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:37.918883 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:37.924475 22249 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.924003 26705 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.926533 26743 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:37.881330 26835 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.928885 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:37.922086 22144 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:37.929486 22175 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.929520 26835 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.930296 26835 raft_consensus.cc:2804] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:37.918397 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:37.931005 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:37.931694 22106 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.923302 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:37.923768 26587 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:37.935226 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:37.924031 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:37.936666 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:37.937065 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:37.937338 22100 raft_consensus.cc:3060] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.935576 26587 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:37.939603 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:37.940469 26587 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:37.935559 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:37.941205 22252 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 14.
I20260709 13:07:37.935261 22105 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:37.940858 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.944902 22782 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:37.948671 22249 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:37.842497 26868 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.957389 22147 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:37.958673 22175 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:37.966748 22815 raft_consensus.cc:1240] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:37.978471 22220 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:37.960057 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:37.930758 26835 raft_consensus.cc:697] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:37.976760 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:37.961866 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:37.982604 22105 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:37.983978 22098 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:37.988565 22144 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:37.971163 26759 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:37.989565 26759 raft_consensus.cc:697] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:37.989729 26362 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:37.990443 26362 raft_consensus.cc:697] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:37.992309 26362 consensus_queue.cc:237] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:37.996513 22144 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:37.997660 26242 raft_consensus.cc:2804] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:37.998248 26242 raft_consensus.cc:697] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:37.999711 26242 consensus_queue.cc:237] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:38.008090 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 50496.8us
I20260709 13:07:38.009209 26705 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.976238 26679 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.048286 26679 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:38.050191 22252 raft_consensus.cc:1275] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:38.050546 26679 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:37.984206 22816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:47484
I20260709 13:07:38.051407 26679 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:38.051693 22816 raft_consensus.cc:606] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:37.946849 26891 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:38.043817 22100 raft_consensus.cc:2468] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
I20260709 13:07:37.886498 26841 consensus_queue.cc:1048] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:07:38.058894 22248 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:38.061349 22106 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:38.065235 22100 raft_consensus.cc:1275] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:38.066315 22144 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:38.051824 26679 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:37.985504 26743 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:38.072356 26868 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:38.075121 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:38.076932 26835 consensus_queue.cc:237] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:38.081730 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.081907 26914 log.cc:927] Time spent T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:07:38.082314 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:38.092465 22100 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:38.083442 22248 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:38.064769 26600 consensus_queue.cc:1048] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:07:38.090310 22247 raft_consensus.cc:2468] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:38.079912 26793 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:38.082806 26679 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:38.095507 26743 raft_consensus.cc:697] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:07:38.107113 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.110009 22100 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:07:38.115648 26891 consensus_queue.cc:1048] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:38.127628 26837 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:38.131084 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:38.131996 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:38.132277 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:38.132766 22246 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:38.133498 22255 raft_consensus.cc:1240] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:38.133561 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:38.094393 26840 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.142207 26847 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:38.064555 22003 catalog_manager.cc:5697] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 5 to 6, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66), no longer has a pending config: VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65), VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66), VOTER 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67), NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 6 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:38.152940 22248 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:07:38.155285 22144 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:38.157971 22180 raft_consensus.cc:2468] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
W20260709 13:07:38.159235 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.030341 26759 consensus_queue.cc:237] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:38.178143 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.185842 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:38.202736 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.155414 26793 raft_consensus.cc:697] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:38.177634 26791 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:38.268555 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:38.260314 26572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.015s	sys 0.017s
I20260709 13:07:38.281996 22255 raft_consensus.cc:2410] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:07:38.274667 26600 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:38.287081 26600 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:38.289266 26600 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:38.289306 26743 consensus_queue.cc:237] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:38.310060 22246 raft_consensus.cc:1240] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:07:38.312212 26891 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:38.313277 26847 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:38.322897 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.312984 26891 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:38.285388 26572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.016s	sys 0.017s
I20260709 13:07:38.176693 26840 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:38.343089 22248 raft_consensus.cc:1240] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:38.343622 26600 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:38.331087 26791 raft_consensus.cc:697] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:38.357457 22003 catalog_manager.cc:5697] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.363919 26600 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:38.381803 22003 catalog_manager.cc:5697] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:38.289378 26793 consensus_queue.cc:237] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:38.407125 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 442351us
I20260709 13:07:38.391685 22249 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:38.423818 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:38.425817 22781 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:38.434113 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:38.450503 26840 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:38.454311 22815 raft_consensus.cc:1240] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:38.460410 26600 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:38.464907 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:38.431736 26837 raft_consensus.cc:2804] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:38.388141 26602 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:38.436501 26242 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:38.436291 26855 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.475451 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:38.476567 22249 raft_consensus.cc:2393] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:38.478582 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:38.469347 26741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.008s	sys 0.011s
I20260709 13:07:38.479688 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:38.492962 26741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.008s	sys 0.011s
I20260709 13:07:38.507606 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:38.512379 26714 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:38.513173 26714 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:38.520565 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:38.523568 26919 log.cc:927] Time spent T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 13:07:38.531742 26923 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:38.495208 22815 raft_consensus.cc:2393] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 13: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:38.534904 26679 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:38.547016 22812 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:38.548656 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:38.549516 22248 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:38.580464 26460 consensus_meta.cc:287] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.770s	user 0.006s	sys 0.006s
W20260709 13:07:38.592393 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.490800 26242 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:38.589058 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:38.602276 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:38.605696 26242 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:38.606489 26242 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.483696 26791 consensus_queue.cc:237] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:38.614981 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:38.616305 22249 raft_consensus.cc:2410] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
W20260709 13:07:38.618263 22145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.006s	sys 0.015s
I20260709 13:07:38.565838 26855 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:38.599864 26891 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:38.627351 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:38.628365 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:38.634712 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:07:38.627059 22145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.006s	sys 0.015s
I20260709 13:07:38.643993 22248 raft_consensus.cc:2468] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
W20260709 13:07:38.697847 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.702292 22249 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:38.617475 26242 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:38.695470 26679 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:38.692677 26861 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.068s	sys 0.163s
W20260709 13:07:38.705924 26362 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.035s	sys 0.031s
I20260709 13:07:38.706429 26891 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:38.718508 26861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.069s	sys 0.164s
I20260709 13:07:38.781754 22779 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:38.783026 22249 raft_consensus.cc:1240] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:38.797648 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:38.767831 26362 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.035s	sys 0.031s
I20260709 13:07:38.806077 22249 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:38.807439 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:38.817518 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.796150 22220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.006s	sys 0.035s
W20260709 13:07:38.798833 22069 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.007s	sys 0.020s
I20260709 13:07:38.802246 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:38.834625 22069 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.007s	sys 0.020s
I20260709 13:07:38.722820 26714 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:38.771847 26312 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.835158 26743 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.006s	sys 0.040s
W20260709 13:07:38.836545 26759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.000s	sys 0.046s
W20260709 13:07:38.838442 26920 log.cc:927] Time spent T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 13:07:38.834299 22220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.006s	sys 0.035s
W20260709 13:07:38.835086 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 53430.6us
W20260709 13:07:38.857847 22101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.032s	sys 0.063s
I20260709 13:07:38.858310 22779 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:38.858940 22101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.033s	sys 0.063s
W20260709 13:07:38.848578 26743 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.006s	sys 0.040s
I20260709 13:07:38.866593 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:38.866906 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.873869 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.869292 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:38.850775 26759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.000s	sys 0.046s
I20260709 13:07:38.877624 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:38.810998 26891 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:38.891309 22175 raft_consensus.cc:1240] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:38.847234 26928 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:38.907963 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:38.844614 26312 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:38.911132 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:38.915380 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:38.916991 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:38.914660 22782 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:38.925231 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:38.904762 26714 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:38.940353 22098 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:07:38.945536 22173 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:38.933492 22782 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:38.962056 22105 raft_consensus.cc:1240] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:07:38.875897 26837 raft_consensus.cc:697] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:38.964919 22179 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:38.967219 26933 log.cc:927] Time spent T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:07:38.921317 26743 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.970991 22104 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.009s	sys 0.020s
W20260709 13:07:38.971328 22104 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.009s	sys 0.020s
I20260709 13:07:38.976473 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:38.978045 22249 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:38.977909 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:38.976159 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:38.984687 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:38.985755 22249 raft_consensus.cc:2393] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 13: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:38.987046 22178 raft_consensus.cc:2393] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 14: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:38.965713 26560 raft_consensus.cc:2804] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:38.989152 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 516020us
I20260709 13:07:38.989353 22105 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:38.964210 26709 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:07:38.997727 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:39.001922 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:39.002903 22172 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:39.006563 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.011314 26932 raft_consensus.cc:2804] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:39.012118 26927 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:39.012920 26927 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:39.014997 26926 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.015694 26926 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:39.020109 26935 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:07:39.022907 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:39.023562 26931 log.cc:927] Time spent T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:07:39.024183 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:39.024895 22247 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
I20260709 13:07:39.025785 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:39.026855 22247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:07:39.027386 22247 raft_consensus.cc:606] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:39.027705 22247 raft_consensus.cc:614] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:39.001685 26560 raft_consensus.cc:697] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:39.028963 22247 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:39.029412 26560 consensus_queue.cc:237] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:38.994445 26855 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:38.983255 26925 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:39.034269 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:39.037904 22105 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:39.039781 26891 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:39.040795 22100 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:39.047971 22097 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:38.995813 26929 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.100937 26929 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:39.107815 26930 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:07:39.109108 26802 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:39.109795 26802 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:39.048444 26696 consensus_queue.cc:1059] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:39.048987 22103 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:07:39.049098 26924 log.cc:927] Time spent T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:07:39.049646 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:39.050541 26949 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:39.052585 22781 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:39.130241 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 77744.9us
I20260709 13:07:39.053897 26837 consensus_queue.cc:237] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:38.976686 26743 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:39.054867 22172 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 15.
I20260709 13:07:39.097764 22251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2256) took 1503 ms. Trace:
I20260709 13:07:39.099640 22218 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:39.057713 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:39.120597 22179 raft_consensus.cc:2410] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:39.125434 22098 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:39.133183 22811 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:39.135844 26709 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:39.137164 26929 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:39.035276 26932 raft_consensus.cc:697] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:39.018865 26926 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:39.186002 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:39.196847 22249 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:39.198444 22782 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:39.205514 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:39.206461 22249 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:39.208102 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.156145 22251 rpcz_store.cc:276] 0709 13:07:37.592424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.612557 (+ 20133us) service_pool.cc:224] Handling call
0709 13:07:37.672143 (+ 59586us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:37.716956 (+ 44813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.717004 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:37.734716 (+ 17712us) log.cc:844] Serialized 52 byte log entry
0709 13:07:38.052833 (+318117us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:38.071578 (+ 18745us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.089768 (+ 18190us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.091660 (+  1892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.091734 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.049242 (+957508us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b24001f4a08. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4ce79c4 00007f66a4ce5acb 00007f66a4ea0dc9 00007f66a4ea0a55 00007f66a4e9ffb0 00007f66a7b16488 00007f66a7b16be8 00007f66a7aee398 00007f66a7ae976a 00007f66a7ae8bb6
0709 13:07:39.096013 (+ 46771us) raft_consensus.cc:1685] finished
0709 13:07:39.096053 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.096265 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18693,"prepare.queue_time_us":18963,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":4163,"raft.queue_time_us":36292,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":12335,"spinlock_wait_cycles":45903744,"thread_start_us":273353,"threads_started":1,"wal-append.queue_time_us":548530}
I20260709 13:07:39.129292 26679 consensus_queue.cc:1059] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
W20260709 13:07:39.220741 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 121225us
I20260709 13:07:39.118054 26925 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:39.219075 26855 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.268666 22218 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:39.271485 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:39.274547 26602 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:39.275954 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2415) took 1142 ms. Trace:
I20260709 13:07:39.276377 22254 rpcz_store.cc:276] 0709 13:07:38.133399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.187658 (+ 54259us) service_pool.cc:224] Handling call
0709 13:07:38.281897 (+ 94239us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:38.340902 (+ 59005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.340948 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:38.380541 (+ 39593us) log.cc:844] Serialized 52 byte log entry
0709 13:07:38.906058 (+525517us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:38.906117 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.906213 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.275718 (+369505us) raft_consensus.cc:1685] finished
0709 13:07:39.275740 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.275895 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":573,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5763,"thread_start_us":480671,"threads_started":1,"wal-append.queue_time_us":817353}
I20260709 13:07:39.278126 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:39.280150 26938 log.cc:927] Time spent T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:07:39.154686 26949 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:39.280792 26802 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:39.287928 22249 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 15.
I20260709 13:07:39.290388 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:39.264936 26679 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:39.252241 26927 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:39.280864 26937 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:39.252657 26926 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:07:39.296689 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:39.366468 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 69889.4us
I20260709 13:07:39.369042 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:39.352875 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 45594.2us
I20260709 13:07:39.289597 26460 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:39.265120 26928 consensus_queue.cc:1059] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:07:39.378615 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:39.343943 26840 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:39.355796 26679 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.373884 26602 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:39.426584 26934 log.cc:927] Time spent T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.579s	user 0.007s	sys 0.001s
W20260709 13:07:39.438325 22816 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.006s	sys 0.022s
I20260709 13:07:39.344353 26855 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:39.452766 22251 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 14.
I20260709 13:07:39.453994 22251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:07:39.454805 22251 raft_consensus.cc:606] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:39.442407 22816 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.006s	sys 0.022s
W20260709 13:07:39.435065 26793 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.001s	sys 0.026s
W20260709 13:07:39.447383 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 191482us
I20260709 13:07:39.376323 26929 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:39.434247 26928 consensus_queue.cc:1243] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:39.415406 26362 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:39.460459 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2421) took 1325 ms. Trace:
I20260709 13:07:39.437656 26679 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.463618 22254 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 14: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:39.349902 26932 consensus_queue.cc:237] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:39.375851 26802 consensus_queue.cc:1059] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:07:39.470268 22251 raft_consensus.cc:614] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:39.436769 26460 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:39.462527 22253 rpcz_store.cc:276] 0709 13:07:38.147300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.300361 (+153061us) service_pool.cc:224] Handling call
0709 13:07:38.300815 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.383364 (+ 82549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.383417 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:38.421706 (+ 38289us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.933619 (+511913us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:38.933676 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.046353 (+112677us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b540019b254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:39.046422 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.460123 (+413701us) raft_consensus.cc:1685] finished
0709 13:07:39.460149 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.460394 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1011,"raft.queue_time_us":1217,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":6459,"spinlock_wait_cycles":125492992,"thread_start_us":465479,"threads_started":1,"wal-append.queue_time_us":779689}
I20260709 13:07:39.377336 26705 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:39.495648 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 452013us
W20260709 13:07:39.470090 26600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.015s	sys 0.079s
W20260709 13:07:39.459487 26793 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.002s	sys 0.026s
W20260709 13:07:39.475572 22246 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.011s	sys 0.030s
I20260709 13:07:39.485700 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2262) took 1659 ms. Trace:
I20260709 13:07:39.473726 26629 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.471716 26840 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:07:39.499120 22104 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.049s	sys 0.041s
I20260709 13:07:39.467943 26362 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:39.511723 22104 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.049s	sys 0.042s
W20260709 13:07:39.473974 22255 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.008s	sys 0.025s
W20260709 13:07:39.494076 26936 log.cc:927] Time spent T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260709 13:07:39.513108 22255 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.008s	sys 0.025s
I20260709 13:07:39.515950 22181 raft_consensus.cc:1240] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:39.516151 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:39.509567 22250 rpcz_store.cc:276] 0709 13:07:37.826177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.826403 (+   226us) service_pool.cc:224] Handling call
0709 13:07:37.826754 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.884365 (+ 57611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.884410 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.961645 (+ 77235us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.412278 (+450633us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:38.412318 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.412399 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.425760 (+1013361us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:39.482766 (+ 57006us) raft_consensus.cc:1685] finished
0709 13:07:39.482795 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.485618 (+  2823us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51950,"raft.queue_time_us":57175,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":11721,"spinlock_wait_cycles":3980032,"thread_start_us":436923,"threads_started":1,"wal-append.queue_time_us":811943}
I20260709 13:07:39.517470 22218 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:39.518745 22251 raft_consensus.cc:2393] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:39.506076 26925 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:39.523720 26362 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:39.514817 26629 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:39.532397 26312 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:39.501976 26705 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:39.540560 26951 log.cc:927] Time spent T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
W20260709 13:07:39.585398 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 446094us
W20260709 13:07:39.551642 26942 log.cc:927] Time spent T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.200s	user 0.001s	sys 0.001s
W20260709 13:07:39.607718 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.556798 26944 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.146s	user 0.001s	sys 0.001s
I20260709 13:07:39.520036 26840 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:39.564272 26937 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.605533 26949 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:39.655719 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:39.656654 22815 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.555420 26696 consensus_queue.cc:1243] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer a07ca3d1b5b84f4bbcb907f709a69275 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:39.663453 26242 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:39.666505 22251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:07:39.667349 22251 raft_consensus.cc:606] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:39.626111 26941 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:39.673009 22781 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.007s	sys 0.019s
W20260709 13:07:39.675668 22781 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.007s	sys 0.019s
I20260709 13:07:39.677407 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:39.680763 22250 raft_consensus.cc:1275] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:07:39.676548 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 545076us
I20260709 13:07:39.684044 22252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2420) took 1549 ms. Trace:
I20260709 13:07:39.658150 26855 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:39.689312 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 722) took 1789 ms. Trace:
I20260709 13:07:39.690169 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:39.693058 22253 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:39.690287 22101 rpcz_store.cc:276] 0709 13:07:37.886831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.887033 (+   202us) service_pool.cc:224] Handling call
0709 13:07:37.983799 (+ 96766us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:38.081072 (+ 97273us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:38.100065 (+ 18993us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.859601 (+759536us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:38.865978 (+  6377us) log.cc:844] Serialized 52 byte log entry
0709 13:07:38.866243 (+   265us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:39.349015 (+482772us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.349407 (+   392us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.675781 (+326374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.675856 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.675914 (+    58us) raft_consensus.cc:1685] finished
0709 13:07:39.675934 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.676117 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51188,"prepare.queue_time_us":938649,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":126,"raft.queue_time_us":70181,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":20937,"thread_start_us":1482557,"threads_started":3,"wal-append.queue_time_us":998221}
I20260709 13:07:39.695802 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:39.685344 22252 rpcz_store.cc:276] 0709 13:07:38.134761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.281763 (+147002us) service_pool.cc:224] Handling call
0709 13:07:38.330472 (+ 48709us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:38.335145 (+  4673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.335208 (+    63us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:38.399723 (+ 64515us) log.cc:844] Serialized 52 byte log entry
0709 13:07:38.895865 (+496142us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:39.359860 (+463995us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.433987 (+ 74127us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.437505 (+  3518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.437609 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.683739 (+246130us) raft_consensus.cc:1685] finished
0709 13:07:39.683768 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.683964 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76735,"prepare.queue_time_us":874646,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":85,"raft.queue_time_us":4483,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":23553,"thread_start_us":903400,"threads_started":2,"wal-append.queue_time_us":841835}
I20260709 13:07:39.674254 26629 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:39.690863 22813 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:39.751662 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:39.753820 22176 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
W20260709 13:07:39.755422 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 258845us
W20260709 13:07:39.755899 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.759792 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:39.760684 22811 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:39.772281 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2116) took 1448 ms. Trace:
W20260709 13:07:39.759126 22069 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.022s	sys 0.029s
I20260709 13:07:39.776304 22250 raft_consensus.cc:2410] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
W20260709 13:07:39.780776 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 266222us
I20260709 13:07:39.780921 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:39.781649 22069 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.023s	sys 0.029s
W20260709 13:07:39.782043 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 726708us
I20260709 13:07:39.757781 26802 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:39.689090 26941 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:39.772835 22104 rpcz_store.cc:276] 0709 13:07:38.324175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.324757 (+   582us) service_pool.cc:224] Handling call
0709 13:07:38.335995 (+ 11238us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:38.345750 (+  9755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.345796 (+    46us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:38.368420 (+ 22624us) log.cc:844] Serialized 78 byte log entry
0709 13:07:38.971690 (+603270us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:39.512089 (+540399us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.755131 (+243042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.755226 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.771944 (+ 16718us) raft_consensus.cc:1685] finished
0709 13:07:39.771973 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.772201 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":582826,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":6244,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":8014,"thread_start_us":1333132,"threads_started":3,"wal-append.queue_time_us":860789}
I20260709 13:07:39.789693 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:39.795223 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:39.791456 22782 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:39.796089 22252 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
W20260709 13:07:39.800401 26970 log.cc:927] Time spent T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:07:39.801838 22102 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 16.
I20260709 13:07:39.804529 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:39.806562 22249 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:39.808465 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2432) took 1159 ms. Trace:
I20260709 13:07:39.810470 22782 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:39.813643 22106 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:39.813932 22105 raft_consensus.cc:1275] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:39.814508 22104 raft_consensus.cc:3055] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:39.814949 22104 raft_consensus.cc:740] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:39.816231 22104 consensus_queue.cc:260] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:39.817521 22104 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.814836 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:39.819386 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:39.821548 22097 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:39.823266 22102 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:39.808996 22247 rpcz_store.cc:276] 0709 13:07:38.649637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.029719 (+380082us) service_pool.cc:224] Handling call
0709 13:07:39.029994 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.030664 (+   670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.030693 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.031166 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.512272 (+481106us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:39.807565 (+295293us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.808062 (+   497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.808159 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.808215 (+    56us) raft_consensus.cc:1685] finished
0709 13:07:39.808233 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.808393 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3174,"prepare.queue_time_us":103029,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":118,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"thread_start_us":668320,"threads_started":2,"wal-append.queue_time_us":626700}
W20260709 13:07:39.826685 26957 log.cc:927] Time spent T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:07:39.830973 22810 raft_consensus.cc:3055] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:07:39.831241 26961 log.cc:927] Time spent T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:07:39.831444 22810 raft_consensus.cc:740] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:39.832547 26967 log.cc:927] Time spent T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:07:39.833050 22248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2428) took 1369 ms. Trace:
I20260709 13:07:39.833690 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:39.793579 26460 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:39.845042 26960 log.cc:927] Time spent T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
W20260709 13:07:39.846798 26953 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.578s	user 0.002s	sys 0.004s
I20260709 13:07:39.847661 22147 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:39.824837 26972 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:07:39.849193 22147 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:39.849113 22255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2425) took 1497 ms. Trace:
I20260709 13:07:39.833451 22248 rpcz_store.cc:276] 0709 13:07:38.463920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.645059 (+181139us) service_pool.cc:224] Handling call
0709 13:07:38.709667 (+ 64608us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.835667 (+126000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.835733 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:38.851157 (+ 15424us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.350999 (+499842us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:39.586138 (+235139us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.586421 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.586521 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.832801 (+246280us) raft_consensus.cc:1685] finished
0709 13:07:39.832821 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.832983 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":264093,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":207854,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":10571,"thread_start_us":588617,"threads_started":2,"wal-append.queue_time_us":644126}
W20260709 13:07:39.849423 26963 log.cc:927] Time spent T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:07:39.870241 22144 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:39.892074 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 135520us
I20260709 13:07:39.897464 22248 raft_consensus.cc:3055] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:39.898053 22248 raft_consensus.cc:740] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:39.899183 22248 consensus_queue.cc:260] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:39.901361 22248 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.893180 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:39.904472 26791 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:39.904946 26791 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.905272 26791 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:39.907248 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:39.909163 22250 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:39.909947 22781 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:39.910372 22250 raft_consensus.cc:3055] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:39.794783 26802 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:39.910804 22250 raft_consensus.cc:740] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:39.856640 26793 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.853178 22255 rpcz_store.cc:276] 0709 13:07:38.368772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.369066 (+   294us) service_pool.cc:224] Handling call
0709 13:07:38.396686 (+ 27620us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.402310 (+  5624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.402340 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:38.439207 (+ 36867us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.916837 (+477630us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:39.517103 (+600266us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.775786 (+258683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.775864 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.846105 (+ 70241us) spinlock_profiling.cc:243] Waited 9.74 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:39.848758 (+  2653us) raft_consensus.cc:1685] finished
0709 13:07:39.848872 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.849041 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":687995,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":22249,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":15839,"spinlock_wait_cycles":22399232,"thread_start_us":1261225,"threads_started":3,"wal-append.queue_time_us":743600}
I20260709 13:07:39.862377 26926 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:39.928535 26941 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:39.863039 26937 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:39.881819 26974 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:39.863884 26460 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:39.949290 26802 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:39.952658 26743 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:39.946743 22249 raft_consensus.cc:1275] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:39.892629 26855 consensus_queue.cc:1048] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:07:39.955646 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2423) took 1680 ms. Trace:
I20260709 13:07:39.955907 26705 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:39.956143 22246 rpcz_store.cc:276] 0709 13:07:38.279137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.311630 (+ 32493us) service_pool.cc:224] Handling call
0709 13:07:38.321026 (+  9396us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:38.336186 (+ 15160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.336229 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:38.384654 (+ 48425us) log.cc:844] Serialized 78 byte log entry
0709 13:07:38.917955 (+533301us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:39.513592 (+595637us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.553702 (+ 40110us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.621279 (+ 67577us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.955110 (+333831us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b540018ca20. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7ec9733 00007f66a7f4edbf 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c
0709 13:07:39.955178 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.955364 (+   186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.955414 (+    50us) raft_consensus.cc:1685] finished
0709 13:07:39.955428 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.955584 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143460,"prepare.queue_time_us":975180,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":6394,"raft.queue_time_us":373541,"raft.run_cpu_time_us":600,"raft.run_wall_time_us":40525,"spinlock_wait_cycles":10393344,"thread_start_us":1220086,"threads_started":3,"wal-append.queue_time_us":883232}
I20260709 13:07:39.957424 22250 consensus_queue.cc:260] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:39.959494 22250 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.964888 22255 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:39.966738 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51872 (request call id 2434) took 1169 ms. Trace:
I20260709 13:07:39.967353 22253 rpcz_store.cc:276] 0709 13:07:38.797731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.496549 (+698818us) service_pool.cc:224] Handling call
0709 13:07:39.683943 (+187394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.693572 (+  9629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.966510 (+272938us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54001cd750. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:39.966660 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430072704}
I20260709 13:07:39.965008 22099 raft_consensus.cc:3055] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:39.969866 22099 raft_consensus.cc:740] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:39.972448 22104 raft_consensus.cc:1275] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:39.979065 22815 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
W20260709 13:07:39.983371 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 230942us
I20260709 13:07:39.984421 22144 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:39.984828 22248 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:07:39.985351 22248 pending_rounds.cc:85] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 7
I20260709 13:07:39.985631 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:39.932826 26932 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:39.935007 26840 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:39.992471 22144 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:39.987635 22099 consensus_queue.cc:260] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:39.992532 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 145973us
I20260709 13:07:39.974787 26989 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:39.998432 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:40.001504 22255 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
W20260709 13:07:39.998250 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 138984us
I20260709 13:07:40.001952 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:39.985737 22248 pending_rounds.cc:107] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:07:40.003144 22815 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:07:40.003721 22248 raft_consensus.cc:2889] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.987005 26974 raft_consensus.cc:697] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:39.973670 26679 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:40.004168 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 94315.9us
I20260709 13:07:39.994485 26949 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:39.991809 26891 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:40.005597 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:40.007972 22144 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:40.008924 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.010462 22099 raft_consensus.cc:3060] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.998631 26600 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:40.006474 26629 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 13:07:40.015450 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 130306us
W20260709 13:07:40.017585 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet 6b965624a67d4adb87e9787782f1715c: Illegal state: Replica 765d912bde9e48959e50d9efec3c26b6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:40.018569 22147 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:39.996145 26705 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:07:40.000988 26989 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:40.022517 22218 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:40.023769 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 2224) took 1098 ms. Trace:
I20260709 13:07:39.993906 26932 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.006953 26972 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:40.027642 22181 rpcz_store.cc:276] 0709 13:07:38.918077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.918207 (+   130us) service_pool.cc:224] Handling call
0709 13:07:38.918471 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.516533 (+598062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.015833 (+499300us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b54003282d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:40.016010 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1373453696}
I20260709 13:07:40.006692 26949 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:40.009742 26891 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:40.062809 26949 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:40.062992 26891 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.042806 26602 consensus_queue.cc:1048] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:40.035879 26941 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:07:40.035168 26996 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:40.044196 22251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:07:40.079736 22251 raft_consensus.cc:606] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:40.080132 22251 raft_consensus.cc:614] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:40.020889 26974 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.081200 26941 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.081770 26941 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:40.083930 26972 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.085014 26941 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:40.086251 26972 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:40.013579 26460 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:40.055338 26791 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:40.030102 26989 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.011829 26840 consensus_queue.cc:1059] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:07:40.096095 22816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 775) took 1611 ms. Trace:
W20260709 13:07:40.100142 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 74500.1us
I20260709 13:07:40.028151 26362 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:40.103145 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.025053 26600 raft_consensus.cc:697] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:40.103469 22251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:07:40.103379 22099 raft_consensus.cc:1275] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:40.105885 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 732) took 1071 ms. Trace:
I20260709 13:07:40.104126 22251 raft_consensus.cc:606] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:40.100680 22816 rpcz_store.cc:276] 0709 13:07:38.430262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.430429 (+   167us) service_pool.cc:224] Handling call
0709 13:07:38.443646 (+ 13217us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:38.707634 (+263988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.707682 (+    48us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:38.770333 (+ 62651us) log.cc:844] Serialized 78 byte log entry
0709 13:07:39.455841 (+685508us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:39.473843 (+ 18002us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.474110 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.943780 (+469670us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b180033a8a0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e61522 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:07:39.963539 (+ 19759us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b180033a8a0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e2f2a6 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419
0709 13:07:40.041535 (+ 77996us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54005e1ad4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:40.041587 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.041641 (+    54us) raft_consensus.cc:1685] finished
0709 13:07:40.041662 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.041843 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29445,"prepare.queue_time_us":17568,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":454,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":9729,"spinlock_wait_cycles":620021760,"thread_start_us":616734,"threads_started":1,"wal-append.queue_time_us":723707}
I20260709 13:07:40.106531 22099 rpcz_store.cc:276] 0709 13:07:39.034510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.034662 (+   152us) service_pool.cc:224] Handling call
0709 13:07:39.038986 (+  4324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.964890 (+925904us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b54004b1ca0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7ec5dc0 00007f66a7f501c0 00007f66a7f51231 00007f66a7f4dd8f 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c
0709 13:07:40.105089 (+140199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.105791 (+   702us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431367040}
I20260709 13:07:40.096660 26460 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:07:40.115335 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 98074.1us
I20260709 13:07:40.104384 26743 raft_consensus.cc:3055] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:40.112473 26460 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:40.104166 26941 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:07:40.121994 26743 raft_consensus.cc:740] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:40.131145 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:40.132079 26743 consensus_queue.cc:260] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.133066 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:40.133234 26968 raft_consensus.cc:3055] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:40.133514 26973 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:07:40.133838 26968 raft_consensus.cc:740] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:40.137492 26971 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.138069 26971 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.133272 26743 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:40.139540 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 351406us
I20260709 13:07:40.122462 26932 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:40.141201 22069 consensus_peers.cc:597] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16e48ec055f940c49e01d5a5d77581aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.142352 22069 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:40.109107 26793 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:07:40.143256 26980 consensus_queue.cc:1059] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:40.145879 26679 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:40.146067 26949 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.148283 26975 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:40.148907 26975 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:40.150223 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 255064us
I20260709 13:07:40.151155 22254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45738 (request call id 917) took 1030 ms. Trace:
I20260709 13:07:40.151527 22810 consensus_queue.cc:260] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.152691 22810 raft_consensus.cc:3060] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:40.152854 22103 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:40.154066 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:40.154704 22098 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
W20260709 13:07:40.155164 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.155961 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.151527 22254 rpcz_store.cc:276] 0709 13:07:39.100761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.352038 (+251277us) service_pool.cc:224] Handling call
0709 13:07:40.130496 (+778458us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b54001cb6d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:40.130657 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104995200}
W20260709 13:07:40.156468 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.129606 22218 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:40.161617 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:40.163563 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:40.166373 26242 consensus_queue.cc:1048] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:40.168064 22069 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:40.168149 26242 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:40.176570 26242 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:40.179700 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:40.180577 22251 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:40.182248 26242 consensus_queue.cc:1048] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:40.183773 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:40.184870 22098 raft_consensus.cc:2393] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 10: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:40.204711 22782 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:40.204942 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.146117 26980 raft_consensus.cc:3055] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:40.205116 26983 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:40.207369 22782 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:40.207619 26791 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:40.208858 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 84687.2us
I20260709 13:07:40.126026 26891 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:40.212093 22052 auto_rebalancer.cc:629] Failed to schedule move for tablet 5d3869ae617b42c89768d68043d44be2: Illegal state: Replica 79683575881f4334bd4dc6d9bdbb45c3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:40.212358 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:40.160677 26560 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:40.204378 26997 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:40.215071 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:40.226162 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.244469 22101 raft_consensus.cc:2410] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:07:40.188094 26981 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:40.253726 26998 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:40.213481 26980 raft_consensus.cc:740] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:40.254289 22147 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:40.206413 26975 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:40.134815 26968 consensus_queue.cc:260] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.279217 26932 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:40.169512 26793 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:40.277135 26997 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:40.283937 22218 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:40.168870 26362 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:07:40.287153 22181 raft_consensus.cc:1240] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:40.254014 27001 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:40.275183 26791 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:40.274839 22254 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:40.295691 22104 raft_consensus.cc:1240] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:07:40.288620 26934 log.cc:927] Time spent T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:40.307844 26793 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:40.308301 27001 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:40.308445 26793 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:40.297281 22249 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:40.274585 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:40.297809 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:40.297894 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:40.183504 26600 consensus_queue.cc:237] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.284610 26705 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:40.307049 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:40.312496 22246 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.310818 26793 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:40.316681 26362 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:40.317090 26791 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.310671 27001 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:40.317600 22810 raft_consensus.cc:1275] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:07:40.331389 22810 pending_rounds.cc:85] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting all ops after (but not including) 10
I20260709 13:07:40.331835 22810 pending_rounds.cc:107] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:07:40.332150 22810 raft_consensus.cc:2889] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:40.325415 22099 raft_consensus.cc:3060] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.295821 26932 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:40.283514 26560 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.303608 26997 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:40.323222 27002 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.177s	user 0.003s	sys 0.000s
W20260709 13:07:40.362479 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 195185us
I20260709 13:07:40.343199 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:40.304529 27004 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:40.364905 22144 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:07:40.368220 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.368662 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 165797us
I20260709 13:07:40.329623 26362 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:40.391352 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 205494us
W20260709 13:07:40.394757 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.358728 26947 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:07:40.401774 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:40.359658 26932 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.329101 26837 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:07:40.344017 26974 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:07:40.389348 22071 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:40.386950 27004 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:40.394016 26971 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:40.406746 26999 log.cc:927] Time spent T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:07:40.424728 26460 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.332962 26705 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.425773 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:40.427222 26705 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:40.427147 26679 consensus_queue.cc:1048] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:40.428202 27004 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:40.392835 26362 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:40.430259 26891 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:40.431048 26460 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:40.435444 26705 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:40.436134 26705 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:40.437958 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 246196us
W20260709 13:07:40.439155 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 49908.5us
I20260709 13:07:40.439610 26937 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.440452 26971 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:40.440224 26937 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.441006 26971 raft_consensus.cc:697] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:40.442003 26971 consensus_queue.cc:237] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:40.442519 26937 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:40.422544 22779 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:40.399142 22069 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:40.360966 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 106734us
I20260709 13:07:40.454099 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:40.454964 22251 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:07:40.448958 22099 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:40.466498 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:40.467329 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 44868.5us
I20260709 13:07:40.421566 26696 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:40.473554 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.443857 26941 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:40.481640 22779 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:40.420847 26949 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:40.490384 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.492244 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:40.434710 26997 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:40.524572 22779 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:40.526213 22779 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:40.483932 26709 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.467399 27004 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:40.495918 26696 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:40.588563 26705 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:40.590191 27006 log.cc:927] Time spent T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 13:07:40.452143 27014 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:07:40.497318 26941 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.520880 27007 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:40.530810 26988 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:40.599586 22251 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 17.
I20260709 13:07:40.643591 22251 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:40.600441 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 135802us
I20260709 13:07:40.607772 22246 raft_consensus.cc:2468] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:40.528649 26840 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:40.399044 26980 consensus_queue.cc:260] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.592072 26927 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:40.639501 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 245346us
I20260709 13:07:40.593583 26855 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:40.629616 26989 consensus_meta.cc:287] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.527s	user 0.004s	sys 0.007s
W20260709 13:07:40.630801 22072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.703s (SENT) [suppressed 16 similar messages]
W20260709 13:07:40.651166 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 121157us
I20260709 13:07:40.631660 26602 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:40.675525 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:40.638855 26941 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:40.680555 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.649629 26891 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:40.693498 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:40.639091 27004 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.694509 26981 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:40.707669 22147 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:40.695134 27016 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:40.703332 26980 raft_consensus.cc:3060] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:40.679216 26989 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.722330 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:40.683277 26602 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:40.731721 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 457395us
I20260709 13:07:40.706881 27024 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.740837 22246 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:40.748819 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:40.700054 26891 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:40.691641 27007 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:40.757266 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:40.761888 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:40.762247 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:40.764384 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:40.720052 26997 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:40.766569 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:40.721326 26460 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:40.768668 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:40.758105 22254 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:40.774014 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:40.756431 26362 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.781059 26362 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:40.721421 26981 raft_consensus.cc:697] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:40.782384 26981 consensus_queue.cc:237] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.784509 27004 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:40.785543 27032 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:07:40.788093 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.788674 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.735635 27031 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:40.821707 22218 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:40.817984 26743 consensus_meta.cc:287] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.678s	user 0.013s	sys 0.000s
I20260709 13:07:40.822429 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:40.827476 22812 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:40.732540 27016 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:40.807552 27032 raft_consensus.cc:697] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:40.806802 27031 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:40.749236 27024 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:40.840281 27015 log.cc:927] Time spent T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:07:40.832437 26984 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:40.876929 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:40.879714 26709 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:40.889828 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:40.894735 27032 consensus_queue.cc:237] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:40.899151 27022 log.cc:927] Time spent T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:07:40.901185 27007 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:40.902439 27031 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:40.839311 27017 log.cc:927] Time spent T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:07:40.871769 27019 log.cc:927] Time spent T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:07:40.905058 26987 consensus_queue.cc:1059] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:40.797588 26460 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:40.909636 26696 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:40.910251 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.945976 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:40.946729 22102 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:40.878599 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:40.816232 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 108577us
W20260709 13:07:40.951658 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.954488 22147 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:40.958945 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 266132us
I20260709 13:07:40.981370 22218 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:40.989949 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:40.996425 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:40.997016 22251 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:40.902763 26560 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:41.007187 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:41.007877 22815 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.008455 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:41.015718 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:41.016415 22810 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:41.019573 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:40.988129 26891 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:41.023464 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:41.025076 22816 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 11: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:41.003335 27007 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:41.031586 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:41.032073 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 116601us
I20260709 13:07:41.009405 26987 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.032073 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:41.034231 22815 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 16.
I20260709 13:07:41.033679 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:41.032279 22807 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:41.037330 22812 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
W20260709 13:07:41.028299 26932 consensus_meta.cc:287] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.617s	user 0.006s	sys 0.006s
I20260709 13:07:40.982110 27031 consensus_queue.cc:1059] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:07:41.040320 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:41.041004 22246 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:41.010655 27014 consensus_queue.cc:1048] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:07:41.044862 26989 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:41.047912 22218 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.065692 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.067137 26987 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:41.067183 26602 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:41.067517 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.069978 22218 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.072103 22251 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:07:41.063195 22810 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:07:41.033015 27007 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:41.053563 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:41.056620 27030 log.cc:927] Time spent T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.144s	user 0.000s	sys 0.002s
I20260709 13:07:41.058676 22782 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:41.037638 26949 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:41.051939 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:41.075702 22246 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:41.076738 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:41.078497 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:41.063910 26998 consensus_meta.cc:287] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.770s	user 0.014s	sys 0.000s
I20260709 13:07:41.083065 22069 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:41.082520 22104 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:41.096376 22102 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 17.
I20260709 13:07:41.069379 26560 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:41.101775 26560 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:41.077540 27007 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:41.103579 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:41.104384 22218 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.079006 26984 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:41.044768 26932 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:41.112340 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:41.117424 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.084398 26989 raft_consensus.cc:2804] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:41.140466 27024 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:41.086138 26949 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:41.152798 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.091323 26998 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:41.097489 26975 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:41.097752 27016 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:41.167311 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 63011.8us
I20260709 13:07:41.105113 26947 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:07:41.080950 26602 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:41.147390 27040 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:41.084597 26362 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:41.103763 27033 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:41.195559 22174 raft_consensus.cc:1240] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:41.102813 26460 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:41.202067 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.202801 22250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2287) took 1042 ms. Trace:
I20260709 13:07:41.248025 22250 rpcz_store.cc:276] 0709 13:07:40.160608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.160725 (+   117us) service_pool.cc:224] Handling call
0709 13:07:40.160989 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.161178 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:40.182197 (+ 21019us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.148498 (+966301us) spinlock_profiling.cc:243] Waited 59.2 ms on lock 0x7b18002f2300. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a7af64bc 00007f66a4e4448b 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e5e455 00007f66a7f46060 00007f66a7f58716 00007f66a7f69287
0709 13:07:41.202424 (+ 53926us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:41.202474 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:41.202518 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.202614 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.202743 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161625,"prepare.queue_time_us":25536,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":2381,"raft.queue_time_us":229698,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4032,"spinlock_wait_cycles":136063872,"thread_start_us":188678,"threads_started":2,"wal-append.queue_time_us":184950}
W20260709 13:07:41.195382 22072 leader_election.cc:336] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.502s (SENT)
I20260709 13:07:41.104063 26560 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:41.210606 26968 raft_consensus.cc:3060] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.210870 26793 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:41.215643 22810 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:41.225723 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:41.280385 22218 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.196774 27048 ts_tablet_manager.cc:933] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:41.219201 26975 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:41.250705 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 55349.9us
W20260709 13:07:41.282955 22072 leader_election.cc:336] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.564s (SENT)
I20260709 13:07:41.283525 22072 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:41.220166 26989 raft_consensus.cc:697] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:41.288295 22072 leader_election.cc:336] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.574s (SENT)
I20260709 13:07:41.288894 22072 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:41.302846 26949 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:41.304348 27049 log.cc:927] Time spent T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:07:41.306480 27029 raft_consensus.cc:3055] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:41.307228 27029 raft_consensus.cc:740] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:41.306574 22250 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:41.284888 26975 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:41.290693 26793 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:41.291522 26696 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:41.332932 26793 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:41.246709 27040 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:41.335366 27040 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:41.339501 27044 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:07:41.340426 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 281487us
I20260709 13:07:41.340351 26989 consensus_queue.cc:237] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:41.347486 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:41.350591 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:41.351469 22250 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:41.348356 22174 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:41.296113 27033 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:41.237534 26602 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:41.249040 26362 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:41.356473 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:41.357892 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:41.362528 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.295471 26979 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:41.379434 22252 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 16.
I20260709 13:07:41.389832 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:41.390388 22252 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 9.
I20260709 13:07:41.391163 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:41.391707 22252 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:41.411191 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:41.286768 26997 consensus_queue.cc:1059] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:07:41.381287 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:41.448985 22181 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 15.
W20260709 13:07:41.387385 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 99148.1us
I20260709 13:07:41.450955 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:41.451418 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:41.452322 22181 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 11: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:41.378675 22144 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.452953 22248 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
W20260709 13:07:41.452445 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.433415 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.453841 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 75215.2us
I20260709 13:07:41.412318 22252 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:41.455101 22144 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.354880 27040 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:41.387162 26987 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:41.463063 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:41.347102 26560 consensus_queue.cc:1059] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:07:41.482079 26242 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.483865 22147 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:41.501361 22147 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:41.422706 27006 log.cc:927] Time spent T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:07:41.386634 26709 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:41.499063 26242 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:41.508009 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 227696us
I20260709 13:07:41.381510 26972 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.451254 26679 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.515286 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:41.466892 27014 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:41.539079 27027 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:41.540086 27027 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:41.565950 27055 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:41.566767 27048 tablet_copy_client.cc:323] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.65:33421
W20260709 13:07:41.573571 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 122917us
I20260709 13:07:41.506569 26949 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:41.576244 26242 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:41.512320 27031 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:41.513010 27032 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:07:41.545156 27038 log.cc:927] Time spent T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:07:41.583074 22072 leader_election.cc:336] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.628s (SENT)
I20260709 13:07:41.588600 22072 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:41.579586 26980 consensus_meta.cc:287] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.825s	user 0.008s	sys 0.004s
I20260709 13:07:41.608186 22218 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.498019 27040 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:41.596663 26971 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.006s	sys 0.015s
I20260709 13:07:41.546288 26679 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:41.514369 26709 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:41.632436 22097 raft_consensus.cc:1275] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:41.580430 27031 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:41.520598 27016 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:07:41.636197 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 53131.4us
I20260709 13:07:41.600910 26932 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:41.519788 26972 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:41.610172 26973 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:41.634089 27033 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:41.638785 27047 log.cc:927] Time spent T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.058s	user 0.004s	sys 0.000s
W20260709 13:07:41.640100 26941 consensus_meta.cc:287] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.943s	user 0.012s	sys 0.002s
I20260709 13:07:41.651352 22816 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:41.666147 27039 raft_consensus.cc:3055] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:41.667105 27039 raft_consensus.cc:740] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:41.668110 27039 consensus_queue.cc:260] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:41.650638 26891 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.020s	sys 0.026s
W20260709 13:07:41.671749 26891 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.020s	sys 0.026s
I20260709 13:07:41.672284 26362 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:41.673671 26602 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:41.674238 26709 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:41.634769 26971 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.007s	sys 0.019s
I20260709 13:07:41.645490 27031 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:41.638581 27032 raft_consensus.cc:697] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:41.661669 27053 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 13:07:41.695207 27040 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:41.697717 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 123665us
W20260709 13:07:41.709299 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.711220 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:41.714402 22218 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.656805 27010 consensus_queue.cc:1059] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:07:41.656747 26941 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:41.717996 22173 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:07:41.718762 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 145896us
I20260709 13:07:41.651439 27016 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:41.703948 26802 consensus_queue.cc:1059] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
W20260709 13:07:41.717087 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 202126us
I20260709 13:07:41.750093 26990 raft_consensus.cc:3055] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:41.750617 26990 raft_consensus.cc:740] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:41.725485 26985 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:41.730682 22147 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:41.757027 22147 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:41.758167 22147 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:41.755645 26802 raft_consensus.cc:3055] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:41.812824 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2134) took 1071 ms. Trace:
I20260709 13:07:41.761829 22147 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:41.793867 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2140) took 1040 ms. Trace:
W20260709 13:07:41.791409 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 81318.4us
I20260709 13:07:41.803422 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:41.777808 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 56346.4us
W20260709 13:07:41.816958 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 55327us
I20260709 13:07:41.824031 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:41.820915 22147 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:41.816061 22098 rpcz_store.cc:276] 0709 13:07:40.754092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.919966 (+165874us) service_pool.cc:224] Handling call
0709 13:07:40.980882 (+ 60916us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.981363 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.981405 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:41.002581 (+ 21176us) log.cc:844] Serialized 26 byte log entry
0709 13:07:41.238816 (+236235us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:41.238874 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.238979 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.793626 (+554647us) raft_consensus.cc:1685] finished
0709 13:07:41.793648 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.793808 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17452,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":10493,"thread_start_us":202144,"threads_started":1,"wal-append.queue_time_us":215112}
I20260709 13:07:41.827808 26362 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:41.829077 22147 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:41.815451 22100 rpcz_store.cc:276] 0709 13:07:40.741641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.741822 (+   181us) service_pool.cc:224] Handling call
0709 13:07:40.769803 (+ 27981us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:40.911100 (+141297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.911141 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:40.911891 (+   750us) log.cc:844] Serialized 78 byte log entry
0709 13:07:41.205836 (+293945us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:41.569765 (+363929us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.571134 (+  1369us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.573252 (+  2118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.803942 (+230690us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54000b8e54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:41.804012 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.812502 (+  8490us) raft_consensus.cc:1685] finished
0709 13:07:41.812536 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.812750 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":562158,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":74,"raft.queue_time_us":481,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":17620,"spinlock_wait_cycles":323715328,"thread_start_us":616816,"threads_started":2,"wal-append.queue_time_us":318843}
I20260709 13:07:41.830624 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:41.831483 22251 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.828395 26362 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:41.832523 26679 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:41.832924 26362 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:41.833168 26972 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:41.819839 27081 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:41.834308 27081 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:41.834652 27081 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:41.798410 26791 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:41.792024 26941 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:41.766577 26891 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:41.839946 26891 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:41.840454 26891 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.841310 26975 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:41.844488 27016 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:41.845539 22251 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:41.844066 26362 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:41.850339 26791 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:41.850827 26791 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:41.851236 26791 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.852015 22782 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:41.852902 27035 log.cc:927] Time spent T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.811s	user 0.003s	sys 0.000s
I20260709 13:07:41.853018 26974 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:41.765151 27040 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:41.818028 26802 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:41.872704 26802 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:41.887128 22097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 747) took 1526 ms. Trace:
I20260709 13:07:41.855697 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:41.868305 26974 raft_consensus.cc:697] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:41.830358 26985 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:41.854063 22071 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:41.874576 22781 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.813364 27012 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:41.793524 27029 consensus_queue.cc:260] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:41.764928 27032 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:41.857251 27040 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:41.884599 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 54040.2us
W20260709 13:07:41.887094 27007 consensus_meta.cc:287] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.738s	user 0.009s	sys 0.003s
I20260709 13:07:41.888852 26975 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:41.865602 22246 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:41.894685 22097 rpcz_store.cc:276] 0709 13:07:40.360405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.360570 (+   165us) service_pool.cc:224] Handling call
0709 13:07:40.378875 (+ 18305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.641824 (+1262949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.886802 (+244978us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540042b654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:41.887061 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2882092288}
I20260709 13:07:41.896757 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:41.898558 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:41.903403 22252 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:41.904876 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:41.912623 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:41.934485 22253 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
W20260709 13:07:41.917235 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 85617.8us
I20260709 13:07:41.912384 27024 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:41.937891 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:41.938467 27007 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:41.940999 27007 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
W20260709 13:07:41.925614 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 51124.6us
I20260709 13:07:41.926600 22218 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.943560 22218 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.944906 22218 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.945758 27063 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:41.946559 27063 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:41.947098 26840 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:41.927383 26974 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:41.929991 26891 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:41.931320 26362 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:41.931260 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:41.932101 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:41.936306 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:41.949100 22250 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 7.
W20260709 13:07:41.949314 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.949448 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.950874 22218 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.952618 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:41.953389 22246 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:41.953989 22781 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.956341 22781 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:41.957630 22781 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:41.935021 27040 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.958581 26950 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:41.963399 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:41.972609 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2292) took 1532 ms. Trace:
I20260709 13:07:41.973225 22250 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:41.934966 26927 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:41.987113 26927 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:41.987624 26927 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:41.967283 26947 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:41.912756 27012 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:41.989347 26990 consensus_queue.cc:260] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:41.990891 27012 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:41.965154 27031 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:41.990691 26990 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.971607 22246 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:41.973240 22247 rpcz_store.cc:276] 0709 13:07:40.440111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.446739 (+  6628us) service_pool.cc:224] Handling call
0709 13:07:40.447163 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.701828 (+254665us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:40.721106 (+ 19278us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.891546 (+1170440us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b1800447d60. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee23a 00007f66a7f58a2a
0709 13:07:41.923566 (+ 32020us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.923774 (+   208us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:41.925451 (+  1677us) log.cc:844] Serialized 26 byte log entry
0709 13:07:41.925576 (+   125us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:41.925609 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.925679 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.972358 (+ 46679us) raft_consensus.cc:1685] finished
0709 13:07:41.972385 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.972544 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32509,"prepare.queue_time_us":27890,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":139502,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":2677,"spinlock_wait_cycles":51992576,"thread_start_us":251751,"threads_started":2,"wal-append.queue_time_us":1243285}
I20260709 13:07:41.972294 27079 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:41.995906 27079 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:41.996438 27079 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.966768 26362 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:07:41.953299 27025 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:41.980891 26791 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.000718 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:42.002128 22180 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:42.002912 27012 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:41.993990 22250 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:07:41.961920 22147 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:42.005705 27001 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:42.006141 27001 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.908380 26985 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.006592 27001 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:42.005880 22147 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:42.009141 26985 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:42.009989 27016 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:42.010617 27016 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:42.011132 27016 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.002821 26791 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:42.017405 22147 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:42.018868 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:42.019755 22254 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.023830 26362 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:42.024672 26362 raft_consensus.cc:697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:42.025753 26362 consensus_queue.cc:237] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.030151 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:42.031215 22250 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.955260 26855 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:07:42.047468 22781 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:42.049333 26988 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:42.052533 27031 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:41.976017 27081 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.061535 27081 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:42.067705 22176 raft_consensus.cc:1240] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:42.059260 22253 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:42.081332 22781 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:42.083326 22147 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:42.088797 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:42.089843 22246 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:42.109982 22816 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:42.110239 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:42.115507 22255 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:42.124183 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:42.082808 26840 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:42.129144 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:42.132984 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:42.109162 27031 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:42.139418 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:42.106190 27076 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:42.147938 22246 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:42.149518 22250 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:42.155682 22147 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:42.164186 22147 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:42.166328 22812 raft_consensus.cc:1240] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:42.166985 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:42.168161 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:42.125460 26974 consensus_queue.cc:1059] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:07:42.159773 27016 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.183553 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:42.185070 27016 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:42.164183 27074 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:42.185011 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:42.172271 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:42.186779 22812 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:42.171218 26997 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:42.187745 26997 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.189730 26997 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:42.190214 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.190515 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:42.191143 22252 raft_consensus.cc:2376] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13. Re-sending same reply.
I20260709 13:07:42.193195 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:42.195633 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:42.197494 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:42.198071 22250 raft_consensus.cc:2376] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10. Re-sending same reply.
I20260709 13:07:42.199312 22812 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:42.200198 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:42.202508 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:42.204150 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.204840 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:42.206933 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.208981 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:42.207238 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:42.209712 22251 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:42.208005 26460 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:07:42.212107 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.215720 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:42.216454 22253 raft_consensus.cc:2376] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 15. Re-sending same reply.
I20260709 13:07:42.216859 26989 raft_consensus.cc:3055] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:42.217267 26989 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:42.218772 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:42.218997 27080 log.cc:927] Time spent T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:42.219468 26460 raft_consensus.cc:697] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:42.219914 27088 log.cc:927] Time spent T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:07:42.220119 22253 raft_consensus.cc:2410] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:07:42.172631 27014 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:42.220574 26460 consensus_queue.cc:237] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:42.221257 27041 log.cc:927] Time spent T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 1.303s	user 0.004s	sys 0.000s
W20260709 13:07:42.222319 27093 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:42.222457 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:42.224382 22253 raft_consensus.cc:2410] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:07:42.224258 27027 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:42.221223 27014 raft_consensus.cc:697] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:42.226893 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:42.228775 22251 raft_consensus.cc:2376] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 15. Re-sending same reply.
I20260709 13:07:42.230896 22176 raft_consensus.cc:1240] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:42.233999 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.234201 22255 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:42.236456 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 752) took 1561 ms. Trace:
I20260709 13:07:42.237138 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:42.237949 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:42.236949 22101 rpcz_store.cc:276] 0709 13:07:40.674700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.675329 (+   629us) service_pool.cc:224] Handling call
0709 13:07:40.692314 (+ 16985us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.702144 (+  9830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.702172 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.702767 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:07:40.770131 (+ 67364us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:40.770212 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.770355 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:42.220579 (+1450224us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:42.227125 (+  6546us) raft_consensus.cc:1685] finished
0709 13:07:42.227147 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.236397 (+  9250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6678,"raft.queue_time_us":16626,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":9080,"spinlock_wait_cycles":332518656,"thread_start_us":30888,"threads_started":1,"wal-append.queue_time_us":95348}
I20260709 13:07:42.241736 22218 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:42.260285 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:42.261370 22106 raft_consensus.cc:2410] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:07:42.262452 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:42.245609 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:42.272267 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:42.272583 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:42.273007 22106 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:42.273104 22810 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:42.276288 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:42.277065 22103 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:42.283241 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:42.285399 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:42.258899 27081 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.251626 26987 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:42.268968 26975 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.294728 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:42.277827 27025 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.297340 22102 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:42.228173 27001 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.299226 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:42.298009 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:42.300917 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:42.259985 27026 consensus_queue.cc:1059] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:07:42.300107 22103 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
W20260709 13:07:42.304806 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 92537.4us
I20260709 13:07:42.274508 27012 consensus_queue.cc:1059] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:07:42.309109 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:42.311030 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:42.315800 22176 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:42.318588 22175 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 13:07:42.299553 27025 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.282796 26971 consensus_queue.cc:1059] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:07:42.322065 22810 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:42.309288 26985 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:42.295701 27081 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:42.347277 22102 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 16.
I20260709 13:07:42.194579 27079 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:42.349978 27009 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:42.346145 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:42.301891 26975 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:42.352779 22246 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.334756 27025 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.310505 26987 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:07:42.363437 22254 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
W20260709 13:07:42.371973 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.374521 27042 log.cc:927] Time spent T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 1.339s	user 0.002s	sys 0.004s
W20260709 13:07:42.375634 27094 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:07:42.374653 27096 log.cc:927] Time spent T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:42.312359 27014 consensus_queue.cc:237] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.403133 22175 raft_consensus.cc:1240] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:42.409550 22246 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:42.336483 27031 raft_consensus.cc:697] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:42.344594 26927 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:42.417901 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.415472 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 104165us
I20260709 13:07:42.423735 22178 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:42.350708 27009 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:42.420646 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 122710us
I20260709 13:07:42.427760 22098 raft_consensus.cc:2410] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:42.428522 22218 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:42.434333 22181 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:42.436759 22100 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:42.478745 27079 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:42.481839 22180 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:42.480150 26974 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.503671 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.484645 26997 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:07:42.508155 22175 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:42.510996 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 81074.2us
I20260709 13:07:42.512279 22218 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:42.484117 27081 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:42.484316 27001 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:42.490859 26987 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:07:42.481367 27104 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.483249 26975 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:42.514068 26927 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:42.510953 26974 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:42.532272 27009 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:42.533147 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:42.509649 27031 consensus_queue.cc:237] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:42.544157 27074 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:42.544957 27074 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:42.557502 27040 consensus_meta.cc:287] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.007s
I20260709 13:07:42.553346 27104 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.561775 27040 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.566356 26974 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:42.566411 22173 raft_consensus.cc:1240] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.567476 27040 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:42.572793 27010 raft_consensus.cc:3055] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:42.573372 27010 raft_consensus.cc:740] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:42.563769 27104 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:42.575361 27104 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.577430 27074 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.588352 22175 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:42.591956 27025 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:42.591382 27074 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:42.592706 27111 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:42.574440 27010 consensus_queue.cc:260] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.596200 22174 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:42.604523 27104 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.600391 22175 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:42.578980 26891 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:42.593309 26802 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:42.607314 27025 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:42.601693 27111 raft_consensus.cc:3055] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:42.585947 26989 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:42.608573 26989 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:42.610834 27010 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:42.615329 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 103134us
W20260709 13:07:42.611395 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.616335 22218 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:42.618000 27111 raft_consensus.cc:740] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:42.618629 27025 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:42.619168 27111 consensus_queue.cc:260] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.620491 27111 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:42.617950 22218 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:42.623425 27025 raft_consensus.cc:2804] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:42.626678 22147 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:42.629442 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:42.630272 22246 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:42.631297 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:42.631836 22249 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:42.634321 22147 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:42.637095 27081 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:42.637331 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:42.637658 27081 raft_consensus.cc:697] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:42.635607 27031 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:42.638536 27031 raft_consensus.cc:697] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:42.639523 27031 consensus_queue.cc:237] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.640441 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:42.641032 27091 log.cc:927] Time spent T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.329s	user 0.002s	sys 0.000s
I20260709 13:07:42.641076 22247 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.632121 27025 raft_consensus.cc:697] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 16 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:42.642411 27025 consensus_queue.cc:237] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.644295 22255 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:42.637928 22101 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.646559 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:42.647367 22254 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
I20260709 13:07:42.647902 27112 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:42.648471 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:42.649080 22250 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:42.648485 27112 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:42.653604 22175 raft_consensus.cc:1240] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:42.657507 22101 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:42.660730 22782 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:42.662096 27112 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:42.663930 22247 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:42.664556 27104 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:42.665831 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:42.659981 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:42.668466 27104 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:42.668948 27104 raft_consensus.cc:697] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:42.665409 22147 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:42.669780 27104 consensus_queue.cc:237] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:42.671031 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:42.671698 22098 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:42.672641 26891 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:42.673458 26891 raft_consensus.cc:697] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:42.674734 26891 consensus_queue.cc:237] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.673295 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:42.684024 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.685724 22250 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 17.
I20260709 13:07:42.687381 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:42.688122 22101 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.691052 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:42.688616 22147 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:42.697975 22246 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 16.
I20260709 13:07:42.691656 26709 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:42.700105 26997 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.700606 26997 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:42.701081 26997 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.693146 27112 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.700352 26709 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:42.706621 26793 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:42.715065 26793 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.715541 26793 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:42.707607 26927 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:42.719350 26927 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.719795 26927 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:42.638613 27081 consensus_queue.cc:237] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.711624 26709 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:42.723374 27027 raft_consensus.cc:3055] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:42.723827 27027 raft_consensus.cc:740] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:42.724722 27027 consensus_queue.cc:260] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.725752 27027 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.728268 26927 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:42.729276 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 1.2354e+06us
I20260709 13:07:42.732136 22144 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:42.705792 22147 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:42.687433 27062 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:07:42.736019 22147 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:42.737051 22147 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:07:42.752027 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.745155 22101 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:42.759718 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:42.754878 22218 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:42.760824 22246 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.767997 22181 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:42.772068 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:42.772339 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:42.772639 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:42.773288 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:42.739828 27055 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.780319 22816 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:42.741230 27001 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:42.749804 27032 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:42.751861 27016 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:07:42.776088 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.785761 22103 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.788255 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:42.794164 22813 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:42.788522 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:42.825944 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.790535 27116 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:07:42.828105 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:42.846244 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:42.851032 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.878552 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.779713 27055 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:42.787052 27112 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:42.901635 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 94359.4us
I20260709 13:07:42.905999 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:42.906527 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.828434 26989 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.821712 27032 raft_consensus.cc:697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:42.791723 26600 consensus_queue.cc:1059] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:07:42.787179 26840 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.129s
I20260709 13:07:42.933496 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:42.903865 27063 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.921130 27094 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:07:42.940218 22101 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:42.904597 27103 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:42.957417 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.957857 27039 raft_consensus.cc:3060] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:42.944830 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:42.958634 22097 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:42.963526 26743 raft_consensus.cc:3055] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:42.964033 26743 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:42.914306 27001 raft_consensus.cc:697] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:42.950706 26793 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:42.969640 22144 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:42.952310 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:42.970870 22097 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:42.957389 27103 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:42.915537 27055 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.946565 27063 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:42.922631 27016 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:42.973462 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:42.926702 27112 raft_consensus.cc:697] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:42.976881 22144 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:07:42.986851 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.988154 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.988528 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.987124 22173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2712) took 1278 ms. Trace:
I20260709 13:07:42.987821 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:42.989921 22173 rpcz_store.cc:276] 0709 13:07:41.708823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.754714 (+ 45891us) service_pool.cc:224] Handling call
0709 13:07:41.791019 (+ 36305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.567132 (+776113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.986878 (+419746us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b54001770d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:42.987064 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1782704256}
I20260709 13:07:43.010878 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:43.011842 22069 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:43.012360 27103 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:43.012970 22069 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:43.014353 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:43.016390 26976 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:43.017151 26976 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:42.741744 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:43.018695 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:42.936712 26989 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.017661 26976 raft_consensus.cc:697] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:43.024178 26927 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:43.024955 26980 consensus_queue.cc:1059] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:43.024734 26976 consensus_queue.cc:237] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.025894 26793 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:43.025565 26983 consensus_queue.cc:1059] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:43.027902 22808 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:43.026882 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:43.059489 22251 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:43.027602 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:43.060372 22247 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:43.061522 26793 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:43.061926 26793 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:43.062216 27063 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:43.062295 26793 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:43.039973 22816 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:43.040560 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:43.000278 27062 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.063951 27062 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.064265 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:43.066087 27062 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:43.001168 27007 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:43.066859 27007 raft_consensus.cc:697] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:43.067390 27114 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:07:43.067871 27007 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:43.046583 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.047380 22813 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:43.051715 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:42.983496 27081 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:43.057760 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:43.076676 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:43.078451 22251 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:07:43.079905 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:43.080576 22810 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.059578 26980 raft_consensus.cc:3055] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:43.086228 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:43.048573 27032 consensus_queue.cc:237] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.086468 26600 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:43.087985 26600 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:43.090242 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:43.077107 27001 consensus_queue.cc:237] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.092643 27029 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.076767 27112 consensus_queue.cc:237] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.059270 26975 consensus_queue.cc:1059] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:07:43.098152 26975 consensus_queue.cc:1243] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:43.086221 26980 raft_consensus.cc:740] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:43.100174 27012 raft_consensus.cc:3055] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:43.100673 27012 raft_consensus.cc:740] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:43.100373 26980 consensus_queue.cc:260] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.102150 26980 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:43.082239 26983 raft_consensus.cc:3055] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:07:43.114216 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.145958 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 56161.8us
I20260709 13:07:43.052762 26997 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.177887 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:43.111361 26600 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:43.220077 26997 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:43.143930 26983 raft_consensus.cc:740] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:43.239876 26983 consensus_queue.cc:260] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.241353 27043 raft_consensus.cc:3055] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:43.239876 26989 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:43.275597 27120 log.cc:927] Time spent T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:07:43.078219 27016 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.278414 22807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 703) took 1136 ms. Trace:
I20260709 13:07:43.293536 22807 rpcz_store.cc:276] 0709 13:07:42.141632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.141803 (+   171us) service_pool.cc:224] Handling call
0709 13:07:42.142115 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:42.159778 (+ 17663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:42.159809 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:42.167818 (+  8009us) log.cc:844] Serialized 26 byte log entry
0709 13:07:42.560665 (+392847us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b18004978c0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee0d1 00007f66a7f09a0f
0709 13:07:42.737915 (+177250us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:42.771693 (+ 33778us) log.cc:844] Serialized 14 byte log entry
0709 13:07:42.776922 (+  5229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.277999 (+501077us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b54004f5954. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:43.278083 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:43.278157 (+    74us) raft_consensus.cc:1685] finished
0709 13:07:43.278177 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.278333 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":491,"prepare.queue_time_us":28177,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":5509,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":15725,"spinlock_wait_cycles":94132992,"thread_start_us":177067,"threads_started":1,"wal-append.queue_time_us":644546}
I20260709 13:07:43.325590 22247 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 14.
I20260709 13:07:43.241870 27043 raft_consensus.cc:740] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:43.338078 22816 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:43.344758 22810 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:43.359298 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:07:43.370344 27111 consensus_meta.cc:287] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.749s	user 0.011s	sys 0.000s
I20260709 13:07:43.370798 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:43.371495 22097 raft_consensus.cc:1240] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:43.371959 22106 raft_consensus.cc:3055] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:43.372318 22106 raft_consensus.cc:740] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:43.373099 22106 consensus_queue.cc:260] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.374034 22106 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:43.374297 22814 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:43.375523 27124 log.cc:927] Time spent T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:43.101657 27012 consensus_queue.cc:260] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:43.376963 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:43.377811 22808 raft_consensus.cc:2410] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:07:43.379192 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:43.378183 22782 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:43.346349 26983 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:43.371528 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:43.370410 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:43.375670 22105 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:43.382447 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:43.390816 22250 raft_consensus.cc:2393] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 15: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
W20260709 13:07:43.391150 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.343302 27103 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:43.395574 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.408993 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.409479 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.409845 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.410233 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.411896 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 334244us
W20260709 13:07:43.414170 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.415664 22106 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:43.366369 26793 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:43.416953 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 396044us
I20260709 13:07:43.422734 22218 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:43.423988 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.424618 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.401634 26989 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:43.401221 26939 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:43.445950 27012 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:43.434587 26939 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.453191 26939 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:43.455499 26793 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:43.427002 26985 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:43.465508 22247 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:43.417870 27103 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.479283 22247 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:07:43.428182 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 399513us
I20260709 13:07:43.401208 26981 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:43.353456 26997 consensus_queue.cc:1059] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:07:43.492190 22250 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:43.434346 26989 raft_consensus.cc:697] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:43.495644 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 485725us
W20260709 13:07:43.504509 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.441076 27016 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:07:43.506829 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 488188us
I20260709 13:07:43.513715 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:43.503890 22072 leader_election.cc:336] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.718s (SENT)
I20260709 13:07:43.516203 22177 raft_consensus.cc:1240] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:43.517407 22147 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:43.514617 22072 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:43.518944 22220 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:43.536170 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:43.536247 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:43.541649 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:43.534709 26362 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:07:43.512267 26939 consensus_queue.cc:1059] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:07:43.548231 26983 raft_consensus.cc:3055] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:43.548622 26983 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:43.549414 26983 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.550627 26983 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:43.542850 27133 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:43.427450 27043 consensus_queue.cc:260] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.554700 26793 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:43.555167 26985 consensus_queue.cc:1059] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:43.556354 27102 raft_consensus.cc:3055] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:43.556800 27102 raft_consensus.cc:740] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:43.557660 27102 consensus_queue.cc:260] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.559712 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:43.560302 22101 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:43.562834 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:43.564728 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:43.567090 22144 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:43.567818 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 63956.8us
I20260709 13:07:43.569619 22255 raft_consensus.cc:1275] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:43.496819 26981 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.578110 26600 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:43.579021 27055 consensus_meta.cc:287] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.581s	user 0.007s	sys 0.003s
W20260709 13:07:43.566737 27027 consensus_meta.cc:287] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.837s	user 0.014s	sys 0.004s
I20260709 13:07:43.594298 22116 tablet_copy_service.cc:140] P c0694f6572bf406a92d55f1f2ab46ef2: Received BeginTabletCopySession request for tablet 16e48ec055f940c49e01d5a5d77581aa from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:43368)
I20260709 13:07:43.539157 27014 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:43.595021 22116 tablet_copy_service.cc:161] P c0694f6572bf406a92d55f1f2ab46ef2: Beginning new tablet copy session on tablet 16e48ec055f940c49e01d5a5d77581aa from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:43368: session id = a07ca3d1b5b84f4bbcb907f709a69275-16e48ec055f940c49e01d5a5d77581aa
W20260709 13:07:43.595412 27123 log.cc:927] Time spent T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:07:43.595710 22104 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:43.596155 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:43.538961 26791 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:43.599601 26791 raft_consensus.cc:697] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:43.594328 27055 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.600610 26791 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.602505 27055 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:43.538812 26891 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:07:43.604595 26981 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:43.606051 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:43.606732 22252 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:43.519722 27016 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.607445 27103 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:43.608665 27016 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:43.610882 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:43.614336 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:43.593050 26696 consensus_queue.cc:1059] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:43.615327 26696 consensus_queue.cc:1243] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:43.604389 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:43.599018 22251 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:43.601225 22180 raft_consensus.cc:1240] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:43.615410 27052 raft_consensus.cc:3055] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:43.616696 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:43.588762 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:43.617803 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:43.622383 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:43.623019 22247 raft_consensus.cc:1275] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:43.624379 22175 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:43.625759 22098 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:43.626503 22247 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:43.630430 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.634238 22072 leader_election.cc:336] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.877s (SENT)
I20260709 13:07:43.647157 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:43.661849 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:43.662853 22098 raft_consensus.cc:2376] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12. Re-sending same reply.
I20260709 13:07:43.666975 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:43.636520 22072 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:43.656248 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:43.572070 26939 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.685727 26793 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:07:43.689966 26939 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.691741 26600 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:43.692384 26939 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:43.671253 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:43.693778 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:43.632932 26891 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:43.694866 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:43.695679 22102 raft_consensus.cc:2410] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:43.694523 26891 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.696557 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:43.697559 26891 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:43.697984 22106 raft_consensus.cc:1275] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:07:43.700192 27029 consensus_meta.cc:287] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.006s
I20260709 13:07:43.701711 27063 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.702280 27063 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.704257 26743 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.705606 26743 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:43.697577 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:43.708214 27129 consensus_queue.cc:1048] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:43.707965 27029 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:43.709879 27029 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.575213 26976 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:43.615947 26696 raft_consensus.cc:3055] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:43.595345 27014 raft_consensus.cc:697] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:43.590992 27122 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:43.680060 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 46167.4us
I20260709 13:07:43.628152 27052 raft_consensus.cc:740] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:43.674487 27034 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:43.632766 27016 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:43.751353 22250 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:43.720579 22252 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:43.632246 27127 consensus_queue.cc:1059] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:07:43.748633 22173 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 LEADER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:43.726711 26696 raft_consensus.cc:740] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:43.821748 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:43.822368 22813 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:43.674127 26709 consensus_queue.cc:1048] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:07:43.671878 27132 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 13:07:43.748368 26840 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:43.678941 26989 consensus_queue.cc:237] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.730662 26950 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.819762 22102 raft_consensus.cc:1275] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:07:43.817757 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.750882 27016 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:43.830466 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:43.833575 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:43.776664 26679 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:43.839666 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:43.841557 22098 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:07:43.842886 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 208797us
I20260709 13:07:43.825740 26976 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:43.855885 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:43.856698 22815 raft_consensus.cc:2393] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 16: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
W20260709 13:07:43.845633 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.860466 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.860788 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.831212 27029 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:43.837888 27016 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:43.863629 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:43.838294 27007 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:43.854398 27039 consensus_meta.cc:287] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.893s	user 0.017s	sys 0.001s
I20260709 13:07:43.873999 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:43.875377 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:43.876530 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:43.877172 22098 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
I20260709 13:07:43.877996 22172 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 16.
I20260709 13:07:43.879140 22098 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:07:43.879444 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 193650us
I20260709 13:07:43.881369 22098 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:43.831506 26840 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:43.887820 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 253613us
W20260709 13:07:43.890007 22072 leader_election.cc:336] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.914s (SENT)
I20260709 13:07:43.844213 26679 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.890908 22072 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:43.838126 26950 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.901010 26950 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:43.901503 22813 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:07:43.889209 26939 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:43.902130 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:43.891902 22221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.902601 26939 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.890558 26998 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.903748 26998 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.904779 26939 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:43.878764 27007 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:43.888530 26980 consensus_meta.cc:287] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.786s	user 0.008s	sys 0.009s
I20260709 13:07:43.907298 22100 raft_consensus.cc:2410] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:07:43.908413 27136 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.909075 27136 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.912408 22246 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 16.
I20260709 13:07:43.913750 27136 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:43.868908 26696 consensus_queue.cc:260] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.881004 27081 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:43.897156 27137 log.cc:927] Time spent T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:43.844283 27014 consensus_queue.cc:237] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.871615 27138 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:43.932993 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 50293us
I20260709 13:07:43.841576 27052 consensus_queue.cc:260] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:43.931192 27149 consensus_queue.cc:1059] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:07:43.939571 27052 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.940145 27149 raft_consensus.cc:3055] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:43.940538 27149 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:43.940564 26679 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:43.941561 27149 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.943106 27149 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:43.947940 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 57972.7us
I20260709 13:07:43.931370 27027 consensus_queue.cc:1059] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:07:43.937733 27127 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:43.973336 27016 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.974563 22178 raft_consensus.cc:1240] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:43.974886 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 971) took 1011 ms. Trace:
I20260709 13:07:43.975358 22249 rpcz_store.cc:276] 0709 13:07:42.963129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.963301 (+   172us) service_pool.cc:224] Handling call
0709 13:07:42.963663 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:42.964026 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:42.964349 (+   323us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.585468 (+621119us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.954148 (+368680us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b2c000ad588. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a6847a11 00007f66a6857372 00007f66a7f89a01 00007f66a7f4e43a 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2
0709 13:07:43.954539 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 13:07:43.954689 (+   150us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:43.954727 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.954795 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:43.974540 (+ 19745us) raft_consensus.cc:1685] finished
0709 13:07:43.974651 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.974819 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21833,"prepare.queue_time_us":731,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":23251,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":1558,"spinlock_wait_cycles":4355200,"thread_start_us":598623,"threads_started":2,"wal-append.queue_time_us":466013}
I20260709 13:07:43.977659 27016 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:43.949771 27138 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:43.981787 27138 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:43.990283 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 125354us
W20260709 13:07:43.948516 22072 connection.cc:256] RPC call timeout handler was delayed by -1.7136319520000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 13:07:43.996236 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 106667us
I20260709 13:07:43.953207 26840 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:44.001040 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:44.001328 22218 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:44.002053 22144 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:44.003963 22144 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:44.004413 22218 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:43.934315 27081 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:44.006788 22072 connection.cc:256] RPC call timeout handler was delayed by -1.3354893560000392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
W20260709 13:07:44.010294 22072 connection.cc:256] RPC call timeout handler was delayed by -1.1808319520000623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2235s for a response
W20260709 13:07:44.010668 22072 connection.cc:256] RPC call timeout handler was delayed by -1.0386319520000598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23929999999999998s for a response
W20260709 13:07:44.011086 22072 connection.cc:256] RPC call timeout handler was delayed by -1.010923000000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
I20260709 13:07:44.012678 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:44.008394 26840 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.008569 27129 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:44.011801 27111 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:44.008798 27147 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:44.059052 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.020527 26791 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:07:44.011610 27029 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:07:44.013177 27112 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
W20260709 13:07:44.072402 22104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 2158) took 1251 ms (client timeout 1520 ms). Trace:
W20260709 13:07:44.072842 22104 rpcz_store.cc:269] 0709 13:07:42.820904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.823506 (+  2602us) service_pool.cc:224] Handling call
0709 13:07:44.072197 (+1248691us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b540001f754. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:44.072308 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559836544}
I20260709 13:07:44.030592 27111 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:44.017215 27055 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 13:07:44.081980 27150 log.cc:927] Time spent T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:44.082286 27111 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:44.091898 27127 raft_consensus.cc:3055] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:07:44.094635 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.092440 27127 raft_consensus.cc:740] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:44.074579 27129 raft_consensus.cc:697] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:44.131407 27012 raft_consensus.cc:3055] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:44.131896 27012 raft_consensus.cc:740] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:44.132800 27012 consensus_queue.cc:260] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:44.143427 27129 consensus_queue.cc:237] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:44.145366 22072 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:44.146203 27009 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.147897 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:44.134600 27012 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.153429 22072 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:44.162832 27154 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:44.164484 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:44.152536 27009 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:44.156935 27063 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:44.176282 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:44.188095 26679 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.188714 26679 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:44.191331 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:44.193567 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:44.195389 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:44.204432 22808 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:07:44.209573 22255 raft_consensus.cc:1240] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:44.198890 27112 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.214325 27112 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:44.216508 27112 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:44.221918 27102 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:44.225208 22172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 2713) took 2516 ms (client timeout 1969 ms). Trace:
I20260709 13:07:44.225402 26976 consensus_queue.cc:1059] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:07:44.225751 22172 rpcz_store.cc:269] 0709 13:07:41.709087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.718461 (+  9374us) service_pool.cc:224] Handling call
0709 13:07:44.224966 (+2506505us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b5400328cd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:44.225107 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4733838080}
I20260709 13:07:44.226737 26976 raft_consensus.cc:3055] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:44.227216 26976 raft_consensus.cc:740] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:44.228253 26976 consensus_queue.cc:260] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:44.228956 27062 consensus_queue.cc:1059] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:44.229915 26976 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:44.230064 27062 raft_consensus.cc:3055] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:44.230562 27062 raft_consensus.cc:740] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:44.230703 26997 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.231384 26997 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:44.231432 27062 consensus_queue.cc:260] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:44.232841 27062 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.233985 26997 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:44.235535 22179 raft_consensus.cc:1275] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:44.155853 27127 consensus_queue.cc:260] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:44.237010 27127 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:44.237709 26998 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:44.227231 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:44.241948 27009 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:07:44.243904 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.244614 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.252017 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:44.252764 22251 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:44.254179 22782 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:44.258750 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 105375us
I20260709 13:07:44.261044 22103 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 8.
I20260709 13:07:44.263190 26927 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:44.263820 26927 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.264312 26927 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.266269 26998 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:44.267174 26998 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:44.270290 26998 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:44.190840 26679 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:44.273082 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:44.286405 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:44.261435 27112 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:44.294366 22072 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:44.298025 22072 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:44.300364 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:44.323611 22072 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:44.325722 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:44.327036 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:44.301875 27009 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.334821 22100 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 16.
I20260709 13:07:44.336112 22809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47484
I20260709 13:07:44.347389 22809 raft_consensus.cc:606] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:44.348292 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:44.339761 22072 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:44.321419 27154 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:44.353533 27032 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:44.354210 27032 raft_consensus.cc:697] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:44.355190 27032 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:44.354590 22177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:07:44.356786 22177 raft_consensus.cc:606] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:44.358850 27129 raft_consensus.cc:993] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3: : Instructing follower c0694f6572bf406a92d55f1f2ab46ef2 to start an election
I20260709 13:07:44.359023 27009 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:44.359419 27129 raft_consensus.cc:1081] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Signalling peer c0694f6572bf406a92d55f1f2ab46ef2 to start an election
I20260709 13:07:44.300335 27112 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:44.364368 22072 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:44.350605 27127 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:44.367666 22072 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:44.371089 27009 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:44.371408 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:44.372004 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:44.372637 27112 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:44.372792 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:44.373387 22177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:07:44.373525 22251 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:44.373939 22177 raft_consensus.cc:606] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:44.374740 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.375727 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.376569 27138 consensus_queue.cc:1175] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "765d912bde9e48959e50d9efec3c26b6" responder_term: 10 status { last_received { term: 10 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 10 index: 7 } }
W20260709 13:07:44.377223 22246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45738 (request call id 974) took 1300 ms (client timeout 1601 ms). Trace:
W20260709 13:07:44.377656 22246 rpcz_store.cc:269] 0709 13:07:43.076351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.076461 (+   110us) service_pool.cc:224] Handling call
0709 13:07:44.377023 (+1300562us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b54002cb0d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:44.377148 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920160512}
I20260709 13:07:44.380482 22782 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:44.381669 26679 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:44.382077 26679 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.382411 26679 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.391206 22177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:07:44.392002 22177 raft_consensus.cc:606] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:44.393793 22218 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:44.357563 27111 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:44.395375 26985 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:44.397019 27111 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:44.397228 22102 raft_consensus.cc:1275] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:44.404722 27007 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:44.405223 26793 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:44.406348 22811 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:44.407044 22811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 712) took 1226 ms. Trace:
I20260709 13:07:44.407346 22811 rpcz_store.cc:276] 0709 13:07:43.181136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.277407 (+ 96271us) service_pool.cc:224] Handling call
0709 13:07:44.405785 (+1128378us) spinlock_profiling.cc:243] Waited 60.1 ms on lock 0x7b58000e3498. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e29a22 00007f66add42c09 00007f66ace9cee0 00007f66acf660ab 00007f66acf66131 00007f66acf27fc0 00007f66acf12929 00007f66acf123d2 00007f66a6489bd4
0709 13:07:44.405991 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.406757 (+   766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.406976 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138147200}
I20260709 13:07:44.425232 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:44.429183 22246 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 13:07:44.436957 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.455212 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:44.457281 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:07:44.462368 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:44.414242 26679 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:44.481220 26679 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 17 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:44.482844 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:44.483191 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:44.483484 22246 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.472110 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:44.488268 22253 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:44.488332 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:44.473640 22781 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:44.489387 22175 raft_consensus.cc:2468] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 16.
I20260709 13:07:44.476508 26793 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:44.490671 22178 raft_consensus.cc:1240] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:44.475805 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:44.491230 22173 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:44.478816 27111 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:07:44.493846 22071 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:44.390744 26927 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:44.497671 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:44.466241 27164 log.cc:927] Time spent T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.079s	user 0.009s	sys 0.009s
I20260709 13:07:44.499218 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:44.502231 22071 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:44.509863 22246 raft_consensus.cc:2468] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 17.
I20260709 13:07:44.510748 22813 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 12: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:44.511549 22782 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:44.521973 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:44.522404 22179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 2258) took 1025 ms. Trace:
I20260709 13:07:44.522686 22105 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 15.
I20260709 13:07:44.522951 22179 rpcz_store.cc:276] 0709 13:07:43.497318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.497893 (+   575us) service_pool.cc:224] Handling call
0709 13:07:44.235190 (+737297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.235962 (+   772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.518068 (+282106us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b5400328cd0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:44.522323 (+  4255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630594816}
I20260709 13:07:44.523816 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:44.496445 26793 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:44.509176 26980 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:44.535792 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:44.496927 27154 raft_consensus.cc:2764] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:07:44.543295 26793 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:44.546406 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:44.497213 27149 consensus_queue.cc:1059] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 13:07:44.568966 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.569139 22180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 2260) took 1053 ms. Trace:
I20260709 13:07:44.569777 22105 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:44.569495 22180 rpcz_store.cc:276] 0709 13:07:43.515490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.516560 (+  1070us) service_pool.cc:224] Handling call
0709 13:07:43.535543 (+ 18983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.616797 (+ 81254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.564711 (+947914us) spinlock_profiling.cc:243] Waited 65.5 ms on lock 0x7b540045f1d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:44.569065 (+  4354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150600960}
I20260709 13:07:44.544981 26709 raft_consensus.cc:2804] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:44.541080 26980 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:44.535163 27062 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:44.573956 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.571203 26998 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.576189 27155 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.576710 27155 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:44.579046 26980 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:44.576236 26998 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:44.581342 26980 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:44.582579 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:44.584524 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:44.585160 22246 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:44.581651 26998 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:44.586339 27155 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:44.588029 22779 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:44.589277 22779 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:44.590310 22779 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:44.593956 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:44.597086 27175 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:44.598227 27175 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:44.599172 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:44.604981 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 131406us
I20260709 13:07:44.617578 26927 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:44.591509 26709 raft_consensus.cc:697] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:44.620388 26709 consensus_queue.cc:237] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:44.628242 27128 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:44.630206 27128 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:44.632582 27043 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:44.638111 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 126685us
I20260709 13:07:44.700809 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:44.747433 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.762372 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:44.763273 22246 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.603830 26679 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:44.767051 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.794214 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.802122 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.759508 27145 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.630856 27128 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:44.861377 27128 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:44.796382 27102 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.877578 27102 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:44.881315 27102 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:44.883828 26980 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.884558 26980 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:44.885552 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:44.888671 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:44.909389 22253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 2360) took 1347 ms. Trace:
I20260709 13:07:44.903065 22255 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:44.910130 22253 rpcz_store.cc:276] 0709 13:07:43.562334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.562491 (+   157us) service_pool.cc:224] Handling call
0709 13:07:44.909205 (+1346714us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b540023b254. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:44.909329 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2083689856}
I20260709 13:07:44.889079 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:44.911218 22180 raft_consensus.cc:3060] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.914389 22246 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:44.923290 27176 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:07:44.890027 27145 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:44.886869 26980 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:44.925653 22181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57856 (request call id 719) took 1363 ms. Trace:
I20260709 13:07:44.944669 22181 rpcz_store.cc:276] 0709 13:07:43.551948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.562072 (+ 10124us) service_pool.cc:224] Handling call
0709 13:07:44.915419 (+1353347us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b540013d654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:44.915628 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1359959808}
I20260709 13:07:44.949951 22180 raft_consensus.cc:2468] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
W20260709 13:07:44.951248 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 323797us
I20260709 13:07:44.957577 22781 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:44.947427 22782 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:44.971038 22781 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:44.987633 22781 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:44.971230 27175 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:44.979117 27062 raft_consensus.cc:2804] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:44.982215 26974 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:45.013271 22099 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:45.021085 27081 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:45.021309 27145 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:45.014106 27062 raft_consensus.cc:697] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:45.033121 27062 consensus_queue.cc:237] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:45.037678 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:45.039143 22246 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 16.
I20260709 13:07:45.011471 27175 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:45.042388 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:45.043334 22246 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
I20260709 13:07:45.062330 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:45.079205 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:45.085232 27176 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:45.085844 27176 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:45.088153 27176 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:45.091368 22101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50288 (request call id 2168) took 1740 ms (client timeout 1850 ms). Trace:
W20260709 13:07:45.091857 22101 rpcz_store.cc:269] 0709 13:07:43.350724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.350986 (+   262us) service_pool.cc:224] Handling call
0709 13:07:45.091173 (+1740187us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400022454. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:45.091303 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440847232}
I20260709 13:07:45.093117 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:45.093791 22101 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:45.094208 22072 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:45.095801 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:45.096058 22101 raft_consensus.cc:1275] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:45.097157 22072 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:45.105202 22106 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:45.106119 22179 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:45.108385 22147 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:45.108616 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:45.109709 22255 raft_consensus.cc:2393] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 13: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:45.113283 22072 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:45.071519 27102 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.081360 27183 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.105183 27043 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:45.126622 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.126976 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:45.132165 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:45.107087 27145 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:45.123083 22101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:50288
I20260709 13:07:45.134126 22101 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:45.134542 22101 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.139671 22179 raft_consensus.cc:2393] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 12: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:45.119765 26980 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:45.116384 27034 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:45.125545 27127 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.102608 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:45.129765 27103 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:45.138036 27183 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:45.184684 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:45.153156 26980 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:45.129338 27102 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:45.178586 27034 raft_consensus.cc:697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:45.160526 22101 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:45.178750 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 76272.8us
I20260709 13:07:45.147444 27112 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:45.190446 22102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.006s	sys 0.011s
W20260709 13:07:45.201299 22102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.007s	sys 0.011s
I20260709 13:07:45.201758 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:45.191913 27039 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:45.178146 27145 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:07:45.193562 26980 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:45.220304 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:45.186545 27103 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:45.223469 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:45.224804 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:45.227239 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 228763us
I20260709 13:07:45.246402 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:45.200774 27081 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:45.230105 22101 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:45.232940 22116 tablet_copy_source_session.cc:215] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:45.235982 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:45.247092 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.252486 22181 raft_consensus.cc:3055] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:45.271782 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:45.272745 22177 raft_consensus.cc:3055] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:45.273128 22177 raft_consensus.cc:740] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:45.314288 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:45.315631 22103 raft_consensus.cc:2410] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 18 because replica has last-logged OpId of term: 16 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:07:45.253113 22181 raft_consensus.cc:740] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:45.335481 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:45.336287 22103 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:45.337224 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:45.337796 22103 raft_consensus.cc:2376] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13. Re-sending same reply.
I20260709 13:07:45.217015 27132 consensus_queue.cc:1048] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:07:45.235998 27039 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:45.358628 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.311568 22177 consensus_queue.cc:260] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:45.379010 22779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.136s	sys 0.231s
W20260709 13:07:45.379601 22779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.136s	sys 0.231s
W20260709 13:07:45.380290 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 789963us
I20260709 13:07:45.210680 27112 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:45.341677 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:45.382308 22779 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:45.419164 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:45.425536 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:45.383526 22181 consensus_queue.cc:260] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:45.426730 22181 raft_consensus.cc:3060] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:45.449394 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 329606us
I20260709 13:07:45.387447 27039 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:45.476673 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:45.477005 22176 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:45.477787 22103 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:45.481853 26927 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:45.483759 26696 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.484475 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2190) took 1229 ms. Trace:
I20260709 13:07:45.484869 22102 rpcz_store.cc:276] 0709 13:07:44.254975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.417503 (+162528us) service_pool.cc:224] Handling call
0709 13:07:44.438300 (+ 20797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.438751 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.438790 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.439335 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.226820 (+787485us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:45.226861 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.226948 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.484271 (+257323us) raft_consensus.cc:1685] finished
0709 13:07:45.484289 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.484421 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5709,"thread_start_us":787031,"threads_started":1,"wal-append.queue_time_us":924161}
I20260709 13:07:45.328200 27081 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:45.475001 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2193) took 1219 ms. Trace:
I20260709 13:07:45.497989 22105 rpcz_store.cc:276] 0709 13:07:44.255658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.807309 (+551651us) service_pool.cc:224] Handling call
0709 13:07:44.852359 (+ 45050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.852618 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:44.881636 (+ 29018us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.362313 (+480677us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.362388 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:45.362448 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.474742 (+112294us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.474909 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28506,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":43,"thread_start_us":480220,"threads_started":1}
I20260709 13:07:45.503473 27138 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:45.505108 27103 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:45.362754 27034 consensus_queue.cc:237] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:45.553712 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2192) took 1298 ms. Trace:
W20260709 13:07:45.563930 22218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.554679 22104 rpcz_store.cc:276] 0709 13:07:44.255454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.578671 (+323217us) service_pool.cc:224] Handling call
0709 13:07:44.590263 (+ 11592us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:44.601698 (+ 11435us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:44.623236 (+ 21538us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.107105 (+483869us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.107318 (+   213us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:45.143932 (+ 36614us) log.cc:844] Serialized 52 byte log entry
0709 13:07:45.144124 (+   192us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:45.144388 (+   264us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.144759 (+   371us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.550739 (+405980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.550825 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.553339 (+  2514us) raft_consensus.cc:1685] finished
0709 13:07:45.553368 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.553631 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21926,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":76806,"raft.run_cpu_time_us":481,"raft.run_wall_time_us":14961,"spinlock_wait_cycles":32022144,"thread_start_us":888573,"threads_started":2,"wal-append.queue_time_us":604146}
I20260709 13:07:45.552959 27102 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:45.553740 22116 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:43368 (request call id 759) took 1969 ms. Trace:
I20260709 13:07:45.608315 22104 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:07:45.634770 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2199) took 1061 ms. Trace:
I20260709 13:07:45.635247 22104 rpcz_store.cc:276] 0709 13:07:44.573057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.589463 (+1016406us) service_pool.cc:224] Handling call
0709 13:07:45.589856 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.634411 (+ 44555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.634676 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:45.637181 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2200) took 1035 ms. Trace:
I20260709 13:07:45.637578 22104 rpcz_store.cc:276] 0709 13:07:44.601762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.636194 (+1034432us) service_pool.cc:224] Handling call
0709 13:07:45.636569 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.636800 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.636829 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.636886 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:45.636929 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.636997 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.637119 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:45.609423 22100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2181) took 1356 ms. Trace:
I20260709 13:07:45.580205 27103 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:45.558538 27183 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:45.618388 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.620301 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 147348us
I20260709 13:07:45.547791 27138 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:45.649137 22098 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:45.611919 27152 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:45.662683 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:45.663213 27102 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:45.663409 22813 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 14.
I20260709 13:07:45.663791 27102 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:45.665488 22072 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:45.665903 27102 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:45.666754 22072 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:45.652683 27103 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:45.667263 27190 log.cc:927] Time spent T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:07:45.667877 22072 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:45.668748 22072 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:45.670022 27009 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.670543 27195 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:45.673878 27195 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.674255 27195 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:45.668992 27103 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:45.675860 27039 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:45.678076 27039 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:45.679934 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:45.680761 22255 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.681742 27176 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.682291 27176 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:45.683300 27007 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:45.684098 27007 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:45.684619 27176 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:45.688372 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2746) took 1200 ms. Trace:
I20260709 13:07:45.688900 22174 rpcz_store.cc:276] 0709 13:07:44.488270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.488398 (+   128us) service_pool.cc:224] Handling call
0709 13:07:44.488638 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.527111 (+ 38473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.527155 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.527221 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:44.527265 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.688064 (+1160799us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b5400176bd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:45.688135 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.688304 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87879552}
I20260709 13:07:45.697413 27200 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:45.698283 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2187) took 1444 ms. Trace:
I20260709 13:07:45.698203 27200 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:45.698866 22099 rpcz_store.cc:276] 0709 13:07:44.254227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.411729 (+157502us) service_pool.cc:224] Handling call
0709 13:07:44.412057 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.013757 (+601700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.697968 (+684211us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b540040fbd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:45.698193 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1378943232}
I20260709 13:07:45.701099 27200 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:45.714746 22218 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:45.706382 27007 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:45.729118 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 344931us
W20260709 13:07:45.702095 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 228700us
I20260709 13:07:45.707242 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:45.734551 22255 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
W20260709 13:07:45.669287 27188 log.cc:927] Time spent T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:07:45.710953 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:45.737488 22251 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
I20260709 13:07:45.633924 22116 rpcz_store.cc:276] 0709 13:07:43.593784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.594009 (+   225us) service_pool.cc:224] Handling call
0709 13:07:45.232418 (+1638409us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54003ff2d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f583f7 00007f66aceee036 00007f66acef7a3e 00007f66a47bb27b 00007f66acef79ba 00007f66acef2acc 00007f66aceedc7b 00007f66acee28d1 00007f66abf964b4 00007f66abf96442
0709 13:07:45.546527 (+314109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512099584}
I20260709 13:07:45.740661 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:45.741803 22811 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
I20260709 13:07:45.740952 22218 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:45.739153 22072 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:45.749063 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:45.749382 22181 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:45.720829 26802 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.752283 22072 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:45.725232 27010 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:45.724839 27111 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:45.725386 26975 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:07:45.757036 22071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.735580 27112 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:45.736011 27081 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:45.789150 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 48266.6us
I20260709 13:07:45.790283 22218 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:45.750933 27186 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:45.798060 27203 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:07:45.788098 27111 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:45.799353 27111 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:45.800485 27196 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:45.798244 27186 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:45.804785 27186 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:45.823339 27207 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:45.824061 27207 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.824486 27207 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:45.827172 27194 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:45.827750 27194 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:45.828200 27194 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:45.641841 22100 rpcz_store.cc:276] 0709 13:07:44.252599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.347885 (+ 95286us) service_pool.cc:224] Handling call
0709 13:07:44.348268 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.348519 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:44.363058 (+ 14539us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.184692 (+821634us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b18002fc320. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee23a 00007f66a7f58a2a
0709 13:07:45.607617 (+422925us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.607709 (+    92us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:45.607761 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.609136 (+  1375us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.609333 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9513,"prepare.queue_time_us":14355,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":23427,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":20539,"spinlock_wait_cycles":8167808,"thread_start_us":399206,"threads_started":1}
I20260709 13:07:45.832664 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:45.829536 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2179) took 1578 ms. Trace:
I20260709 13:07:45.829291 27111 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:45.834694 22098 rpcz_store.cc:276] 0709 13:07:44.251364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.251489 (+   125us) service_pool.cc:224] Handling call
0709 13:07:44.251760 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.651336 (+1399576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.829216 (+177880us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54002b8754. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:45.829452 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3212379008}
I20260709 13:07:45.837662 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:45.843274 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:45.844125 22098 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:45.845336 27111 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:45.845640 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:45.847481 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:45.875058 22176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51118 (request call id 2744) took 1387 ms. Trace:
I20260709 13:07:45.875728 22176 rpcz_store.cc:276] 0709 13:07:44.487574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.493166 (+  5592us) service_pool.cc:224] Handling call
0709 13:07:44.493398 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.491881 (+998483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.874691 (+382810us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b54001766d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:45.874967 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2251514624}
I20260709 13:07:45.788863 27126 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:45.878404 27126 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:45.791661 27010 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:45.889060 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 136829us
I20260709 13:07:45.896857 22779 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:45.903899 22251 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:45.907826 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:45.752928 27191 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:45.908180 22779 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:45.909566 22255 raft_consensus.cc:1275] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:45.912503 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:45.788573 27149 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:45.781695 27184 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:45.914702 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 77485.7us
I20260709 13:07:45.916460 22779 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:45.917629 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:45.919116 22247 raft_consensus.cc:1240] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:45.924944 22254 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:45.906520 26985 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:45.899521 27126 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:45.908833 26939 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:45.906260 27112 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.894171 22218 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:45.907065 27192 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:45.932404 22254 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:07:45.910791 27111 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:45.935503 22252 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:45.931854 22218 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:45.936218 22812 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:07:45.936724 22812 pending_rounds.cc:85] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Aborting all ops after (but not including) 10
I20260709 13:07:45.937016 22812 pending_rounds.cc:107] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:07:45.937320 22812 raft_consensus.cc:2889] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:45.938117 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.914158 27201 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:45.939406 27138 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:45.939822 27111 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:45.940472 27195 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:45.911098 26974 consensus_queue.cc:1048] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:07:45.911337 26998 consensus_queue.cc:1048] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:07:45.943353 27192 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:45.793128 26975 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:45.946125 26975 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:45.946192 27192 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:45.947144 27205 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.933243 26985 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:45.947671 27205 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:45.949045 27152 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:45.949648 26985 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:45.949597 27152 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:45.951646 27043 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.950060 27205 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:45.952234 22098 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:45.923547 27203 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:45.958422 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:45.959328 22173 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
W20260709 13:07:45.960269 22147 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.540s (SENT) [suppressed 6 similar messages]
I20260709 13:07:45.960954 22175 raft_consensus.cc:1240] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:45.946657 27112 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:45.955799 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:45.964326 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:45.964717 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 774) took 1479 ms. Trace:
I20260709 13:07:45.930475 27189 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.942591 27111 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:45.971738 22071 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:45.978060 22097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 772) took 1539 ms. Trace:
I20260709 13:07:45.980072 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:45.975037 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:45.939244 27201 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.982784 22069 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:45.987833 22254 raft_consensus.cc:1240] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:45.981690 22811 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:45.933928 26939 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.987589 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:45.966516 22105 rpcz_store.cc:276] 0709 13:07:44.485425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.511893 (+1026468us) service_pool.cc:224] Handling call
0709 13:07:45.512279 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.512678 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.512715 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.521596 (+  8881us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.724111 (+202515us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:45.928816 (+204705us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.964395 (+ 35579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.964474 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.964518 (+    44us) raft_consensus.cc:1685] finished
0709 13:07:45.964531 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.964662 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34718,"prepare.queue_time_us":112209,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":8231,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":5281,"thread_start_us":406494,"threads_started":2,"wal-append.queue_time_us":263933}
I20260709 13:07:45.995175 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:45.952661 26560 consensus_queue.cc:1048] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
W20260709 13:07:45.964888 26980 consensus_meta.cc:287] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.654s	user 0.007s	sys 0.006s
I20260709 13:07:46.000007 26980 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.001571 22099 raft_consensus.cc:1240] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:45.996122 22105 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 14.
I20260709 13:07:46.004570 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:46.010777 22252 raft_consensus.cc:1275] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:46.011994 22811 raft_consensus.cc:2468] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
I20260709 13:07:46.013103 22814 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 14. Current term is 15. Ops: [13.9-14.10]
I20260709 13:07:46.014022 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:45.961740 27149 raft_consensus.cc:697] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:45.976792 27103 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:46.016067 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:45.978415 27192 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:45.981109 27183 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:45.980513 26696 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:46.002349 26939 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:45.787892 26802 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.049216 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2197) took 1636 ms. Trace:
I20260709 13:07:46.049772 22102 rpcz_store.cc:276] 0709 13:07:44.412625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.486595 (+1073970us) service_pool.cc:224] Handling call
0709 13:07:45.492836 (+  6241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.493054 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.493091 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.506376 (+ 13285us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.723711 (+217335us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:45.723757 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.723835 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.048901 (+325066us) raft_consensus.cc:1685] finished
0709 13:07:46.048930 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.049123 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":174675,"threads_started":1,"wal-append.queue_time_us":395758}
I20260709 13:07:46.047544 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:46.002038 26975 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:46.056018 22102 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:45.918503 27191 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:45.965022 27043 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.063233 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2206) took 1068 ms. Trace:
I20260709 13:07:46.073293 22102 rpcz_store.cc:276] 0709 13:07:44.995103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.051479 (+1056376us) service_pool.cc:224] Handling call
0709 13:07:46.051891 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.062880 (+ 10989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.063168 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:46.063676 22246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.039s	sys 0.086s
W20260709 13:07:46.056565 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 96350.4us
I20260709 13:07:46.003943 27201 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:46.027433 27204 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:46.083043 22248 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:46.083796 27010 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:46.084116 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:46.086144 26802 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:45.928957 27184 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.016276 26985 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:46.008893 26983 consensus_queue.cc:1059] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:07:46.027758 27102 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:46.030611 27212 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.089097 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.033908 27111 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:46.087407 22246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.039s	sys 0.086s
I20260709 13:07:46.094014 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.044214 27103 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:46.062624 26975 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:46.107242 22809 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:46.109977 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:46.119716 22811 raft_consensus.cc:2393] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 13: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:46.092828 27203 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.055186 27192 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.065653 26696 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.098306 27195 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 17 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:46.126084 22815 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:46.137430 22101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2205) took 1144 ms. Trace:
I20260709 13:07:46.156100 22101 rpcz_store.cc:276] 0709 13:07:44.993043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.872670 (+879627us) service_pool.cc:224] Handling call
0709 13:07:45.873087 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.923672 (+ 50585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.923722 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.923789 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:45.923842 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.137209 (+213367us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b54000b8954. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:46.137255 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.137372 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115722112}
I20260709 13:07:46.138406 22099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2203) took 1165 ms. Trace:
I20260709 13:07:46.157886 22099 rpcz_store.cc:276] 0709 13:07:44.973446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.700091 (+726645us) service_pool.cc:224] Handling call
0709 13:07:45.700483 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.002150 (+301667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.138181 (+136031us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b540009e2d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:46.138349 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691749248}
I20260709 13:07:46.096930 26802 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:46.157217 22218 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:46.120253 26975 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.114912 27103 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:46.189653 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:46.194993 22815 raft_consensus.cc:2393] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 13: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:46.122579 27200 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:46.196628 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.195574 22248 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:46.099314 27207 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.099607 26985 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.111259 27102 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.179214 26802 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.198010 27029 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:07:46.215875 27214 log.cc:927] Time spent T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:07:46.115954 27212 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.228176 22103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2196) took 1820 ms. Trace:
W20260709 13:07:46.229185 27221 log.cc:927] Time spent T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:07:46.229588 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:46.230489 27218 log.cc:927] Time spent T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:07:46.119069 27111 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:46.220556 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 112346us
I20260709 13:07:46.222055 27029 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.230376 22249 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:46.231899 27226 consensus_queue.cc:1048] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:46.232887 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:46.233420 27226 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:46.231487 27216 log.cc:927] Time spent T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:46.233875 27226 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:46.234505 22220 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:46.234606 27226 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:46.235328 26980 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:46.235854 22220 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:46.213745 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:46.149992 27203 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.239547 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:46.228621 22103 rpcz_store.cc:276] 0709 13:07:44.408171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.492010 (+1083839us) service_pool.cc:224] Handling call
0709 13:07:45.492541 (+   531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.523191 (+ 30650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.523330 (+   139us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.529008 (+  5678us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.787119 (+258111us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:45.787167 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.787260 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.227958 (+440698us) raft_consensus.cc:1685] finished
0709 13:07:46.227980 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.228119 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34715,"raft.queue_time_us":60561,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":4456,"thread_start_us":179713,"threads_started":1,"wal-append.queue_time_us":354232}
I20260709 13:07:46.243151 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:46.244318 22104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2201) took 1277 ms. Trace:
I20260709 13:07:46.244818 22104 rpcz_store.cc:276] 0709 13:07:44.967385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.638703 (+671318us) service_pool.cc:224] Handling call
0709 13:07:45.645925 (+  7222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.650509 (+  4584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.650540 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.653152 (+  2612us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.833792 (+180640us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b180043ed60. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e43e07 00007f66adc9eab9 00007f66a4e6069b 00007f66a4e5e93f 00007f66a4e60c02 00007f66a7ae820b 00007f66a7aedd23 00007f66a7aee0d1 00007f66a7f09a0f
0709 13:07:45.972039 (+138247us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:45.972081 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.972156 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.237855 (+265699us) raft_consensus.cc:1685] finished
0709 13:07:46.237875 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.244256 (+  6381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":821,"raft.queue_time_us":8558,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2359,"spinlock_wait_cycles":4547840,"thread_start_us":138050,"threads_started":1,"wal-append.queue_time_us":393357}
I20260709 13:07:46.248844 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:46.253077 22144 consensus_peers.cc:597] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16e48ec055f940c49e01d5a5d77581aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:46.162572 27149 consensus_queue.cc:237] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.261514 27154 raft_consensus.cc:3055] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:46.266587 22779 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:46.246093 27152 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:46.269239 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 112161us
I20260709 13:07:46.275182 27234 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:46.275900 27234 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:46.267992 27154 raft_consensus.cc:740] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:46.262991 27055 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:46.272130 27189 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:46.269649 27048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16e48ec055f940c49e01d5a5d77581aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:46.287720 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.293432 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:46.265043 26793 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:07:46.265209 26460 consensus_queue.cc:1059] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:07:46.284493 27112 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:46.314584 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:46.325485 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:46.325729 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.316495 27200 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:46.317416 27208 log.cc:927] Time spent T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:07:46.318011 27229 log.cc:927] Time spent T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 13:07:46.318617 27220 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:07:46.319700 27192 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:46.322081 27111 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:46.269112 27232 consensus_queue.cc:1059] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:07:46.395809 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:46.431265 26985 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:46.432278 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:46.433522 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:46.434155 22255 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 17.
I20260709 13:07:46.434219 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:46.294344 27043 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:46.418570 27102 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:46.422035 27212 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:46.273401 27213 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:07:46.406776 26981 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:46.422255 26975 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.285455 27055 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.434908 22252 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:46.440920 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:46.443714 22177 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:46.446470 22105 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:46.447952 22249 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:46.466703 22249 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:46.468164 22246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 1009) took 1407 ms. Trace:
I20260709 13:07:46.468686 22246 rpcz_store.cc:276] 0709 13:07:45.061135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.061323 (+   188us) service_pool.cc:224] Handling call
0709 13:07:45.112125 (+ 50802us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:45.423890 (+311765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.423936 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:45.424686 (+   750us) log.cc:844] Serialized 52 byte log entry
0709 13:07:46.112067 (+687381us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:46.280833 (+168766us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.281026 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.281098 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.467916 (+186818us) raft_consensus.cc:1685] finished
0709 13:07:46.467942 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.468099 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4871,"prepare.queue_time_us":67391,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":1897,"raft.queue_time_us":510433,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":15133,"thread_start_us":1010655,"threads_started":3,"wal-append.queue_time_us":627651}
I20260709 13:07:46.442605 27195 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:46.471524 27195 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.445519 27027 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:46.475014 27027 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.410054 27154 consensus_queue.cc:260] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.477599 27027 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:46.441517 27029 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:46.446913 26983 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.479475 26983 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.481854 26983 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:46.441360 26981 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.436797 27183 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:46.484751 27183 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:46.486129 26981 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:46.487253 22104 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:46.490286 27191 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:45.980428 22097 rpcz_store.cc:276] 0709 13:07:44.438377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.502890 (+1064513us) service_pool.cc:224] Handling call
0709 13:07:45.503327 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.503585 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:45.722821 (+219236us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.977662 (+254841us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.977716 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:45.977758 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.977840 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.977990 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":332510,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":2220,"thread_start_us":457703,"threads_started":2}
I20260709 13:07:46.492786 27055 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:46.493700 27184 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:46.439268 27203 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:46.495227 27195 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:46.496417 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:46.496948 27111 raft_consensus.cc:3055] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:46.497339 27111 raft_consensus.cc:740] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:46.498306 26696 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:46.498463 27111 consensus_queue.cc:260] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.500015 27111 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.500370 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2182) took 2247 ms. Trace:
I20260709 13:07:46.500725 22106 rpcz_store.cc:276] 0709 13:07:44.252847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.350219 (+ 97372us) service_pool.cc:224] Handling call
0709 13:07:45.095661 (+745442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.105922 (+ 10261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.500142 (+1394220us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b5400022450. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:46.500286 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1713681664}
I20260709 13:07:46.501881 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:46.493713 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:46.503706 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:46.503537 26939 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.497328 22246 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:07:46.508517 22102 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:07:46.437789 27194 consensus_meta.cc:287] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.000s
I20260709 13:07:46.517865 27194 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.519098 22255 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:46.502445 22106 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:46.521463 22106 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:07:46.521763 22098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2204) took 1538 ms. Trace:
I20260709 13:07:46.522152 22098 rpcz_store.cc:276] 0709 13:07:44.983513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.848685 (+865172us) service_pool.cc:224] Handling call
0709 13:07:45.849060 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.956593 (+107533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.521549 (+564956us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540001e854. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:46.521707 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236823808}
I20260709 13:07:46.524766 27194 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:46.525197 22177 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
W20260709 13:07:46.527058 27222 log.cc:927] Time spent T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.314s	user 0.001s	sys 0.001s
W20260709 13:07:46.529420 27239 log.cc:927] Time spent T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:07:46.532444 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 2758) took 1263 ms. Trace:
W20260709 13:07:46.533784 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 243905us
I20260709 13:07:46.521796 22106 pending_rounds.cc:85] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting all ops after (but not including) 9
I20260709 13:07:46.535411 22106 pending_rounds.cc:107] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:07:46.535668 22106 raft_consensus.cc:2889] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:46.536610 22252 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 17.
I20260709 13:07:46.533155 22177 rpcz_store.cc:276] 0709 13:07:45.269512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.271392 (+  1880us) service_pool.cc:224] Handling call
0709 13:07:45.859570 (+588178us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b180003de00. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f89646 00007f66a7ec358e 00007f66a7f44f9e 00007f66a7f467de 00007f66a7f5227c 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c
0709 13:07:46.443533 (+583963us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b580075bfd0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7eaa0aa 00007f66a7f2c447 00007f66a7f44fe7 00007f66a7f467de 00007f66a7f5227c 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c
0709 13:07:46.532371 (+ 88838us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1785358976}
I20260709 13:07:46.540791 22072 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:46.543298 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:46.543972 27242 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.544572 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:46.545284 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:46.546656 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:46.581276 22218 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:46.582332 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:46.583181 22098 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:46.551316 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:46.549791 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 44388.6us
I20260709 13:07:46.553256 26560 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.554831 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:46.589257 22103 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 17.
W20260709 13:07:46.589331 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 353537us
I20260709 13:07:46.589499 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:46.589892 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 49193.3us
I20260709 13:07:46.590161 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:46.590631 22253 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 16: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:46.560477 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:46.561146 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:46.592761 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:46.563151 27215 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:46.564154 27233 log.cc:927] Time spent T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.251s	user 0.001s	sys 0.001s
I20260709 13:07:46.603518 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:46.564363 27132 raft_consensus.cc:3055] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:46.565021 27175 raft_consensus.cc:993] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: : Instructing follower 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:07:46.565282 27226 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.566684 26975 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:46.564194 27103 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.567988 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:46.568078 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.570182 26939 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:46.568696 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.568806 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.569733 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.570185 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.570334 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.551085 27194 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:46.602391 27204 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:46.571911 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:46.644291 22248 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:46.644449 22179 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.577096 22249 raft_consensus.cc:1240] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:46.559681 22811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:46.571871 22782 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:46.600162 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:46.645612 22811 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
W20260709 13:07:46.646421 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 46334.4us
I20260709 13:07:46.610544 27132 raft_consensus.cc:740] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:46.602540 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:46.609040 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:46.609040 22220 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:46.654938 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:46.656486 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:46.657191 22253 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:46.611227 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:46.613613 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:46.658330 22252 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:46.616218 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:46.545223 27200 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.627584 22098 raft_consensus.cc:2468] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 14.
I20260709 13:07:46.573088 27032 raft_consensus.cc:493] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:46.616806 22781 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:46.662052 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 56894us
I20260709 13:07:46.630836 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:46.632022 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:46.490744 27201 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.604441 27010 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:46.571648 22097 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:46.667035 22247 raft_consensus.cc:1240] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:46.667876 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:46.668638 22097 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:46.640496 27194 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.642671 27103 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:46.648193 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:46.649827 22218 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:46.600299 22072 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:46.651791 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 79986.6us
I20260709 13:07:46.598340 27242 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.652652 27034 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:46.662855 22220 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:46.684140 22808 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:46.662685 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 45976.8us
W20260709 13:07:46.684697 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 84478.9us
I20260709 13:07:46.602484 26560 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.610244 27215 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.673614 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:46.659616 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:46.702037 22250 raft_consensus.cc:2393] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 11: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:46.652763 27191 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:46.663844 26927 raft_consensus.cc:1081] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Signalling peer 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:07:46.660568 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:46.706951 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:46.707559 22098 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 14.
I20260709 13:07:46.708501 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:46.709052 22098 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:46.674049 26998 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:46.710459 26998 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.710908 26998 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:46.685611 22072 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:46.714861 22072 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:46.716382 27184 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:46.716897 27184 raft_consensus.cc:697] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:46.717738 27184 consensus_queue.cc:237] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.719246 26975 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:46.719671 26975 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.720016 26975 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:46.628474 27238 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:07:46.682982 26709 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:46.687742 27226 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:46.688498 22253 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 15.
I20260709 13:07:46.689643 27241 raft_consensus.cc:2804] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:46.689491 27174 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:07:46.692703 27242 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:46.693115 27034 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.680765 27112 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:46.694571 27183 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:46.689544 22097 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:46.696588 27201 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:46.749948 27225 log.cc:927] Time spent T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.481s	user 0.001s	sys 0.003s
I20260709 13:07:46.672610 27228 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:46.699465 22816 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 16.
I20260709 13:07:46.700538 26560 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:46.702327 27215 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:46.803431 27112 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:46.814127 27112 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:46.816172 27034 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:46.816989 26975 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.732470 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:46.736649 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 73883.9us
W20260709 13:07:46.819990 27235 log.cc:927] Time spent T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.518s	user 0.003s	sys 0.000s
I20260709 13:07:46.820546 22220 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:46.821723 22220 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:46.823084 27111 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:46.823801 27111 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:07:46.736892 27126 consensus_meta.cc:287] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.778s	user 0.013s	sys 0.000s
I20260709 13:07:46.844444 27126 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.822459 27112 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.847441 22105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50282 (request call id 2057) took 1635 ms. Trace:
I20260709 13:07:46.847949 22105 rpcz_store.cc:276] 0709 13:07:45.211907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.070331 (+858424us) service_pool.cc:224] Handling call
0709 13:07:46.070695 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.465140 (+394445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.847157 (+382017us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b540008e3d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:46.847373 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863600384}
I20260709 13:07:46.781556 27241 raft_consensus.cc:697] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:46.736377 27010 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:46.849587 22069 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:46.672273 27032 raft_consensus.cc:515] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.698136 27194 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:46.727346 27048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35198 (request call id 1165) took 5900 ms. Trace:
W20260709 13:07:46.803611 22070 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.852213 27206 log.cc:927] Time spent T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:07:46.794015 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 179385us
I20260709 13:07:46.746219 27191 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:46.791749 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 111250us
I20260709 13:07:46.849776 27010 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.856144 27010 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:46.860517 27126 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:46.863307 27215 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:46.868721 22250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:45738
I20260709 13:07:46.869333 22250 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:46.869772 22250 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.869378 27215 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:46.871337 27215 consensus_queue.cc:1059] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:46.871774 27112 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:46.872952 27183 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:46.864925 26460 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:46.862747 27032 leader_election.cc:290] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:46.874486 26460 raft_consensus.cc:3055] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:46.875003 26460 raft_consensus.cc:740] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:46.865535 27055 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:46.876122 27241 consensus_queue.cc:237] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.878264 27183 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:46.881006 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 54740.5us
I20260709 13:07:46.889374 22069 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:46.891471 26975 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:46.892135 27009 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:46.894568 27009 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:46.895069 27009 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.893335 26460 consensus_queue.cc:260] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.899605 26460 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:46.852341 27048 rpcz_store.cc:276] 0709 13:07:40.832117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.851838 (+ 19721us) service_pool.cc:224] Handling call
0709 13:07:41.286708 (+434870us) ts_tablet_manager.cc:934] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
0709 13:07:45.928030 (+4641322us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:46.557360 (+629330us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:46.557474 (+   114us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:46.690772 (+133298us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:46.725695 (+ 34923us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:46.726594 (+   899us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:46.726850 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":349,"tablet-copy.queue_time_us":225370,"thread_start_us":434300,"threads_started":2}
I20260709 13:07:46.811064 22098 raft_consensus.cc:2468] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
I20260709 13:07:46.911518 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:46.907197 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.914878 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.907805 22179 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:46.907738 22250 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:46.927018 27250 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:07:46.931398 27034 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:07:46.929733 27213 consensus_queue.cc:1059] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:07:46.938735 27213 raft_consensus.cc:3055] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:46.939252 27213 raft_consensus.cc:740] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:46.950640 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.951452 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.946189 22250 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:46.956506 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.953238 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.958709 22172 raft_consensus.cc:2393] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 12: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:46.959810 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:46.961156 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:46.963608 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 358495us
I20260709 13:07:46.965405 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:46.967363 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.941951 27048 tablet_copy_client.cc:806] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:46.970013 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:46.970824 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.972361 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.973562 22071 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:46.929968 26793 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:07:46.975204 22003 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40924 (request call id 276) took 47355 ms (client timeout 15000 ms). Trace:
W20260709 13:07:46.975688 22100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 2069) took 1222 ms (client timeout 1531 ms). Trace:
I20260709 13:07:46.931646 27007 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:07:46.976528 22102 raft_consensus.cc:1240] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:46.976210 22100 rpcz_store.cc:269] 0709 13:07:45.784973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.832328 (+ 47355us) service_pool.cc:224] Handling call
0709 13:07:46.975497 (+1143169us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54000b8e54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:46.975635 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1795710208}
I20260709 13:07:46.979276 22071 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:46.940670 27213 consensus_queue.cc:260] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:46.981451 22071 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:46.982824 22072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.984648 22071 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:46.985193 22218 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:46.989239 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.990732 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.991887 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:46.993134 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:46.996683 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.998312 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:46.999840 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:47.001631 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:47.002373 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:47.003136 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:47.004119 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:47.008769 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:47.010663 22071 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:46.978072 27043 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:47.012681 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:47.021520 26975 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:47.022249 27183 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.049031 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:47.049405 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 364357us
I20260709 13:07:47.024546 22072 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:47.024758 27145 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:47.025375 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:47.026090 22071 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:47.026795 27012 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:47.028522 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:47.029049 22069 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:46.980672 27007 consensus_queue.cc:1243] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 15.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:47.031759 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:47.031769 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:46.993597 27195 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:46.981277 27152 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:46.985518 27048 tablet_copy_client.cc:670] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:47.066712 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:47.068068 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:47.068401 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:47.069178 22810 raft_consensus.cc:3055] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:47.069545 22810 raft_consensus.cc:740] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:47.069375 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 44913.1us
I20260709 13:07:47.040613 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:47.073508 22248 raft_consensus.cc:2468] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:07:47.012177 22218 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:47.060166 22103 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 16.
I20260709 13:07:47.011628 27234 raft_consensus.cc:2804] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:47.063766 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:47.077968 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:47.086093 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:47.078429 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 66307us
I20260709 13:07:47.079595 22810 consensus_queue.cc:260] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:47.080961 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 53434.3us
I20260709 13:07:47.030807 27238 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:47.048020 27213 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:47.088208 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:47.088598 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 62613.5us
I20260709 13:07:47.024567 21999 catalog_manager.cc:5697] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 9 to 12, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 12 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:47.091738 22071 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:47.093798 22100 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:47.099555 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:47.103916 22779 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:47.106997 22100 raft_consensus.cc:2468] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 18.
I20260709 13:07:47.108089 22172 raft_consensus.cc:1240] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:47.111903 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:47.112320 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:47.112689 22172 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:47.113900 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:47.101049 22218 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:47.080358 26939 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:07:47.118028 22069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.085973 27194 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:47.129379 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:47.122594 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:47.129542 22255 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:47.072180 27145 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:46.975765 22003 rpcz_store.cc:269] 0709 13:06:59.616941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.617093 (+   152us) service_pool.cc:224] Handling call
0709 13:07:46.971713 (+47354620us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:39.527973 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:39.528727 (+   754us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:39.528787 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:07:39.528826 (+    39us) tablet.cc:662] Decoding operations
0709 13:07:39.529992 (+  1166us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:39.530084 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:39.530118 (+    34us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:07:39.531389 (+  1271us) tablet.cc:701] Row locks acquired
0709 13:07:39.531438 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:07:39.531610 (+   172us) write_op.cc:270] Start()
0709 13:07:39.531781 (+   171us) write_op.cc:276] Timestamp: P: 1783602459531548 usec, L: 0
0709 13:07:39.531823 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:07:39.532516 (+   693us) log.cc:844] Serialized 4024 byte log entry
0709 13:07:40.328100 (+795584us) op_driver.cc:464] REPLICATION: finished
0709 13:07:40.735532 (+407432us) write_op.cc:301] APPLY: starting
0709 13:07:40.758694 (+ 23162us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:41.156450 (+397756us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:41.218792 (+ 62342us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:41.796654 (+577862us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:41.796970 (+   316us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:07:41.797036 (+    66us) write_op.cc:312] APPLY: finished
0709 13:07:41.797394 (+   358us) log.cc:844] Serialized 97 byte log entry
0709 13:07:41.915783 (+118389us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:41.915973 (+   190us) write_op.cc:454] Released schema lock
0709 13:07:41.916060 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:41.916499 (+   439us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:41.916549 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6103554,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":364717,"apply.run_cpu_time_us":33542,"apply.run_wall_time_us":1201756,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45867,"num_ops":10,"prepare.queue_time_us":560152,"prepare.run_cpu_time_us":15987,"prepare.run_wall_time_us":407883,"raft.queue_time_us":267586,"raft.run_cpu_time_us":109362,"raft.run_wall_time_us":308390,"replication_time_us":767238,"thread_start_us":1230539,"threads_started":5,"wal-append.queue_time_us":570068,"wal-append.run_cpu_time_us":63421,"wal-append.run_wall_time_us":2209234}]]}
I20260709 13:07:47.093075 27127 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:47.104655 26975 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:47.090090 27238 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:47.132277 22220 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:47.062294 27183 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.109143 26793 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.141657 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:47.173581 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:47.183514 22251 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:47.183578 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 51405.8us
I20260709 13:07:47.182153 22255 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:47.141279 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:47.191799 22220 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:47.118304 27252 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:47.116688 27112 consensus_queue.cc:1059] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:07:47.101897 27009 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.110411 27234 raft_consensus.cc:697] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 14 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:47.120923 27242 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.194288 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 327513us
I20260709 13:07:47.135694 27195 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:47.200774 22248 raft_consensus.cc:1275] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:47.135583 27245 raft_consensus.cc:2804] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:47.167929 27154 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:47.214368 22098 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:47.179975 27194 raft_consensus.cc:697] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:47.179684 27212 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:47.166829 27127 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.139344 27012 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:47.189651 27238 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:47.188014 27103 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:47.197048 22172 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:47.222450 22255 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 15.
I20260709 13:07:47.223922 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:47.197713 22220 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:47.206754 27252 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.210685 27228 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:47.255074 26939 raft_consensus.cc:697] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:47.257927 22251 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
I20260709 13:07:47.184782 26793 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.270701 22098 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 16.
I20260709 13:07:47.227316 27195 raft_consensus.cc:697] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:07:47.271910 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 43528.4us
I20260709 13:07:47.243291 27207 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:47.280206 26802 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:47.315106 27234 consensus_queue.cc:237] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:47.285609 27012 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:47.284787 27252 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:47.321481 26793 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:47.272434 27127 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:47.303550 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:47.289425 27262 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:07:47.275964 27245 raft_consensus.cc:697] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:47.325568 27245 consensus_queue.cc:237] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:47.306404 22175 raft_consensus.cc:1275] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:47.306752 26939 consensus_queue.cc:237] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:47.313771 27010 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:47.339743 27010 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 18 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:47.340751 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 116901us
I20260709 13:07:47.357029 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:47.341971 27267 log.cc:927] Time spent T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:07:47.342214 27007 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:47.342757 27259 log.cc:927] Time spent T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:07:47.343257 27194 consensus_queue.cc:237] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:47.344749 27183 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:47.337258 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:47.348017 27200 consensus_meta.cc:287] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.002s
I20260709 13:07:47.219907 21999 catalog_manager.cc:5697] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 11 to 14, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 14 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:47.224308 27242 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.359068 22251 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:47.359658 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:47.361954 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:47.295815 27103 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:47.364331 22071 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:47.318725 27012 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:47.391628 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:47.397051 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 199411us
I20260709 13:07:47.398241 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:47.406407 22254 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
I20260709 13:07:47.399791 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:47.407785 22104 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:07:47.403607 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:47.404657 22807 raft_consensus.cc:1240] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 14. Current term is 15. Ops: [13.9-14.10]
I20260709 13:07:47.333431 27126 consensus_queue.cc:1048] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:07:47.410846 22220 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:47.413359 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 49089.5us
I20260709 13:07:47.417279 27152 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:47.419986 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:47.422478 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:47.386896 27262 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:47.427268 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:47.434976 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:47.436368 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:47.409350 27250 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:47.387593 26793 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:07:47.451870 27103 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:47.452126 27145 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:47.442232 27195 consensus_queue.cc:237] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:47.388163 27251 consensus_queue.cc:1059] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:07:47.351655 27238 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.448453 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:47.440125 27048 tablet_copy_client.cc:538] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:47.433224 27262 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:47.502381 27262 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:47.510140 27251 consensus_queue.cc:1243] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer c0694f6572bf406a92d55f1f2ab46ef2 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:47.516268 27132 consensus_queue.cc:260] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.517411 27132 raft_consensus.cc:3060] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:47.498981 27269 log.cc:927] Time spent T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:07:47.528646 26998 consensus_meta.cc:287] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.817s	user 0.008s	sys 0.004s
I20260709 13:07:47.529119 26998 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.499279 27250 raft_consensus.cc:697] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:47.535993 27250 consensus_queue.cc:237] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.536888 27111 raft_consensus.cc:3055] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:47.537318 27111 raft_consensus.cc:740] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:47.538071 27111 consensus_queue.cc:260] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:47.403496 27200 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:47.540856 27200 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:47.484373 27268 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:47.541674 27268 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.543890 27268 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:47.443435 26802 consensus_queue.cc:1048] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:07:47.461592 27177 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.544792 27177 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.492007 27009 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:47.494186 27242 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:47.492669 27238 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:47.497627 27127 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:47.552380 26460 consensus_meta.cc:287] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.000s
I20260709 13:07:47.553431 27127 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 17 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:47.555094 27043 consensus_meta.cc:287] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.507s	user 0.005s	sys 0.006s
I20260709 13:07:47.555620 27043 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:47.556661 26998 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:47.559667 27177 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:47.501556 27252 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.560971 22815 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:47.561970 27252 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 17 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:47.498260 26709 consensus_meta.cc:287] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.747s	user 0.008s	sys 0.000s
I20260709 13:07:47.563303 27111 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:47.563577 26709 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:47.553484 22810 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:47.575285 27262 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.577951 27262 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:47.583853 22810 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 9.
I20260709 13:07:47.590674 27048 tablet_bootstrap.cc:492] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:07:47.632915 21999 catalog_manager.cc:5697] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 5 to 14. New cstate: current_term: 14 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.644712 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:47.645713 22100 raft_consensus.cc:1240] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:07:47.641991 21999 catalog_manager.cc:5697] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 5 to 12, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 12 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:47.645785 22099 raft_consensus.cc:1240] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:47.650543 21999 catalog_manager.cc:5697] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 8 to 12, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 12 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.646795 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:47.654657 22104 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:07:47.657232 22102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2216) took 1208 ms. Trace:
I20260709 13:07:47.659298 22099 raft_consensus.cc:1240] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:47.669664 22100 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:47.672122 22103 raft_consensus.cc:1240] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:07:47.675065 22105 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:47.676074 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.720700 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.721339 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.714659 22102 rpcz_store.cc:276] 0709 13:07:46.451573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.510342 (+ 58769us) service_pool.cc:224] Handling call
0709 13:07:46.976325 (+465983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.978747 (+  2422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.656533 (+677786us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54000b8e50. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:47.656972 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1071030144}
I20260709 13:07:47.676369 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:47.449386 22220 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:47.495075 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2387) took 1417 ms. Trace:
W20260709 13:07:47.678609 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.754211 22247 rpcz_store.cc:276] 0709 13:07:46.077911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.089728 (+ 11817us) service_pool.cc:224] Handling call
0709 13:07:46.666843 (+577115us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.667462 (+   619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.494843 (+827381us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54002cb0d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:47.495013 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1303636224}
I20260709 13:07:47.755160 27250 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:47.494185 22248 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:47.756665 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:47.756786 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:47.757939 22104 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:47.756052 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 80088.5us
I20260709 13:07:47.759698 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:47.686358 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.687609 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51880 (request call id 2400) took 1595 ms. Trace:
I20260709 13:07:47.761535 22249 rpcz_store.cc:276] 0709 13:07:46.091722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.467590 (+375868us) service_pool.cc:224] Handling call
0709 13:07:46.576899 (+109309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.645199 (+ 68300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.687002 (+1041803us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54001cc5d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4d8ad 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:47.687283 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250589568}
I20260709 13:07:47.687711 22072 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:47.762696 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:47.763754 22814 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
W20260709 13:07:47.764326 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 77173us
I20260709 13:07:47.765635 22072 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:47.695506 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:47.767603 22807 raft_consensus.cc:2393] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 17: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:47.698652 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:47.769049 22246 raft_consensus.cc:2393] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 11: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:47.700384 22175 raft_consensus.cc:3055] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:47.770234 22175 raft_consensus.cc:740] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:47.695506 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:47.703866 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:47.702756 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:47.705139 26802 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:47.706122 26975 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.706885 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:47.707367 27010 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:47.747303 22218 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:47.723745 22098 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.724327 27183 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:47.751219 27204 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:47.802083 27204 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:47.803452 26802 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:47.804913 27204 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:47.752045 26696 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:47.805815 26696 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:47.705649 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.807034 22815 raft_consensus.cc:2393] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 16: Already voted for candidate a07ca3d1b5b84f4bbcb907f709a69275 in this term.
I20260709 13:07:47.809007 26696 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:47.779675 22175 consensus_queue.cc:260] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:47.811834 22175 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:47.783416 27032 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.785904 22809 raft_consensus.cc:2368] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12.
I20260709 13:07:47.786849 22252 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:47.797037 26975 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.801002 27183 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:47.806159 26802 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:47.763981 22779 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:47.851013 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:47.859027 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 95377us
W20260709 13:07:47.861815 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 96580.8us
I20260709 13:07:47.867858 27194 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:47.871013 27127 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:47.871739 27127 raft_consensus.cc:697] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:47.871670 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:47.873528 22069 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:47.874367 26939 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:47.875123 26939 raft_consensus.cc:697] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:47.875990 22069 leader_election.cc:400] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12.
I20260709 13:07:47.876415 22069 leader_election.cc:403] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:47.876909 27204 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:47.870836 22071 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:47.873209 27127 consensus_queue.cc:237] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:47.884295 22173 pending_rounds.cc:85] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 12
I20260709 13:07:47.884765 22173 pending_rounds.cc:107] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:07:47.885079 22173 raft_consensus.cc:2889] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:47.888547 26975 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:47.888639 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:47.889528 22255 raft_consensus.cc:3060] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.890340 27183 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:47.891036 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:47.866225 27010 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.893373 27284 consensus_queue.cc:1059] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:07:47.870761 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:47.895057 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 445628us
I20260709 13:07:47.895794 22172 raft_consensus.cc:2393] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 11: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:47.896235 22220 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:47.896761 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:47.898198 22220 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:47.899070 27288 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:47.904410 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:47.906103 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:47.786398 21999 catalog_manager.cc:5697] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 5 to 8, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 8 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.898205 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:47.910899 27207 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:47.913570 26696 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:47.915637 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:47.899959 27010 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:47.918632 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 199699us
I20260709 13:07:47.921628 22218 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:47.921696 26998 consensus_queue.cc:1059] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:47.942515 22104 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
W20260709 13:07:47.945297 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 45037.9us
I20260709 13:07:47.949100 22098 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:47.876523 26939 consensus_queue.cc:237] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:47.967888 22179 raft_consensus.cc:1240] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:47.941730 27288 raft_consensus.cc:697] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:47.971125 22176 raft_consensus.cc:1240] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:47.974992 22175 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:47.980715 22105 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:47.964236 27200 raft_consensus.cc:2804] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:47.899617 27032 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.986472 22072 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:47.988338 27152 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 11. Current term is 12.
I20260709 13:07:47.989461 27111 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:47.982960 22218 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:47.988665 21999 catalog_manager.cc:5697] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 4 to 11, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 11 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:47.990561 22815 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:07:47.992308 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.991338 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 50530.7us
I20260709 13:07:48.007534 26460 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:07:48.009361 27177 raft_consensus.cc:3055] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:48.014210 27132 consensus_queue.cc:1059] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:48.015450 27007 raft_consensus.cc:3055] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:48.015758 22181 raft_consensus.cc:1275] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:48.015882 27007 raft_consensus.cc:740] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:48.016932 27278 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:48.017434 27007 consensus_queue.cc:260] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.015806 27200 raft_consensus.cc:697] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 18 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:48.019527 27007 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:48.020426 27200 consensus_queue.cc:237] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:48.023140 27034 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:07:48.024189 27288 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.000337 22248 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 18.
I20260709 13:07:48.028656 22147 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:48.012835 27111 raft_consensus.cc:697] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:48.030527 27111 consensus_queue.cc:237] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:47.969139 26696 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:07:48.012250 27177 raft_consensus.cc:740] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
W20260709 13:07:48.056697 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 44003.5us
W20260709 13:07:48.054186 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 107722us
I20260709 13:07:48.064702 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:48.070776 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:48.069268 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 55487.8us
I20260709 13:07:48.056609 27284 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:48.064327 26696 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:07:48.081224 22174 raft_consensus.cc:3055] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:48.079613 27207 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:48.082635 21999 catalog_manager.cc:5697] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 4 to 7, term changed from 7 to 11, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to <none>, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New cstate: current_term: 11 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:48.094769 26998 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
W20260709 13:07:48.104293 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 75897.7us
I20260709 13:07:48.095134 22175 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
W20260709 13:07:48.095611 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 197607us
I20260709 13:07:48.097522 22174 raft_consensus.cc:740] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:48.066313 27032 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:48.096864 26696 consensus_queue.cc:1243] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:48.110744 27194 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:48.111126 22220 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:48.104516 27207 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.113461 22174 consensus_queue.cc:260] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:48.115175 26998 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.117005 21999 catalog_manager.cc:5697] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:48.120303 27242 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:07:48.120389 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:48.132936 22174 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:48.133003 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 167783us
W20260709 13:07:48.133504 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.135219 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.136986 22071 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:48.128676 27207 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:48.139497 27183 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:48.148909 22071 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:48.147862 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:48.151288 22815 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:48.160177 22072 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:48.161082 27287 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:48.161888 27287 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.164597 27287 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:48.164954 27274 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:48.168670 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:48.169795 22248 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 15.
I20260709 13:07:48.172209 27238 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:48.179258 27177 consensus_queue.cc:260] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.180986 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:48.181686 22105 raft_consensus.cc:1240] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:07:48.181766 22782 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:07:48.182308 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 71418.4us
I20260709 13:07:48.183282 22220 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:48.186798 26974 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:48.188896 27174 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:48.188270 26974 raft_consensus.cc:493] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:48.151574 27183 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.190891 27255 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:48.190732 26974 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:48.191371 27183 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:48.191781 27255 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.164436 27242 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:48.193288 27242 raft_consensus.cc:697] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:48.194566 27242 consensus_queue.cc:237] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.196909 26998 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:48.196964 27255 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:48.189806 27174 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:48.198199 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 63110.7us
I20260709 13:07:48.180809 22106 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:48.205483 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.180935 27177 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:48.172233 27194 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:48.213085 22814 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:48.210403 22174 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:07:48.239588 22174 pending_rounds.cc:85] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 7
I20260709 13:07:48.212606 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:48.214015 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:48.223327 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:48.209201 22181 pending_rounds.cc:85] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 8
W20260709 13:07:48.241057 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.241727 22181 pending_rounds.cc:107] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:07:48.239279 22255 raft_consensus.cc:2468] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:07:48.244613 22174 pending_rounds.cc:107] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:07:48.240499 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:48.245296 22174 raft_consensus.cc:2889] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:48.242043 22181 raft_consensus.cc:2889] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:48.241022 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 57947us
I20260709 13:07:48.213515 27238 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:48.219820 27055 raft_consensus.cc:3055] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:07:48.259333 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 110449us
I20260709 13:07:48.233286 27007 consensus_queue.cc:1059] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:07:48.228406 27274 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:48.269696 27007 consensus_queue.cc:1243] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:48.264204 22147 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:48.268831 22144 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:48.275010 21999 catalog_manager.cc:5697] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 8 to 11, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 11 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:48.220961 27034 consensus_queue.cc:1048] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:07:48.260452 27194 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:48.268122 22782 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:48.297356 27204 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:48.278987 27207 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.301478 27207 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:48.302604 27034 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:48.304085 22220 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:48.304898 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:48.305835 22253 raft_consensus.cc:2393] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 16: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:48.279513 27007 raft_consensus.cc:3055] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:48.235266 27262 consensus_queue.cc:1059] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:07:48.259904 27055 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:48.311173 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 50056.3us
I20260709 13:07:48.311424 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:48.317847 22220 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:48.319665 27238 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:48.319476 27055 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.320942 27055 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:48.325659 27194 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:48.336162 22102 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:48.337630 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:48.338721 22098 raft_consensus.cc:2393] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 in current term 17: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:48.347170 27262 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:48.348241 27262 raft_consensus.cc:3055] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:48.348690 27262 raft_consensus.cc:740] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:48.349828 27262 consensus_queue.cc:260] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:48.357349 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 43649.5us
W20260709 13:07:48.359007 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.278172 21999 catalog_manager.cc:5697] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:48.384636 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 61562.5us
I20260709 13:07:48.310045 27007 raft_consensus.cc:740] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:48.399017 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 137619us
I20260709 13:07:48.401376 26560 raft_consensus.cc:2804] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:48.402407 26560 raft_consensus.cc:697] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:48.401558 22103 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
W20260709 13:07:48.422129 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 175745us
I20260709 13:07:48.424832 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:48.426707 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.429363 27213 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:48.429015 27274 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:48.434208 22220 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:48.430447 27213 consensus_queue.cc:1059] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:48.441849 27262 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.458850 22144 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:48.460649 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:48.473728 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:48.469647 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:48.474634 22176 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
I20260709 13:07:48.462157 27207 raft_consensus.cc:2749] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:48.494691 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 355391us
I20260709 13:07:48.497764 27200 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:07:48.461395 27007 consensus_queue.cc:260] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:48.509204 27007 raft_consensus.cc:3060] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:48.511895 27213 raft_consensus.cc:3055] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:48.512527 27213 raft_consensus.cc:740] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:48.513751 27213 consensus_queue.cc:260] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:48.514786 27255 consensus_queue.cc:1059] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:48.515535 27183 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.516245 27213 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:48.516419 27174 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:48.517035 27174 raft_consensus.cc:3055] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:48.517437 27174 raft_consensus.cc:740] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:48.505688 22097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50288 (request call id 2223) took 1002 ms. Trace:
W20260709 13:07:48.522301 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 105146us
I20260709 13:07:48.518469 27174 consensus_queue.cc:260] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.543588 22104 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:48.418826 21999 catalog_manager.cc:5697] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 4 to 8, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 8 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:48.537329 27174 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:48.543601 27250 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.488797 26560 consensus_queue.cc:237] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.521461 22097 rpcz_store.cc:276] 0709 13:07:47.398437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.408447 (+ 10010us) service_pool.cc:224] Handling call
0709 13:07:47.408697 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.408872 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:47.963669 (+554797us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.258023 (+294354us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.269622 (+ 11599us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:48.269714 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.393307 (+123593us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.400973 (+  7666us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":740,"prepare.queue_time_us":44262,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":2237,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":9799,"spinlock_wait_cycles":3675520,"thread_start_us":683009,"threads_started":2,"wal-append.queue_time_us":456457}
I20260709 13:07:48.542126 26974 raft_consensus.cc:515] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.577042 27252 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:48.577672 27252 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.570297 27250 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:48.588605 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:48.589680 22104 raft_consensus.cc:2393] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 13: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:48.568050 27132 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:48.593633 27250 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:48.595057 27268 consensus_queue.cc:1059] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:07:48.599284 27204 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:48.599977 27204 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:48.604943 22147 leader_election.cc:336] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.680s (SENT)
I20260709 13:07:48.605428 22147 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:48.606717 27250 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:48.615532 26939 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.616423 26939 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:48.619334 26939 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:48.623497 27032 raft_consensus.cc:3055] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:48.624053 27032 raft_consensus.cc:740] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:48.625188 27032 consensus_queue.cc:260] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.626595 27032 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:48.630267 22147 leader_election.cc:336] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.930s (SENT)
I20260709 13:07:48.673949 22147 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:48.678174 22815 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:48.679003 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.585009 27252 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:48.679766 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.695159 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 129314us
W20260709 13:07:48.696158 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.674068 27127 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.711169 21999 catalog_manager.cc:5697] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:48.713405 21999 catalog_manager.cc:5697] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 6 to 11, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 11 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:48.725243 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 95031.5us
W20260709 13:07:48.726119 22147 leader_election.cc:336] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.970s (SENT)
I20260709 13:07:48.726581 22147 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:48.727409 27262 raft_consensus.cc:2749] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:48.735036 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:48.735669 22180 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:48.738461 27308 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:48.739120 27308 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:48.741382 27308 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:48.744787 27305 log.cc:927] Time spent T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:07:48.745199 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.746989 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:48.747861 22252 raft_consensus.cc:2393] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 11: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:48.749467 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:48.751097 27311 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:48.751510 22248 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:48.753281 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:48.754747 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:48.755541 22248 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 10.
W20260709 13:07:48.727852 22147 leader_election.cc:336] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 2.078s (SENT)
I20260709 13:07:48.756395 22147 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:48.734894 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:48.762976 22180 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
I20260709 13:07:48.758100 27183 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:48.766455 27268 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:48.780817 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 256183us
I20260709 13:07:48.768400 27127 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:48.783124 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 55310.3us
I20260709 13:07:48.790059 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:48.792985 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:48.795472 22253 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:07:48.798218 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 314646us
I20260709 13:07:48.801079 22249 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:48.805523 22071 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:48.783483 27242 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:07:48.822182 22072 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:48.816862 27183 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:48.799712 21999 catalog_manager.cc:5697] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 8 to 11, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 11 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:48.831773 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:48.832479 22253 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:48.835091 26802 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:48.806313 27204 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:48.831281 21999 catalog_manager.cc:5697] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:07:48.835932 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 251034us
I20260709 13:07:48.835691 26802 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:48.822731 27111 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:48.836366 27183 raft_consensus.cc:697] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
W20260709 13:07:48.897835 27303 log.cc:927] Time spent T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.416s	user 0.004s	sys 0.000s
I20260709 13:07:48.898030 27183 consensus_queue.cc:237] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:48.827924 26974 leader_election.cc:290] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:48.932551 22173 raft_consensus.cc:3055] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:07:48.936190 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 132966us
I20260709 13:07:48.933146 22173 raft_consensus.cc:740] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
W20260709 13:07:48.939260 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 139281us
I20260709 13:07:48.943431 22779 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:48.945061 22779 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:48.946342 27177 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:07:48.948354 27310 log.cc:927] Time spent T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:07:48.966852 22253 raft_consensus.cc:2468] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 16.
I20260709 13:07:48.931105 26939 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:48.973450 22147 leader_election.cc:336] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Timed out: RequestConsensusVote RPC to 127.20.130.67:42273 timed out after 1.829s (SENT)
I20260709 13:07:48.974207 22147 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:48.973667 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:48.975867 22812 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:48.980238 22782 leader_election.cc:304] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:48.976612 22781 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:48.939684 26974 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:48.983557 22781 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:48.968497 22173 consensus_queue.cc:260] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:48.998059 22174 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:48.970669 27207 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.000903 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:48.970504 26998 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:49.019013 22180 raft_consensus.cc:2410] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:07:49.022456 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:49.026806 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 55194.6us
I20260709 13:07:48.963943 26560 consensus_queue.cc:1048] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:07:49.006834 26998 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.969415 27111 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:49.044821 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 69675.3us
I20260709 13:07:49.047452 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:49.049516 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.051520 27333 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.052240 27333 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.017097 27252 raft_consensus.cc:2804] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:49.057653 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:49.031152 27288 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:49.062376 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 53836.7us
I20260709 13:07:48.980648 26939 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.064587 26939 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:49.002789 27032 consensus_queue.cc:1059] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:07:49.065608 27127 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:49.040266 26998 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.074738 22104 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:49.017149 27207 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:49.081344 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 110303us
I20260709 13:07:49.086818 22179 raft_consensus.cc:1275] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:07:49.085795 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 47383us
I20260709 13:07:49.090428 22072 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:49.073369 27242 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:49.044855 26974 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:49.093406 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:49.027009 26802 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.094228 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:49.096809 22180 raft_consensus.cc:2368] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 13. Current term is 14.
I20260709 13:07:49.097213 22248 raft_consensus.cc:1240] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:07:49.099750 27333 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:49.101642 27213 consensus_queue.cc:1059] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:49.103361 27213 raft_consensus.cc:3055] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:49.103770 27213 raft_consensus.cc:740] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:49.105962 27207 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:49.109771 22249 raft_consensus.cc:1240] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 14. Current term is 15. Ops: [13.9-14.10]
W20260709 13:07:49.102824 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.080314 27252 raft_consensus.cc:697] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:49.112609 22103 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:49.114423 22253 raft_consensus.cc:1240] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:07:49.111552 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:49.116588 26927 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:49.117115 26927 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:49.117194 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:49.117553 26927 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.117911 22098 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
W20260709 13:07:49.119585 27322 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.166s	user 0.000s	sys 0.002s
I20260709 13:07:49.121001 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:49.121589 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.071252 26460 consensus_queue.cc:1059] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:07:49.122565 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:49.123778 22072 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:49.126876 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:49.127161 22104 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:49.137383 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8d3d512e804f4bbd58ae1baf74c000" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:49.096292 27204 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:49.112100 27315 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:49.151264 26975 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:49.152729 22072 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:49.139178 22248 raft_consensus.cc:1240] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 17. Current term is 18. Ops: [16.7-17.8]
I20260709 13:07:49.142794 22180 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:49.124138 27207 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.091638 27183 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:07:49.145767 27274 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.146018 27332 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.134788 27242 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.163195 27152 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:49.148765 26974 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:49.149679 26998 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:49.167593 27316 log.cc:927] Time spent T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:07:49.168236 27242 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:49.168777 26998 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:49.156224 22072 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:49.161572 22812 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 14.
W20260709 13:07:49.164265 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 113595us
I20260709 13:07:49.172494 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:49.174782 22253 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:49.176349 22253 raft_consensus.cc:1240] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:49.176401 22147 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:49.179116 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:49.180011 22174 raft_consensus.cc:2410] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:07:49.180260 22100 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 16.
I20260709 13:07:49.182511 22180 raft_consensus.cc:3055] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:49.182956 22180 raft_consensus.cc:740] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:49.183676 22072 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:49.184219 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.185438 22106 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:07:49.185855 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:49.110675 27213 consensus_queue.cc:260] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.189630 27262 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:49.194821 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.198701 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:49.138379 27319 consensus_queue.cc:1059] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.188s
I20260709 13:07:49.162895 27207 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.184072 27152 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:49.200747 22180 consensus_queue.cc:260] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.212301 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:49.227842 22246 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.211992 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:49.211395 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:49.207702 26975 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 13:07:49.221742 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.222886 27321 log.cc:927] Time spent T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.274s	user 0.003s	sys 0.000s
I20260709 13:07:49.232858 22253 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 15. Current term is 16. Ops: [13.12-15.13]
I20260709 13:07:49.225528 27111 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:49.213528 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:49.208945 27193 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:49.246333 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 81541us
I20260709 13:07:49.251801 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:49.212817 27152 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:49.257462 22180 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.262617 22100 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 13: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:49.259305 27200 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:07:49.263827 27213 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.208981 27204 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:49.249835 27055 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.265897 27055 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:49.245730 27319 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.273088 22253 raft_consensus.cc:1240] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:49.274653 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 197971us
I20260709 13:07:49.247834 27341 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.276351 27337 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:49.276484 27341 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.276949 27337 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:49.285367 27337 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:49.250317 27327 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
W20260709 13:07:49.315429 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.315505 22246 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:49.317166 22173 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:49.245018 27242 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:07:49.278688 27341 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:49.268640 27152 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.332379 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:49.237885 27252 consensus_queue.cc:237] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:49.329849 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:49.333915 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:49.348701 22807 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.322716 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:49.323992 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 56319.3us
I20260709 13:07:49.320452 22180 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:07:49.335410 27332 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.336138 22810 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:49.365626 22807 raft_consensus.cc:2468] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 14.
I20260709 13:07:49.343202 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:49.346899 27314 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.368778 22100 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:49.319247 26460 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:07:49.369228 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:49.359519 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
W20260709 13:07:49.332126 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 130735us
I20260709 13:07:49.370183 22246 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
I20260709 13:07:49.269582 27032 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.355939 22180 pending_rounds.cc:85] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 8
I20260709 13:07:49.371480 22180 pending_rounds.cc:107] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:07:49.371796 22180 raft_consensus.cc:2889] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:49.378010 27048 log.cc:927] Time spent T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:49.380324 22807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:49.354578 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:49.382983 22106 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:49.392704 22781 leader_election.cc:400] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 13. Current term is 14.
I20260709 13:07:49.393390 22781 leader_election.cc:403] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:49.389274 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:49.391472 22782 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:49.334242 27204 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:49.434754 22172 raft_consensus.cc:3055] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:49.435072 22218 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:49.435177 22172 raft_consensus.cc:740] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:49.439263 22809 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:07:49.431262 27341 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:49.443048 27341 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.445188 27341 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:49.447360 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d62f92be1345e38ad2eeb98d958d91" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:49.448299 22181 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:49.448594 22254 raft_consensus.cc:1240] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:49.448769 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:49.449425 22250 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:49.449577 27337 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:07:49.450165 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 95718.1us
I20260709 13:07:49.450104 27337 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:49.333153 27132 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 13:07:49.449434 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:49.460449 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 61860.2us
I20260709 13:07:49.452194 22174 raft_consensus.cc:3055] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:49.461359 22174 raft_consensus.cc:740] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:49.390856 27177 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.445387 22172 consensus_queue.cc:260] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.448817 22247 raft_consensus.cc:1240] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 18 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 17. Current term is 18. Ops: []
W20260709 13:07:49.453025 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 61633.8us
I20260709 13:07:49.425823 26460 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:49.308640 27319 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.467195 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:49.468639 22174 consensus_queue.cc:260] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:49.469638 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 98559.1us
I20260709 13:07:49.473984 22103 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.475339 26709 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:49.475847 26709 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:49.476011 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:49.476253 26709 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.476627 22177 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
W20260709 13:07:49.477051 22069 consensus_peers.cc:597] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:49.476838 27341 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:49.478860 22174 raft_consensus.cc:3060] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:49.479153 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:49.479761 22181 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:49.481637 27318 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 13. Current term is 14.
I20260709 13:07:49.489549 22172 raft_consensus.cc:3060] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:49.490453 27337 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:49.493600 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:49.462234 27311 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:07:49.498692 22247 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:49.491035 26709 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:49.501605 22812 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:07:49.503273 27348 log.cc:927] Time spent T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:07:49.503571 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:49.506078 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:49.388263 27032 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:49.512696 22174 raft_consensus.cc:1275] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:49.524236 22779 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:49.526518 27287 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:49.527171 26709 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:49.531090 22178 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 16.
I20260709 13:07:49.495134 27200 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:49.475252 27177 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:49.539884 27318 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.540531 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:49.541695 27177 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:49.532126 27308 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.542078 22181 pending_rounds.cc:85] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 12
I20260709 13:07:49.542460 22181 pending_rounds.cc:107] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:07:49.542737 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:49.542750 22181 raft_consensus.cc:2889] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:49.554309 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:49.556012 27183 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:49.542461 27308 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.561281 27308 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:49.472095 27315 consensus_queue.cc:1059] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:07:49.566732 27315 raft_consensus.cc:3055] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:49.567168 27315 raft_consensus.cc:740] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:49.437691 27204 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.511541 27055 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:49.531014 27048 log.cc:927] Time spent T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:07:49.285406 27207 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:49.386055 27327 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.545483 27200 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.786947 27183 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.788082 22179 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:49.796291 22173 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:07:49.788873 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 353856us
W20260709 13:07:49.788722 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 207549us
I20260709 13:07:49.805555 26974 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.806316 26974 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:49.807717 22097 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
I20260709 13:07:49.815049 22218 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:49.793962 27200 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:49.793159 27055 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.837051 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:49.800292 26927 consensus_meta.cc:287] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 0.682s	user 0.013s	sys 0.017s
I20260709 13:07:49.400439 27314 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.841665 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:49.849712 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 45764.4us
I20260709 13:07:49.840071 27055 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.830358 27349 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:07:49.808043 27183 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:49.858420 27341 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:49.902084 22220 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:49.911214 22106 raft_consensus.cc:1275] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:49.912897 27334 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.913493 27327 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:49.914193 27213 consensus_queue.cc:1059] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:49.914568 22147 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:49.914661 27324 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:49.958559 22172 raft_consensus.cc:1275] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:07:49.976533 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 74555.6us
I20260709 13:07:49.983224 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:49.990353 22179 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 9.
I20260709 13:07:49.915477 27324 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:49.985589 22144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.005s	sys 0.001s
W20260709 13:07:50.013861 22144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.009s	sys 0.005s
I20260709 13:07:49.981431 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:50.051141 22220 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:49.976168 22781 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:49.913627 27334 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:50.047447 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 595852us
W20260709 13:07:49.986078 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 131618us
I20260709 13:07:50.013746 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:49.934471 27333 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:50.053676 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:50.055378 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 181130us
I20260709 13:07:50.016050 22253 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:07:50.016790 27350 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:07:50.020465 27055 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:49.903677 27347 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.338s
W20260709 13:07:49.988731 27007 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:07:50.018079 27315 consensus_queue.cc:260] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:49.908409 27311 consensus_queue.cc:1059] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:07:49.908944 27341 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:49.906649 26927 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:50.031165 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 165376us
I20260709 13:07:49.989809 27319 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:49.959069 26460 consensus_queue.cc:1059] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:07:50.095413 22253 raft_consensus.cc:1275] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:50.098973 27327 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:50.100005 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 67563.6us
I20260709 13:07:50.058174 27204 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:50.058966 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:50.055794 22072 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:07:50.060009 22174 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.016s	sys 0.008s
W20260709 13:07:50.062533 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.146433 22174 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.017s	sys 0.008s
W20260709 13:07:50.146593 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.056656 27374 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.149952 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:50.150134 27374 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.151201 26927 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:50.151414 27369 consensus_queue.cc:1048] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:50.152550 27274 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:50.152673 27374 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:50.153417 27288 consensus_meta.cc:287] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: Time spent flushing consensus metadata: real 1.091s	user 0.007s	sys 0.006s
I20260709 13:07:50.153877 27288 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:50.153949 22144 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:50.154784 22813 raft_consensus.cc:1240] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:50.155790 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:50.156392 22102 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 16.
I20260709 13:07:50.076133 27362 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.157269 27362 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.159045 27341 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:50.159581 27362 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:50.162271 22103 consensus_meta.cc:287] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.652s	user 0.007s	sys 0.000s
I20260709 13:07:50.079298 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:50.080312 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:50.081063 22810 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:07:50.029202 27356 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:50.171290 27356 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.171689 27356 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.154815 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:50.093196 26974 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:50.125090 27355 log.cc:927] Time spent T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:07:50.135685 27357 log.cc:927] Time spent T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 13:07:50.054471 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 78456.3us
I20260709 13:07:50.063515 26560 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:50.145051 22814 raft_consensus.cc:1240] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:50.147433 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 91743.9us
I20260709 13:07:50.186896 22072 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:50.055212 27308 consensus_queue.cc:1048] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:07:50.163058 27311 raft_consensus.cc:3055] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:50.164326 27314 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:50.078794 22816 raft_consensus.cc:1240] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:07:50.166986 27183 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:50.201781 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
W20260709 13:07:50.102773 27152 consensus_meta.cc:287] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2: Time spent flushing consensus metadata: real 0.755s	user 0.008s	sys 0.000s
I20260709 13:07:50.170696 22103 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 14.
I20260709 13:07:50.176031 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:50.170004 22815 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 17.
I20260709 13:07:50.141544 27334 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:50.201949 27349 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:07:50.204463 22246 raft_consensus.cc:2955] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:07:50.194396 22218 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:50.156538 27268 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:50.196884 22072 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:50.197229 22220 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:50.198519 22781 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
W20260709 13:07:50.105221 27359 log.cc:927] Time spent T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:07:50.178504 27252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.015s	sys 0.003s
I20260709 13:07:50.197264 27308 consensus_queue.cc:1243] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:50.224437 27308 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:50.201800 27341 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:50.226756 27034 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.227376 27034 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
W20260709 13:07:50.228845 27252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.016s	sys 0.004s
I20260709 13:07:50.229671 27034 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:50.186153 27374 consensus_queue.cc:1059] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:07:50.215909 27268 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.231323 27268 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:50.214835 22103 raft_consensus.cc:1240] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:50.217504 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:50.233201 22181 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 14.
I20260709 13:07:50.207828 22102 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:50.215282 27288 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:50.218829 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:50.219118 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:50.234139 22175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.005s	sys 0.009s
I20260709 13:07:50.219573 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:50.219820 27352 log.cc:927] Time spent T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.175s	user 0.001s	sys 0.001s
W20260709 13:07:50.221197 27328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.035s	sys 0.035s
I20260709 13:07:50.222967 27324 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:50.196759 27311 raft_consensus.cc:740] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:50.215549 27111 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:50.256644 22247 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:07:50.258777 22147 leader_election.cc:304] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:50.254902 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:50.243064 27328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.036s	sys 0.035s
I20260709 13:07:50.265661 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:50.266680 22252 raft_consensus.cc:2393] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 9: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:50.238358 27362 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:50.212895 27152 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:50.195204 27207 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:07:50.235042 22808 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 17.
I20260709 13:07:50.219259 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:50.239856 22781 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:50.234413 22101 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 17.
I20260709 13:07:50.235352 27288 raft_consensus.cc:493] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.217872 27333 raft_consensus.cc:2804] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:50.251852 22072 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:50.231348 27374 raft_consensus.cc:3055] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:50.285957 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:50.286139 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:50.287619 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:50.291798 22816 raft_consensus.cc:1240] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:50.289264 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:50.234488 22175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.005s	sys 0.009s
I20260709 13:07:50.283450 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:50.281186 27288 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.258601 27111 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:50.284786 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:50.301812 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:50.302428 22250 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 16.
I20260709 13:07:50.295526 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:50.273967 27034 raft_consensus.cc:2749] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:50.298350 22072 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:50.304219 22101 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 15.
I20260709 13:07:50.305191 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:50.305372 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:50.305955 22101 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
I20260709 13:07:50.307969 27317 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:50.308418 27317 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.308774 27317 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:50.269971 27242 consensus_queue.cc:1048] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:07:50.312124 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:50.294529 22100 raft_consensus.cc:1240] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:50.253433 27366 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:07:50.281536 27362 raft_consensus.cc:697] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:50.295122 27328 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:50.285596 27374 raft_consensus.cc:740] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:50.293401 27324 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:50.306874 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:50.321547 22072 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:50.310796 27111 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.282882 27314 consensus_queue.cc:1059] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:07:50.318291 27127 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:50.323977 27048 tablet_bootstrap.cc:492] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:07:50.355922 27200 consensus_meta.cc:287] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.002s
I20260709 13:07:50.327805 27204 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:50.368606 27032 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:50.345927 27132 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:50.376750 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:50.294869 27311 consensus_queue.cc:260] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:50.378221 27378 log.cc:927] Time spent T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 13:07:50.379150 27383 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:07:50.375841 27374 consensus_queue.cc:260] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.317399 27332 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:07:50.327562 27333 raft_consensus.cc:697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 14 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:50.474076 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:50.372679 22779 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:50.459408 27048 tablet_bootstrap.cc:492] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:07:50.463101 27362 consensus_queue.cc:237] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:50.468353 27375 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.330s	user 0.003s	sys 0.000s
I20260709 13:07:50.358141 27363 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:07:50.388090 27207 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:07:50.481640 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 109014us
I20260709 13:07:50.482390 22779 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:50.479122 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 194082us
I20260709 13:07:50.456197 27213 consensus_queue.cc:1059] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
W20260709 13:07:50.490113 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 174117us
I20260709 13:07:50.412019 27200 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:50.493470 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.494079 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.482803 27363 consensus_queue.cc:1243] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer 765d912bde9e48959e50d9efec3c26b6 log is divergent from this leader: its last log entry 15.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:50.494812 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:50.485404 27287 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:50.501187 22247 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 17: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:50.482987 27207 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:50.505673 22147 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:50.505107 27333 consensus_queue.cc:237] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.508397 22097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50282 (request call id 2109) took 1139 ms. Trace:
I20260709 13:07:50.517086 22097 rpcz_store.cc:276] 0709 13:07:49.368823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.368966 (+   143us) service_pool.cc:224] Handling call
0709 13:07:50.508199 (+1139233us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54000235d4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:50.508301 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1006774016}
I20260709 13:07:50.502045 27374 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:50.500453 27048 ts_tablet_manager.cc:1403] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 2.910s	user 0.071s	sys 0.047s
I20260709 13:07:50.502975 27287 raft_consensus.cc:697] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:50.504026 27132 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:50.502864 26998 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:50.526904 22218 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:50.527940 22147 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:50.541106 27132 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.554616 27287 consensus_queue.cc:237] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.556087 27366 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:50.556939 22103 raft_consensus.cc:1240] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:50.525043 27032 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:50.562105 22147 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:50.581688 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 45887us
I20260709 13:07:50.566210 27132 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:50.590538 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.594431 27207 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:50.596347 27370 log.cc:927] Time spent T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.444s	user 0.000s	sys 0.002s
I20260709 13:07:50.601866 27268 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:50.603781 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:50.603870 27111 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:50.604737 22813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35214 (request call id 842) took 1492 ms. Trace:
I20260709 13:07:50.605237 27391 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:50.606189 27111 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:50.520319 27356 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:50.609053 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:50.609615 27356 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:50.610034 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:50.606851 22144 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:50.587496 27317 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.611330 22815 raft_consensus.cc:2368] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 14. Current term is 15.
I20260709 13:07:50.612365 27317 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:50.605099 22813 rpcz_store.cc:276] 0709 13:07:49.112036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.112153 (+   117us) service_pool.cc:224] Handling call
0709 13:07:49.124691 (+ 12538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.155243 (+1030552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.604469 (+449226us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540004fe54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:50.604649 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2368560512}
I20260709 13:07:50.613024 27032 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:50.613492 27032 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.613842 27032 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:50.615185 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:50.615804 22098 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:50.616734 27311 raft_consensus.cc:3060] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:50.607554 27200 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:50.607321 27132 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.625357 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:50.626077 22105 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.612931 22144 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:50.628588 22098 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 17.
I20260709 13:07:50.570444 27374 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:50.566387 27366 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:50.633592 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:50.635591 22104 raft_consensus.cc:2393] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 13: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:50.635622 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:50.636504 22098 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:07:50.640262 22246 pending_rounds.cc:85] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 6
I20260709 13:07:50.640025 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:50.635465 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:50.641304 22177 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:50.640585 22246 pending_rounds.cc:107] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 15.7
I20260709 13:07:50.642555 22246 raft_consensus.cc:2889] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:50.657683 22144 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:50.668007 22098 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 15.
I20260709 13:07:50.672930 27132 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 18 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:50.675598 27048 raft_consensus.cc:359] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:50.676223 27288 raft_consensus.cc:515] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.676699 27048 raft_consensus.cc:740] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:07:50.677451 27048 consensus_queue.cc:260] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:50.636709 27366 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:50.682505 22144 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:50.683408 27132 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:50.684078 27132 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.636889 26975 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:50.685034 26975 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:50.686547 22808 raft_consensus.cc:1240] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:50.688519 22172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:07:50.632241 27374 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.689301 22172 raft_consensus.cc:606] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:50.635521 26802 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:50.697520 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:50.687443 26975 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:50.639010 27391 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:50.687460 27395 log.cc:927] Time spent T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:07:50.708304 22177 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 15.
W20260709 13:07:50.708703 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 69974.5us
I20260709 13:07:50.678812 27288 leader_election.cc:290] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:50.720609 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 64468.3us
I20260709 13:07:50.721304 22781 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:50.698758 27007 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:50.703938 27374 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:50.697826 27132 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:50.724073 22106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43368 (request call id 816) took 1144 ms. Trace:
I20260709 13:07:50.724475 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77137a3a1cee4b55ae36e0a368f7e363" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:50.726671 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:50.708176 27314 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:50.729475 22098 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:50.727778 22106 rpcz_store.cc:276] 0709 13:07:49.579237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.579389 (+   152us) service_pool.cc:224] Handling call
0709 13:07:49.793004 (+213615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.911760 (+118756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.721107 (+809347us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400215a54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:50.724011 (+  2904us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261643136}
I20260709 13:07:50.730007 22177 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.732573 27268 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:50.733218 27268 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:50.733654 27268 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:50.727388 27007 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.745101 22172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:07:50.748917 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:50.754554 22813 raft_consensus.cc:3060] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:50.760222 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:50.760869 22249 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:50.710393 26802 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.736812 27288 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:50.800042 22098 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 18.
I20260709 13:07:50.730383 27132 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:50.807106 27356 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:50.807760 27356 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.812446 27048 ts_tablet_manager.cc:1434] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.271s	user 0.006s	sys 0.002s
W20260709 13:07:50.815483 27409 log.cc:927] Time spent T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:07:50.816789 22813 raft_consensus.cc:2468] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 18.
I20260709 13:07:50.736661 27314 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:50.828799 22177 raft_consensus.cc:2468] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
I20260709 13:07:50.830897 22781 leader_election.cc:304] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:50.814113 27032 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:50.840296 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:50.839917 22144 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:50.801573 27288 raft_consensus.cc:697] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:50.847452 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:50.817865 27007 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:50.850231 22172 raft_consensus.cc:606] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:50.851234 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:50.851374 22172 raft_consensus.cc:614] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:50.838135 27390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.014s	sys 0.012s
I20260709 13:07:50.852059 22098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:50.853745 22098 raft_consensus.cc:3060] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:50.851374 22100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:50.855374 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:50.834671 27356 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:50.841830 27287 raft_consensus.cc:2804] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:50.861564 27410 raft_consensus.cc:2804] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:50.865140 27374 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.867329 27032 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:50.870319 22098 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:50.871958 26802 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:50.879343 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:50.883437 22105 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:50.920038 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:50.926540 22175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 759) took 1567 ms. Trace:
I20260709 13:07:50.927021 22175 rpcz_store.cc:276] 0709 13:07:49.359161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.359306 (+   145us) service_pool.cc:224] Handling call
0709 13:07:49.388727 (+ 29421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.396692 (+  7965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.396738 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.453931 (+ 57193us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.301207 (+847276us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:50.327313 (+ 26106us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.337743 (+ 10430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.337857 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.466055 (+128198us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b180002f860. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:07:50.925644 (+459589us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b24002ba7c8. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4ce79c4 00007f66a4ce5acb 00007f66a4ea0dc9 00007f66a4ea0a55 00007f66a4e9ffb0 00007f66a7b16488 00007f66a7b16be8 00007f66a7aee398 00007f66a7ae976a 00007f66a7ae8bb6
0709 13:07:50.926276 (+   632us) raft_consensus.cc:1685] finished
0709 13:07:50.926298 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.926450 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17619,"prepare.queue_time_us":25744,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":75949,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":12001,"spinlock_wait_cycles":52657280,"thread_start_us":770523,"threads_started":1,"wal-append.queue_time_us":761139}
W20260709 13:07:50.928766 27371 log.cc:927] Time spent T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.775s	user 0.002s	sys 0.000s
W20260709 13:07:50.854558 27390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.015s	sys 0.012s
I20260709 13:07:50.857525 27268 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:50.876121 27132 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:50.937042 27356 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:50.953145 27356 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.955385 27356 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:50.939757 27401 log.cc:927] Time spent T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:07:50.940575 27314 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:50.941066 27288 consensus_queue.cc:237] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.958428 26998 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:50.935518 27287 raft_consensus.cc:697] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:50.941704 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:50.958962 26998 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:50.959619 27287 consensus_queue.cc:237] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.943542 27152 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:50.945660 27319 raft_consensus.cc:3055] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:50.950064 27055 raft_consensus.cc:3055] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:50.942341 27410 raft_consensus.cc:697] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:50.970180 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:50.972158 22069 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:50.963673 22782 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:50.977032 22181 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 8. (term mismatch)
I20260709 13:07:50.977515 22181 pending_rounds.cc:85] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 7
I20260709 13:07:50.977840 22181 pending_rounds.cc:107] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 13:07:50.978130 22181 raft_consensus.cc:2889] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:50.985316 22177 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:50.967722 27319 raft_consensus.cc:740] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:50.989120 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:50.993966 27410 consensus_queue.cc:237] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:50.971385 27055 raft_consensus.cc:740] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:50.991780 22103 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 14.
I20260709 13:07:50.981480 26709 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:51.032698 27319 consensus_queue.cc:260] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:51.034052 27319 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.022626 27268 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:51.039534 26998 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:51.041810 27366 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:51.043502 22814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35230 (request call id 736) took 1793 ms. Trace:
I20260709 13:07:51.053719 27132 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:51.056970 27132 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:51.054338 22814 rpcz_store.cc:276] 0709 13:07:49.267598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.272715 (+  5117us) service_pool.cc:224] Handling call
0709 13:07:49.279507 (+  6792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.190096 (+910589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.043276 (+853180us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54004f5954. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:51.043446 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1990134528}
I20260709 13:07:51.059778 27374 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:51.060336 27268 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:51.061412 27400 log.cc:927] Time spent T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.351s	user 0.000s	sys 0.000s
I20260709 13:07:51.057874 26998 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:51.064421 27132 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:51.062649 27268 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:51.022892 27314 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:51.065562 27314 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:51.067248 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:51.067528 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:51.068044 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:51.068656 22248 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:51.069185 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:51.074904 22249 raft_consensus.cc:2468] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:51.076375 22255 raft_consensus.cc:1240] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:51.077320 27055 consensus_queue.cc:260] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:51.077907 27414 log.cc:927] Time spent T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 13:07:51.078589 27413 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:07:51.096608 27055 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.080459 27314 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:51.082015 27366 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:07:51.084969 27412 log.cc:927] Time spent T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:07:51.095078 22248 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 17.
I20260709 13:07:51.094075 22147 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:51.132709 22147 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:51.133843 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:51.145418 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:51.145561 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:51.149501 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 177451us
I20260709 13:07:51.150347 22069 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:51.136283 27314 raft_consensus.cc:2804] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:51.152256 22069 leader_election.cc:400] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 14. Current term is 15.
I20260709 13:07:51.152367 22181 raft_consensus.cc:1275] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:51.155290 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:51.170203 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:51.165396 22147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.171053 22180 raft_consensus.cc:2410] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for term 19 because replica has last-logged OpId of term: 16 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:07:51.172510 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:51.176760 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 336896us
I20260709 13:07:51.179160 22144 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.182003 22069 leader_election.cc:403] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:51.148661 27262 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:51.177074 26560 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.214684 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:51.215281 27034 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:51.215062 26560 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:51.153453 27331 raft_consensus.cc:2749] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.216216 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:51.216934 22814 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:51.217406 26560 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:51.219682 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:51.222481 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:51.224573 22180 pending_rounds.cc:85] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 6
I20260709 13:07:51.224918 22180 pending_rounds.cc:107] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:07:51.225157 22180 raft_consensus.cc:2889] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:51.226274 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:51.146974 27356 consensus_queue.cc:1048] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:07:51.167927 27152 raft_consensus.cc:2764] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:07:51.192648 22144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.232484 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 80391.6us
I20260709 13:07:51.192003 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:51.238761 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:51.239578 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:51.234133 27268 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.241370 27268 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:51.245452 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:51.248291 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:51.248919 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:51.251449 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:51.146589 27374 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.254370 22246 raft_consensus.cc:2393] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 12: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:51.256232 22814 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 17.
I20260709 13:07:51.256305 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:51.257010 22101 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 17: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:51.257536 22099 raft_consensus.cc:2393] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 12: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:51.237560 27331 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 14. Current term is 15.
I20260709 13:07:51.266438 22808 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:51.210979 27314 raft_consensus.cc:697] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:51.268553 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:51.253427 27375 log.cc:927] Time spent T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:07:51.270279 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:51.191150 27132 consensus_queue.cc:1059] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:07:51.254905 27268 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:51.273257 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 95031.4us
I20260709 13:07:51.257052 27391 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.281582 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:51.283556 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:51.284515 22175 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.238799 27262 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:51.262605 27374 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:51.294288 27415 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.310480 22220 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.316565 22220 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.317770 22220 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.296115 27396 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:51.294708 27391 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:51.315814 26460 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:51.327854 27374 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:51.328322 27315 raft_consensus.cc:3060] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:51.328666 27426 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:51.329048 27396 raft_consensus.cc:697] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:51.340667 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:51.331881 22247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51880 (request call id 2432) took 1046 ms. Trace:
I20260709 13:07:51.341355 22247 rpcz_store.cc:276] 0709 13:07:50.285503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.285682 (+   179us) service_pool.cc:224] Handling call
0709 13:07:51.331668 (+1045986us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b540023bc54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:51.331806 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493072640}
I20260709 13:07:51.321576 27200 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:51.322497 27242 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:51.319269 27415 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:51.348460 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:51.342115 27356 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.349997 27415 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:51.315587 27034 consensus_queue.cc:1059] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:07:51.350566 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:51.354804 22175 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:07:51.335575 26460 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:51.359256 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:51.359992 22175 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:51.363657 27262 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:51.363883 27396 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:51.365852 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:51.363095 27417 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.377174 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:51.377955 22218 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:51.378393 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:51.379542 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:51.379925 27392 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:51.380244 22179 raft_consensus.cc:2393] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 17: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:51.380672 27392 raft_consensus.cc:697] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 17 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:51.381880 22179 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:07:51.382385 22179 pending_rounds.cc:85] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 9
I20260709 13:07:51.382661 22179 pending_rounds.cc:107] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:07:51.383101 22179 raft_consensus.cc:2889] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:51.381887 27392 consensus_queue.cc:237] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:51.390209 27372 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 1.095s	user 0.004s	sys 0.000s
I20260709 13:07:51.398377 22173 raft_consensus.cc:1240] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:51.399309 22218 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:51.400224 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:51.400923 27333 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:51.401453 27333 raft_consensus.cc:697] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:51.401580 27200 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:51.424472 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:51.340529 27314 consensus_queue.cc:237] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:51.426704 27417 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:51.427397 26460 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:51.423609 27200 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:51.428400 27200 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:51.429289 27417 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:51.343605 27426 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:51.437098 27426 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:51.443032 27200 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:51.447633 27391 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:51.449031 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 169061us
I20260709 13:07:51.453853 27127 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:51.455255 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:51.455783 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:51.459657 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:51.460341 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:51.460005 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 165188us
I20260709 13:07:51.467362 22071 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:51.467602 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:51.449452 27200 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:51.461947 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:51.475157 22177 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
W20260709 13:07:51.481737 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 163991us
I20260709 13:07:51.488876 22220 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.482312 27364 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:07:51.498432 27392 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:51.497426 22249 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:51.497044 27333 consensus_queue.cc:237] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:51.487958 27200 consensus_queue.cc:1048] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:07:51.508363 22220 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.513502 27439 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:51.514070 27439 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:51.514534 27439 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.516330 22220 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:51.527496 22816 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.010s	sys 0.021s
W20260709 13:07:51.527948 22816 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.010s	sys 0.021s
I20260709 13:07:51.528855 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:51.530062 22178 raft_consensus.cc:2368] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 14. Current term is 15.
I20260709 13:07:51.483820 27341 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:51.481756 27152 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
W20260709 13:07:51.545318 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 76092.4us
I20260709 13:07:51.560176 22220 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.562101 27356 consensus_queue.cc:1059] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:51.563212 27434 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:51.531347 27111 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.566620 22071 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:51.573622 22071 leader_election.cc:400] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 14. Current term is 15.
I20260709 13:07:51.574890 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:51.576918 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:51.578680 22175 raft_consensus.cc:1275] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:51.580343 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:51.581118 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:51.535574 27200 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:07:51.574322 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:51.596494 22175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:07:51.597502 22175 raft_consensus.cc:606] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.597985 22175 raft_consensus.cc:614] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:51.599174 27396 consensus_queue.cc:1059] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:07:51.625833 22812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35198 (request call id 1247) took 1062 ms. Trace:
W20260709 13:07:51.635947 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.631992 22812 rpcz_store.cc:276] 0709 13:07:50.563793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.563952 (+   159us) service_pool.cc:224] Handling call
0709 13:07:51.625488 (+1061536us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b54007f9328. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66ace77aa1 00007f66acef2ebc 00007f66acf2808c 00007f66acf1293b 00007f66acf123d2 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c
0709 13:07:51.625756 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41944448}
I20260709 13:07:51.638144 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:51.639051 22101 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:51.605631 27010 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:51.585274 27439 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:51.613703 27367 consensus_queue.cc:1059] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:07:51.631074 26975 consensus_queue.cc:1048] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:07:51.667480 22812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:47484
I20260709 13:07:51.666664 22097 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:51.671167 27439 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:51.674799 22812 raft_consensus.cc:606] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.680982 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:07:51.683485 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:51.705657 22812 raft_consensus.cc:1275] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:51.705899 27410 raft_consensus.cc:3055] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:51.706269 27410 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:51.707237 27410 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:51.707507 27393 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:51.724332 27055 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:07:51.795845 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 170434us
W20260709 13:07:51.775764 27449 log.cc:927] Time spent T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.164s	user 0.004s	sys 0.000s
W20260709 13:07:51.797405 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 177930us
I20260709 13:07:51.801549 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:51.752518 27055 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:51.813817 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:51.814687 22104 raft_consensus.cc:2393] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 13: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:51.804908 27439 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:51.827509 27381 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:51.832149 27381 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:51.834555 27381 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:51.848337 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:51.855523 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.861608 22101 raft_consensus.cc:2468] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
I20260709 13:07:51.868436 22218 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:51.871048 22144 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.840880 27439 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:51.865741 27262 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:51.863348 27454 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:51.863483 27415 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:51.887058 27451 raft_consensus.cc:2804] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:51.889551 27055 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:51.887455 27314 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:51.930961 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 60032.3us
I20260709 13:07:51.932003 22144 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.937687 22144 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.925961 27319 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.945466 22144 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.929090 27451 raft_consensus.cc:697] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:51.949668 22218 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:51.951313 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.940894 27055 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:51.920121 27454 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:51.946115 27262 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:51.959875 22144 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:51.924531 27415 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:51.948938 27391 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:51.958946 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:51.967572 22809 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:51.979257 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:51.979977 27439 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:51.980567 27439 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.969542 27381 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:51.967746 27466 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.981573 27381 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:51.983294 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:51.983783 27381 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:51.985805 27415 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:51.981927 27466 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:51.987071 27268 raft_consensus.cc:3055] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:51.986634 27451 consensus_queue.cc:237] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:51.987512 27268 raft_consensus.cc:740] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:51.988510 27268 consensus_queue.cc:260] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:51.947005 27319 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:51.992420 27319 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:51.995343 22178 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:07:51.995862 27446 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:51.995936 22178 pending_rounds.cc:85] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3: Aborting all ops after (but not including) 11
I20260709 13:07:51.998183 22178 pending_rounds.cc:107] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:07:51.998529 22178 raft_consensus.cc:2889] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.000844 22181 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:52.003331 22814 raft_consensus.cc:1275] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:07:52.008803 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 59257.6us
I20260709 13:07:51.996776 27446 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.012805 22181 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:52.019675 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:52.018512 22781 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:52.022586 22179 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:52.024896 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:52.020490 27446 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:52.046676 27467 consensus_queue.cc:1059] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:07:52.051717 27454 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:52.032838 27428 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:52.055227 27428 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.026829 27368 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:52.060518 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:52.044984 27381 consensus_queue.cc:1059] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 13:07:52.045269 22071 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.130.66:42399 timed out after 1.869s (SENT) [suppressed 9 similar messages]
I20260709 13:07:52.065598 27428 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:52.076184 22252 raft_consensus.cc:1275] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:52.080168 26975 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:52.080387 27287 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.080857 26975 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.080984 27287 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.083053 27362 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:52.083304 27287 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:52.083628 27362 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.083906 27381 raft_consensus.cc:3055] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:52.084565 27381 raft_consensus.cc:740] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:52.085479 27381 consensus_queue.cc:260] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.086122 27362 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:52.087119 22814 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEARNER]: Advancing to term 15
I20260709 13:07:52.089080 27468 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:52.089874 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:52.089816 27468 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:52.091936 27468 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:52.095839 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:07:52.098537 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 63993.1us
I20260709 13:07:52.099916 22814 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:52.101356 27398 consensus_queue.cc:1059] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:52.102485 27398 consensus_queue.cc:1048] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:52.102768 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:52.103112 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:52.103744 22097 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:07:52.113751 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 153953us
I20260709 13:07:52.114537 22144 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.116983 22144 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.118620 27398 raft_consensus.cc:493] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:52.118896 27451 raft_consensus.cc:493] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:52.119336 27398 raft_consensus.cc:515] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.119557 27451 raft_consensus.cc:515] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.121469 27398 leader_election.cc:290] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:52.121789 27451 leader_election.cc:290] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:52.122555 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 96834.3us
I20260709 13:07:52.123435 27335 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:52.123428 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:52.126199 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:52.128228 27335 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:52.131518 22252 raft_consensus.cc:1275] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:52.133594 27111 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:52.134140 27111 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:52.134153 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.137135 22220 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.138652 27315 raft_consensus.cc:3055] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:52.139101 27315 raft_consensus.cc:740] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:52.140141 27452 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.139955 27315 consensus_queue.cc:260] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:52.141263 27315 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:52.143007 27469 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:52.143388 27390 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:52.143569 27469 raft_consensus.cc:697] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:52.143754 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:52.143918 27390 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:52.144513 27469 consensus_queue.cc:237] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:52.147137 27111 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:52.146400 27390 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:52.145102 27468 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:52.148736 27468 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:52.149622 27410 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.150857 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:52.152829 22144 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:52.155303 22220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.156796 22106 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:52.157976 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:52.161353 22101 raft_consensus.cc:1240] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:52.165755 22172 raft_consensus.cc:1240] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:52.166857 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:52.168087 22144 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.104679 27127 consensus_queue.cc:1050] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:07:52.169759 22097 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:52.171900 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:52.172276 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:52.175163 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:52.175994 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.177485 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:52.178635 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ac70b72e5d452ca6dd020f9ccb0541" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:52.181166 22181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:52.187186 22144 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.156159 27034 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.190008 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57adaf54eaf24c778165ac40cc629c38" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:52.190228 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.190681 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.158898 27242 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:52.193913 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.157915 27391 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:52.196455 22144 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.198305 22180 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:07:52.171185 27466 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.195708 27398 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.179729 27451 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:52.197705 27391 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.197798 27396 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:52.207795 27468 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:52.207727 27396 consensus_queue.cc:1048] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:52.208536 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:52.204512 22099 raft_consensus.cc:1240] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:52.188344 26975 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:07:52.203744 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 158507us
I20260709 13:07:52.173456 27426 consensus_queue.cc:1048] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:07:52.213955 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:52.214592 22099 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:52.206645 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:52.215545 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:52.215858 22097 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 16.
I20260709 13:07:52.182729 27319 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:52.218051 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:52.219501 27471 log.cc:927] Time spent T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:52.192153 27415 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.222002 22144 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.207602 27451 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:52.226640 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:52.194779 27314 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:52.223441 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:52.202687 27452 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.179667 27390 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:07:52.230291 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:52.230479 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:52.203254 27242 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:52.247296 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:52.248468 26975 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.248996 27242 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:52.249202 22072 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:52.223063 27415 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.250708 27127 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.258699 22220 leader_election.cc:304] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:52.259243 22173 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 14.
I20260709 13:07:52.260885 22220 leader_election.cc:304] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:52.265389 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:52.262639 22218 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.271780 22218 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.259701 27055 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:52.231613 27034 consensus_queue.cc:1059] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:52.277187 22116 tablet_copy_service.cc:342] P c0694f6572bf406a92d55f1f2ab46ef2: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-16e48ec055f940c49e01d5a5d77581aa received from {username='slave'} at 127.0.0.1:43368
I20260709 13:07:52.266690 27452 raft_consensus.cc:2749] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:52.284449 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:52.276356 27469 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.272802 27398 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.294137 22249 raft_consensus.cc:3055] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:52.290759 27467 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.269738 27415 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:52.271914 27200 raft_consensus.cc:2749] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.279395 27055 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.293392 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:52.249001 26975 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:52.306542 22249 raft_consensus.cc:740] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:52.309412 22072 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:52.274528 27444 raft_consensus.cc:493] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:52.266052 27468 consensus_queue.cc:1059] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:07:52.300611 22116 tablet_copy_service.cc:434] P c0694f6572bf406a92d55f1f2ab46ef2: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-16e48ec055f940c49e01d5a5d77581aa on tablet 16e48ec055f940c49e01d5a5d77581aa with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:52.307222 27469 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:52.283571 27410 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
W20260709 13:07:52.339901 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 68180.8us
I20260709 13:07:52.342372 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:52.312022 27415 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:52.347806 22252 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:52.337697 27055 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:52.351039 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:52.345800 22249 consensus_queue.cc:260] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.338876 27127 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.354413 22099 raft_consensus.cc:1275] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:52.355080 27451 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:52.356482 27333 raft_consensus.cc:3055] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:52.356891 27333 raft_consensus.cc:740] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:52.358033 27344 raft_consensus.cc:3055] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:52.358510 27344 raft_consensus.cc:740] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:52.359380 27344 consensus_queue.cc:260] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.360631 27344 raft_consensus.cc:3060] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:52.360860 27464 log.cc:927] Time spent T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.419s	user 0.002s	sys 0.000s
I20260709 13:07:52.341192 27444 raft_consensus.cc:515] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.365162 27444 leader_election.cc:290] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:52.367462 26975 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:52.372581 27469 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:52.374771 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:52.379115 27034 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:52.379585 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:52.383952 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.354074 22179 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
I20260709 13:07:52.385488 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:52.387989 22220 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:52.391242 27366 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:52.352572 27415 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:52.391666 27366 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:52.392086 27366 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:52.393504 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57856 (request call id 767) took 2170 ms. Trace:
I20260709 13:07:52.393888 22174 rpcz_store.cc:276] 0709 13:07:50.216420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.220177 (+  3757us) service_pool.cc:224] Handling call
0709 13:07:50.225975 (+  5798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.514837 (+1288862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.514873 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.514910 (+    37us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:51.514975 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.386717 (+871742us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540013d654. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f4ee01 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c 00007f66a6488cc2 00007f66a628948c 00007f66a62888c6
0709 13:07:52.386762 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.386867 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":408,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":9534,"spinlock_wait_cycles":2963426176}
I20260709 13:07:52.395607 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:52.396225 27476 log.cc:927] Time spent T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:07:52.349722 27337 consensus_queue.cc:1048] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:07:52.401047 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 63836.8us
W20260709 13:07:52.400197 27477 log.cc:927] Time spent T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:52.432103 22218 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.433490 22218 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.436299 27392 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.437024 27392 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.446125 22177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51118 (request call id 2852) took 1347 ms. Trace:
I20260709 13:07:52.446635 22177 rpcz_store.cc:276] 0709 13:07:51.098456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.098603 (+   147us) service_pool.cc:224] Handling call
0709 13:07:52.445916 (+1347313us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b5400177fd4. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7f522fa 00007f66acf13b17 00007f66a648e6d4 00007f66a648e662 00007f66a648e591 00007f66a648e50c 00007f66a648d7c2 00007f66a628948c 00007f66a62888c6 00007f66a628826f
0709 13:07:52.446032 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774222208}
I20260709 13:07:52.450058 27381 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.460901 27341 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:52.461534 27341 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.461822 27415 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:52.473734 22145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.463337 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 48647.2us
I20260709 13:07:52.463927 22218 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.348387 27410 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.468863 22781 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:52.413499 27319 consensus_queue.cc:1048] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:07:52.496888 27335 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:52.498664 27385 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:52.499147 27385 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.499032 27335 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.499614 27385 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:52.501336 27335 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:52.492475 27317 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:07:52.488927 27446 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.490568 27315 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:07:52.520851 27315 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.523474 27315 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:52.525049 27341 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:52.511852 22218 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.510814 22178 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:52.530668 22104 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:52.531904 22181 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:52.533392 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:52.535867 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:52.536496 22101 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 8.
I20260709 13:07:52.540493 22106 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:52.530675 27456 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:52.522461 27055 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:52.552083 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 81212.8us
I20260709 13:07:52.558892 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:52.576983 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.555570 27446 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:07:52.512326 27366 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:52.587378 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:52.587962 22105 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:52.589321 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:52.590595 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:52.583931 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:52.584499 27415 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:52.586398 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:52.591511 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383c9bd275674f7d8d5cdf16a1456960" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:52.592371 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:52.605720 22102 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:52.609211 27385 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.583103 27055 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:52.590816 22218 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.597757 22105 raft_consensus.cc:2468] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:07:52.611344 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:52.612135 27308 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:52.612337 22144 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:52.612855 27410 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:52.613510 27410 raft_consensus.cc:2804] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:52.613969 27410 raft_consensus.cc:697] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:52.614411 22105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:52.621713 22102 raft_consensus.cc:2468] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 17.
I20260709 13:07:52.625185 22144 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:52.612854 27308 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:07:52.629506 27055 raft_consensus.cc:2804] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:52.630098 27055 raft_consensus.cc:697] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:52.631081 27055 consensus_queue.cc:237] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.633275 22814 raft_consensus.cc:1240] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Rejecting Update request from peer 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 13. Current term is 15. Ops: []
I20260709 13:07:52.636255 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:52.638197 22814 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:52.638793 27268 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.639664 27366 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:52.642823 27335 raft_consensus.cc:493] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:52.643525 27335 raft_consensus.cc:515] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.647523 27333 consensus_queue.cc:260] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.648414 27335 leader_election.cc:290] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:52.648613 27333 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:52.652204 27410 consensus_queue.cc:237] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.656785 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:52.656950 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:52.657769 22809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:52.662222 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:52.664216 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:52.678783 27385 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:52.680042 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:52.680694 22813 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 11.
I20260709 13:07:52.681945 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:52.687368 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:52.690292 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:52.691087 22180 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 9.
I20260709 13:07:52.694674 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:52.695603 22177 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:52.698287 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:52.702811 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 234003us
I20260709 13:07:52.718178 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:52.719004 22172 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:52.722287 22177 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:52.728856 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8407607d7441c7bdac45e1dadc700d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:52.729687 22071 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:52.726006 22779 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.733601 22813 raft_consensus.cc:1240] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:52.738427 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.739840 27317 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:52.686784 27446 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:07:52.751927 22071 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:52.736868 27341 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.732131 27486 consensus_queue.cc:1048] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:07:52.788659 22172 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 15.
I20260709 13:07:52.789085 22178 raft_consensus.cc:1275] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:07:52.789722 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 55570.2us
I20260709 13:07:52.757226 27337 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:52.757618 27341 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:52.803488 22781 leader_election.cc:304] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:52.806800 27341 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.799052 27337 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.815425 27337 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:52.819818 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 63392us
W20260709 13:07:52.824046 27491 log.cc:927] Time spent T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:07:52.825160 22146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.826053 22781 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:52.826604 27317 raft_consensus.cc:2749] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:52.828527 27344 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:07:52.829042 27493 log.cc:927] Time spent T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:07:52.829169 27344 raft_consensus.cc:697] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:52.830171 22069 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
W20260709 13:07:52.835216 22219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.835583 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:52.840453 27335 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:52.841382 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:52.841876 27335 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:52.830137 27344 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:52.844626 26802 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.849648 27055 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:52.855682 27327 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.856252 27327 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:52.864284 22249 raft_consensus.cc:3060] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.866724 27177 raft_consensus.cc:993] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: : Instructing follower c0694f6572bf406a92d55f1f2ab46ef2 to start an election
I20260709 13:07:52.867274 27486 raft_consensus.cc:1081] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Signalling peer c0694f6572bf406a92d55f1f2ab46ef2 to start an election
I20260709 13:07:52.806469 27454 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:07:52.877255 22072 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:52.881068 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:07:52.895982 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 49260.4us
I20260709 13:07:52.897272 22144 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:52.898301 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 68200.6us
I20260709 13:07:52.901196 22099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:52.911062 22072 leader_election.cc:304] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:52.911315 22144 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.924443 22072 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:52.935485 22248 raft_consensus.cc:1240] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Rejecting Update request from peer c0694f6572bf406a92d55f1f2ab46ef2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:52.945989 22249 raft_consensus.cc:1275] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:07:52.946602 22249 pending_rounds.cc:85] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Aborting all ops after (but not including) 8
I20260709 13:07:52.952916 22249 pending_rounds.cc:107] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:52.953318 22249 raft_consensus.cc:2889] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.915025 27442 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.954214 22249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45738 (request call id 1107) took 1400 ms. Trace:
I20260709 13:07:52.956022 22249 rpcz_store.cc:276] 0709 13:07:51.554437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.554882 (+   445us) service_pool.cc:224] Handling call
0709 13:07:51.570704 (+ 15822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.294042 (+723338us) spinlock_profiling.cc:243] Waited 60.8 ms on lock 0x7b540018ed20. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7ec5dc0 00007f66a7f501c0 00007f66a7f51231 00007f66a7f4dd8f 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4 00007f66a6489b62 00007f66a6489a91 00007f66a6489a0c
0709 13:07:52.863728 (+569686us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b58009785d0. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb7571 00007f66a7eaa0aa 00007f66a7f2c447 00007f66a7f44fe7 00007f66a7f467de 00007f66a7f50b49 00007f66a7f51416 00007f66a7f4dd8f 00007f66a7f4d83e 00007f66acf12419 00007f66a6489bd4
0709 13:07:52.953853 (+ 90125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.954124 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741166976}
I20260709 13:07:52.929956 27362 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.923115 27315 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.932843 27319 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.975507 22218 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:52.933125 26802 raft_consensus.cc:2749] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.921038 27334 consensus_queue.cc:1059] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
W20260709 13:07:52.968907 27434 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:07:52.955462 27442 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:53.016007 22218 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:52.946178 27472 consensus_queue.cc:1059] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:07:53.019240 27442 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.019946 27381 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:52.986511 27439 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:07:53.013399 27390 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:53.012709 27362 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:53.043540 27499 log.cc:927] Time spent T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:53.026315 27127 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.083972 22814 raft_consensus.cc:1275] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:53.055900 27472 consensus_queue.cc:1243] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Peer 79683575881f4334bd4dc6d9bdbb45c3 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:53.059484 27390 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.082403 27318 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.106793 27390 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.094781 27333 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:53.080319 27127 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:53.151623 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 227243us
W20260709 13:07:53.156255 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 215207us
I20260709 13:07:53.129365 27318 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:53.172399 27318 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:53.172583 27341 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:53.147111 27333 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:53.176717 27333 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:53.184464 27334 raft_consensus.cc:3055] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:53.184743 27127 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:53.185004 27334 raft_consensus.cc:740] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:53.166738 27327 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:53.196717 27177 raft_consensus.cc:3055] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:53.197460 27177 raft_consensus.cc:740] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:53.204191 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:53.204905 22249 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 14.
I20260709 13:07:53.204820 27318 consensus_queue.cc:1048] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:53.205920 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:53.186163 27334 consensus_queue.cc:260] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:53.207739 27334 raft_consensus.cc:3060] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:53.211377 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:53.214655 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:53.216962 22177 raft_consensus.cc:2368] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 14. Current term is 15.
I20260709 13:07:53.206465 27337 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:53.198311 27177 consensus_queue.cc:260] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:53.242400 22220 leader_election.cc:400] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 14. Current term is 15.
I20260709 13:07:53.245241 22106 raft_consensus.cc:1240] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:53.243479 22220 leader_election.cc:403] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:53.179926 27390 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:53.230417 27341 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:07:53.279632 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 44396.4us
I20260709 13:07:53.281613 27308 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:07:53.287533 27177 raft_consensus.cc:3060] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:53.327791 22780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.339900 27442 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:53.342893 27442 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:53.343442 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
W20260709 13:07:53.368561 27501 log.cc:927] Time spent T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6: Append to log took a long time: real 0.316s	user 0.002s	sys 0.000s
I20260709 13:07:53.373821 27308 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399) with higher term. Message: Invalid argument: T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 for earlier term 14. Current term is 15.
I20260709 13:07:53.374720 27390 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:53.381763 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:07:53.384963 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 221399us
I20260709 13:07:53.382251 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:53.388206 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:53.389007 22176 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.385649 22097 raft_consensus.cc:3060] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.383945 27390 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.394400 27390 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:53.406375 22097 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:53.409785 22218 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:07:53.413936 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 255045us
I20260709 13:07:53.419267 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:53.420465 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:53.421671 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:53.425743 22779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.412328 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 252482us
I20260709 13:07:53.442458 27514 consensus_queue.cc:1059] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:07:53.451159 27514 raft_consensus.cc:3055] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:53.451532 27514 raft_consensus.cc:740] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:53.451941 27381 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:53.452404 27514 consensus_queue.cc:260] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:53.448261 22103 raft_consensus.cc:1240] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:53.454041 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:53.455109 27514 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:53.455682 27390 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:53.459192 27337 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:53.438081 22071 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:07:53.449805 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 47361.9us
I20260709 13:07:53.468379 22176 raft_consensus.cc:2468] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:53.426877 27446 consensus_queue.cc:1059] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:53.475219 22104 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:07:53.524902 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 115202us
I20260709 13:07:53.525693 22218 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:53.523440 27447 raft_consensus.cc:3055] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:53.548590 22106 raft_consensus.cc:1240] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:53.554095 22106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:53.557602 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:53.559732 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:53.556036 22106 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
I20260709 13:07:53.551738 27446 raft_consensus.cc:2804] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:53.579964 27446 raft_consensus.cc:697] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:53.581012 27363 raft_consensus.cc:1064] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:07:53.581483 27446 consensus_queue.cc:237] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:53.585525 27526 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.586117 27526 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:53.588469 27526 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:53.591817 27363 consensus_queue.cc:237] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:53.554128 22104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:43368
I20260709 13:07:53.595889 22104 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:53.596274 22104 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.598269 22218 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:53.549688 27447 raft_consensus.cc:740] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:53.605926 22779 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:53.608259 27177 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:53.611805 22072 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:53.613940 27366 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:53.620108 27366 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.620497 27366 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:53.620862 27514 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:53.622018 27447 consensus_queue.cc:260] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:53.625177 27470 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:53.629654 22816 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:07:53.630048 22816 pending_rounds.cc:85] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: Aborting all ops after (but not including) 11
I20260709 13:07:53.630326 22816 pending_rounds.cc:107] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:07:53.630546 22099 raft_consensus.cc:1275] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:53.630614 22816 raft_consensus.cc:2889] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.629287 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:53.633934 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:53.632784 22103 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:07:53.635978 22144 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:53.637856 27521 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:53.609536 27442 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:53.646466 27521 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:53.652006 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 66867.3us
I20260709 13:07:53.655614 27521 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:53.647912 27447 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:53.654258 22104 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:53.643725 27470 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:07:53.693245 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:53.694667 22255 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.699967 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:53.700650 22814 raft_consensus.cc:3055] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:53.700958 22814 raft_consensus.cc:740] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:53.701705 22814 consensus_queue.cc:260] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:53.768325 22097 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:53.768466 22808 raft_consensus.cc:1275] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:53.769932 22255 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:53.771138 27415 consensus_queue.cc:1048] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:53.775179 22251 raft_consensus.cc:2410] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:07:53.776525 27415 consensus_queue.cc:1048] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:53.778743 22782 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:53.781432 27489 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:53.781827 27489 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.782166 27489 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:53.783097 22104 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:53.783969 27366 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:53.786077 27366 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:53.788080 22814 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.801151 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:53.804119 22097 raft_consensus.cc:3060] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:07:53.806542 27111 consensus_queue.cc:1048] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:07:53.816860 27489 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:53.817137 22176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:53.821293 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:53.822113 22248 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 17: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:53.833588 22814 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:53.836304 22069 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:53.839720 22097 raft_consensus.cc:2468] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 17.
W20260709 13:07:53.841739 22781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.793603 27470 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.877832 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:07:53.875590 27507 log.cc:927] Time spent T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.578s	user 0.006s	sys 0.000s
I20260709 13:07:53.874136 26975 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:53.894124 27177 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.898268 27489 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:53.875665 27470 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:53.900974 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:53.901698 22174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51114 (request call id 2377) took 1027 ms. Trace:
I20260709 13:07:53.926373 22174 rpcz_store.cc:276] 0709 13:07:52.873809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.874091 (+   282us) service_pool.cc:224] Handling call
0709 13:07:52.874491 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.874880 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.874938 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.875451 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:07:53.145814 (+270363us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:53.145857 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.145933 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:53.701975 (+556042us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b4800271a58. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66ace77aa1 00007f66ace6eb37 00007f66ace6e9ca 00007f66acf6626f 00007f66acf65f37 00007f66acf7a55c 00007f66acf7a508 00007f66acf7a488 00007f66acf7a443 00007f66acf796ec 00007f66abea3a96
0709 13:07:53.793095 (+ 91120us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b4400022b4c. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4d87c85 00007f66a4d886a2 00007f66a7afa1db 00007f66a7af5aaf 00007f66a7ae986e 00007f66a7ae8bb6 00007f66a7ae87d8 00007f66a7af2221 00007f66a7af21d9 00007f66a7af2169
0709 13:07:53.901507 (+108412us) raft_consensus.cc:1685] finished
0709 13:07:53.901526 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.901643 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33240,"raft.run_cpu_time_us":4534,"raft.run_wall_time_us":792665,"spinlock_wait_cycles":24392960,"thread_start_us":216550,"threads_started":1,"wal-append.queue_time_us":354248}
I20260709 13:07:53.882074 27534 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:53.941969 27200 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:07:53.942554 27200 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:53.946762 27200 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:53.948769 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:53.915856 27521 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:53.950603 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:53.951218 22179 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 17: Already voted for candidate 79683575881f4334bd4dc6d9bdbb45c3 in this term.
I20260709 13:07:53.951618 22097 raft_consensus.cc:2393] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 11: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:53.952064 27521 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:53.953770 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:53.954450 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:53.954815 22250 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 17: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:53.954949 22174 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:07:53.956300 27470 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:53.927404 27177 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:53.960493 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:53.961321 22250 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 10.
I20260709 13:07:53.961766 22097 raft_consensus.cc:2393] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 17: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:53.960493 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:53.962414 22147 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:53.965078 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:53.965941 22102 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
I20260709 13:07:53.970510 22144 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:53.928254 26975 raft_consensus.cc:697] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:53.973739 26975 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:53.975540 27410 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:07:53.986330 27539 log.cc:927] Time spent T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:07:53.976111 27391 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:53.999397 27391 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.000000 27391 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.938238 27534 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:54.005555 27534 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:54.006331 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:54.007263 22250 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:07:54.010140 22147 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:54.010598 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:54.011454 22816 raft_consensus.cc:2368] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 14. Current term is 15.
I20260709 13:07:54.013324 27268 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:54.013833 27268 raft_consensus.cc:493] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:53.982736 27177 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:54.015612 27055 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:54.017364 22144 leader_election.cc:400] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Vote denied by peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973) with higher term. Message: Invalid argument: T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 14. Current term is 15.
I20260709 13:07:54.017935 27268 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.021872 27055 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:54.031966 22072 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:54.033824 27337 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.044101 27451 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.044922 22072 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:54.048085 22097 raft_consensus.cc:1240] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:54.050076 22249 raft_consensus.cc:1240] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Rejecting Update request from peer a07ca3d1b5b84f4bbcb907f709a69275 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:54.051496 27127 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:54.051502 27451 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:07:53.982298 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 78290.6us
I20260709 13:07:54.056795 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:54.060105 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:54.060753 22253 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:54.071030 27391 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:54.074194 27451 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:54.075171 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:54.075666 27055 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:54.083770 22179 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:54.125408 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:54.126322 22814 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 16.
I20260709 13:07:54.127190 27268 raft_consensus.cc:515] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:54.128242 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:54.128837 22174 raft_consensus.cc:3060] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:54.128999 22250 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:54.130064 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:54.136705 26709 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:54.138392 27268 leader_election.cc:290] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:54.138803 22782 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:54.143781 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:54.145555 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:54.161331 22097 raft_consensus.cc:1275] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:54.172748 22174 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 15.
I20260709 13:07:54.178310 22253 raft_consensus.cc:2468] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 15.
I20260709 13:07:54.187014 22782 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:54.192925 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:54.173382 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 51436.4us
I20260709 13:07:54.198879 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d674bb7c45c407e8aa9767c7438a39e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:54.205942 22104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:54.206668 22104 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.213645 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:54.214406 22253 raft_consensus.cc:3060] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.198148 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:54.167127 27543 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:07:54.224352 22104 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:54.214344 22144 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:54.211886 27335 raft_consensus.cc:2804] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:54.194360 27391 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:54.230536 22253 raft_consensus.cc:2468] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:07:54.222469 27451 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:54.230630 22144 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:54.227749 26709 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:54.234227 27335 raft_consensus.cc:697] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:54.250532 22218 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:54.230394 27410 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:54.273365 22220 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:54.234962 27451 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:54.287891 22147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 54110.9us
I20260709 13:07:54.309626 27335 consensus_queue.cc:237] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:54.306702 22179 raft_consensus.cc:1275] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:07:54.320832 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 90272.4us
W20260709 13:07:54.327896 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 54614.2us
W20260709 13:07:54.327965 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 77513.5us
I20260709 13:07:54.331172 27319 raft_consensus.cc:2804] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:54.331014 27451 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:54.331010 27356 raft_consensus.cc:2804] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:54.331434 27454 raft_consensus.cc:2764] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:54.363822 27467 consensus_queue.cc:1059] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:07:54.394114 27467 raft_consensus.cc:3055] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:54.394536 27467 raft_consensus.cc:740] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:54.395505 27467 consensus_queue.cc:260] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:54.397174 27467 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.390796 27356 raft_consensus.cc:697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 17 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:54.400189 27356 consensus_queue.cc:237] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:54.370013 27428 raft_consensus.cc:1027] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 LEADER]: attempt to promote peer a07ca3d1b5b84f4bbcb907f709a69275: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:07:54.367544 27319 raft_consensus.cc:697] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:54.380249 27434 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:54.386047 27530 consensus_queue.cc:1048] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:07:54.435029 27434 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:54.498677 22251 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:54.502976 27319 consensus_queue.cc:237] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:54.511005 27530 consensus_queue.cc:1048] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:54.522487 22812 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:54.524091 22144 leader_election.cc:304] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:54.539310 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:54.529453 27315 raft_consensus.cc:2749] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:54.523883 26802 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:07:54.540091 27434 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
W20260709 13:07:54.578781 27554 log.cc:927] Time spent T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:07:54.627617 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 103050us
I20260709 13:07:54.551178 27337 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:07:54.630144 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
W20260709 13:07:54.634299 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 105889us
I20260709 13:07:54.627767 27483 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.638643 27446 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.662662 22218 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:54.669796 22175 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:54.673395 22808 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:07:54.683255 27446 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:54.694665 27010 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:54.681897 27447 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:54.709733 22101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:54.704092 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:54.648494 27483 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:54.727948 22251 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:07:54.737573 27451 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:54.739910 27451 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:54.747467 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:54.748288 22097 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:07:54.751359 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:54.751984 22812 raft_consensus.cc:3060] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:54.756016 22101 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 16.
W20260709 13:07:54.757866 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 65808.7us
I20260709 13:07:54.705837 27446 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:54.692466 27127 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:07:54.781262 22812 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 17.
I20260709 13:07:54.784668 22218 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:07:54.781826 22097 raft_consensus.cc:2468] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 17.
I20260709 13:07:54.806030 27483 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:54.814015 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:54.814793 22255 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 16.
I20260709 13:07:54.818033 22072 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:54.789806 27362 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:07:54.817888 27434 raft_consensus.cc:2804] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:54.822721 27428 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:54.884193 27428 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.884639 27428 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:54.907212 22175 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:54.915632 27356 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:54.912709 27434 raft_consensus.cc:697] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 17 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:54.924815 22218 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:54.904296 27392 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.947331 27434 consensus_queue.cc:237] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:54.948766 27392 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:54.936605 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 177236us
I20260709 13:07:54.954447 22174 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:07:54.950023 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 48032.1us
I20260709 13:07:54.960139 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:54.964709 22255 raft_consensus.cc:1275] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:07:54.967888 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 61871.5us
I20260709 13:07:54.969509 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:54.970619 22097 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 14.
I20260709 13:07:54.975009 27410 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:07:54.975569 27410 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:07:54.977885 27410 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:07:54.981016 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:54.957928 27392 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:54.996750 22218 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:55.003981 27385 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:55.008364 27366 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:55.008898 27366 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.009258 27366 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:55.013247 27177 consensus_queue.cc:1048] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:54.990483 27559 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:55.023244 27559 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.023629 27559 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:55.046192 27428 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:07:55.047803 27575 log.cc:927] Time spent T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.003s
I20260709 13:07:55.057978 22097 raft_consensus.cc:1275] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:55.061578 22249 raft_consensus.cc:1275] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:55.068719 22097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:55.074643 22003 catalog_manager.cc:5697] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 8 to 12, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 12 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.076694 22003 catalog_manager.cc:5697] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.078363 22003 catalog_manager.cc:5697] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:07:55.097069 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 146181us
I20260709 13:07:55.102355 22003 catalog_manager.cc:5697] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.111208 22144 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:55.114713 27262 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:55.117483 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:07:55.100973 27521 consensus_queue.cc:1048] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:55.118167 22175 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 15.
I20260709 13:07:55.183300 22003 catalog_manager.cc:5697] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 8 to 13, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 13 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:07:55.186038 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 58910.1us
I20260709 13:07:55.207327 22003 catalog_manager.cc:5697] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.213894 27559 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:55.216231 27559 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:55.221058 27363 raft_consensus.cc:2955] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 9 to 12, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:55.095587 27452 consensus_queue.cc:1048] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:07:55.236188 22102 raft_consensus.cc:1275] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:55.226612 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:55.237643 22178 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:07:55.231792 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:55.230415 22816 raft_consensus.cc:2955] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:55.244295 22003 catalog_manager.cc:5697] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 9 to 14, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 14 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.246222 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:55.247027 22251 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c0694f6572bf406a92d55f1f2ab46ef2 in current term 17: Already voted for candidate 765d912bde9e48959e50d9efec3c26b6 in this term.
I20260709 13:07:55.255059 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:55.255882 22102 raft_consensus.cc:2393] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 765d912bde9e48959e50d9efec3c26b6 in current term 17: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
I20260709 13:07:55.223557 27428 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 17 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:55.209995 27571 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:07:55.262498 22003 catalog_manager.cc:5697] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 12 to 13, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 13 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:07:55.223855 21999 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40410 (request call id 197) took 26476 ms (client timeout 15000 ms). Trace:
I20260709 13:07:55.371160 22003 catalog_manager.cc:5697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:55.276399 27573 consensus_queue.cc:1048] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:07:55.374960 22003 catalog_manager.cc:5697] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 6 to 11, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 11 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.398590 22251 raft_consensus.cc:2955] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:55.419834 22003 catalog_manager.cc:5697] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 6 to 12, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 12 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.276538 27571 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:55.346356 22166 tablet_service.cc:1558] Processing DeleteTablet for tablet 252049d2bcdd4f329ca5015bf10c1b19 with delete_type TABLET_DATA_TOMBSTONED (TS 79683575881f4334bd4dc6d9bdbb45c3 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:36942
I20260709 13:07:55.426862 27571 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:55.431754 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" is_pre_election: true
I20260709 13:07:55.432523 22102 raft_consensus.cc:2393] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 in current term 14: Already voted for candidate c0694f6572bf406a92d55f1f2ab46ef2 in this term.
W20260709 13:07:55.372030 21999 rpcz_store.cc:269] 0709 13:07:28.651477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.651767 (+   290us) service_pool.cc:224] Handling call
0709 13:07:55.109281 (+26457514us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:49.896966 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:50.096384 (+199418us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:50.139461 (+ 43077us) write_op.cc:435] Acquired schema lock
0709 13:07:50.139502 (+    41us) tablet.cc:662] Decoding operations
0709 13:07:50.226861 (+ 87359us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:50.226982 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:50.227011 (+    29us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:07:50.228392 (+  1381us) tablet.cc:701] Row locks acquired
0709 13:07:50.228447 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:07:50.228599 (+   152us) write_op.cc:270] Start()
0709 13:07:50.257816 (+ 29217us) write_op.cc:276] Timestamp: P: 1783602470228539 usec, L: 0
0709 13:07:50.267053 (+  9237us) op_driver.cc:348] REPLICATION: starting
0709 13:07:50.367880 (+100827us) log.cc:844] Serialized 6248 byte log entry
0709 13:07:51.223152 (+855272us) op_driver.cc:464] REPLICATION: finished
0709 13:07:51.329793 (+106641us) write_op.cc:301] APPLY: starting
0709 13:07:51.329904 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:51.507544 (+177640us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:51.507676 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:51.794594 (+286918us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:51.795092 (+   498us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:07:51.795175 (+    83us) write_op.cc:312] APPLY: finished
0709 13:07:51.824665 (+ 29490us) log.cc:844] Serialized 148 byte log entry
0709 13:07:51.844524 (+ 19859us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:51.865371 (+ 20847us) write_op.cc:454] Released schema lock
0709 13:07:51.875919 (+ 10548us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:51.895454 (+ 19535us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:51.895500 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7424,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":106322,"apply.run_cpu_time_us":30234,"apply.run_wall_time_us":565585,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70911,"num_ops":16,"prepare.queue_time_us":477539,"prepare.run_cpu_time_us":32381,"prepare.run_wall_time_us":640247,"raft.queue_time_us":279166,"raft.run_cpu_time_us":25617,"raft.run_wall_time_us":148231,"replication_time_us":920461,"spinlock_wait_cycles":3840,"thread_start_us":647335,"threads_started":4,"wal-append.queue_time_us":139400,"wal-append.run_cpu_time_us":43784,"wal-append.run_wall_time_us":2381018}]]}
I20260709 13:07:55.424378 22178 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 17.
I20260709 13:07:55.321790 27366 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:55.442827 27366 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:55.451176 22003 catalog_manager.cc:5697] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.453282 22003 catalog_manager.cc:5697] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 5 to 13. New cstate: current_term: 13 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.455459 22175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:55.456143 22175 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:07:55.459221 22220 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:55.460659 27452 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:55.461165 27452 raft_consensus.cc:697] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 17 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:55.463256 27452 consensus_queue.cc:237] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:55.473328 27510 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.473927 27510 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:55.476082 27510 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:55.476886 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:55.477931 22254 raft_consensus.cc:2368] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 14. Current term is 15.
I20260709 13:07:55.485889 27594 tablet_replica.cc:333] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:07:55.490234 27594 raft_consensus.cc:2243] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:55.491143 27594 raft_consensus.cc:2272] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:55.494285 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:55.494650 22103 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:07:55.500015 22102 raft_consensus.cc:3060] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:55.499467 22808 raft_consensus.cc:1275] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:07:55.502298 27594 ts_tablet_manager.cc:1916] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:55.506210 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:07:55.514053 22003 catalog_manager.cc:5697] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 11 to 14, leader changed from <none> to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 14 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.527828 27452 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:55.529700 22147 leader_election.cc:400] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 14. Current term is 15.
I20260709 13:07:55.531422 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:07:55.540437 22253 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 12.
I20260709 13:07:55.534130 22102 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
I20260709 13:07:55.540928 22147 leader_election.cc:403] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:55.541877 22003 catalog_manager.cc:5697] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 11 to 12, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 12 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:55.526799 22175 raft_consensus.cc:2468] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
I20260709 13:07:55.551736 22218 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:55.556442 22003 catalog_manager.cc:5697] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.557873 22072 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:07:55.556340 27572 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273) with higher term. Message: Invalid argument: T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79683575881f4334bd4dc6d9bdbb45c3 for earlier term 14. Current term is 15.
I20260709 13:07:55.569825 27447 raft_consensus.cc:2804] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:55.559369 27356 consensus_queue.cc:1048] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:07:55.570569 27447 raft_consensus.cc:697] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:55.582502 27447 consensus_queue.cc:237] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:55.583555 27442 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:55.584028 27442 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.584405 27442 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.577800 22003 catalog_manager.cc:5697] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.617005 22003 catalog_manager.cc:5697] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.624253 27594 ts_tablet_manager.cc:1929] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 13:07:55.624842 27594 log.cc:1199] T 252049d2bcdd4f329ca5015bf10c1b19 P 79683575881f4334bd4dc6d9bdbb45c3: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/wals/252049d2bcdd4f329ca5015bf10c1b19
I20260709 13:07:55.648506 21990 catalog_manager.cc:5028] TS 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): tablet 252049d2bcdd4f329ca5015bf10c1b19 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:07:55.652669 22003 catalog_manager.cc:5697] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 11 to 13, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 13 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:55.654544 22003 catalog_manager.cc:5697] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 11 to 13, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 13 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:07:55.660125 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 381283us
I20260709 13:07:55.663146 22071 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:55.669359 27588 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:55.688323 22172 raft_consensus.cc:2955] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:55.767845 27442 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:55.770110 27442 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:55.772470 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:55.773131 22253 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.782578 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:55.783298 22808 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.787518 22253 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:55.795336 22072 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:55.805130 27442 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:55.813894 27442 raft_consensus.cc:697] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:55.867743 22808 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 13.
I20260709 13:07:55.896005 22097 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:07:55.897580 27446 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:55.912364 22179 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:07:55.918291 27446 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:55.878548 27442 consensus_queue.cc:237] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:55.998845 22179 raft_consensus.cc:1275] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:56.011544 27451 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:56.072359 22097 raft_consensus.cc:1275] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:56.083308 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:56.119848 27451 consensus_queue.cc:1048] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:07:56.237812 22808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:47484
I20260709 13:07:56.238410 22808 raft_consensus.cc:606] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:56.252514 22816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf"
dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
mode: GRACEFUL
new_leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:47484
I20260709 13:07:56.253113 22816 raft_consensus.cc:606] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 LEADER]: Received request to transfer leadership to TS c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:07:56.258493 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:56.260578 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:56.314738 22808 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:56.316566 27444 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:56.404743 22254 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:56.407652 27568 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:56.504226 22003 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40410 (request call id 198) took 9276 ms. Trace:
I20260709 13:07:56.504733 22003 rpcz_store.cc:276] 0709 13:07:47.227551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.242763 (+ 15212us) service_pool.cc:224] Handling call
0709 13:07:56.504139 (+9261376us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:55.974232 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:55.975034 (+   802us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:55.975084 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:07:55.975113 (+    29us) tablet.cc:662] Decoding operations
0709 13:07:55.991651 (+ 16538us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:55.991764 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:55.991816 (+    52us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:07:56.033810 (+ 41994us) tablet.cc:701] Row locks acquired
0709 13:07:56.033832 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:07:56.034016 (+   184us) write_op.cc:270] Start()
0709 13:07:56.034156 (+   140us) write_op.cc:276] Timestamp: P: 1783602476033962 usec, L: 0
0709 13:07:56.034182 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:07:56.035024 (+   842us) log.cc:844] Serialized 7810 byte log entry
0709 13:07:56.156453 (+121429us) op_driver.cc:464] REPLICATION: finished
0709 13:07:56.234633 (+ 78180us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b1800298180. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66a4e613f3 00007f66a4e637c1 00007f66a4e63779 00007f66a4e63709 00007f66a4e636d1 00007f66a4e629cd 000000000038f354 000000000038f199 00007f66a4e4483a
0709 13:07:56.234777 (+   144us) write_op.cc:301] APPLY: starting
0709 13:07:56.234857 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:56.269298 (+ 34441us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:56.269320 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:56.357296 (+ 87976us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:56.357632 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:07:56.357691 (+    59us) write_op.cc:312] APPLY: finished
0709 13:07:56.358160 (+   469us) log.cc:844] Serialized 180 byte log entry
0709 13:07:56.364366 (+  6206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:56.364594 (+   228us) write_op.cc:454] Released schema lock
0709 13:07:56.364661 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:56.415214 (+ 50553us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:56.415253 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":723965,"reported_tablets":33,"spinlock_wait_cycles":35072,"child_traces":[["op",{"apply.queue_time_us":59980,"apply.run_cpu_time_us":25859,"apply.run_wall_time_us":180366,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87607,"num_ops":20,"prepare.queue_time_us":139861,"prepare.run_cpu_time_us":7887,"prepare.run_wall_time_us":81309,"raft.queue_time_us":90646,"raft.run_cpu_time_us":30114,"raft.run_wall_time_us":59467,"replication_time_us":122105,"spinlock_wait_cycles":8173184,"thread_start_us":262086,"threads_started":4,"wal-append.queue_time_us":21618}]]}
I20260709 13:07:56.548738 22001 catalog_manager.cc:5697] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 5 to 6, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 6 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.575156 27318 raft_consensus.cc:993] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: : Instructing follower c0694f6572bf406a92d55f1f2ab46ef2 to start an election
I20260709 13:07:56.577445 27486 raft_consensus.cc:1081] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 LEADER]: Signalling peer c0694f6572bf406a92d55f1f2ab46ef2 to start an election
I20260709 13:07:56.579113 22102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
 from {username='slave'} at 127.0.0.1:43368
I20260709 13:07:56.579679 22102 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:56.580042 22102 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:56.592877 22102 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:56.612433 22102 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:56.595960 22001 catalog_manager.cc:5697] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.613390 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:56.617934 22816 raft_consensus.cc:3055] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:56.618263 22816 raft_consensus.cc:740] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:56.619028 22816 consensus_queue.cc:260] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:56.619313 22001 catalog_manager.cc:5697] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.620250 22816 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:56.616199 22172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:56.628091 22172 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:56.677201 27367 raft_consensus.cc:993] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: : Instructing follower 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:07:56.677778 27367 raft_consensus.cc:1081] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 LEADER]: Signalling peer 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:07:56.679831 22254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:45738
I20260709 13:07:56.680637 22254 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:56.682776 22254 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:56.668664 22816 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 16.
I20260709 13:07:56.689687 22069 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:56.690546 27341 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:56.691505 27341 raft_consensus.cc:697] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 LEADER]: Becoming Leader. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:56.692396 27341 consensus_queue.cc:237] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:56.717947 22254 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:56.736733 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:56.737381 22177 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:56.747725 22177 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 16.
I20260709 13:07:56.750458 22220 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:56.749094 22254 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:07:56.752185 27451 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:56.752715 27451 raft_consensus.cc:697] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 16 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:56.753700 27451 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:56.775071 21998 catalog_manager.cc:5697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:56.777415 21998 catalog_manager.cc:5697] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 7 to 11, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 11 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:56.782104 22166 tablet_service.cc:1558] Processing DeleteTablet for tablet 252049d2bcdd4f329ca5015bf10c1b19 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:36942
W20260709 13:07:56.787318 22001 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40934 (request call id 285) took 51863 ms (client timeout 15000 ms). Trace:
I20260709 13:07:56.793402 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:07:56.794094 22808 raft_consensus.cc:3055] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:56.794481 22808 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:07:56.795854 22808 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:56.800984 21990 catalog_manager.cc:5028] TS 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): tablet 252049d2bcdd4f329ca5015bf10c1b19 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:07:56.783453 21998 catalog_manager.cc:5697] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 8 to 13, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 13 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.811558 21998 catalog_manager.cc:5697] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:56.815095 21998 catalog_manager.cc:5697] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:07:56.787829 22001 rpcz_store.cc:269] 0709 13:07:04.923972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.976051 (+ 52079us) service_pool.cc:224] Handling call
0709 13:07:56.787223 (+51811172us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:56.633124 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:56.633676 (+   552us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:56.633706 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:07:56.633723 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:56.634219 (+   496us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:56.634299 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:56.634324 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:07:56.634620 (+   296us) tablet.cc:701] Row locks acquired
0709 13:07:56.634636 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:07:56.634768 (+   132us) write_op.cc:270] Start()
0709 13:07:56.634866 (+    98us) write_op.cc:276] Timestamp: P: 1783602476634721 usec, L: 0
0709 13:07:56.634887 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:07:56.635518 (+   631us) log.cc:844] Serialized 1317 byte log entry
0709 13:07:56.637475 (+  1957us) op_driver.cc:464] REPLICATION: finished
0709 13:07:56.637905 (+   430us) write_op.cc:301] APPLY: starting
0709 13:07:56.637980 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:56.639953 (+  1973us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:56.640038 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:56.656202 (+ 16164us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:56.656371 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:07:56.656412 (+    41us) write_op.cc:312] APPLY: finished
0709 13:07:56.656617 (+   205us) log.cc:844] Serialized 41 byte log entry
0709 13:07:56.657351 (+   734us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:56.657446 (+    95us) write_op.cc:454] Released schema lock
0709 13:07:56.657486 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:56.657829 (+   343us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:56.657856 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1862897,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":223,"apply.run_cpu_time_us":5085,"apply.run_wall_time_us":19872,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12522,"num_ops":3,"prepare.queue_time_us":8253,"prepare.run_cpu_time_us":2721,"prepare.run_wall_time_us":2888,"replication_time_us":2461,"thread_start_us":10875,"threads_started":1}]]}
I20260709 13:07:56.817098 21998 catalog_manager.cc:5697] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 6 to 8, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 8 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:56.823047 21998 catalog_manager.cc:5697] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:56.825438 21998 catalog_manager.cc:5697] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:56.827704 21998 catalog_manager.cc:5697] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 9 to 11, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 11 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:56.829759 21998 catalog_manager.cc:5697] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 7 to 9, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 9 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:56.831493 21998 catalog_manager.cc:5697] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 5 to 7, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 7 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:56.833515 21998 catalog_manager.cc:5697] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 7 to 11, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 11 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.835836 21998 catalog_manager.cc:5697] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.841063 21998 catalog_manager.cc:5697] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 5 to 9, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 9 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:56.842859 21998 catalog_manager.cc:5697] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 7 to 11, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 11 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:56.845356 21998 catalog_manager.cc:5697] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 8 to 10, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 10 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:56.847795 21998 catalog_manager.cc:5697] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:56.850328 21998 catalog_manager.cc:5697] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.863198 22808 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:56.688346 22172 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0694f6572bf406a92d55f1f2ab46ef2 in term 16.
W20260709 13:07:56.940567 22071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 64421.6us
I20260709 13:07:56.942248 22808 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 16.
I20260709 13:07:57.038242 22000 catalog_manager.cc:5697] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 9 to 16, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 16 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.041558 22000 catalog_manager.cc:5697] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 13 to 14, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 14 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:57.049903 22166 tablet_service.cc:1558] Processing DeleteTablet for tablet 252049d2bcdd4f329ca5015bf10c1b19 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:36942
I20260709 13:07:57.052141 21990 catalog_manager.cc:5028] TS 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): tablet 252049d2bcdd4f329ca5015bf10c1b19 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:07:57.053627 22000 catalog_manager.cc:5697] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:57.055696 22000 catalog_manager.cc:5697] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 6 to 14, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 14 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:57.066661 22000 catalog_manager.cc:5697] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 6 to 11, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 11 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:57.069598 21998 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40934 (request call id 286) took 27182 ms (client timeout 15000 ms). Trace:
I20260709 13:07:57.071795 22000 catalog_manager.cc:5697] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.081477 22000 catalog_manager.cc:5697] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 11 to 15, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 15 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:57.094769 22000 catalog_manager.cc:5697] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
W20260709 13:07:57.073628 21998 rpcz_store.cc:269] 0709 13:07:29.897469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.913450 (+ 15981us) service_pool.cc:224] Handling call
0709 13:07:57.069510 (+27156060us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:56.862673 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:56.863267 (+   594us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:56.863303 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:07:56.863334 (+    31us) tablet.cc:662] Decoding operations
0709 13:07:56.865117 (+  1783us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:56.865182 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:56.865217 (+    35us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:07:56.939796 (+ 74579us) tablet.cc:701] Row locks acquired
0709 13:07:56.939817 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:07:56.939959 (+   142us) write_op.cc:270] Start()
0709 13:07:56.940091 (+   132us) write_op.cc:276] Timestamp: P: 1783602476939914 usec, L: 0
0709 13:07:56.940117 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:07:56.940799 (+   682us) log.cc:844] Serialized 7133 byte log entry
0709 13:07:56.944931 (+  4132us) op_driver.cc:464] REPLICATION: finished
0709 13:07:56.945490 (+   559us) write_op.cc:301] APPLY: starting
0709 13:07:56.945571 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:56.954517 (+  8946us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:56.954626 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:56.974521 (+ 19895us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:56.974848 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:07:56.974903 (+    55us) write_op.cc:312] APPLY: finished
0709 13:07:56.987398 (+ 12495us) log.cc:844] Serialized 164 byte log entry
0709 13:07:56.988254 (+   856us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:56.988453 (+   199us) write_op.cc:454] Released schema lock
0709 13:07:56.988523 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:56.989214 (+   691us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:56.989250 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":342835,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":348,"apply.run_cpu_time_us":21403,"apply.run_wall_time_us":43663,"cfile_cache_hit":72,"cfile_cache_hit_bytes":75132,"num_ops":18,"prepare.queue_time_us":128,"prepare.run_cpu_time_us":54637,"prepare.run_wall_time_us":81682,"replication_time_us":4667}]]}
I20260709 13:07:57.098045 22000 catalog_manager.cc:5697] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 7 to 9, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 9 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.108021 22000 catalog_manager.cc:5697] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 11 to 14, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 14 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:57.110358 22000 catalog_manager.cc:5697] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 11 to 12, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 12 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.112108 22000 catalog_manager.cc:5697] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:57.113385 22000 catalog_manager.cc:5697] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 8 to 12, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 12 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:57.115566 22000 catalog_manager.cc:5697] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 11 to 12, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 12 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:57.117551 22000 catalog_manager.cc:5697] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 11 to 12, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 12 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:57.119046 22000 catalog_manager.cc:5697] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:57.121583 22000 catalog_manager.cc:5697] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:57.263787 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:57.282449 22004 catalog_manager.cc:5697] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 1 to 11. New cstate: current_term: 11 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:57.283991 22816 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:57.298888 22179 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:57.305092 27568 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:57.305861 27444 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:57.323171 22812 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:57.333190 22172 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:57.335940 27446 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:57.343132 27446 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:57.352326 22003 catalog_manager.cc:5697] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 14 to 17, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 17 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:57.354344 22003 catalog_manager.cc:5697] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.369815 22003 catalog_manager.cc:5697] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 14 to 17, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 17 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:57.371717 22003 catalog_manager.cc:5697] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 13 to 15, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 15 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.375525 22003 catalog_manager.cc:5697] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 9 to 18, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 18 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:07:57.379205 22000 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40946 (request call id 279) took 11577 ms (client timeout 15000 ms). Trace:
I20260709 13:07:57.403403 22003 catalog_manager.cc:5697] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.406257 22003 catalog_manager.cc:5697] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:57.415601 22003 catalog_manager.cc:5697] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 14 to 15, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 15 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:07:57.395658 22000 rpcz_store.cc:269] 0709 13:07:45.801618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.801927 (+   309us) service_pool.cc:224] Handling call
0709 13:07:46.444553 (+642626us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x7b5400002490. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a4ce9db1 00007f66a4e29b71 00007f66a4e2a0b2 00007f66adda3a89 00007f66add3bda6 00007f66add0d088 00007f66ade0b37e 00007f66ac2cc2a4 00007f66ac2cc232 00007f66ac2cc161 00007f66ac2cc0dc
0709 13:07:46.530026 (+ 85473us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x7b540001de54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb8090 00007f66a7f56f3a 00007f66add0d1cc 00007f66ade0b37e 00007f66ac2cc2a4 00007f66ac2cc232 00007f66ac2cc161 00007f66ac2cc0dc 00007f66ac2cb392 00007f66a628948c 00007f66a62888c6
0709 13:07:57.379144 (+10849118us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:57.136680 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:57.137302 (+   622us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:57.137334 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:07:57.137346 (+    12us) tablet.cc:662] Decoding operations
0709 13:07:57.138826 (+  1480us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:57.138877 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:57.138906 (+    29us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:07:57.140092 (+  1186us) tablet.cc:701] Row locks acquired
0709 13:07:57.140107 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:07:57.140242 (+   135us) write_op.cc:270] Start()
0709 13:07:57.140374 (+   132us) write_op.cc:276] Timestamp: P: 1783602477140201 usec, L: 0
0709 13:07:57.140394 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:07:57.141164 (+   770us) log.cc:844] Serialized 6735 byte log entry
0709 13:07:57.143951 (+  2787us) op_driver.cc:464] REPLICATION: finished
0709 13:07:57.144396 (+   445us) write_op.cc:301] APPLY: starting
0709 13:07:57.144484 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:57.172391 (+ 27907us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:57.173180 (+   789us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:57.230014 (+ 56834us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:57.230324 (+   310us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:07:57.230383 (+    59us) write_op.cc:312] APPLY: finished
0709 13:07:57.230845 (+   462us) log.cc:844] Serialized 156 byte log entry
0709 13:07:57.244387 (+ 13542us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:57.244565 (+   178us) write_op.cc:454] Released schema lock
0709 13:07:57.244628 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:57.259868 (+ 15240us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:57.259912 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":302006,"reported_tablets":49,"spinlock_wait_cycles":134344832,"child_traces":[["op",{"apply.queue_time_us":261,"apply.run_cpu_time_us":22239,"apply.run_wall_time_us":115390,"cfile_cache_hit":68,"cfile_cache_hit_bytes":70958,"num_ops":17,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":4790,"prepare.run_wall_time_us":7075,"replication_time_us":3433}]]}
I20260709 13:07:57.424681 22003 catalog_manager.cc:5697] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 14 to 15, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 15 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:57.450054 22003 catalog_manager.cc:5697] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.465590 22003 catalog_manager.cc:5697] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 11 to 13, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 13 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:57.471798 22003 catalog_manager.cc:5697] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:57.487666 22003 catalog_manager.cc:5697] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:07:57.478052 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 77767.4us
W20260709 13:07:57.477312 22004 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40946 (request call id 278) took 31522 ms (client timeout 15000 ms). Trace:
W20260709 13:07:57.494518 22004 rpcz_store.cc:269] 0709 13:07:25.955403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.955598 (+   195us) service_pool.cc:224] Handling call
0709 13:07:57.325751 (+31370153us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:57.325795 (+    44us) write_op.cc:454] Released schema lock
0709 13:07:57.477246 (+151451us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:57.317184 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:57.317731 (+   547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:57.317770 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:07:57.317789 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:57.318143 (+   354us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:57.318199 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:57.318224 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:57.318401 (+   177us) tablet.cc:701] Row locks acquired
0709 13:07:57.318417 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:07:57.318546 (+   129us) write_op.cc:270] Start()
0709 13:07:57.318657 (+   111us) write_op.cc:276] Timestamp: P: 1783602477318504 usec, L: 0
0709 13:07:57.318681 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:07:57.319429 (+   748us) log.cc:844] Serialized 541 byte log entry
0709 13:07:57.321918 (+  2489us) op_driver.cc:464] REPLICATION: finished
0709 13:07:57.322349 (+   431us) write_op.cc:301] APPLY: starting
0709 13:07:57.322422 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:57.323163 (+   741us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:57.323246 (+    83us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:57.323900 (+   654us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:57.324036 (+   136us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:07:57.324087 (+    51us) write_op.cc:312] APPLY: finished
0709 13:07:57.324246 (+   159us) log.cc:844] Serialized 25 byte log entry
0709 13:07:57.324392 (+   146us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:57.324467 (+    75us) write_op.cc:454] Released schema lock
0709 13:07:57.324504 (+    37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":87369,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":235,"apply.run_cpu_time_us":2421,"apply.run_wall_time_us":2421,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":107,"prepare.run_cpu_time_us":2536,"prepare.run_wall_time_us":2535,"replication_time_us":3127}]]}
I20260709 13:07:57.498209 22003 catalog_manager.cc:5697] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 12 to 13, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 13 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:57.511430 22003 catalog_manager.cc:5697] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index -1 to 12, term changed from 7 to 15, VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 15 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:57.513329 22003 catalog_manager.cc:5697] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 7 to 12, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 12 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.518420 22003 catalog_manager.cc:5697] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 12 to 15, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 15 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:57.529081 22003 catalog_manager.cc:5697] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 13 to 15, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 15 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.635566 21997 catalog_manager.cc:5697] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 8 to 13, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 13 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.638757 21997 catalog_manager.cc:5697] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.657665 21997 catalog_manager.cc:5697] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 11 to 14, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 14 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.668378 21997 catalog_manager.cc:5697] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 11 to 12, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 12 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.670377 21997 catalog_manager.cc:5697] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 7 to 8, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 8 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.680236 21997 catalog_manager.cc:5697] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 7 to 17, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 17 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.682735 21997 catalog_manager.cc:5697] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 9 to 10, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 10 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.693317 21997 catalog_manager.cc:5697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.755709 22003 catalog_manager.cc:5697] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 15 to 16, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 16 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:57.757642 22003 catalog_manager.cc:5697] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 15 to 16, leader changed from a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 16 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:57.934347 22166 tablet_service.cc:1558] Processing DeleteTablet for tablet 252049d2bcdd4f329ca5015bf10c1b19 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:36942
I20260709 13:07:58.006495 21997 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40934 (request call id 287) took 9499 ms. Trace:
I20260709 13:07:58.022953 21997 rpcz_store.cc:276] 0709 13:07:48.507530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.507876 (+   346us) service_pool.cc:224] Handling call
0709 13:07:58.006204 (+9498328us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:57.708208 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:57.708717 (+   509us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:57.708752 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:07:57.708768 (+    16us) tablet.cc:662] Decoding operations
0709 13:07:57.709593 (+   825us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:57.709645 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:57.709674 (+    29us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:07:57.710377 (+   703us) tablet.cc:701] Row locks acquired
0709 13:07:57.710395 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:07:57.710534 (+   139us) write_op.cc:270] Start()
0709 13:07:57.710641 (+   107us) write_op.cc:276] Timestamp: P: 1783602477710497 usec, L: 0
0709 13:07:57.710662 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:07:57.711384 (+   722us) log.cc:844] Serialized 3258 byte log entry
0709 13:07:57.716057 (+  4673us) op_driver.cc:464] REPLICATION: finished
0709 13:07:57.718545 (+  2488us) write_op.cc:301] APPLY: starting
0709 13:07:57.718630 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:57.722815 (+  4185us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:57.727801 (+  4986us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:57.739480 (+ 11679us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:57.739695 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:07:57.739748 (+    53us) write_op.cc:312] APPLY: finished
0709 13:07:57.740054 (+   306us) log.cc:844] Serialized 81 byte log entry
0709 13:07:57.747105 (+  7051us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:57.747242 (+   137us) write_op.cc:454] Released schema lock
0709 13:07:57.747297 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:57.747644 (+   347us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:57.747687 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":95847,"reported_tablets":49,"spinlock_wait_cycles":13568,"child_traces":[["op",{"apply.queue_time_us":2245,"apply.run_cpu_time_us":10662,"apply.run_wall_time_us":29072,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33392,"num_ops":8,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":3414,"prepare.run_wall_time_us":5355,"replication_time_us":5265}]]}
W20260709 13:07:58.151049 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 84486.6us
I20260709 13:07:58.127617 21990 catalog_manager.cc:5028] TS 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): tablet 252049d2bcdd4f329ca5015bf10c1b19 (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
W20260709 13:07:58.197930 21990 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 70442.7us
I20260709 13:07:58.200073 21996 catalog_manager.cc:5697] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 14 to 15, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 15 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.208338 21996 catalog_manager.cc:5697] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 13 to 14, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 14 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
W20260709 13:07:58.220039 22002 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40924 (request call id 277) took 30835 ms (client timeout 15000 ms). Trace:
I20260709 13:07:58.240918 21996 catalog_manager.cc:5697] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 13 to 14, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 14 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:58.229386 22002 rpcz_store.cc:269] 0709 13:07:27.385109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.392121 (+  7012us) service_pool.cc:224] Handling call
0709 13:07:27.735619 (+343498us) spinlock_profiling.cc:243] Waited 8.87 ms on lock 0x7b540001de54. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66a7eb8090 00007f66a7f56f3a 00007f66add0d1cc 00007f66ade0b37e 00007f66ac2cc2a4 00007f66ac2cc232 00007f66ac2cc161 00007f66ac2cc0dc 00007f66ac2cb392 00007f66a628948c 00007f66a62888c6
0709 13:07:58.219803 (+30484184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64017,"reported_tablets":47,"spinlock_wait_cycles":20402432}
W20260709 13:07:58.257302 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 116235us
W20260709 13:07:58.275950 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 44672.9us
I20260709 13:07:58.279520 21996 catalog_manager.cc:5697] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 10 to 11, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 11 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.326375 21996 catalog_manager.cc:5697] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 12 to 17, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 17 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.336410 21996 catalog_manager.cc:5697] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 14 to 15, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 15 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:58.341202 21996 catalog_manager.cc:5697] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 17 to 18, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 18 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:58.367611 21996 catalog_manager.cc:5697] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 17 to 18, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 18 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.377255 21996 catalog_manager.cc:5697] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: term changed from 11 to 12, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 12 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.524194 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:58.660284 22000 catalog_manager.cc:5697] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:58.668283 22000 catalog_manager.cc:5697] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 12 to 15, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 15 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.673067 22000 catalog_manager.cc:5697] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 11 to 12, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 12 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.683733 22000 catalog_manager.cc:5697] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 15 to 17, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 17 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.688944 22000 catalog_manager.cc:5697] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:58.680912 21996 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40924 (request call id 278) took 6605 ms. Trace:
I20260709 13:07:58.695187 21996 rpcz_store.cc:276] 0709 13:07:52.075804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.076125 (+   321us) service_pool.cc:224] Handling call
0709 13:07:58.680821 (+6604696us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:58.441961 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:58.442648 (+   687us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:58.442696 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:07:58.442714 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:58.443798 (+  1084us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:58.443910 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:58.443941 (+    31us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:07:58.444835 (+   894us) tablet.cc:701] Row locks acquired
0709 13:07:58.444882 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:07:58.445046 (+   164us) write_op.cc:270] Start()
0709 13:07:58.445197 (+   151us) write_op.cc:276] Timestamp: P: 1783602478444984 usec, L: 0
0709 13:07:58.445230 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:07:58.446122 (+   892us) log.cc:844] Serialized 3646 byte log entry
0709 13:07:58.462893 (+ 16771us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b180047f380. stack: 00007f66a4e2f343 00007f66a4e2f240 00007f66a47be1d4 00007f66ae4fc304 00007f66ae4fc299 00007f66add29de1 00007f66add365b1 00007f66ab98541d 00007f66ab98771a 00007f66ab9876a8 00007f66ab987628 00007f66ab9875e3 00007f66ab9867fc 00007f66addb9626 00007f66addb3dd8 00007f66a7f5a310
0709 13:07:58.462975 (+    82us) op_driver.cc:464] REPLICATION: finished
0709 13:07:58.482869 (+ 19894us) write_op.cc:301] APPLY: starting
0709 13:07:58.482999 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:58.519896 (+ 36897us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:58.519936 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:58.534689 (+ 14753us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:58.535018 (+   329us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:07:58.552185 (+ 17167us) write_op.cc:312] APPLY: finished
0709 13:07:58.552701 (+   516us) log.cc:844] Serialized 89 byte log entry
0709 13:07:58.552914 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:58.553033 (+   119us) write_op.cc:454] Released schema lock
0709 13:07:58.553102 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:58.553581 (+   479us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:58.553617 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":65683,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":19555,"apply.run_cpu_time_us":14219,"apply.run_wall_time_us":70702,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41693,"num_ops":9,"prepare.queue_time_us":27121,"prepare.run_cpu_time_us":4623,"prepare.run_wall_time_us":9257,"replication_time_us":6487,"spinlock_wait_cycles":16084736,"thread_start_us":37023,"threads_started":2}]]}
I20260709 13:07:58.694181 22000 catalog_manager.cc:5697] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 11 to 17, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 17 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.729735 22000 catalog_manager.cc:5697] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 10 to 11, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65). New cstate: current_term: 11 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } }
I20260709 13:07:58.732070 22000 catalog_manager.cc:5697] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 8 to 10, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 10 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.735034 22000 catalog_manager.cc:5697] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.744156 22000 catalog_manager.cc:5697] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 15 to 17, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 17 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.849612 22102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38574701043e46cb978340cb6753faae"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:07:58.850486 22102 raft_consensus.cc:606] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:58.870623 22102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:07:58.871431 22102 raft_consensus.cc:606] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Received request to transfer leadership to TS 765d912bde9e48959e50d9efec3c26b6
I20260709 13:07:58.988579 22000 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40946 (request call id 280) took 1485 ms. Trace:
I20260709 13:07:58.992902 22101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efc23a012ae0497797e82803613f3835"
dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:33706
I20260709 13:07:59.012560 22101 raft_consensus.cc:606] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:07:59.014232 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:59.016148 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:59.013629 22000 rpcz_store.cc:276] 0709 13:07:57.502672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.502863 (+   191us) service_pool.cc:224] Handling call
0709 13:07:58.988486 (+1485623us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:58.751154 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:58.751725 (+   571us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:58.751761 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:07:58.751781 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:58.752779 (+   998us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:58.752832 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:58.752858 (+    26us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:07:58.753703 (+   845us) tablet.cc:701] Row locks acquired
0709 13:07:58.753724 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:07:58.753880 (+   156us) write_op.cc:270] Start()
0709 13:07:58.753982 (+   102us) write_op.cc:276] Timestamp: P: 1783602478753838 usec, L: 0
0709 13:07:58.754001 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:07:58.754649 (+   648us) log.cc:844] Serialized 4034 byte log entry
0709 13:07:58.757123 (+  2474us) op_driver.cc:464] REPLICATION: finished
0709 13:07:58.757578 (+   455us) write_op.cc:301] APPLY: starting
0709 13:07:58.757662 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:58.763155 (+  5493us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:58.763247 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:58.774261 (+ 11014us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:58.774508 (+   247us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:07:58.774555 (+    47us) write_op.cc:312] APPLY: finished
0709 13:07:58.774843 (+   288us) log.cc:844] Serialized 97 byte log entry
0709 13:07:58.787104 (+ 12261us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:58.787240 (+   136us) write_op.cc:454] Released schema lock
0709 13:07:58.787298 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:58.787706 (+   408us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:58.787739 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30538,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":255,"apply.run_cpu_time_us":12780,"apply.run_wall_time_us":30062,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41740,"num_ops":10,"prepare.queue_time_us":128,"prepare.run_cpu_time_us":3804,"prepare.run_wall_time_us":11914,"replication_time_us":2983}]]}
I20260709 13:07:59.177567 22101 consensus_queue.cc:237] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:07:59.186656 27638 raft_consensus.cc:993] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:07:59.187299 27638 raft_consensus.cc:1081] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Signalling peer 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:07:59.189677 22251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38574701043e46cb978340cb6753faae"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:51872
I20260709 13:07:59.191128 22251 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.192137 22251 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.235567 22816 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:59.239269 27640 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:59.242166 22254 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:59.253259 27638 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:59.256780 27633 raft_consensus.cc:993] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:07:59.257539 27630 raft_consensus.cc:1081] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Signalling peer 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:07:59.259811 22177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efc23a012ae0497797e82803613f3835"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:07:59.260463 22177 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.260919 22177 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:59.269827 22177 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:59.286361 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:07:59.287314 22254 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:59.284787 22177 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:07:59.304229 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:59.304942 22103 raft_consensus.cc:3055] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:59.305253 22103 raft_consensus.cc:740] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:59.306157 22103 consensus_queue.cc:260] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:59.309326 22253 raft_consensus.cc:2955] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:59.311414 22103 raft_consensus.cc:3060] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:59.306699 27633 raft_consensus.cc:2955] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:59.332113 27444 raft_consensus.cc:993] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: : Instructing follower 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:07:59.332695 27444 raft_consensus.cc:1081] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Signalling peer 765d912bde9e48959e50d9efec3c26b6 to start an election
I20260709 13:07:59.337230 21996 catalog_manager.cc:5697] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 12 to 13, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New cstate: current_term: 15 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:59.330439 22103 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:07:59.346328 22144 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:59.350328 27571 raft_consensus.cc:2804] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:59.351099 22255 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
 from {username='slave'} at 127.0.0.1:51872
I20260709 13:07:59.351574 27571 raft_consensus.cc:697] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:07:59.351702 22255 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.352669 27571 consensus_queue.cc:237] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:59.353022 22255 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.383720 22254 raft_consensus.cc:2468] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:07:59.386638 22251 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:59.410995 21988 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 16e48ec055f940c49e01d5a5d77581aa with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:59.411350 22255 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:59.433436 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:59.434159 22103 raft_consensus.cc:3055] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:59.434463 22103 raft_consensus.cc:740] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:59.435315 22103 consensus_queue.cc:260] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:59.436470 22103 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.438990 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:59.439608 22177 raft_consensus.cc:3060] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.443408 22816 raft_consensus.cc:2955] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:07:59.450380 22177 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:59.456857 22220 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:07:59.457943 27446 raft_consensus.cc:2804] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:59.458420 27446 raft_consensus.cc:697] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:59.459285 27446 consensus_queue.cc:237] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:59.433470 22251 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 10 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:59.465258 22255 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:07:59.468608 22103 raft_consensus.cc:2468] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 10.
I20260709 13:07:59.468029 22102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:07:59.470232 22102 raft_consensus.cc:3055] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:59.471828 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:07:59.472406 22174 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.470544 22102 raft_consensus.cc:740] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c0694f6572bf406a92d55f1f2ab46ef2, State: Running, Role: LEADER
I20260709 13:07:59.492440 22002 catalog_manager.cc:5697] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 14 to 15, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 15 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.486452 22102 consensus_queue.cc:260] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:59.498416 22102 raft_consensus.cc:3060] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.547791 22102 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:59.555809 22218 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:07:59.565075 22174 raft_consensus.cc:2468] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:07:59.566088 22166 tablet_service.cc:1558] Processing DeleteTablet for tablet 16e48ec055f940c49e01d5a5d77581aa with delete_type TABLET_DATA_TOMBSTONED (TS 79683575881f4334bd4dc6d9bdbb45c3 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:36942
I20260709 13:07:59.587224 27649 raft_consensus.cc:2804] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:59.587852 27649 raft_consensus.cc:697] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:07:59.588847 27649 consensus_queue.cc:237] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:07:59.592033 22002 catalog_manager.cc:5697] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 9 to 10, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 10 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.623694 27656 tablet_replica.cc:333] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:07:59.639896 27656 raft_consensus.cc:2243] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:59.642266 27656 raft_consensus.cc:2272] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:59.646247 27656 ts_tablet_manager.cc:1916] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:59.656852 22002 catalog_manager.cc:5697] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 12 to 13, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 13 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.689558 27656 ts_tablet_manager.cc:1929] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 13:07:59.690984 27656 log.cc:1199] T 16e48ec055f940c49e01d5a5d77581aa P 79683575881f4334bd4dc6d9bdbb45c3: Deleting WAL directory at /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/wals/16e48ec055f940c49e01d5a5d77581aa
I20260709 13:07:59.693037 21990 catalog_manager.cc:5028] TS 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): tablet 16e48ec055f940c49e01d5a5d77581aa (table test-workload [id=d5af6317536c47538ac6f9c92c40cbaa]) successfully deleted
I20260709 13:07:59.772090 22251 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:59.774168 27655 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:59.841619 22103 raft_consensus.cc:1275] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:59.843287 27571 consensus_queue.cc:1048] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:00.017490 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:00.070636 22101 raft_consensus.cc:1275] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:00.077468 27625 consensus_queue.cc:1048] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:00.088896 22177 raft_consensus.cc:1275] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:00.090582 27446 consensus_queue.cc:1048] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:00.172883 22101 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:00.180338 27667 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:08:00.198446 22177 raft_consensus.cc:1275] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:00.206825 27625 consensus_queue.cc:1048] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:00.878007 22177 consensus_queue.cc:237] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
W20260709 13:08:00.903258 22144 consensus_peers.cc:597] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b965624a67d4adb87e9787782f1715c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:00.906951 22255 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:00.909116 27650 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:00.933328 22102 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:00.937270 27650 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:00.975970 27675 raft_consensus.cc:2955] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:08:00.980121 22255 raft_consensus.cc:2955] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
W20260709 13:08:01.014614 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 46977.6us
I20260709 13:08:01.023962 22002 catalog_manager.cc:5697] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index -1 to 8, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 12 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:08:01.027220 22102 raft_consensus.cc:2955] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:08:01.066425 22254 consensus_queue.cc:237] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:01.146577 22101 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:01.152544 22177 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:08:01.156908 22218 consensus_peers.cc:597] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0232d828f8664f348df823432990379b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:01.169236 27681 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:08:01.197196 22072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 86318us
I20260709 13:08:01.203759 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:01.224308 27680 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:08:01.299175 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 119783us
W20260709 13:08:01.304549 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 98947.8us
I20260709 13:08:01.415829 22254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0232d828f8664f348df823432990379b"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:08:01.416567 22254 raft_consensus.cc:606] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 17 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:01.428030 22253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:08:01.428661 22253 raft_consensus.cc:606] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 16 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:01.437541 27666 raft_consensus.cc:993] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6: : Instructing follower 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:08:01.438269 27666 raft_consensus.cc:1081] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 17 LEADER]: Signalling peer 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:08:01.439579 27691 raft_consensus.cc:2955] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:08:01.439962 22174 raft_consensus.cc:2955] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:08:01.440851 22173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0232d828f8664f348df823432990379b"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:51114
W20260709 13:08:01.460317 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 96740.3us
I20260709 13:08:01.462445 22173 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:01.463934 22173 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:01.465494 22254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9235083e4800460ca0b4619abda2917b"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:08:01.466804 22254 raft_consensus.cc:606] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:01.475857 22254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:08:01.480161 22254 raft_consensus.cc:606] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:01.478242 22173 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:01.500960 22173 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 18 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:01.506160 22255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94"
dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
mode: GRACEFUL
new_leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:45874
I20260709 13:08:01.507007 22255 raft_consensus.cc:606] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 17 LEADER]: Received request to transfer leadership to TS 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:01.509570 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:01.511693 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:01.512935 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:08:01.513543 22103 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:01.515358 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:08:01.516047 22253 raft_consensus.cc:3055] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:01.516355 22253 raft_consensus.cc:740] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:08:01.517150 22253 consensus_queue.cc:260] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:01.518630 22253 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:01.521217 22103 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 18.
I20260709 13:08:01.525077 27699 ts_tablet_manager.cc:933] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:01.540416 22102 raft_consensus.cc:1240] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Rejecting Update request from peer 765d912bde9e48959e50d9efec3c26b6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:01.528702 22104 consensus_queue.cc:237] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:01.532315 27683 raft_consensus.cc:993] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6: : Instructing follower 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:08:01.545058 27683 raft_consensus.cc:1081] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Signalling peer 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:08:01.549760 22144 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:08:01.550475 27699 tablet_copy_client.cc:323] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.66:42399
I20260709 13:08:01.550774 27650 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:01.551470 27650 raft_consensus.cc:697] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:08:01.552589 27650 consensus_queue.cc:237] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:01.553821 22000 catalog_manager.cc:5697] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index -1 to 10, term changed from 17 to 18, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to <none>, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 18 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:08:01.551154 22173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:51114
I20260709 13:08:01.555742 22173 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:01.556149 22191 tablet_copy_service.cc:140] P 79683575881f4334bd4dc6d9bdbb45c3: Received BeginTabletCopySession request for tablet 6b965624a67d4adb87e9787782f1715c from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:57856)
I20260709 13:08:01.556778 22191 tablet_copy_service.cc:161] P 79683575881f4334bd4dc6d9bdbb45c3: Beginning new tablet copy session on tablet 6b965624a67d4adb87e9787782f1715c from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:57856: session id = a07ca3d1b5b84f4bbcb907f709a69275-6b965624a67d4adb87e9787782f1715c
I20260709 13:08:01.570014 22253 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 18.
I20260709 13:08:01.556183 22173 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.592661 22191 tablet_copy_source_session.cc:215] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:08:01.598457 22069 consensus_peers.cc:597] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 931a6490a0ea49419e07ac75f5c84030. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:01.599601 22253 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:01.600358 22174 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:01.601963 27679 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:01.604803 22173 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:01.610276 27699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b965624a67d4adb87e9787782f1715c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.610162 27684 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:01.611240 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:08:01.611863 22103 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.615015 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:08:01.615643 22254 raft_consensus.cc:3055] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:01.616017 22254 raft_consensus.cc:740] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:08:01.616791 22254 consensus_queue.cc:260] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:01.617864 22254 raft_consensus.cc:3060] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.621783 22173 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:01.632963 22254 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:08:01.637738 22147 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:08:01.639178 27650 raft_consensus.cc:2804] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:01.640839 27650 raft_consensus.cc:697] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:08:01.641822 27650 consensus_queue.cc:237] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:01.647733 22103 raft_consensus.cc:2468] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:08:01.650112 27687 raft_consensus.cc:993] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: : Instructing follower 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:08:01.648442 22000 catalog_manager.cc:5697] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: leader changed from <none> to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 18 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.650665 27687 raft_consensus.cc:1081] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 16 LEADER]: Signalling peer 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:08:01.652796 22172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:51114
I20260709 13:08:01.653376 22172 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:01.653713 22172 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:01.676986 22172 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:01.740216 27679 raft_consensus.cc:2955] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:08:01.764348 22172 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 election: Requested vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:01.764667 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:08:01.765524 22255 raft_consensus.cc:3055] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:01.765887 22255 raft_consensus.cc:740] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:08:01.766877 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:08:01.767445 27689 raft_consensus.cc:993] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6: : Instructing follower 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:08:01.767614 22816 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:01.767990 27689 raft_consensus.cc:1081] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Signalling peer 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:08:01.771312 22255 consensus_queue.cc:260] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:01.772557 22255 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:01.773689 22177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9235083e4800460ca0b4619abda2917b"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:51114
I20260709 13:08:01.774278 22177 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:01.774617 22177 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.780611 22174 raft_consensus.cc:2955] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:08:01.801364 22000 catalog_manager.cc:5697] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 reported cstate change: config changed from index -1 to 9, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 14 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.805627 22253 raft_consensus.cc:2955] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:08:01.809484 22255 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 17.
I20260709 13:08:01.805559 22816 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 17.
I20260709 13:08:01.796923 22177 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:01.820780 21996 catalog_manager.cc:5697] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 12 to 13, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 13 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.822383 22144 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:08:01.834306 27675 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:01.834829 27675 raft_consensus.cc:697] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:08:01.835695 27675 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:01.842859 27699 tablet_copy_client.cc:806] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:01.856138 22177 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:01.856123 27699 tablet_copy_client.cc:670] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:01.858810 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
W20260709 13:08:01.859297 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 43673.3us
I20260709 13:08:01.859428 22103 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.879165 22103 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:08:01.880623 27699 tablet_copy_client.cc:538] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:01.893015 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:08:01.893697 22253 raft_consensus.cc:3055] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:01.893954 22253 raft_consensus.cc:740] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:08:01.894690 22253 consensus_queue.cc:260] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:01.895970 22253 raft_consensus.cc:3060] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.899454 22144 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:08:01.903653 22255 consensus_queue.cc:237] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:01.904774 27650 raft_consensus.cc:2804] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:01.905499 22253 raft_consensus.cc:2468] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 13.
I20260709 13:08:01.909021 27667 raft_consensus.cc:993] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6: : Instructing follower 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:08:01.906250 27650 raft_consensus.cc:697] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:08:01.911087 27667 raft_consensus.cc:1081] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 17 LEADER]: Signalling peer 79683575881f4334bd4dc6d9bdbb45c3 to start an election
I20260709 13:08:01.911640 27650 consensus_queue.cc:237] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:01.909018 27699 tablet_bootstrap.cc:492] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:08:01.913446 22174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94"
dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
 from {username='slave'} at 127.0.0.1:51114
I20260709 13:08:01.914038 22174 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:01.914417 22174 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:01.929627 22000 catalog_manager.cc:5697] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 16 to 17, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 17 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.932588 22174 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:01.937610 22103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "c0694f6572bf406a92d55f1f2ab46ef2"
I20260709 13:08:01.938210 22103 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:01.938269 22174 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 18 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:01.943367 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:08:01.944156 22254 raft_consensus.cc:3055] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:01.944545 22254 raft_consensus.cc:740] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:08:01.945474 22254 consensus_queue.cc:260] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:01.946836 22103 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 18.
I20260709 13:08:01.947202 22254 raft_consensus.cc:3060] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:01.948266 22144 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2; no voters: 
I20260709 13:08:01.949232 27675 raft_consensus.cc:2804] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:01.950553 27675 raft_consensus.cc:697] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:08:01.951597 27675 consensus_queue.cc:237] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:01.971485 22254 raft_consensus.cc:2468] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 18.
I20260709 13:08:01.996517 22102 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:02.001740 27676 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:02.009961 22103 raft_consensus.cc:2955] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:08:02.019623 22177 raft_consensus.cc:1275] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:02.021632 22102 raft_consensus.cc:1275] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:02.022095 27680 consensus_queue.cc:1048] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:02.024434 27680 consensus_queue.cc:1048] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:02.041544 22218 consensus_peers.cc:597] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b85b002ea7945719057edb66d543287. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.050588 22000 catalog_manager.cc:5697] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 12 to 13, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 13 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.067385 27683 raft_consensus.cc:2955] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:08:02.082186 22180 raft_consensus.cc:2955] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:08:02.094745 22255 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:02.105512 27709 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:02.111187 22144 consensus_peers.cc:597] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973): Couldn't send request to peer a07ca3d1b5b84f4bbcb907f709a69275. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0232d828f8664f348df823432990379b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.113515 22255 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:02.118382 27709 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:02.133889 22002 catalog_manager.cc:5697] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 17 to 18, leader changed from 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 18 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.213150 27717 ts_tablet_manager.cc:933] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:08:02.219703 22002 catalog_manager.cc:5697] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index -1 to 7, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New cstate: current_term: 9 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:08:02.285066 22104 raft_consensus.cc:1275] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:08:02.294153 27694 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2: Append to log took a long time: real 0.121s	user 0.004s	sys 0.000s
I20260709 13:08:02.297142 27709 consensus_queue.cc:1048] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:08:02.329101 22104 raft_consensus.cc:2955] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } }
I20260709 13:08:02.331159 27717 tablet_copy_client.cc:323] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.65:33421
I20260709 13:08:02.333580 22116 tablet_copy_service.cc:140] P c0694f6572bf406a92d55f1f2ab46ef2: Received BeginTabletCopySession request for tablet 931a6490a0ea49419e07ac75f5c84030 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:43368)
I20260709 13:08:02.334340 22116 tablet_copy_service.cc:161] P c0694f6572bf406a92d55f1f2ab46ef2: Beginning new tablet copy session on tablet 931a6490a0ea49419e07ac75f5c84030 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:43368: session id = a07ca3d1b5b84f4bbcb907f709a69275-931a6490a0ea49419e07ac75f5c84030
I20260709 13:08:02.343024 22253 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:02.344873 22116 tablet_copy_source_session.cc:215] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:02.345067 27709 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:02.360775 27717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931a6490a0ea49419e07ac75f5c84030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:02.388537 22816 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:02.390290 27676 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:02.398152 27699 tablet_bootstrap.cc:492] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:02.415591 27699 tablet_bootstrap.cc:492] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:08:02.416463 27699 ts_tablet_manager.cc:1403] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.508s	user 0.061s	sys 0.065s
I20260709 13:08:02.429131 22097 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:02.432736 27676 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:02.473308 27699 raft_consensus.cc:359] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:02.477501 27699 raft_consensus.cc:740] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:08:02.428146 22104 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:02.481634 27655 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:08:02.494735 22255 raft_consensus.cc:1275] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:02.513070 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:02.509321 27724 ts_tablet_manager.cc:933] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:02.478262 27699 consensus_queue.cc:260] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:02.531612 27655 consensus_queue.cc:1048] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:02.542845 22253 raft_consensus.cc:1275] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:02.556200 27676 consensus_queue.cc:1048] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:08:02.562490 27699 ts_tablet_manager.cc:1434] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.146s	user 0.005s	sys 0.003s
I20260709 13:08:02.578810 22191 tablet_copy_service.cc:342] P 79683575881f4334bd4dc6d9bdbb45c3: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-6b965624a67d4adb87e9787782f1715c received from {username='slave'} at 127.0.0.1:57856
I20260709 13:08:02.579576 22191 tablet_copy_service.cc:434] P 79683575881f4334bd4dc6d9bdbb45c3: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-6b965624a67d4adb87e9787782f1715c on tablet 6b965624a67d4adb87e9787782f1715c with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:08:02.632927 27717 tablet_copy_client.cc:806] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:02.633827 27717 tablet_copy_client.cc:670] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:02.648187 27699 ts_tablet_manager.cc:933] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275: Initiating tablet copy from peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:02.653508 27717 tablet_copy_client.cc:538] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:02.706161 27717 tablet_bootstrap.cc:492] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:08:02.739070 27724 tablet_copy_client.cc:323] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.66:42399
I20260709 13:08:02.748953 22191 tablet_copy_service.cc:140] P 79683575881f4334bd4dc6d9bdbb45c3: Received BeginTabletCopySession request for tablet 0232d828f8664f348df823432990379b from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:57856)
I20260709 13:08:02.749563 22191 tablet_copy_service.cc:161] P 79683575881f4334bd4dc6d9bdbb45c3: Beginning new tablet copy session on tablet 0232d828f8664f348df823432990379b from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:57856: session id = a07ca3d1b5b84f4bbcb907f709a69275-0232d828f8664f348df823432990379b
I20260709 13:08:02.743615 27699 tablet_copy_client.cc:323] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Beginning tablet copy session from remote peer at address 127.20.130.67:42273
I20260709 13:08:02.780854 22191 tablet_copy_source_session.cc:215] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:02.802480 27724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0232d828f8664f348df823432990379b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:02.816601 22264 tablet_copy_service.cc:140] P 765d912bde9e48959e50d9efec3c26b6: Received BeginTabletCopySession request for tablet 6b85b002ea7945719057edb66d543287 from peer a07ca3d1b5b84f4bbcb907f709a69275 ({username='slave'} at 127.0.0.1:45738)
I20260709 13:08:02.817232 22264 tablet_copy_service.cc:161] P 765d912bde9e48959e50d9efec3c26b6: Beginning new tablet copy session on tablet 6b85b002ea7945719057edb66d543287 from peer a07ca3d1b5b84f4bbcb907f709a69275 at {username='slave'} at 127.0.0.1:45738: session id = a07ca3d1b5b84f4bbcb907f709a69275-6b85b002ea7945719057edb66d543287
I20260709 13:08:02.843380 21001 tablet_server.cc:179] TabletServer@127.20.130.65:0 shutting down...
W20260709 13:08:02.845333 22218 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:02.855985 22264 tablet_copy_source_session.cc:215] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:02.883531 22816 raft_consensus.cc:1217] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:08:02.905082 27699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b85b002ea7945719057edb66d543287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:02.906273 27724 tablet_copy_client.cc:806] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:02.907336 27724 tablet_copy_client.cc:670] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
W20260709 13:08:02.916095 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 70785.2us
I20260709 13:08:02.926146 27724 tablet_copy_client.cc:538] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:08:02.928591 22144 consensus_peers.cc:597] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:02.963279 22218 consensus_peers.cc:597] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:02.965471 22218 consensus_peers.cc:597] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:02.967087 22144 consensus_peers.cc:597] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:02.986598 22779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 70739us
W20260709 13:08:02.978255 22218 consensus_peers.cc:597] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.004570 22218 consensus_peers.cc:597] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.018450 22218 consensus_peers.cc:597] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:03.023828 27724 tablet_bootstrap.cc:492] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:08:03.029513 21001 tablet_copy_service.cc:362] P c0694f6572bf406a92d55f1f2ab46ef2: Destroying tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-931a6490a0ea49419e07ac75f5c84030 due to service shutdown
I20260709 13:08:03.030128 21001 tablet_copy_service.cc:434] P c0694f6572bf406a92d55f1f2ab46ef2: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-931a6490a0ea49419e07ac75f5c84030 on tablet 931a6490a0ea49419e07ac75f5c84030 with peer a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:08:03.030699 22144 consensus_peers.cc:597] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.031430 22144 consensus_peers.cc:597] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.032188 22218 consensus_peers.cc:597] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.041445 22218 consensus_peers.cc:597] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.078617 22218 consensus_peers.cc:597] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.078830 22144 consensus_peers.cc:597] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.079821 22144 consensus_peers.cc:597] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.048699 22779 consensus_peers.cc:597] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.084759 22144 consensus_peers.cc:597] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.090507 22144 consensus_peers.cc:597] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.096854 22779 consensus_peers.cc:597] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.121881 22779 consensus_peers.cc:597] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.141887 22779 consensus_peers.cc:597] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.148133 22779 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.216209 22779 consensus_peers.cc:597] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:03.223516 27699 tablet_copy_client.cc:806] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:03.241549 27699 tablet_copy_client.cc:670] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:03.249543 27699 tablet_copy_client.cc:538] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:08:03.233991 22144 consensus_peers.cc:597] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.258785 22144 consensus_peers.cc:597] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.260249 22144 consensus_peers.cc:597] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.261667 22144 consensus_peers.cc:597] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.268625 22144 consensus_peers.cc:597] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.271920 22218 consensus_peers.cc:597] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.272907 22218 consensus_peers.cc:597] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.274469 22218 consensus_peers.cc:597] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.278326 22218 consensus_peers.cc:597] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.283291 22779 consensus_peers.cc:597] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:03.451050 27717 tablet_bootstrap.cc:492] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:03.452128 27717 tablet_bootstrap.cc:492] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:08:03.452934 27717 ts_tablet_manager.cc:1403] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.747s	user 0.038s	sys 0.018s
W20260709 13:08:03.598593 22218 consensus_peers.cc:597] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:03.625608 27699 tablet_bootstrap.cc:492] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap starting.
I20260709 13:08:03.655431 27655 raft_consensus.cc:1064] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
W20260709 13:08:03.696135 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 46418.7us
I20260709 13:08:03.726657 27655 consensus_queue.cc:237] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:03.779641 27685 raft_consensus.cc:493] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:03.806975 27685 raft_consensus.cc:515] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:03.809132 27685 leader_election.cc:290] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:03.811834 27717 raft_consensus.cc:359] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:03.812850 27717 raft_consensus.cc:740] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:08:03.813588 27717 consensus_queue.cc:260] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:03.828228 27717 ts_tablet_manager.cc:1434] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.375s	user 0.010s	sys 0.000s
I20260709 13:08:03.876232 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:03.872870 27690 raft_consensus.cc:493] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:03.894126 27690 raft_consensus.cc:515] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:03.896574 27690 leader_election.cc:290] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:03.900002 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:03.903313 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938b9c784244a59de8b48c3136eb3f" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:03.909862 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b85b002ea7945719057edb66d543287" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:03.961472 27756 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:03.962327 27756 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:03.965299 27756 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:03.971285 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:03.975732 27756 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:03.976348 27756 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:03.979286 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:03.979696 27756 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:03.993134 22072 leader_election.cc:304] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:03.998273 22253 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:04.014264 27633 raft_consensus.cc:2749] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.024170 27737 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:08:04.024909 27737 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:04.012524 27756 raft_consensus.cc:493] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:04.028103 27756 raft_consensus.cc:515] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.029088 22808 raft_consensus.cc:1217] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
W20260709 13:08:04.006678 27724 log.cc:927] Time spent T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 13:08:04.006280 27679 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:08:04.054774 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.062202 27679 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:04.064214 27679 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:04.054352 27690 raft_consensus.cc:493] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:08:04.045797 27655 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 13:08:04.085552 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 351603us
I20260709 13:08:04.070724 27685 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:04.112257 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.103999 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:04.111963 27633 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:04.120285 27633 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.122545 27633 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.123138 27764 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:04.102669 27684 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:04.123785 27740 raft_consensus.cc:493] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:04.154350 27740 raft_consensus.cc:515] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.155166 27684 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.156909 27740 leader_election.cc:290] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.157514 27740 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:04.157603 27684 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.158051 27740 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:04.101714 27692 raft_consensus.cc:493] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:04.114425 27685 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:04.160358 27692 raft_consensus.cc:515] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.161854 27685 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:04.127779 27756 leader_election.cc:290] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.100430 27690 raft_consensus.cc:515] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:04.166033 27690 leader_election.cc:290] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:04.145005 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.153333 27764 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.171701 21001 tablet_replica.cc:333] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.162621 27692 leader_election.cc:290] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.176211 21001 raft_consensus.cc:2243] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.176875 27764 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:08:04.177538 22069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 59818.5us
I20260709 13:08:04.180711 27724 tablet_bootstrap.cc:492] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:04.158658 27684 raft_consensus.cc:493] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:08:04.191325 22816 raft_consensus.cc:1275] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEARNER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:04.202199 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.202777 22069 leader_election.cc:304] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:08:04.204111 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.218186 27633 raft_consensus.cc:2749] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:04.222405 27762 raft_consensus.cc:493] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:04.223029 27762 raft_consensus.cc:515] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.223384 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:04.225399 27762 leader_election.cc:290] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.225914 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:04.227061 27764 raft_consensus.cc:493] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:04.227617 27764 raft_consensus.cc:515] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.228380 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:04.229640 27764 leader_election.cc:290] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.206192 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ed5952f28c46d8b66e87a9d1b03981" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.230072 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:04.118729 27737 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:04.207130 21001 raft_consensus.cc:2272] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.207695 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.208993 27724 tablet_bootstrap.cc:492] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:08:04.212993 27740 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:04.214774 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.233960 27724 ts_tablet_manager.cc:1403] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 1.210s	user 0.071s	sys 0.020s
W20260709 13:08:04.216336 22144 consensus_peers.cc:597] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.217041 27684 raft_consensus.cc:515] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:04.232173 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4e641637cf41118865c96aec55b340" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:04.206194 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.239934 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.240903 27684 leader_election.cc:290] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:04.244050 21001 tablet_replica.cc:333] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.245066 21001 raft_consensus.cc:2243] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.246344 21001 raft_consensus.cc:2272] T 383c9bd275674f7d8d5cdf16a1456960 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.246212 22173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.231390 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:04.251524 27745 consensus_queue.cc:1048] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:04.259783 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:04.245884 27724 raft_consensus.cc:359] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:04.262050 27724 raft_consensus.cc:740] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:08:04.270079 27724 consensus_queue.cc:260] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:04.266554 27762 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:04.274755 27762 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.263266 27737 raft_consensus.cc:493] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:04.276515 27737 raft_consensus.cc:515] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.277112 27692 raft_consensus.cc:493] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:08:04.277510 27762 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.277740 27692 raft_consensus.cc:515] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:04.273594 27764 raft_consensus.cc:493] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:04.281013 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.279182 27764 raft_consensus.cc:515] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.282896 27692 leader_election.cc:290] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:04.285233 27764 leader_election.cc:290] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.285395 27724 ts_tablet_manager.cc:1434] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.005s
I20260709 13:08:04.281122 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.278880 27737 leader_election.cc:290] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.291414 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.292028 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.273895 21001 tablet_replica.cc:333] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.296696 21001 raft_consensus.cc:2243] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.297457 21001 raft_consensus.cc:2272] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.299086 22069 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:08:04.299813 22069 raft_consensus.cc:2686] T 03ed5952f28c46d8b66e87a9d1b03981 P c0694f6572bf406a92d55f1f2ab46ef2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:08:04.303828 22069 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:08:04.308295 27764 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:04.305665 21001 tablet_replica.cc:333] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.310875 21001 raft_consensus.cc:2243] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.309149 22069 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:08:04.313125 22069 raft_consensus.cc:2686] T 0911b6e64ffb48bd9fc4968f8f52860c P c0694f6572bf406a92d55f1f2ab46ef2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:08:04.314266 21001 raft_consensus.cc:2272] T a37c5a7045b24e5f8f89b17248cb9529 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.321516 27699 tablet_bootstrap.cc:492] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:04.322708 27699 tablet_bootstrap.cc:492] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275: Bootstrap complete.
I20260709 13:08:04.322907 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "116931ff9e08478dadc7bdc9e917454a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:04.330631 27684 raft_consensus.cc:493] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:04.343588 27684 raft_consensus.cc:515] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.346688 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.346985 27684 leader_election.cc:290] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.335506 27763 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:04.347980 27763 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.350886 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.352994 27699 ts_tablet_manager.cc:1403] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent bootstrapping tablet: real 0.728s	user 0.029s	sys 0.014s
I20260709 13:08:04.361078 27764 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:04.361685 27764 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.364320 27764 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.364959 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.369356 27737 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:04.369976 27737 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:04.372102 27737 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:04.375064 21001 tablet_replica.cc:333] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.376092 21001 raft_consensus.cc:2243] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.377274 21001 raft_consensus.cc:2272] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.371402 27758 raft_consensus.cc:2955] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
W20260709 13:08:04.378311 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 280648us
I20260709 13:08:04.383909 22191 tablet_copy_service.cc:342] P 79683575881f4334bd4dc6d9bdbb45c3: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-0232d828f8664f348df823432990379b received from {username='slave'} at 127.0.0.1:57856
I20260709 13:08:04.384428 22191 tablet_copy_service.cc:434] P 79683575881f4334bd4dc6d9bdbb45c3: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-0232d828f8664f348df823432990379b on tablet 0232d828f8664f348df823432990379b with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:08:04.386108 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.388309 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.389604 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53b5061ddba43b7ae5a93ea344b61ca" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.390479 27763 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.391367 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d958965f6f1e46f7917ee6e8a28078ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.394544 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0d86a3e0d843d0a468840a4f90cbf4" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.399699 22253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6617a460ae364f94b826785a9e77ec86" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.399998 22252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebf4c9a0fe314a8db203637fffd1dc52" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.395923 22255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbbed7673fb44214a4548960bdacf99b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.402448 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1364cdaa794f9fb4739365dc79d393" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.402535 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2b1eeb3bb341638b56bf74c37e2045" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.358177 27699 raft_consensus.cc:359] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:04.396467 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38b6e6d2d3741e9b61d5a743ca099a2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.407231 27699 raft_consensus.cc:740] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Initialized, Role: LEARNER
I20260709 13:08:04.396608 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef905e474cc543dc9b0f2de05a3807c6" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.397328 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3869ae617b42c89768d68043d44be2" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.407946 27699 consensus_queue.cc:260] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:04.398226 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00aee6f5c28c45b0841b480190d2c555" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.409453 27763 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:04.411736 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e0f44b43c1a477e9c7c66c034c8844a" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.415818 27699 ts_tablet_manager.cc:1434] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.001s
I20260709 13:08:04.417938 22264 tablet_copy_service.cc:342] P 765d912bde9e48959e50d9efec3c26b6: Request end of tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-6b85b002ea7945719057edb66d543287 received from {username='slave'} at 127.0.0.1:45738
I20260709 13:08:04.418440 22264 tablet_copy_service.cc:434] P 765d912bde9e48959e50d9efec3c26b6: ending tablet copy session a07ca3d1b5b84f4bbcb907f709a69275-6b85b002ea7945719057edb66d543287 on tablet 6b85b002ea7945719057edb66d543287 with peer a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:08:04.414894 22250 raft_consensus.cc:2955] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:04.410035 27763 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:04.424338 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:04.422036 27684 raft_consensus.cc:493] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:08:04.438628 27684 raft_consensus.cc:515] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:04.440579 22069 leader_election.cc:304] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:08:04.441234 27740 raft_consensus.cc:2749] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.425335 27737 raft_consensus.cc:493] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:04.436502 27762 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:04.427064 27692 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:04.443797 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:04.452359 27692 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } }
I20260709 13:08:04.453630 22815 raft_consensus.cc:1217] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 13:08:04.455467 22072 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.457589 22072 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:08:04.458000 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.458791 22072 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:08:04.459868 22072 leader_election.cc:304] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.461731 22072 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.463112 27685 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.463843 21001 tablet_replica.cc:333] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.464877 27763 leader_election.cc:290] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.466363 27755 raft_consensus.cc:2749] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:04.467139 27679 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.469609 27766 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.469627 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.472680 27685 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.446291 27737 raft_consensus.cc:515] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.469794 22002 catalog_manager.cc:5697] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 8 to 9, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:04.477572 27737 leader_election.cc:290] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.476931 22072 leader_election.cc:304] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.478107 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.478883 27737 raft_consensus.cc:2749] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:04.454612 27762 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:04.486246 27762 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:04.483580 27692 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.487823 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:04.441279 27684 leader_election.cc:290] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:04.492352 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.497099 22072 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.498274 22072 leader_election.cc:304] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.495085 22816 raft_consensus.cc:2955] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:04.499032 27737 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.499684 27737 raft_consensus.cc:2749] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:04.499971 22071 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:08:04.501112 27740 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:04.505239 22815 raft_consensus.cc:1217] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 LEARNER]: Deduplicated request from leader. Original: 17.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 13:08:04.509474 22072 leader_election.cc:304] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.511183 27764 raft_consensus.cc:2749] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:04.512472 22072 leader_election.cc:304] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:08:04.513232 27764 raft_consensus.cc:2749] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.514554 22072 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.515331 27764 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.516515 22072 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.517168 27764 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:04.518482 22072 leader_election.cc:304] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
W20260709 13:08:04.519143 22072 raft_consensus.cc:2686] T ef905e474cc543dc9b0f2de05a3807c6 P c0694f6572bf406a92d55f1f2ab46ef2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:08:04.519991 22072 leader_election.cc:304] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.520720 27764 raft_consensus.cc:2749] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.521879 22072 leader_election.cc:304] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.522657 27764 raft_consensus.cc:2749] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:04.525305 22072 leader_election.cc:304] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.526100 27764 raft_consensus.cc:2749] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.544229 27684 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:04.544809 27684 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:04.547842 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:04.547969 21001 raft_consensus.cc:2243] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.549867 27684 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:04.551692 21001 raft_consensus.cc:2272] T 3f1a2136ffa84255b65c2f9037b0e55d P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.558881 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42ecdbc6a0d4ed88048a3ea9bc6b893" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.559125 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc23a012ae0497797e82803613f3835" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.561285 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252049d2bcdd4f329ca5015bf10c1b19" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.569031 27764 raft_consensus.cc:1064] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:08:04.569522 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394d042ced1042eb99ada43cc8ab55ba" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.576200 22249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.578043 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5e08d4c24545e18b620e33800d39d3" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.580196 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9235083e4800460ca0b4619abda2917b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.580142 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea960f06fa1940d49afea738c7cd0e94" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.581844 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:04.583406 22072 leader_election.cc:304] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.585500 22072 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.584491 21001 tablet_replica.cc:333] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.588239 21001 raft_consensus.cc:2243] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.589540 22072 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:08:04.590404 27762 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:04.592458 27692 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:04.587944 27740 raft_consensus.cc:2749] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:04.601691 22072 leader_election.cc:304] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:08:04.603134 22072 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.599610 27764 consensus_queue.cc:237] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:04.603920 27762 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.605151 22072 leader_election.cc:304] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.603264 27740 raft_consensus.cc:2749] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.605858 27762 raft_consensus.cc:2749] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.608119 22072 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.608796 27762 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:04.609591 21001 raft_consensus.cc:2272] T c80e8c56632c46d9a35c63a2ca8a532f P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.610204 22072 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.610976 27762 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.612066 22072 leader_election.cc:304] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0694f6572bf406a92d55f1f2ab46ef2; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:04.612766 27762 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:04.614601 21001 tablet_replica.cc:333] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.621832 21001 raft_consensus.cc:2243] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.639477 22251 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:04.644740 27762 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:04.650159 22178 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:04.655140 27740 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:04.658668 22816 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEARNER]: Refusing update from remote peer c0694f6572bf406a92d55f1f2ab46ef2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:04.690562 27740 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:04.695420 21001 raft_consensus.cc:2272] T 00aee6f5c28c45b0841b480190d2c555 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.698463 21001 tablet_replica.cc:333] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.702512 27666 raft_consensus.cc:1064] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:08:04.707495 27666 consensus_queue.cc:237] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:04.734275 21001 raft_consensus.cc:2243] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.743673 21001 raft_consensus.cc:2272] T cbe9d18a693340a29f852081a41a74f1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.746641 21001 tablet_replica.cc:333] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.769208 22180 raft_consensus.cc:1275] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:04.773334 21001 raft_consensus.cc:2243] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:04.774051 22218 consensus_peers.cc:597] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.774405 27683 consensus_queue.cc:1048] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:04.777824 27764 raft_consensus.cc:2955] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:04.791695 22251 raft_consensus.cc:2955] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:04.795892 21001 raft_consensus.cc:2272] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.806718 21001 tablet_replica.cc:333] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.807757 21001 raft_consensus.cc:2243] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.808503 21001 raft_consensus.cc:2272] T 6617a460ae364f94b826785a9e77ec86 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.809283 22815 raft_consensus.cc:2955] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:04.811229 22816 raft_consensus.cc:1275] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 LEARNER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:04.814851 27739 consensus_queue.cc:1048] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:04.823849 21001 tablet_replica.cc:333] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.827047 21001 raft_consensus.cc:2243] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.829154 21001 raft_consensus.cc:2272] T 931a6490a0ea49419e07ac75f5c84030 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.836170 22178 raft_consensus.cc:2955] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:04.843849 21996 catalog_manager.cc:5697] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 9 to 10, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:04.848258 21001 tablet_replica.cc:333] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.852773 21001 raft_consensus.cc:2243] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.868281 21001 raft_consensus.cc:2272] T f79004ff583f4b278afa2453c7088bf7 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.904881 21001 tablet_replica.cc:333] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.916193 21001 raft_consensus.cc:2243] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.916965 21001 raft_consensus.cc:2272] T 116931ff9e08478dadc7bdc9e917454a P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.925457 21001 tablet_replica.cc:333] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.926455 21001 raft_consensus.cc:2243] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.927443 21001 raft_consensus.cc:2272] T dd0d86a3e0d843d0a468840a4f90cbf4 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.927543 27683 raft_consensus.cc:2955] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:04.929351 22816 raft_consensus.cc:2955] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:04.941484 21001 tablet_replica.cc:333] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.948794 21001 raft_consensus.cc:2243] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.949494 21001 raft_consensus.cc:2272] T 8f5e08d4c24545e18b620e33800d39d3 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.952683 21001 tablet_replica.cc:333] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:04.953848 21001 raft_consensus.cc:2243] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.954548 21001 raft_consensus.cc:2272] T 5d3869ae617b42c89768d68043d44be2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.956430 22180 raft_consensus.cc:2955] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:04.978380 22000 catalog_manager.cc:5697] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: config changed from index 7 to 8, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:05.021631 21001 tablet_replica.cc:333] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.036126 21001 raft_consensus.cc:2243] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.046208 21001 raft_consensus.cc:2272] T 9235083e4800460ca0b4619abda2917b P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.105139 21001 tablet_replica.cc:333] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.106127 21001 raft_consensus.cc:2243] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.124236 27745 raft_consensus.cc:1064] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: attempting to promote NON_VOTER a07ca3d1b5b84f4bbcb907f709a69275 to VOTER
I20260709 13:08:05.130198 27745 consensus_queue.cc:237] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:05.159865 21001 raft_consensus.cc:2272] T 38574701043e46cb978340cb6753faae P c0694f6572bf406a92d55f1f2ab46ef2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.170068 21001 tablet_replica.cc:333] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.170832 22250 consensus_queue.cc:237] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:05.174312 22251 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:05.175963 27745 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:05.173313 22816 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 LEARNER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:05.180537 22816 raft_consensus.cc:1275] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:05.180414 27770 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:05.174253 21001 raft_consensus.cc:2243] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.183459 27683 consensus_queue.cc:1048] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:05.184072 21001 raft_consensus.cc:2272] T 0f980cc59e6c41d7b5d29d438419c0d1 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.186683 22144 consensus_peers.cc:597] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.187661 21001 tablet_replica.cc:333] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.188606 21001 raft_consensus.cc:2243] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.189265 21001 raft_consensus.cc:2272] T ee2b1eeb3bb341638b56bf74c37e2045 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.192245 21001 tablet_replica.cc:333] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.194702 27666 raft_consensus.cc:2955] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:05.201290 21001 raft_consensus.cc:2243] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.203521 21001 raft_consensus.cc:2272] T 394d042ced1042eb99ada43cc8ab55ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.202587 22810 raft_consensus.cc:2955] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:05.206501 21001 tablet_replica.cc:333] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.210141 21001 raft_consensus.cc:2243] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.210891 21001 raft_consensus.cc:2272] T db1364cdaa794f9fb4739365dc79d393 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.221367 22178 raft_consensus.cc:1275] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:05.222970 21991 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b85b002ea7945719057edb66d543287 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:05.223160 27739 consensus_queue.cc:1048] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:05.230890 21996 catalog_manager.cc:5697] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 8 to 9, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New cstate: current_term: 9 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:05.229970 22178 raft_consensus.cc:2955] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:05.232609 21001 tablet_replica.cc:333] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.233577 21001 raft_consensus.cc:2243] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.234694 21001 raft_consensus.cc:2272] T 96aa7e0b91bf482db9b8977df7574baf P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.251029 21001 tablet_replica.cc:333] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.252130 21001 raft_consensus.cc:2243] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.258869 21001 raft_consensus.cc:2272] T 252049d2bcdd4f329ca5015bf10c1b19 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.261808 21001 tablet_replica.cc:333] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.262746 21001 raft_consensus.cc:2243] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.263567 21001 raft_consensus.cc:2272] T 6b85b002ea7945719057edb66d543287 P c0694f6572bf406a92d55f1f2ab46ef2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.266088 21001 tablet_replica.cc:333] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.266894 21001 raft_consensus.cc:2243] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.272981 21001 raft_consensus.cc:2272] T 0232d828f8664f348df823432990379b P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.280759 21001 tablet_replica.cc:333] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.281530 21001 raft_consensus.cc:2243] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.282104 21001 raft_consensus.cc:2272] T 7e0f44b43c1a477e9c7c66c034c8844a P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.283142 22218 consensus_peers.cc:597] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:05.287658 27770 raft_consensus.cc:2955] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 10 to 12, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:05.295019 21001 tablet_replica.cc:333] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.295989 21001 raft_consensus.cc:2243] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.301256 22251 raft_consensus.cc:2955] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 10 to 12, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:05.303987 21001 raft_consensus.cc:2272] T 9be7e328170d4837bbaade0fb02dead2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.306326 21988 catalog_manager.cc:4755] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6b85b002ea7945719057edb66d543287: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:08:05.307240 21001 tablet_replica.cc:333] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.315070 21001 raft_consensus.cc:2243] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.315812 21001 raft_consensus.cc:2272] T bbbed7673fb44214a4548960bdacf99b P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.320042 21001 tablet_replica.cc:333] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.320874 21001 raft_consensus.cc:2243] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.326289 21001 raft_consensus.cc:2272] T 7a567384a18d40a09c5a3e09e6c15ef6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.330132 21001 tablet_replica.cc:333] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.332841 22815 raft_consensus.cc:2955] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 10 to 12, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:05.334781 21001 raft_consensus.cc:2243] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.337152 21001 raft_consensus.cc:2272] T d38b6e6d2d3741e9b61d5a743ca099a2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.342862 21001 tablet_replica.cc:333] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.343695 21001 raft_consensus.cc:2243] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.344715 21001 raft_consensus.cc:2272] T 00e5bf29367f432285b4e873ecccea9e P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.346246 22000 catalog_manager.cc:5697] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: config changed from index 10 to 12, a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:05.347518 21001 tablet_replica.cc:333] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.354677 21001 raft_consensus.cc:2243] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.355800 21001 raft_consensus.cc:2272] T 79d645cd970b4b2789be5374cc2005aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.358390 21001 tablet_replica.cc:333] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.359194 21001 raft_consensus.cc:2243] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.359691 21001 raft_consensus.cc:2272] T b53b5061ddba43b7ae5a93ea344b61ca P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.363524 21001 tablet_replica.cc:333] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.364256 21001 raft_consensus.cc:2243] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.364878 21001 raft_consensus.cc:2272] T d958965f6f1e46f7917ee6e8a28078ba P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.369969 22178 consensus_queue.cc:237] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:05.367386 21001 tablet_replica.cc:333] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.378295 21001 raft_consensus.cc:2243] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.379956 22251 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:05.381893 27745 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:05.384974 21001 raft_consensus.cc:2272] T 6d938b9c784244a59de8b48c3136eb3f P c0694f6572bf406a92d55f1f2ab46ef2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.389189 21001 tablet_replica.cc:333] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.389948 21001 raft_consensus.cc:2243] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.392706 21001 raft_consensus.cc:2272] T ea960f06fa1940d49afea738c7cd0e94 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.395318 21001 tablet_replica.cc:333] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.396108 21001 raft_consensus.cc:2243] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.397163 21001 raft_consensus.cc:2272] T 9c6cd0878342413eb24e0e69b3a96aa0 P c0694f6572bf406a92d55f1f2ab46ef2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.397518 27786 raft_consensus.cc:2955] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:05.401191 22250 raft_consensus.cc:2955] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:05.407073 21001 tablet_replica.cc:333] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.407912 21001 raft_consensus.cc:2243] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.408639 21001 raft_consensus.cc:2272] T efc23a012ae0497797e82803613f3835 P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.411412 21001 tablet_replica.cc:333] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.412125 21001 raft_consensus.cc:2243] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.413127 21001 raft_consensus.cc:2272] T 5f9abb5a83ca4007a03cd4613544f2eb P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.413923 22218 consensus_peers.cc:597] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:05.415668 21001 tablet_replica.cc:333] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.416530 21001 raft_consensus.cc:2243] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.417629 21001 raft_consensus.cc:2272] T 16e48ec055f940c49e01d5a5d77581aa P c0694f6572bf406a92d55f1f2ab46ef2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.420469 21001 tablet_replica.cc:333] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.421226 21001 raft_consensus.cc:2243] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.421780 21001 raft_consensus.cc:2272] T 9a4e641637cf41118865c96aec55b340 P c0694f6572bf406a92d55f1f2ab46ef2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.424523 21001 tablet_replica.cc:333] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.425293 21001 raft_consensus.cc:2243] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.432236 21001 raft_consensus.cc:2272] T 5ed3b0d7588c4652991dbe99eb204ae2 P c0694f6572bf406a92d55f1f2ab46ef2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.436687 22815 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:05.442575 21001 tablet_replica.cc:333] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.445086 27745 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:08:05.447537 21001 raft_consensus.cc:2243] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.448273 21001 raft_consensus.cc:2272] T 6b965624a67d4adb87e9787782f1715c P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.461364 22815 raft_consensus.cc:2955] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:05.464020 21990 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0232d828f8664f348df823432990379b with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:05.450830 21001 tablet_replica.cc:333] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.465361 21001 raft_consensus.cc:2243] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.468058 21001 raft_consensus.cc:2272] T 663cabb59b2041f98e811d0b49faf5da P c0694f6572bf406a92d55f1f2ab46ef2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.470376 21001 tablet_replica.cc:333] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.471647 21996 catalog_manager.cc:5697] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: config changed from index 12 to 13, VOTER c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) evicted. New cstate: current_term: 18 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } } }
I20260709 13:08:05.470844 21001 raft_consensus.cc:2243] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.475097 21001 raft_consensus.cc:2272] T ebf4c9a0fe314a8db203637fffd1dc52 P c0694f6572bf406a92d55f1f2ab46ef2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.478061 21001 tablet_replica.cc:333] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2: stopping tablet replica
I20260709 13:08:05.478955 21001 raft_consensus.cc:2243] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.480046 21001 raft_consensus.cc:2272] T 5d6633743ea44146a5164f64185db9a6 P c0694f6572bf406a92d55f1f2ab46ef2 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.489306 22218 consensus_peers.cc:597] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:05.514786 22779 consensus_peers.cc:597] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:05.556198 27786 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:05.556847 27786 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:05.559151 27786 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:05.561761 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:05.563977 27739 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:05.564579 27739 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:05.569336 22144 leader_election.cc:336] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:05.567680 22218 consensus_peers.cc:597] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:05.569092 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:05.579840 22144 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:05.581943 27745 raft_consensus.cc:2749] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:05.584838 22218 leader_election.cc:336] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:05.585322 22218 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:05.586310 27738 raft_consensus.cc:2749] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:05.566882 27739 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:08:05.593757 22144 consensus_peers.cc:597] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:05.597091 22218 consensus_peers.cc:597] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:05.645660 22218 consensus_peers.cc:597] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:05.665592 22218 consensus_peers.cc:597] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:05.675444 22218 consensus_peers.cc:597] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:05.761300 27759 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:05.761940 27759 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:05.764576 27759 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:05.765607 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:08:05.779122 22779 leader_election.cc:336] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:05.779670 22779 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:05.780759 27759 raft_consensus.cc:2749] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:05.794456 22779 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:05.798439 27717 tablet_copy_client.cc:1131] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:05.806231 22144 consensus_peers.cc:597] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:05.806849 22144 consensus_peers.cc:597] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:05.809959 22779 consensus_peers.cc:597] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:05.813148 22218 consensus_peers.cc:597] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:05.813784 22218 consensus_peers.cc:597] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:05.826323 27759 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:05.827162 27759 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:05.832276 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:05.833036 22250 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
I20260709 13:08:05.834609 22782 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:08:05.835618 27767 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:05.836086 27767 raft_consensus.cc:493] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:05.836583 27767 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:05.851585 27759 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:05.874483 27767 raft_consensus.cc:515] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:05.876783 27767 leader_election.cc:290] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:05.878065 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37c5a7045b24e5f8f89b17248cb9529" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:08:05.878712 22250 raft_consensus.cc:3060] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:05.885962 22250 raft_consensus.cc:2468] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 14.
I20260709 13:08:05.887192 22782 leader_election.cc:304] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:08:05.888017 27759 raft_consensus.cc:2804] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:05.889143 27759 raft_consensus.cc:697] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:08:05.890015 27759 consensus_queue.cc:237] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:05.868089 22779 leader_election.cc:336] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:05.891276 22144 consensus_peers.cc:597] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:05.896932 27759 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:08:05.897552 22779 leader_election.cc:336] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:05.904351 21996 catalog_manager.cc:5697] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 13 to 14, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 14 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:05.897521 27759 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:05.953540 27759 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:05.961019 22779 leader_election.cc:336] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:05.989530 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:05.990159 22180 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 10.
W20260709 13:08:05.999984 22144 consensus_peers.cc:597] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:06.001446 22779 consensus_peers.cc:597] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:06.008332 22781 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:08:06.008667 22779 consensus_peers.cc:597] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:06.012913 22144 consensus_peers.cc:597] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:06.015187 27759 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:06.015715 27759 raft_consensus.cc:493] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.016120 27759 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:06.053568 22144 consensus_peers.cc:597] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:06.057143 22779 consensus_peers.cc:597] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:06.081146 27759 raft_consensus.cc:515] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:06.083161 22218 consensus_peers.cc:597] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:06.085623 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80e8c56632c46d9a35c63a2ca8a532f" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:08:06.086308 22177 raft_consensus.cc:3060] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.097998 22177 raft_consensus.cc:2468] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 11.
I20260709 13:08:06.099452 22781 leader_election.cc:304] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:08:06.100189 27797 raft_consensus.cc:2804] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:06.101433 27797 raft_consensus.cc:697] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:08:06.102391 27797 consensus_queue.cc:237] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.111955 27759 leader_election.cc:290] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:06.108430 22779 leader_election.cc:336] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.144411 21996 catalog_manager.cc:5697] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 10 to 11, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 11 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:06.174799 22144 consensus_peers.cc:597] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:06.182636 22144 consensus_peers.cc:597] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:06.209896 22144 consensus_peers.cc:597] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:06.214092 27739 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.214710 27739 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.216974 27739 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:06.220639 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:06.221369 22815 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:08:06.223436 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:08:06.224995 27666 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:06.225394 27666 raft_consensus.cc:493] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.225772 27666 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:06.229533 22218 leader_election.cc:336] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.237406 27666 raft_consensus.cc:515] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.239887 27666 leader_election.cc:290] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:06.243076 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9d18a693340a29f852081a41a74f1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:08:06.243795 22815 raft_consensus.cc:3060] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.252561 22815 raft_consensus.cc:2468] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 14.
I20260709 13:08:06.261628 22218 leader_election.cc:304] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:08:06.262511 27666 raft_consensus.cc:2804] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:06.263084 27666 raft_consensus.cc:697] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 14 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:08:06.263989 27666 consensus_queue.cc:237] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:06.265658 22218 leader_election.cc:336] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.287575 21996 catalog_manager.cc:5697] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 13 to 14, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 14 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:06.292615 27739 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.293473 27739 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.298210 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:06.301010 27739 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:08:06.304487 22218 leader_election.cc:336] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.305058 22218 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:06.307287 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:06.308394 27666 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.310753 27797 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.316110 27797 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.320036 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:06.323369 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:06.324103 22251 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 14.
W20260709 13:08:06.329339 21988 catalog_manager.cc:4755] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 0232d828f8664f348df823432990379b: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.332396 27797 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:08:06.339903 22779 consensus_peers.cc:597] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:06.340408 22779 leader_election.cc:336] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.340833 22779 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:06.341697 27797 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.362329 27786 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.362910 27786 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.366074 27786 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:06.369410 27786 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.369952 27786 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.373298 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:06.373967 22251 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:08:06.377198 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:06.378341 27666 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.378891 27666 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:06.381784 27759 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.382400 27759 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.384533 27759 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:06.386184 22218 leader_election.cc:336] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.387748 27666 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:06.390511 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:06.392560 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:06.394699 22220 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:06.398059 27739 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.406755 22250 raft_consensus.cc:1275] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:08:06.408430 27795 consensus_queue.cc:1048] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:06.377543 27786 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:08:06.430835 22144 consensus_peers.cc:597] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:06.431452 22144 leader_election.cc:336] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.432754 22144 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:06.437530 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:06.438275 22810 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
W20260709 13:08:06.439841 22779 leader_election.cc:336] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.437573 27786 raft_consensus.cc:2749] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:06.440358 22779 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:08:06.445659 22144 leader_election.cc:336] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.447553 27767 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.450405 22144 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:06.451699 27786 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:06.452272 27786 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.452664 27786 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:06.461850 27786 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.483318 27786 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:06.486550 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:08:06.487241 22251 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:06.488129 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:08:06.488718 22810 raft_consensus.cc:3060] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:06.500078 22251 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:08:06.507819 22810 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
W20260709 13:08:06.515707 22144 leader_election.cc:336] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.516592 22144 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:06.517825 27800 raft_consensus.cc:2804] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:06.518311 27800 raft_consensus.cc:697] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:08:06.519222 27800 consensus_queue.cc:237] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:06.519804 22779 consensus_peers.cc:597] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:06.530115 27786 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.530766 27786 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:08:06.532754 22779 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:06.537112 27797 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.538985 27767 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.539956 27767 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.541364 27786 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:06.544386 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:06.545069 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:06.537698 27797 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.547909 27797 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:06.549239 27759 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.558135 27759 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.549556 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:06.559473 22180 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 16.
I20260709 13:08:06.560911 22781 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:08:06.561736 27767 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421)
I20260709 13:08:06.562392 27767 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:06.562815 27767 raft_consensus.cc:493] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.563289 27767 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:06.553905 21996 catalog_manager.cc:5697] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 14 to 15, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 15 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:06.575011 27759 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:06.576121 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:06.585412 27786 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.586301 27745 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.586432 27786 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:06.587448 27745 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:06.588984 27786 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:06.589404 27745 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:06.591699 22251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:06.593529 27797 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.594678 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:06.594555 27797 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:06.596273 22218 consensus_peers.cc:597] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:06.598045 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:06.598681 22177 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:08:06.599259 27739 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.599761 27739 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:06.601075 22781 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:08:06.610719 27797 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:06.638552 27683 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.641494 27808 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.641999 27808 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.642361 27808 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.641547 27683 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:06.645069 27683 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:06.648463 22218 leader_election.cc:336] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:06.652091 22218 leader_election.cc:336] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.654022 27739 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:06.660439 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:06.661331 22177 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:08:06.662559 22220 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:06.663700 27739 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.663115 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:06.664830 22180 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 18.
I20260709 13:08:06.664182 27739 raft_consensus.cc:493] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.666090 27739 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.666033 22220 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:06.667567 27683 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:06.667932 27683 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.668288 27683 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:06.676684 27683 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:08:06.685586 21001 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22127)
I20260709 13:08:06.689849 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:08:06.691045 22180 raft_consensus.cc:3060] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:06.692022 22779 leader_election.cc:336] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.692521 22779 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:08:06.693070 22218 leader_election.cc:336] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.694033 27809 raft_consensus.cc:2749] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:06.694844 22779 leader_election.cc:336] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:06.699153 22779 leader_election.cc:336] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.700453 22779 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:08:06.700742 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 114573us
W20260709 13:08:06.702442 22144 leader_election.cc:336] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.703015 22144 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:06.704738 27683 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:06.707543 27745 raft_consensus.cc:2749] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.709656 27759 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.710263 27759 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.711846 27767 raft_consensus.cc:515] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.712570 27759 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:06.713678 22218 consensus_peers.cc:597] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:06.714090 22779 leader_election.cc:336] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.702069 27809 raft_consensus.cc:2749] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.714003 27767 leader_election.cc:290] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 17 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:06.716090 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:06.716521 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96aa7e0b91bf482db9b8977df7574baf" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:08:06.717274 22178 raft_consensus.cc:3060] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:06.728391 22779 leader_election.cc:336] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.728906 22779 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:06.729645 27767 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.729960 22178 raft_consensus.cc:2468] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 17.
W20260709 13:08:06.729897 22779 leader_election.cc:336] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.731617 22781 leader_election.cc:304] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:06.732617 27767 raft_consensus.cc:2804] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:06.733105 27767 raft_consensus.cc:697] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:08:06.733148 27808 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.734056 27767 consensus_queue.cc:237] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.736682 27808 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:06.736063 22180 raft_consensus.cc:2468] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 19.
I20260709 13:08:06.740051 22220 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:06.740845 27683 raft_consensus.cc:2804] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:06.741356 27683 raft_consensus.cc:697] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 19 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:08:06.742242 27683 consensus_queue.cc:237] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:06.738703 27739 raft_consensus.cc:515] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:06.749696 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d645cd970b4b2789be5374cc2005aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:08:06.750303 22177 raft_consensus.cc:3060] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:06.754177 22144 leader_election.cc:336] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:06.757652 22218 leader_election.cc:336] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.759318 22178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:08:06.760242 22178 raft_consensus.cc:3060] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.754704 22144 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:08:06.763753 22144 leader_election.cc:336] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.764789 27806 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:06.767627 22173 raft_consensus.cc:1275] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:06.769356 27739 leader_election.cc:290] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:06.764168 22144 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:06.769891 27759 consensus_queue.cc:1048] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:06.772425 27807 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:06.779294 22144 consensus_peers.cc:597] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:06.782054 27739 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.782666 27739 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.784768 27739 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:06.786834 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:06.787266 27807 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.787634 22810 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:08:06.787997 27807 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:06.790115 27807 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:06.790716 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:08:06.791666 22250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:06.792455 22250 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 11.
W20260709 13:08:06.793520 22218 leader_election.cc:336] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.794095 27666 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:06.794486 27666 raft_consensus.cc:493] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.794828 27666 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.799823 22147 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:08:06.801290 27807 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:06.801671 27807 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.802074 27807 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.805145 27739 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.805367 27666 raft_consensus.cc:515] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.801811 22178 raft_consensus.cc:2468] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 13.
I20260709 13:08:06.805768 27739 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:06.786674 22177 raft_consensus.cc:2468] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 13.
I20260709 13:08:06.807300 27666 leader_election.cc:290] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:06.807956 22220 leader_election.cc:304] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:06.807957 22781 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:08:06.813481 27795 raft_consensus.cc:2804] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:06.813683 22779 leader_election.cc:336] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.814734 22815 raft_consensus.cc:1275] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:08:06.815140 27795 raft_consensus.cc:697] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 LEADER]: Becoming Leader. State: Replica: a07ca3d1b5b84f4bbcb907f709a69275, State: Running, Role: LEADER
I20260709 13:08:06.816119 27795 consensus_queue.cc:237] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.823800 27807 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:06.825001 27815 raft_consensus.cc:2804] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:06.825714 27815 raft_consensus.cc:697] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:08:06.827520 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed3b0d7588c4652991dbe99eb204ae2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:08:06.833596 22815 raft_consensus.cc:3060] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.835266 27739 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:06.833936 27815 consensus_queue.cc:237] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:06.843544 22815 raft_consensus.cc:2468] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 14.
I20260709 13:08:06.826969 27666 consensus_queue.cc:1048] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:08:06.822867 22144 leader_election.cc:336] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.830019 27813 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.847251 27813 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.849604 27813 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:08:06.851191 22218 leader_election.cc:336] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.852144 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:06.859134 22177 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 17.
I20260709 13:08:06.862347 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:06.863047 22810 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 15.
I20260709 13:08:06.863191 22220 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:08:06.861218 22218 leader_election.cc:304] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:06.864248 27813 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:06.864679 27813 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.864822 27666 raft_consensus.cc:2804] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:06.865221 27813 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:06.873135 21996 catalog_manager.cc:5697] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 18 to 19, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 19 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:06.865345 27666 raft_consensus.cc:697] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:08:06.866309 22218 leader_election.cc:336] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.875312 27666 consensus_queue.cc:237] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.896113 27739 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.896713 27739 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:06.905694 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:06.906383 22177 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 11.
I20260709 13:08:06.907612 22220 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:08:06.919137 27786 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.919744 27786 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:06.924290 27786 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:06.924964 27683 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:06.925405 27683 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.925761 27683 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.905838 27739 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:06.934655 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:06.935602 22816 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:08:06.938990 22218 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:08:06.943471 27817 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:06.944173 27817 raft_consensus.cc:493] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
W20260709 13:08:06.944880 22218 leader_election.cc:336] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.949870 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:08:06.944640 27817 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:06.979575 22144 leader_election.cc:336] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.981490 27745 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:06.981976 27745 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.982375 27745 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:06.963675 27807 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:06.973079 22002 catalog_manager.cc:5697] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 16 to 17, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 17 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:06.975131 27786 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:06.977887 27813 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:08:06.989924 22144 leader_election.cc:336] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:06.990301 22002 catalog_manager.cc:5697] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 reported cstate change: term changed from 12 to 13, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68). New cstate: current_term: 13 leader_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.000105 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5bf29367f432285b4e873ecccea9e" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6"
I20260709 13:08:07.001065 22248 raft_consensus.cc:3060] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:06.995015 22218 leader_election.cc:336] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:07.029657 22248 raft_consensus.cc:2468] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 12.
I20260709 13:08:07.034248 27813 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:07.034650 22147 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:07.000759 27786 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:07.060772 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:08:07.061408 22177 raft_consensus.cc:3060] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:07.036635 27807 raft_consensus.cc:2804] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:07.063463 27807 raft_consensus.cc:697] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:08:07.064337 27807 consensus_queue.cc:237] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:07.068392 22815 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:07.074604 22177 raft_consensus.cc:2468] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 18.
I20260709 13:08:07.076037 22220 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
I20260709 13:08:07.078070 27745 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:07.087674 21996 catalog_manager.cc:5697] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 12 to 13, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 13 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.089144 27745 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:07.089452 21996 catalog_manager.cc:5697] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 13 to 14, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 14 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.102279 27786 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:07.089780 27806 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:08:07.104483 27821 raft_consensus.cc:2804] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:07.105283 27821 raft_consensus.cc:697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 18 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
W20260709 13:08:07.125123 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 45510.1us
I20260709 13:08:07.144002 27683 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:07.148599 22177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3"
I20260709 13:08:07.149196 22177 raft_consensus.cc:3060] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.106565 27821 consensus_queue.cc:237] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:07.175081 27817 raft_consensus.cc:515] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:07.175644 22177 raft_consensus.cc:2468] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:08:07.177425 27817 leader_election.cc:290] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:07.178220 22220 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3; no voters: 
W20260709 13:08:07.181712 22218 leader_election.cc:336] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:07.184684 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9abb5a83ca4007a03cd4613544f2eb" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:08:07.185302 22815 raft_consensus.cc:3060] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.186951 22816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:07.187350 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e48ec055f940c49e01d5a5d77581aa" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:08:07.187618 22816 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 14.
I20260709 13:08:07.187996 22810 raft_consensus.cc:3060] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:07.191219 22218 leader_election.cc:336] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:07.169641 27683 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 12 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:07.188572 27817 raft_consensus.cc:2804] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:07.199594 22810 raft_consensus.cc:2468] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 16.
I20260709 13:08:07.204416 21996 catalog_manager.cc:5697] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 11 to 12, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 12 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:07.221127 22218 leader_election.cc:336] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:07.222641 22248 raft_consensus.cc:1275] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:07.232582 27817 raft_consensus.cc:697] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:08:07.235759 27817 consensus_queue.cc:237] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:07.237632 22218 leader_election.cc:304] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:08:07.238814 22779 consensus_peers.cc:597] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:07.243149 27683 raft_consensus.cc:2804] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:07.243736 27683 raft_consensus.cc:697] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 16 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:08:07.244664 27828 consensus_queue.cc:1048] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:07.244704 27683 consensus_queue.cc:237] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:07.253980 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
W20260709 13:08:07.261258 22218 consensus_peers.cc:597] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:07.266985 27807 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:07.267620 27807 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c0694f6572bf406a92d55f1f2ab46ef2)
I20260709 13:08:07.273483 22177 raft_consensus.cc:1275] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:07.274431 22815 raft_consensus.cc:2468] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
W20260709 13:08:07.288826 22144 leader_election.cc:336] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:07.290230 22144 leader_election.cc:336] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:07.294708 22144 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:07.287914 27807 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.295974 27800 raft_consensus.cc:2804] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:07.329362 22218 consensus_peers.cc:597] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:07.327736 22144 consensus_peers.cc:597] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:07.339478 21996 catalog_manager.cc:5697] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 17 to 18, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 18 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.291247 27767 consensus_queue.cc:1048] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:08:07.344482 27800 raft_consensus.cc:697] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:08:07.365684 27800 consensus_queue.cc:237] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:07.371143 22177 raft_consensus.cc:1275] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Refusing update from remote peer a07ca3d1b5b84f4bbcb907f709a69275: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:07.374609 27810 consensus_queue.cc:1048] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:07.389151 22816 raft_consensus.cc:1275] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:07.391067 27683 consensus_queue.cc:1048] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:07.411562 22177 raft_consensus.cc:1275] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:07.412926 27683 consensus_queue.cc:1048] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:07.458568 22002 catalog_manager.cc:5697] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 14 to 15, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 15 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:07.465309 22218 consensus_peers.cc:597] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:07.465620 22779 consensus_peers.cc:597] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:07.462052 27807 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:07.480276 22179 raft_consensus.cc:1275] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 19 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
W20260709 13:08:07.487558 27837 log.cc:927] Time spent T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:07.498829 27826 consensus_queue.cc:1048] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:07.512023 22250 raft_consensus.cc:1275] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:07.519521 27823 consensus_queue.cc:1048] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:08:07.534691 21996 catalog_manager.cc:5697] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 15 to 16, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 16 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.549883 21996 catalog_manager.cc:5697] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 11 to 12, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 12 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.550772 27807 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Requested vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:07.559950 22810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:08:07.560672 22810 raft_consensus.cc:3060] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:07.583212 22144 leader_election.cc:336] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:07.586582 22810 raft_consensus.cc:2468] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79683575881f4334bd4dc6d9bdbb45c3 in term 15.
I20260709 13:08:07.608443 22144 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275; no voters: c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:07.621287 27823 raft_consensus.cc:2804] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:07.686128 21001 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:07.751902 21988 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 86840.4us
W20260709 13:08:07.766211 22144 consensus_peers.cc:597] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:07.756098 27823 raft_consensus.cc:697] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Becoming Leader. State: Replica: 79683575881f4334bd4dc6d9bdbb45c3, State: Running, Role: LEADER
I20260709 13:08:07.811820 27823 consensus_queue.cc:237] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:07.817179 22174 raft_consensus.cc:1275] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:08:07.862900 22144 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111) [suppressed 368 similar messages]
W20260709 13:08:07.892828 21988 catalog_manager.cc:4755] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6b85b002ea7945719057edb66d543287: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:07.880400 27739 consensus_queue.cc:1048] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 13:08:07.914785 22218 consensus_peers.cc:597] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:07.915766 22218 consensus_peers.cc:597] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:07.946310 22816 raft_consensus.cc:1275] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:08:07.952884 22218 consensus_peers.cc:597] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:07.954598 22173 raft_consensus.cc:1275] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:07.973112 27827 consensus_queue.cc:1048] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:07.972600 21996 catalog_manager.cc:5697] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 reported cstate change: term changed from 14 to 15, leader changed from c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65) to 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66). New cstate: current_term: 15 leader_uuid: "79683575881f4334bd4dc6d9bdbb45c3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.994479 22810 raft_consensus.cc:1275] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:08.004690 27850 consensus_queue.cc:1048] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:08.044813 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 87360.7us
W20260709 13:08:08.059906 22218 consensus_peers.cc:597] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.062848 22218 consensus_peers.cc:597] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.063763 22218 consensus_peers.cc:597] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.064348 22218 consensus_peers.cc:597] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:08.067934 27817 consensus_queue.cc:1048] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:08:08.143524 22144 consensus_peers.cc:597] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:08.248900 22218 consensus_peers.cc:597] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.264626 22218 consensus_peers.cc:597] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.414531 22218 consensus_peers.cc:597] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.417908 22218 consensus_peers.cc:597] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.427382 22218 consensus_peers.cc:597] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.430704 22779 consensus_peers.cc:597] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.431376 22779 consensus_peers.cc:597] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.434545 22144 consensus_peers.cc:597] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.435243 22144 consensus_peers.cc:597] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:08.435734 22144 consensus_peers.cc:597] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.463137 22144 consensus_peers.cc:597] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.478374 22218 consensus_peers.cc:597] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.544435 22779 consensus_peers.cc:597] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:08.548960 22815 raft_consensus.cc:1275] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Refusing update from remote peer 79683575881f4334bd4dc6d9bdbb45c3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:08:08.553176 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 64261.1us
W20260709 13:08:08.558059 22218 consensus_peers.cc:597] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.569293 22779 consensus_peers.cc:597] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:08.571208 27849 consensus_queue.cc:1048] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:08.579139 22779 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.578855 22144 consensus_peers.cc:597] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.636021 22144 consensus_peers.cc:597] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.686818 21001 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:08.735646 22144 consensus_peers.cc:597] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.748096 22779 consensus_peers.cc:597] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.762548 22144 consensus_peers.cc:597] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.783051 22144 consensus_peers.cc:597] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.902186 22144 consensus_peers.cc:597] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:08.972421 22144 consensus_peers.cc:597] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:09.049139 22779 consensus_peers.cc:597] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:09.059180 22779 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:09.112663 22779 consensus_peers.cc:597] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:09.194569 22144 consensus_peers.cc:597] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:09.272320 22218 consensus_peers.cc:597] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:09.328128 22144 consensus_peers.cc:597] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:09.397059 22218 consensus_peers.cc:597] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:09.687351 21001 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:09.867268 22218 consensus_peers.cc:597] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:09.933867 22779 consensus_peers.cc:597] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:09.965894 22144 consensus_peers.cc:597] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:09.997149 21988 catalog_manager.cc:4755] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6b85b002ea7945719057edb66d543287: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:10.029465 22779 consensus_peers.cc:597] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:10.136130 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 43835.1us
W20260709 13:08:10.173367 22218 consensus_peers.cc:597] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:10.182024 22218 consensus_peers.cc:597] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:10.316779 22218 consensus_peers.cc:597] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:10.326457 22218 consensus_peers.cc:597] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:10.335337 22144 consensus_peers.cc:597] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:10.545573 22218 consensus_peers.cc:597] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:10.565408 22218 consensus_peers.cc:597] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:10.607788 22218 consensus_peers.cc:597] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:10.620023 22218 consensus_peers.cc:597] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:10.662849 22144 consensus_peers.cc:597] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:10.688124 21001 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:10.730280 22218 consensus_peers.cc:597] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:10.781201 22779 consensus_peers.cc:597] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:10.790972 22218 consensus_peers.cc:597] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:10.793715 22218 consensus_peers.cc:597] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:10.799723 22218 consensus_peers.cc:597] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:10.830118 22144 consensus_peers.cc:597] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:10.837350 22779 consensus_peers.cc:597] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:10.850504 22144 consensus_peers.cc:597] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:10.877310 22144 consensus_peers.cc:597] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:10.894874 22218 consensus_peers.cc:597] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:10.926043 22218 consensus_peers.cc:597] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:10.931355 22218 consensus_peers.cc:597] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:10.987205 22144 consensus_peers.cc:597] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:10.987825 22144 consensus_peers.cc:597] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.051493 22144 consensus_peers.cc:597] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.064944 22779 consensus_peers.cc:597] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.118553 22779 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.137658 22779 consensus_peers.cc:597] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.138866 22144 consensus_peers.cc:597] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.148548 22218 consensus_peers.cc:597] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.333365 22144 consensus_peers.cc:597] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.352826 22144 consensus_peers.cc:597] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.388439 22779 consensus_peers.cc:597] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.399712 22144 consensus_peers.cc:597] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.441668 22144 consensus_peers.cc:597] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.549434 22779 consensus_peers.cc:597] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:11.558682 22144 consensus_peers.cc:597] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.583415 22144 consensus_peers.cc:597] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.590121 22779 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:11.668416 22779 consensus_peers.cc:597] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.687870 22218 consensus_peers.cc:597] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:11.688634 21001 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:12.042485 22218 consensus_peers.cc:597] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:12.357720 22218 consensus_peers.cc:597] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:12.380119 22779 consensus_peers.cc:597] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:12.655718 22779 consensus_peers.cc:597] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:12.689213 21001 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:12.752296 22218 consensus_peers.cc:597] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:12.752966 22218 consensus_peers.cc:597] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:12.822039 22218 consensus_peers.cc:597] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:12.831267 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 112586us
W20260709 13:08:12.853575 22218 consensus_peers.cc:597] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:12.872767 22218 consensus_peers.cc:597] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:12.881199 22218 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111) [suppressed 461 similar messages]
W20260709 13:08:12.937398 22144 consensus_peers.cc:597] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:13.018000 22218 consensus_peers.cc:597] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:13.169199 22144 consensus_peers.cc:597] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:13.188838 22218 consensus_peers.cc:597] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.221849 22144 consensus_peers.cc:597] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:13.234546 22218 consensus_peers.cc:597] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.281353 22218 consensus_peers.cc:597] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.349864 22144 consensus_peers.cc:597] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.362303 22218 consensus_peers.cc:597] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.364931 22218 consensus_peers.cc:597] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:13.367588 22218 consensus_peers.cc:597] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.404039 22218 consensus_peers.cc:597] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.408290 22218 consensus_peers.cc:597] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.412961 22144 consensus_peers.cc:597] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.414777 22144 consensus_peers.cc:597] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:13.416657 22218 consensus_peers.cc:597] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.432683 22144 consensus_peers.cc:597] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.477679 22779 consensus_peers.cc:597] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.556425 22144 consensus_peers.cc:597] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.573701 22218 consensus_peers.cc:597] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.638790 22779 consensus_peers.cc:597] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.647423 22779 consensus_peers.cc:597] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.649611 22144 consensus_peers.cc:597] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.678876 22779 consensus_peers.cc:597] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.689718 21001 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:13.738085 22779 consensus_peers.cc:597] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.787515 22144 consensus_peers.cc:597] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.792034 22779 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.819576 22144 consensus_peers.cc:597] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:13.869729 22144 consensus_peers.cc:597] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:14.028384 22144 consensus_peers.cc:597] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:14.161755 22218 consensus_peers.cc:597] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:14.166121 22779 consensus_peers.cc:597] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:14.175797 21988 catalog_manager.cc:4755] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6b85b002ea7945719057edb66d543287: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:14.188654 22144 consensus_peers.cc:597] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:14.199321 22144 consensus_peers.cc:597] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:14.208843 22779 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:14.319424 22779 consensus_peers.cc:597] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:14.331287 22144 consensus_peers.cc:597] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:14.493007 22218 consensus_peers.cc:597] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:14.582700 22779 consensus_peers.cc:597] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:14.690249 21001 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:15.139263 22837 debug-util.cc:398] Leaking SignalData structure 0x7b080003ab40 after lost signal to thread 21004
W20260709 13:08:15.140409 22837 debug-util.cc:398] Leaking SignalData structure 0x7b080032bd40 after lost signal to thread 22038
W20260709 13:08:15.141753 22837 debug-util.cc:398] Leaking SignalData structure 0x7b08002ddc60 after lost signal to thread 22205
W20260709 13:08:15.147879 22218 consensus_peers.cc:597] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:15.165638 22837 debug-util.cc:398] Leaking SignalData structure 0x7b08001f20a0 after lost signal to thread 22279
W20260709 13:08:15.167084 22837 debug-util.cc:398] Leaking SignalData structure 0x7b08001e54c0 after lost signal to thread 22840
W20260709 13:08:15.254658 22218 consensus_peers.cc:597] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:15.299007 22779 consensus_peers.cc:597] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:15.320621 22218 consensus_peers.cc:597] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:15.355327 22218 consensus_peers.cc:597] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:15.408596 22144 consensus_peers.cc:597] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:15.412357 22218 consensus_peers.cc:597] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:15.412992 22218 consensus_peers.cc:597] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:15.415491 22218 consensus_peers.cc:597] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:15.487108 22144 consensus_peers.cc:597] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:15.629674 22218 consensus_peers.cc:597] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:15.633754 22144 consensus_peers.cc:597] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:15.688802 22218 consensus_peers.cc:597] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:15.690716 21001 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:15.781652 22218 consensus_peers.cc:597] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:15.802310 22144 consensus_peers.cc:597] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:15.804813 22144 consensus_peers.cc:597] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:15.808560 22144 consensus_peers.cc:597] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:15.821419 22218 consensus_peers.cc:597] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:15.908329 22144 consensus_peers.cc:597] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:15.908084 22218 consensus_peers.cc:597] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:15.910822 22218 consensus_peers.cc:597] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:15.950762 22144 consensus_peers.cc:597] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:16.019429 22779 consensus_peers.cc:597] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.071907 22779 consensus_peers.cc:597] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.081115 22218 consensus_peers.cc:597] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.121695 22218 consensus_peers.cc:597] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.183929 22779 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.203714 22218 consensus_peers.cc:597] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:16.339071 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 87305.6us
W20260709 13:08:16.379758 22779 consensus_peers.cc:597] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.382367 22218 consensus_peers.cc:597] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.387054 22779 consensus_peers.cc:597] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.437597 22779 consensus_peers.cc:597] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.447391 22144 consensus_peers.cc:597] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.495648 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 48297.3us
W20260709 13:08:16.496395 22144 consensus_peers.cc:597] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.486203 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 46569.6us
W20260709 13:08:16.565667 22779 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:16.580950 22144 consensus_peers.cc:597] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.672281 22144 consensus_peers.cc:597] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.691226 21001 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:16.738186 22779 consensus_peers.cc:597] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.760077 22144 consensus_peers.cc:597] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.798405 22144 consensus_peers.cc:597] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.844537 22218 consensus_peers.cc:597] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.879818 22779 consensus_peers.cc:597] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:16.907085 22144 consensus_peers.cc:597] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:16.976917 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 62687.7us
W20260709 13:08:17.017340 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 46586.6us
W20260709 13:08:17.124022 22144 consensus_peers.cc:597] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:17.124903 22779 consensus_peers.cc:597] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:17.243243 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 61108.9us
W20260709 13:08:17.503858 22218 consensus_peers.cc:597] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:17.684800 22218 consensus_peers.cc:597] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:17.691715 21001 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:17.700752 22218 consensus_peers.cc:597] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:17.750167 22218 consensus_peers.cc:597] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:17.782310 22779 consensus_peers.cc:597] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:17.854032 22218 consensus_peers.cc:597] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:17.867626 22218 consensus_peers.cc:597] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:17.889652 22779 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111) [suppressed 450 similar messages]
W20260709 13:08:18.020443 22218 consensus_peers.cc:597] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:18.068650 22144 consensus_peers.cc:597] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:18.130878 22218 consensus_peers.cc:597] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:18.143630 22218 consensus_peers.cc:597] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.198223 22144 consensus_peers.cc:597] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.229595 22144 consensus_peers.cc:597] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.237290 22779 consensus_peers.cc:597] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.272379 22144 consensus_peers.cc:597] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:18.281169 22218 consensus_peers.cc:597] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:18.372381 22218 consensus_peers.cc:597] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.456010 22144 consensus_peers.cc:597] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.516924 22144 consensus_peers.cc:597] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:18.560185 22779 consensus_peers.cc:597] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.562577 22144 consensus_peers.cc:597] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.636112 22218 consensus_peers.cc:597] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.662479 22779 consensus_peers.cc:597] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.692374 21001 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:18.709031 22218 consensus_peers.cc:597] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.714746 22779 consensus_peers.cc:597] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.730129 22218 consensus_peers.cc:597] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.730778 22218 consensus_peers.cc:597] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.731248 22218 consensus_peers.cc:597] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.781399 22144 consensus_peers.cc:597] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.813405 22144 consensus_peers.cc:597] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:18.815281 22779 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.829877 22779 consensus_peers.cc:597] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:18.863883 22218 consensus_peers.cc:597] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:18.979190 22218 consensus_peers.cc:597] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:19.042876 22144 consensus_peers.cc:597] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:19.081432 22144 consensus_peers.cc:597] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:19.125916 22144 consensus_peers.cc:597] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:19.159292 22144 consensus_peers.cc:597] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:19.320575 22218 consensus_peers.cc:597] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:19.324898 22144 consensus_peers.cc:597] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:19.325577 22144 consensus_peers.cc:597] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:19.341091 22779 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:19.342092 22779 consensus_peers.cc:597] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:19.357936 22779 consensus_peers.cc:597] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:19.376267 22144 consensus_peers.cc:597] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:19.692886 21001 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:19.699873 22218 consensus_peers.cc:597] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:19.949290 22218 consensus_peers.cc:597] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:20.030131 22779 consensus_peers.cc:597] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:20.170174 22218 consensus_peers.cc:597] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:20.218253 22779 consensus_peers.cc:597] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:20.254420 22218 consensus_peers.cc:597] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:20.328480 22218 consensus_peers.cc:597] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:20.369169 22218 consensus_peers.cc:597] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:20.450207 22218 consensus_peers.cc:597] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:20.483922 22218 consensus_peers.cc:597] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:20.539624 22144 consensus_peers.cc:597] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:20.580044 22144 consensus_peers.cc:597] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:20.668063 22218 consensus_peers.cc:597] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:20.693403 21001 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:20.724603 22144 consensus_peers.cc:597] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:20.743597 22144 consensus_peers.cc:597] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:20.750101 22218 consensus_peers.cc:597] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:20.784257 22144 consensus_peers.cc:597] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:20.830950 22218 consensus_peers.cc:597] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:20.834127 22218 consensus_peers.cc:597] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:20.872193 22779 consensus_peers.cc:597] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:20.909319 22218 consensus_peers.cc:597] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:20.956451 22779 consensus_peers.cc:597] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:20.999852 22144 consensus_peers.cc:597] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.005157 22218 consensus_peers.cc:597] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.153294 22144 consensus_peers.cc:597] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:21.242326 22218 consensus_peers.cc:597] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.250053 22779 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.304942 22779 consensus_peers.cc:597] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.320952 22779 consensus_peers.cc:597] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.314761 22218 consensus_peers.cc:597] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:21.339952 22144 consensus_peers.cc:597] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:21.344319 22218 consensus_peers.cc:597] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.392015 22144 consensus_peers.cc:597] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.394901 22144 consensus_peers.cc:597] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.409665 22218 consensus_peers.cc:597] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.465504 22779 consensus_peers.cc:597] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.473942 22218 consensus_peers.cc:597] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.670519 22144 consensus_peers.cc:597] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.693950 21001 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:21.731325 22144 consensus_peers.cc:597] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.732028 22144 consensus_peers.cc:597] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.798631 22144 consensus_peers.cc:597] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.809669 22144 consensus_peers.cc:597] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.867486 22779 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:21.873760 22144 consensus_peers.cc:597] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:21.892138 22779 consensus_peers.cc:597] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:22.000015 22779 consensus_peers.cc:597] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:22.694491 21001 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 22127)
I20260709 13:08:23.164273 27908 raft_consensus.cc:493] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:08:23.168974 27908 raft_consensus.cc:515] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:23.171519 21988 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.028s	sys 0.045s
W20260709 13:08:23.171994 21988 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.028s	sys 0.045s
W20260709 13:08:23.172252 21988 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 727744us
W20260709 13:08:23.172814 21988 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111) [suppressed 392 similar messages]
I20260709 13:08:23.185520 27908 leader_election.cc:290] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:08:23.185423 21988 catalog_manager.cc:4755] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6b85b002ea7945719057edb66d543287: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:23.188439 27908 raft_consensus.cc:493] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:23.187815 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:23.200291 27908 raft_consensus.cc:515] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:23.203800 27908 leader_election.cc:290] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:23.204649 27908 raft_consensus.cc:493] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:23.204972 27918 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:23.205543 27918 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:23.200296 27909 raft_consensus.cc:493] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:23.208446 27909 raft_consensus.cc:515] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:23.211890 27909 leader_election.cc:290] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:23.212230 22254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f980cc59e6c41d7b5d29d438419c0d1" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:23.225999 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6cd0878342413eb24e0e69b3a96aa0" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:23.205209 27908 raft_consensus.cc:515] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:23.245280 27908 leader_election.cc:290] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:23.241108 27907 raft_consensus.cc:493] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:23.247267 27914 raft_consensus.cc:493] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:08:23.247869 27914 raft_consensus.cc:515] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:23.246578 27907 raft_consensus.cc:515] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:23.250396 27907 leader_election.cc:290] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:23.250528 27914 leader_election.cc:290] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:23.253785 27909 raft_consensus.cc:493] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:23.253098 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38574701043e46cb978340cb6753faae" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:23.257915 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:23.259091 27918 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:23.254436 27909 raft_consensus.cc:515] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:23.280022 27890 raft_consensus.cc:493] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:08:23.280647 27890 raft_consensus.cc:515] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:23.289896 27909 leader_election.cc:290] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:23.290778 27894 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:23.291374 27894 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:23.293162 27916 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:23.293708 27916 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:23.296059 27916 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:23.313881 22180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911b6e64ffb48bd9fc4968f8f52860c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:23.318884 27890 leader_election.cc:290] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:23.330066 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a567384a18d40a09c5a3e09e6c15ef6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:23.334982 27894 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:08:23.337417 22144 leader_election.cc:336] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:23.337581 22179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1a2136ffa84255b65c2f9037b0e55d" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:23.338034 22144 leader_election.cc:304] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:08:23.339083 22144 leader_election.cc:336] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:23.339296 27901 raft_consensus.cc:2749] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:23.339620 22144 leader_election.cc:304] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:23.340435 27901 raft_consensus.cc:2749] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:23.342249 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:23.345747 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:23.347206 27915 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:23.347851 27915 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:23.351069 27915 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:23.359774 27916 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:23.360529 27916 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:23.364707 22276 debug-util.cc:398] Leaking SignalData structure 0x7b0800324220 after lost signal to thread 21004
I20260709 13:08:23.365875 22781 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:08:23.366240 22276 debug-util.cc:398] Leaking SignalData structure 0x7b0800194700 after lost signal to thread 22038
W20260709 13:08:23.346312 22144 leader_election.cc:336] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:23.368327 22248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:08:23.368549 22144 leader_election.cc:336] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:23.368893 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27e0e0f167848adb3889027a46ee857" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:08:23.371244 22276 debug-util.cc:398] Leaking SignalData structure 0x7b0800138580 after lost signal to thread 22205
W20260709 13:08:23.372459 22276 debug-util.cc:398] Leaking SignalData structure 0x7b080016d220 after lost signal to thread 22279
I20260709 13:08:23.372370 27894 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:23.376070 22144 leader_election.cc:336] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:23.376523 22144 leader_election.cc:304] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:23.378835 27901 raft_consensus.cc:2749] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.382308 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5e8334eaf044d0ba6d7817e7e9b2fd9" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:23.386207 22812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6633743ea44146a5164f64185db9a6" candidate_uuid: "79683575881f4334bd4dc6d9bdbb45c3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:08:23.389552 22276 debug-util.cc:398] Leaking SignalData structure 0x7b080013bea0 after lost signal to thread 22840
W20260709 13:08:23.391136 22220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 92134.5us
I20260709 13:08:23.381052 27916 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:23.396230 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
W20260709 13:08:23.384919 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 76249.8us
I20260709 13:08:23.399977 22147 leader_election.cc:304] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:23.403457 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79004ff583f4b278afa2453c7088bf7" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:23.403946 27901 raft_consensus.cc:2749] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:23.405499 22779 consensus_peers.cc:597] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:23.405750 22781 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:23.407274 27916 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:23.411326 22174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cabb59b2041f98e811d0b49faf5da" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "79683575881f4334bd4dc6d9bdbb45c3" is_pre_election: true
I20260709 13:08:23.416993 22144 leader_election.cc:304] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:08:23.418030 27892 raft_consensus.cc:2749] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:23.419946 22144 leader_election.cc:304] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:08:23.422211 27892 raft_consensus.cc:2749] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:23.424543 22144 leader_election.cc:304] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79683575881f4334bd4dc6d9bdbb45c3; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:23.425516 27892 raft_consensus.cc:2749] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:23.431274 22779 leader_election.cc:336] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:23.433665 22779 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:23.434610 27916 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:23.447075 22218 consensus_peers.cc:597] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:23.449507 22218 consensus_peers.cc:597] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:23.450143 22218 leader_election.cc:336] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:23.450623 22218 leader_election.cc:304] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:23.451651 27923 raft_consensus.cc:2749] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:23.470855 22779 leader_election.cc:336] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:23.471931 22779 leader_election.cc:336] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:23.472772 22779 leader_election.cc:336] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:23.473165 22779 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:23.473896 27916 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:23.475010 22779 consensus_peers.cc:597] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:23.475975 22779 leader_election.cc:336] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:23.476399 22779 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:23.477159 27916 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:23.628080 22218 consensus_peers.cc:597] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:23.641762 22218 consensus_peers.cc:597] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:23.697736 21001 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:23.786103 22144 consensus_peers.cc:597] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:23.799070 22218 consensus_peers.cc:597] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:23.820470 22781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:42399, user_credentials={real_user=slave}} blocked reactor thread for 98967.4us
W20260709 13:08:23.833168 22218 consensus_peers.cc:597] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:23.835589 22218 consensus_peers.cc:597] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:23.866407 27923 raft_consensus.cc:493] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a07ca3d1b5b84f4bbcb907f709a69275)
I20260709 13:08:23.867081 27923 raft_consensus.cc:515] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:23.870296 27923 leader_election.cc:290] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:23.892485 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be7e328170d4837bbaade0fb02dead2" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:08:23.894088 22218 leader_election.cc:336] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:23.903234 22218 consensus_peers.cc:597] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:23.903872 22218 consensus_peers.cc:597] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:23.905653 22218 leader_election.cc:304] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: a07ca3d1b5b84f4bbcb907f709a69275, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:23.906446 27923 raft_consensus.cc:2749] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:23.923131 22218 consensus_peers.cc:597] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.148620 22779 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.205531 22144 consensus_peers.cc:597] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.234292 22218 consensus_peers.cc:597] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.240391 22144 consensus_peers.cc:597] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.305408 22144 consensus_peers.cc:597] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.313123 22144 consensus_peers.cc:597] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.323632 22779 consensus_peers.cc:597] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.340215 22218 consensus_peers.cc:597] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.357385 22779 consensus_peers.cc:597] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.374341 22144 consensus_peers.cc:597] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:24.451139 22144 consensus_peers.cc:597] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.491120 22218 consensus_peers.cc:597] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.552299 22144 consensus_peers.cc:597] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.552784 22144 consensus_peers.cc:597] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.601130 22218 consensus_peers.cc:597] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.611362 22779 consensus_peers.cc:597] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.647805 22218 consensus_peers.cc:597] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.680681 22218 consensus_peers.cc:597] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.687099 22144 consensus_peers.cc:597] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.698248 21001 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:24.751998 22218 consensus_peers.cc:597] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.826900 22779 consensus_peers.cc:597] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.827518 22144 consensus_peers.cc:597] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:24.839166 22779 consensus_peers.cc:597] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.839476 22218 consensus_peers.cc:597] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.895110 22144 consensus_peers.cc:597] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:24.922997 22144 consensus_peers.cc:597] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:24.945073 22144 consensus_peers.cc:597] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:25.024423 22779 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:25.193216 22779 consensus_peers.cc:597] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:25.214205 22144 consensus_peers.cc:597] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:25.278990 22779 consensus_peers.cc:597] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:25.279521 22218 consensus_peers.cc:597] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:25.497663 22144 consensus_peers.cc:597] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:25.698724 21001 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 22127)
W20260709 13:08:25.779783 22218 consensus_peers.cc:597] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:25.805748 22779 consensus_peers.cc:597] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:25.821991 22218 consensus_peers.cc:597] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:25.959923 22218 consensus_peers.cc:597] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:25.960062 22779 consensus_peers.cc:597] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:26.081380 22218 consensus_peers.cc:597] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:26.183578 22218 consensus_peers.cc:597] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:26.428131 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 75527.2us
W20260709 13:08:26.448218 22218 consensus_peers.cc:597] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:26.471561 22782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:42273, user_credentials={real_user=slave}} blocked reactor thread for 68251.3us
W20260709 13:08:26.513309 22218 consensus_peers.cc:597] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:26.538935 22144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:33421, user_credentials={real_user=slave}} blocked reactor thread for 55335us
W20260709 13:08:26.541910 22144 consensus_peers.cc:597] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:26.606738 22779 consensus_peers.cc:597] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:26.636474 22779 consensus_peers.cc:597] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:26.649726 22218 consensus_peers.cc:597] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:26.650606 22218 consensus_peers.cc:597] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:26.651099 22218 consensus_peers.cc:597] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:26.651553 22218 consensus_peers.cc:597] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:26.692232 22144 consensus_peers.cc:597] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:26.708540 22144 consensus_peers.cc:597] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:26.734899 22218 consensus_peers.cc:597] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:26.741086 22144 consensus_peers.cc:597] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:26.862337 22144 consensus_peers.cc:597] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:26.870764 22779 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:26.903685 22144 consensus_peers.cc:597] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:26.908318 22218 consensus_peers.cc:597] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:26.931584 22144 consensus_peers.cc:597] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:26.937466 22144 consensus_peers.cc:597] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:27.007965 22218 consensus_peers.cc:597] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:27.036461 22144 consensus_peers.cc:597] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:27.052834 22144 consensus_peers.cc:597] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:27.109258 22218 consensus_peers.cc:597] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:27.132288 22779 consensus_peers.cc:597] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:27.156387 22144 consensus_peers.cc:597] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:27.201812 22779 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:27.209030 22218 consensus_peers.cc:597] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:27.302151 22779 consensus_peers.cc:597] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:27.317744 22779 consensus_peers.cc:597] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:27.321326 22218 consensus_peers.cc:597] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:27.398613 22144 consensus_peers.cc:597] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:27.503934 21001 tablet_server.cc:196] TabletServer@127.20.130.65:0 shutdown complete.
W20260709 13:08:27.505916 22779 consensus_peers.cc:597] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:27.565238 22144 consensus_peers.cc:597] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:27.595502 22218 consensus_peers.cc:597] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:27.807199 21001 tablet_server.cc:179] TabletServer@127.20.130.66:0 shutting down...
W20260709 13:08:27.839501 22144 consensus_peers.cc:597] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:27.844966 22220 consensus_peers.cc:597] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:27.884645 22144 consensus_peers.cc:597] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:27.891542 22220 consensus_peers.cc:597] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:27.914093 22779 consensus_peers.cc:597] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:27.911864 22220 consensus_peers.cc:597] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:27.957960 22220 consensus_peers.cc:597] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:27.961103 22218 consensus_peers.cc:597] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:27.962553 22220 consensus_peers.cc:597] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:27.984560 22144 consensus_peers.cc:597] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:28.004925 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:28.005975 21001 tablet_replica.cc:333] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.006961 21001 raft_consensus.cc:2243] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.008064 21001 raft_consensus.cc:2272] T 03ed5952f28c46d8b66e87a9d1b03981 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.011417 21001 tablet_replica.cc:333] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
W20260709 13:08:28.019281 22781 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.022337 21001 raft_consensus.cc:2243] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.024159 21001 raft_consensus.cc:2272] T 6b965624a67d4adb87e9787782f1715c P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.027108 21001 tablet_replica.cc:333] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.028981 21001 raft_consensus.cc:2243] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.048264 21001 raft_consensus.cc:2272] T 12ac70b72e5d452ca6dd020f9ccb0541 P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.051457 21001 tablet_replica.cc:333] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.052704 21001 raft_consensus.cc:2243] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.053418 21001 raft_consensus.cc:2272] T 5d674bb7c45c407e8aa9767c7438a39e P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.056651 21001 tablet_replica.cc:333] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.057536 21001 raft_consensus.cc:2243] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.058265 21001 raft_consensus.cc:2272] T 57adaf54eaf24c778165ac40cc629c38 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.065147 21001 tablet_replica.cc:333] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.068212 21001 raft_consensus.cc:2243] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.069406 21001 raft_consensus.cc:2272] T 6ac896e940b543ae8dc989463d3c33a8 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:28.084501 22781 consensus_peers.cc:597] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.092935 22220 consensus_peers.cc:597] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.104283 22220 consensus_peers.cc:597] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.109452 22781 consensus_peers.cc:597] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.077088 21001 tablet_replica.cc:333] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.111179 21001 raft_consensus.cc:2243] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:08:28.126343 22781 consensus_peers.cc:597] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.127146 22781 consensus_peers.cc:597] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.127661 21001 raft_consensus.cc:2272] T 3f1a2136ffa84255b65c2f9037b0e55d P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.130364 21001 tablet_replica.cc:333] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.131196 21001 raft_consensus.cc:2243] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.131848 21001 raft_consensus.cc:2272] T c80e8c56632c46d9a35c63a2ca8a532f P 79683575881f4334bd4dc6d9bdbb45c3 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:28.163713 22220 consensus_peers.cc:597] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.163967 22781 consensus_peers.cc:597] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.134552 21001 tablet_replica.cc:333] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.169332 21001 raft_consensus.cc:2243] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.170070 21001 raft_consensus.cc:2272] T 00aee6f5c28c45b0841b480190d2c555 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.172847 21001 tablet_replica.cc:333] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
W20260709 13:08:28.175962 22781 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 497 similar messages]
W20260709 13:08:28.180766 22781 consensus_peers.cc:597] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.181885 21001 raft_consensus.cc:2243] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.182629 21001 raft_consensus.cc:2272] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:28.195353 22220 consensus_peers.cc:597] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.216634 22781 consensus_peers.cc:597] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.227859 22220 consensus_peers.cc:597] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.235831 22781 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.243881 22220 consensus_peers.cc:597] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.244994 21001 tablet_replica.cc:333] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.247335 21001 raft_consensus.cc:2243] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.252074 21001 raft_consensus.cc:2272] T 931a6490a0ea49419e07ac75f5c84030 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.254973 21001 tablet_replica.cc:333] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
W20260709 13:08:28.249244 22220 consensus_peers.cc:597] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.255766 22220 consensus_peers.cc:597] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.257190 21001 raft_consensus.cc:2243] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.259199 21001 raft_consensus.cc:2272] T 6617a460ae364f94b826785a9e77ec86 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.262117 21001 tablet_replica.cc:333] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.263103 21001 raft_consensus.cc:2243] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.264000 21001 raft_consensus.cc:2272] T 62d62f92be1345e38ad2eeb98d958d91 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.266994 21001 tablet_replica.cc:333] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.267980 21001 raft_consensus.cc:2243] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.268757 21001 raft_consensus.cc:2272] T 7a567384a18d40a09c5a3e09e6c15ef6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.271647 21001 tablet_replica.cc:333] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.272543 21001 raft_consensus.cc:2243] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.273721 21001 raft_consensus.cc:2272] T d38b6e6d2d3741e9b61d5a743ca099a2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.277815 21001 tablet_replica.cc:333] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.278772 21001 raft_consensus.cc:2243] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.280472 21001 raft_consensus.cc:2272] T 00e5bf29367f432285b4e873ecccea9e P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.283515 21001 tablet_replica.cc:333] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.284368 21001 raft_consensus.cc:2243] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.285343 21001 raft_consensus.cc:2272] T 96aa7e0b91bf482db9b8977df7574baf P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.288240 21001 tablet_replica.cc:333] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.289108 21001 raft_consensus.cc:2243] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.290159 21001 raft_consensus.cc:2272] T 6b85b002ea7945719057edb66d543287 P 79683575881f4334bd4dc6d9bdbb45c3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.293061 21001 tablet_replica.cc:333] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.293937 21001 raft_consensus.cc:2243] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.294653 21001 raft_consensus.cc:2272] T 77137a3a1cee4b55ae36e0a368f7e363 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.297439 21001 tablet_replica.cc:333] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.298295 21001 raft_consensus.cc:2243] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:28.304682 22220 consensus_peers.cc:597] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.305409 22220 consensus_peers.cc:597] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.299595 21001 raft_consensus.cc:2272] T 0f980cc59e6c41d7b5d29d438419c0d1 P 79683575881f4334bd4dc6d9bdbb45c3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.308713 21001 tablet_replica.cc:333] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.309738 21001 raft_consensus.cc:2243] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.311043 21001 raft_consensus.cc:2272] T ee2b1eeb3bb341638b56bf74c37e2045 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.315665 21001 tablet_replica.cc:333] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.316659 21001 raft_consensus.cc:2243] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.317437 21001 raft_consensus.cc:2272] T bbbed7673fb44214a4548960bdacf99b P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.325441 21001 tablet_replica.cc:333] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.326402 21001 raft_consensus.cc:2243] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.327415 21001 raft_consensus.cc:2272] T 79d645cd970b4b2789be5374cc2005aa P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:28.331343 22781 consensus_peers.cc:597] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.332172 22781 consensus_peers.cc:597] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.333410 21001 tablet_replica.cc:333] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.334430 21001 raft_consensus.cc:2243] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.335744 21001 raft_consensus.cc:2272] T 0232d828f8664f348df823432990379b P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:28.336766 22218 consensus_peers.cc:597] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:28.338593 21001 tablet_replica.cc:333] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.339638 21001 raft_consensus.cc:2243] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.340502 21001 raft_consensus.cc:2272] T 7e0f44b43c1a477e9c7c66c034c8844a P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.343518 21001 tablet_replica.cc:333] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.344705 21001 raft_consensus.cc:2243] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.345955 21001 raft_consensus.cc:2272] T d958965f6f1e46f7917ee6e8a28078ba P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:28.350706 22220 consensus_peers.cc:597] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.352715 21001 tablet_replica.cc:333] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.353744 21001 raft_consensus.cc:2243] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.355355 21001 raft_consensus.cc:2272] T ea960f06fa1940d49afea738c7cd0e94 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.358137 21001 tablet_replica.cc:333] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.359103 21001 raft_consensus.cc:2243] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.360245 21001 raft_consensus.cc:2272] T 688b3a79146a41e2b683e0642b986d9a P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.363476 21001 tablet_replica.cc:333] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.364434 21001 raft_consensus.cc:2243] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.365365 21001 raft_consensus.cc:2272] T 6f8407607d7441c7bdac45e1dadc700d P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.368187 21001 tablet_replica.cc:333] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.368992 21001 raft_consensus.cc:2243] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.369714 21001 raft_consensus.cc:2272] T b53b5061ddba43b7ae5a93ea344b61ca P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:28.374207 22220 consensus_peers.cc:597] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.376721 22779 consensus_peers.cc:597] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:28.383350 21001 tablet_replica.cc:333] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
W20260709 13:08:28.383980 22779 consensus_peers.cc:597] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:28.384285 21001 raft_consensus.cc:2243] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.392601 21001 raft_consensus.cc:2272] T 8f5e08d4c24545e18b620e33800d39d3 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.395494 21001 tablet_replica.cc:333] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.396343 21001 raft_consensus.cc:2243] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.400115 21001 raft_consensus.cc:2272] T 5d3869ae617b42c89768d68043d44be2 P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.403146 21001 tablet_replica.cc:333] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.404037 21001 raft_consensus.cc:2243] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.404762 21001 raft_consensus.cc:2272] T 38574701043e46cb978340cb6753faae P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.407960 21001 tablet_replica.cc:333] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.408946 21001 raft_consensus.cc:2243] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.410400 21001 raft_consensus.cc:2272] T 9235083e4800460ca0b4619abda2917b P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.413101 21001 tablet_replica.cc:333] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.415714 21001 raft_consensus.cc:2243] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.416661 21001 raft_consensus.cc:2272] T 2f8d3d512e804f4bbd58ae1baf74c000 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.419426 21001 tablet_replica.cc:333] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.420357 21001 raft_consensus.cc:2243] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.421185 21001 raft_consensus.cc:2272] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.424000 21001 tablet_replica.cc:333] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.428449 21001 raft_consensus.cc:2243] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.429234 21001 raft_consensus.cc:2272] T 9c6cd0878342413eb24e0e69b3a96aa0 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.488595 21001 tablet_replica.cc:333] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.489202 21001 raft_consensus.cc:2243] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.490083 21001 raft_consensus.cc:2272] T efc23a012ae0497797e82803613f3835 P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.492655 21001 tablet_replica.cc:333] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.495095 21001 raft_consensus.cc:2243] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.496074 21001 raft_consensus.cc:2272] T 0911b6e64ffb48bd9fc4968f8f52860c P 79683575881f4334bd4dc6d9bdbb45c3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.501950 21001 tablet_replica.cc:333] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.503014 21001 raft_consensus.cc:2243] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.503690 21001 raft_consensus.cc:2272] T 116931ff9e08478dadc7bdc9e917454a P 79683575881f4334bd4dc6d9bdbb45c3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.506392 21001 tablet_replica.cc:333] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.568115 21001 raft_consensus.cc:2243] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.570530 21001 raft_consensus.cc:2272] T dd0d86a3e0d843d0a468840a4f90cbf4 P 79683575881f4334bd4dc6d9bdbb45c3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.574939 21001 tablet_replica.cc:333] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.576747 21001 raft_consensus.cc:2243] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.580749 21001 raft_consensus.cc:2272] T 663cabb59b2041f98e811d0b49faf5da P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.588948 21001 tablet_replica.cc:333] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.590210 21001 raft_consensus.cc:2243] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.591946 21001 raft_consensus.cc:2272] T f27e0e0f167848adb3889027a46ee857 P 79683575881f4334bd4dc6d9bdbb45c3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.596041 21001 tablet_replica.cc:333] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.597268 21001 raft_consensus.cc:2243] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.598583 21001 raft_consensus.cc:2272] T ebf4c9a0fe314a8db203637fffd1dc52 P 79683575881f4334bd4dc6d9bdbb45c3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.602644 21001 tablet_replica.cc:333] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.604013 21001 raft_consensus.cc:2243] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.606192 21001 raft_consensus.cc:2272] T 5d6633743ea44146a5164f64185db9a6 P 79683575881f4334bd4dc6d9bdbb45c3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.611625 21001 tablet_replica.cc:333] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.612291 21001 raft_consensus.cc:2243] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.615051 21001 raft_consensus.cc:2272] T 9a4e641637cf41118865c96aec55b340 P 79683575881f4334bd4dc6d9bdbb45c3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.619874 21001 tablet_replica.cc:333] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3: stopping tablet replica
I20260709 13:08:28.620476 21001 raft_consensus.cc:2243] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.623318 21001 raft_consensus.cc:2272] T 5f9abb5a83ca4007a03cd4613544f2eb P 79683575881f4334bd4dc6d9bdbb45c3 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:28.821542 22779 consensus_peers.cc:597] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:28.905139 22218 consensus_peers.cc:597] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:28.905690 22218 consensus_peers.cc:597] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:28.927964 22218 consensus_peers.cc:597] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:28.933678 22218 consensus_peers.cc:597] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:28.934298 22218 consensus_peers.cc:597] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:28.934881 22218 consensus_peers.cc:597] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:28.992833 22218 consensus_peers.cc:597] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:29.074427 27944 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.075315 27944 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:29.078492 27944 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:29.079687 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:08:29.084969 22218 consensus_peers.cc:597] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:29.086156 22781 leader_election.cc:336] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:29.086578 22781 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:29.087239 27944 raft_consensus.cc:2749] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:29.137956 22218 consensus_peers.cc:597] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:29.193804 27943 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.194542 27943 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:29.196563 27943 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:29.198156 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:29.199057 22814 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 17.
I20260709 13:08:29.200448 22218 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 
I20260709 13:08:29.201399 27943 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:29.201709 22220 leader_election.cc:336] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:29.201942 27943 raft_consensus.cc:493] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.202443 27943 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:29.212338 27943 raft_consensus.cc:515] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:29.214205 27943 leader_election.cc:290] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:29.215956 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac896e940b543ae8dc989463d3c33a8" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:08:29.216624 22813 raft_consensus.cc:3060] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:29.221104 22220 leader_election.cc:336] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:29.225129 22813 raft_consensus.cc:2468] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 18.
W20260709 13:08:29.226138 22779 consensus_peers.cc:597] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:29.227029 22218 leader_election.cc:304] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:29.227861 27943 raft_consensus.cc:2804] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:29.228739 27943 raft_consensus.cc:697] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 18 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:08:29.230109 27943 consensus_queue.cc:237] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:29.250440 21996 catalog_manager.cc:5697] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 17 to 18, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 18 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:29.276188 22218 consensus_peers.cc:597] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:29.301869 27916 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.302544 27916 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:29.309432 27916 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:29.311086 22779 leader_election.cc:336] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:29.312647 22781 leader_election.cc:336] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:29.314735 22781 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.316068 27944 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:29.317919 27943 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.318602 27943 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:29.320611 27943 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:29.325728 22220 leader_election.cc:336] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
W20260709 13:08:29.333673 22218 leader_election.cc:336] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:29.334218 22218 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.335865 27943 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:29.336962 22218 consensus_peers.cc:597] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:29.341521 22218 consensus_peers.cc:597] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:29.349901 27946 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.351046 27946 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:29.356878 27942 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.357539 27942 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:29.360587 27942 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:08:29.361727 22220 leader_election.cc:336] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:29.363323 27946 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:29.367285 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:29.367834 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
W20260709 13:08:29.371680 22220 leader_election.cc:336] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
W20260709 13:08:29.382030 22218 leader_election.cc:336] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:29.382551 22218 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.387194 27943 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:29.391451 22218 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, a07ca3d1b5b84f4bbcb907f709a69275
I20260709 13:08:29.392318 27943 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:29.395241 22218 leader_election.cc:336] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:29.410671 27955 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.411504 27955 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:29.410485 27944 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.412837 27944 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:29.419665 22779 leader_election.cc:336] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:29.422585 27944 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:29.424188 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:29.424860 22246 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 12.
I20260709 13:08:29.430697 27955 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:29.434702 22781 leader_election.cc:336] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:29.439321 22781 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.440158 27916 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:29.456058 22220 leader_election.cc:336] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
W20260709 13:08:29.457367 22218 leader_election.cc:336] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:29.457818 22218 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.458607 27955 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:29.461946 27955 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.462589 27955 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:08:29.469264 22220 leader_election.cc:336] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:29.469280 27955 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:29.472972 22218 leader_election.cc:336] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:29.473480 22218 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.474253 27955 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:29.522874 22202 debug-util.cc:398] Leaking SignalData structure 0x7b08003884a0 after lost signal to thread 21004
W20260709 13:08:29.524310 22202 debug-util.cc:398] Leaking SignalData structure 0x7b080039a840 after lost signal to thread 22038
W20260709 13:08:29.524945 22202 debug-util.cc:398] Leaking SignalData structure 0x7b08002710c0 after lost signal to thread 22205
W20260709 13:08:29.526080 22202 debug-util.cc:398] Leaking SignalData structure 0x7b08001f70a0 after lost signal to thread 22279
W20260709 13:08:29.527323 22202 debug-util.cc:398] Leaking SignalData structure 0x7b0800379a20 after lost signal to thread 22840
I20260709 13:08:29.528812 27916 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.529568 27916 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:29.532279 27916 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:29.533464 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:29.534181 22246 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 15.
W20260709 13:08:29.541643 22781 leader_election.cc:336] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
W20260709 13:08:29.542409 22779 leader_election.cc:336] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:29.542810 22779 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.544088 27916 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:29.548276 22218 consensus_peers.cc:597] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:29.553128 27916 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.553777 27916 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:29.557217 27916 leader_election.cc:290] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:29.558377 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:08:29.563400 22781 leader_election.cc:336] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:29.566321 22781 leader_election.cc:304] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:29.568164 27916 raft_consensus.cc:2749] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:29.584986 27916 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.585732 27916 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:29.586423 22779 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:29.589157 22218 consensus_peers.cc:597] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:29.590449 27916 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:29.592773 22781 leader_election.cc:336] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
W20260709 13:08:29.593696 22779 leader_election.cc:336] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:29.594247 22779 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.594892 27916 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.595984 27916 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:29.596879 27944 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:29.596966 27943 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.598361 27943 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:29.599395 27945 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.600062 27945 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:29.600611 27943 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:29.608382 22220 leader_election.cc:336] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:29.602615 27945 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:29.609892 22218 leader_election.cc:336] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:29.612504 22218 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.615556 27943 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:29.618777 22781 leader_election.cc:336] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:29.626570 27916 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:29.627655 22246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
W20260709 13:08:29.636796 22779 leader_election.cc:336] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:29.637482 22779 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.638972 27916 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:29.634384 22781 leader_election.cc:336] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:29.641887 22782 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:29.643194 27916 raft_consensus.cc:2749] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:29.654512 27943 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.655220 27943 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:29.661217 27943 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:29.661960 22220 consensus_peers.cc:597] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:29.672767 22220 leader_election.cc:336] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
W20260709 13:08:29.675601 22218 leader_election.cc:336] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:29.676080 22218 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.677712 27942 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:29.681073 27943 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.681651 27943 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:29.683785 27943 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:29.696033 27916 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.696642 27916 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:29.719447 22779 leader_election.cc:336] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:29.733611 27916 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:29.744786 22779 consensus_peers.cc:597] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:29.746707 27942 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.747350 27942 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:29.749460 27942 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:29.751380 27942 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.752030 27942 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:29.754383 27942 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:29.732409 22218 leader_election.cc:336] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:29.762432 22220 leader_election.cc:336] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:29.763828 22220 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.765578 27943 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:29.786121 27942 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.787115 27942 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:29.794263 27942 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:29.796113 22781 leader_election.cc:336] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:29.796617 22781 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.801229 27916 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:29.803483 27916 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.804060 27916 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:29.815189 22779 leader_election.cc:336] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:29.825214 27943 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.825888 27943 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:29.828389 27943 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:29.832356 27916 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:29.835184 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:29.835806 22814 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 17.
I20260709 13:08:29.837015 22808 raft_consensus.cc:1275] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:08:29.846205 22220 leader_election.cc:336] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
W20260709 13:08:29.846976 22220 leader_election.cc:336] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
W20260709 13:08:29.848693 22218 leader_election.cc:336] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:29.849167 22218 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.853514 27942 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:29.863061 22779 consensus_peers.cc:597] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:29.866312 22779 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:29.887027 27916 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.887645 27916 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:29.889815 27916 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:29.897529 22220 leader_election.cc:336] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
W20260709 13:08:29.898268 22220 leader_election.cc:336] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
W20260709 13:08:29.902741 22779 leader_election.cc:336] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:29.907582 22781 leader_election.cc:336] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:29.908102 22781 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.910351 22218 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:29.918053 27943 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:29.919028 27943 raft_consensus.cc:493] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:29.919405 27943 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:29.918313 27942 consensus_queue.cc:1048] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
W20260709 13:08:29.932392 22218 consensus_peers.cc:597] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:29.935532 27945 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:29.947525 22808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:29.948319 22808 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 18.
W20260709 13:08:29.939543 22218 leader_election.cc:336] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:29.949069 22218 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.950490 27942 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:29.974802 22779 consensus_peers.cc:597] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:29.984651 22781 leader_election.cc:336] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:29.985136 22781 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:29.992590 27943 raft_consensus.cc:515] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:29.993768 27945 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:30.011598 27943 leader_election.cc:290] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:08:30.027215 21001 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22202)
W20260709 13:08:30.029613 22779 consensus_peers.cc:597] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:30.030666 22218 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:08:30.032137 22218 consensus_peers.cc:597] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:30.038218 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688b3a79146a41e2b683e0642b986d9a" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:08:30.039312 27955 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:30.040874 27955 raft_consensus.cc:493] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:30.039589 22814 raft_consensus.cc:3060] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:30.041278 27955 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:30.055001 22220 leader_election.cc:336] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:30.073936 22814 raft_consensus.cc:2468] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 18.
I20260709 13:08:30.081110 27955 raft_consensus.cc:515] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:30.093092 27955 leader_election.cc:290] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 election: Requested vote from peers 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
W20260709 13:08:30.096865 22218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:35973, user_credentials={real_user=slave}} blocked reactor thread for 59207.7us
W20260709 13:08:30.099112 22220 leader_election.cc:336] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:30.102253 22218 leader_election.cc:304] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:30.104249 27955 raft_consensus.cc:2804] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:30.105014 27955 raft_consensus.cc:697] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 18 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:08:30.106475 27955 consensus_queue.cc:237] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:30.118489 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0232d828f8664f348df823432990379b" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275"
I20260709 13:08:30.119364 22814 raft_consensus.cc:3060] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:30.132608 22218 consensus_peers.cc:597] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:30.143769 22814 raft_consensus.cc:2468] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 19.
I20260709 13:08:30.156715 22218 leader_election.cc:304] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:30.159389 27958 raft_consensus.cc:2804] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:30.159966 27958 raft_consensus.cc:697] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 19 LEADER]: Becoming Leader. State: Replica: 765d912bde9e48959e50d9efec3c26b6, State: Running, Role: LEADER
I20260709 13:08:30.161022 27958 consensus_queue.cc:237] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:30.167237 21996 catalog_manager.cc:5697] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 17 to 18, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 18 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:30.170799 22779 consensus_peers.cc:597] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:30.204875 21996 catalog_manager.cc:5697] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 reported cstate change: term changed from 18 to 19, leader changed from 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66) to 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67). New cstate: current_term: 19 leader_uuid: "765d912bde9e48959e50d9efec3c26b6" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:30.287132 22220 consensus_peers.cc:597] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.352579 22220 consensus_peers.cc:597] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.412354 22220 consensus_peers.cc:597] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.462188 22220 consensus_peers.cc:597] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.477977 22220 consensus_peers.cc:597] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.519531 22814 raft_consensus.cc:1275] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:30.521495 27959 consensus_queue.cc:1048] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:30.532212 22220 consensus_peers.cc:597] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.566741 22220 consensus_peers.cc:597] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.567487 22220 consensus_peers.cc:597] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.590587 22220 consensus_peers.cc:597] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.595589 22220 consensus_peers.cc:597] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.625854 22781 consensus_peers.cc:597] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.635011 22781 consensus_peers.cc:597] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.660153 22781 consensus_peers.cc:597] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.677801 22781 consensus_peers.cc:597] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.678333 22781 consensus_peers.cc:597] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.690786 22220 consensus_peers.cc:597] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.719550 22814 raft_consensus.cc:1275] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 19 FOLLOWER]: Refusing update from remote peer 765d912bde9e48959e50d9efec3c26b6: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:30.720899 27959 consensus_queue.cc:1048] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:08:30.742547 22218 consensus_peers.cc:597] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:30.758162 22781 consensus_peers.cc:597] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.769929 22218 consensus_peers.cc:597] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:08:30.785737 22781 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.810730 22220 consensus_peers.cc:597] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.815977 22220 consensus_peers.cc:597] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.828478 22220 consensus_peers.cc:597] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.907116 22781 consensus_peers.cc:597] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.930677 22220 consensus_peers.cc:597] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.935611 27956 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:30.936233 27956 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:30.946614 22218 leader_election.cc:336] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:30.947098 22781 consensus_peers.cc:597] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.947834 27956 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), a07ca3d1b5b84f4bbcb907f709a69275 (127.20.130.68:35973)
I20260709 13:08:30.950229 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b965624a67d4adb87e9787782f1715c" candidate_uuid: "765d912bde9e48959e50d9efec3c26b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" is_pre_election: true
I20260709 13:08:30.953058 22814 raft_consensus.cc:2468] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765d912bde9e48959e50d9efec3c26b6 in term 12.
I20260709 13:08:30.958178 27956 raft_consensus.cc:493] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:30.958892 27956 raft_consensus.cc:515] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:30.963713 27956 leader_election.cc:290] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:30.971213 22218 leader_election.cc:336] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:30.972816 22220 leader_election.cc:336] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:30.973357 22220 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:08:30.973891 22781 consensus_peers.cc:597] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.976078 22220 consensus_peers.cc:597] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.974709 27956 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:30.984284 22220 consensus_peers.cc:597] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.984946 22220 leader_election.cc:336] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:30.985332 22220 leader_election.cc:304] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:30.986136 27956 raft_consensus.cc:2749] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:31.008704 22781 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:31.027753 21001 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22202)
W20260709 13:08:31.042348 22220 consensus_peers.cc:597] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:31.063089 22220 consensus_peers.cc:597] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:31.071739 22779 consensus_peers.cc:597] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:31.072721 27963 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:31.073355 27963 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:31.077553 22247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931a6490a0ea49419e07ac75f5c84030" candidate_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "765d912bde9e48959e50d9efec3c26b6" is_pre_election: true
I20260709 13:08:31.078188 22247 raft_consensus.cc:2468] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07ca3d1b5b84f4bbcb907f709a69275 in term 15.
I20260709 13:08:31.084856 27963 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:08:31.085491 22781 leader_election.cc:336] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
W20260709 13:08:31.086534 22779 leader_election.cc:336] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:31.087002 22779 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6, a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:31.087911 27963 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:31.092373 22779 consensus_peers.cc:597] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:31.108222 22218 consensus_peers.cc:597] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:31.130964 22218 consensus_peers.cc:597] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:31.135484 27958 raft_consensus.cc:493] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:31.136188 27958 raft_consensus.cc:515] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:31.138424 27958 leader_election.cc:290] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:31.147105 22218 leader_election.cc:336] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:31.147680 22220 leader_election.cc:336] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
W20260709 13:08:31.147732 22218 consensus_peers.cc:597] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:31.148511 22220 leader_election.cc:304] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:31.150372 27958 raft_consensus.cc:2749] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:31.210976 22218 consensus_peers.cc:597] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:31.288599 22218 consensus_peers.cc:597] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:08:31.320462 27958 raft_consensus.cc:493] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:31.320997 27958 raft_consensus.cc:515] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:31.323135 27958 leader_election.cc:290] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:31.325532 27963 raft_consensus.cc:493] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:31.326092 27963 raft_consensus.cc:515] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:31.329931 22220 leader_election.cc:336] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
W20260709 13:08:31.330674 22218 leader_election.cc:336] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:31.331084 22218 leader_election.cc:304] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:31.332310 27958 raft_consensus.cc:2749] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:31.338368 22779 leader_election.cc:336] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:31.341183 27963 leader_election.cc:290] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:31.345541 22781 leader_election.cc:336] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:31.345992 22781 leader_election.cc:304] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:31.347499 27963 raft_consensus.cc:2749] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:31.362349 22218 consensus_peers.cc:597] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:31.374320 22218 consensus_peers.cc:597] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:08:31.411384 22779 consensus_peers.cc:597] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:08:31.495078 27956 raft_consensus.cc:493] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:31.495729 27956 raft_consensus.cc:515] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:31.500049 27956 leader_election.cc:290] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:31.508670 22220 leader_election.cc:336] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:31.514628 27958 raft_consensus.cc:493] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:31.515182 27958 raft_consensus.cc:515] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:31.517210 27958 leader_election.cc:290] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:31.521064 22218 leader_election.cc:336] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:31.521533 22218 leader_election.cc:304] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
W20260709 13:08:31.522760 22220 leader_election.cc:336] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:31.523720 27958 raft_consensus.cc:2749] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:31.525609 27963 raft_consensus.cc:493] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:31.526140 27963 raft_consensus.cc:515] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:31.531757 22218 leader_election.cc:336] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:31.532143 22779 leader_election.cc:336] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:31.532366 22218 leader_election.cc:304] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:31.533221 27958 raft_consensus.cc:2749] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:31.533288 27963 leader_election.cc:290] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:31.534372 22218 consensus_peers.cc:597] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:08:31.538705 22781 leader_election.cc:336] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:31.539225 22781 leader_election.cc:304] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:31.540011 27963 raft_consensus.cc:2749] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:31.583455 27963 raft_consensus.cc:493] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:31.584051 27963 raft_consensus.cc:515] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
W20260709 13:08:31.583458 22218 consensus_peers.cc:597] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:31.587086 27963 leader_election.cc:290] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:31.589897 22779 leader_election.cc:336] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:31.596844 22781 leader_election.cc:336] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:31.597399 22781 leader_election.cc:304] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:31.598232 27963 raft_consensus.cc:2749] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:31.614938 27963 raft_consensus.cc:493] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:31.615563 27963 raft_consensus.cc:515] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:31.617730 27963 leader_election.cc:290] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
I20260709 13:08:31.633183 27958 raft_consensus.cc:493] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:31.633852 27958 raft_consensus.cc:515] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:08:31.632830 22779 leader_election.cc:336] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:31.637053 27956 raft_consensus.cc:493] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:31.639245 27956 raft_consensus.cc:515] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
I20260709 13:08:31.641312 27956 leader_election.cc:290] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:31.646595 22220 leader_election.cc:336] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:31.637517 27958 leader_election.cc:290] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:31.650998 22220 leader_election.cc:336] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
W20260709 13:08:31.652268 22218 leader_election.cc:336] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:31.651450 22781 leader_election.cc:336] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:31.652743 22218 leader_election.cc:304] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:31.653445 22781 leader_election.cc:304] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:31.656345 27972 raft_consensus.cc:2749] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:31.658075 27956 raft_consensus.cc:2749] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:31.663844 22218 leader_election.cc:336] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:31.664353 22218 leader_election.cc:304] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:31.665081 27973 raft_consensus.cc:2749] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:31.720860 22779 consensus_peers.cc:597] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:08:31.740465 27958 raft_consensus.cc:493] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:31.741139 27958 raft_consensus.cc:515] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } }
W20260709 13:08:31.747969 22218 leader_election.cc:336] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:31.749372 27958 leader_election.cc:290] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:31.761179 22220 leader_election.cc:336] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:31.762099 22220 leader_election.cc:304] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765d912bde9e48959e50d9efec3c26b6; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:31.765003 27958 raft_consensus.cc:2749] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:31.774961 27963 raft_consensus.cc:493] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:31.775614 27963 raft_consensus.cc:515] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:31.777878 27963 leader_election.cc:290] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:31.783828 22781 leader_election.cc:336] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
W20260709 13:08:31.797024 22779 leader_election.cc:336] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:31.797529 22779 leader_election.cc:304] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:31.798252 27963 raft_consensus.cc:2749] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:31.804726 22218 consensus_peers.cc:597] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:08:31.818463 27963 raft_consensus.cc:493] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:31.819345 27963 raft_consensus.cc:515] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:31.821806 27963 leader_election.cc:290] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399)
W20260709 13:08:31.825865 22779 leader_election.cc:336] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
W20260709 13:08:31.828202 22781 leader_election.cc:336] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:31.828734 22781 leader_election.cc:304] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 79683575881f4334bd4dc6d9bdbb45c3, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:31.829864 27963 raft_consensus.cc:2749] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:31.859151 22218 consensus_peers.cc:597] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:08:31.980270 22779 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:08:32.028421 21001 tablet_server.cc:196] TabletServer@127.20.130.66:0 shutdown complete.
W20260709 13:08:32.073287 22218 consensus_peers.cc:597] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:08:32.123989 22779 consensus_peers.cc:597] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:08:32.171463 22218 consensus_peers.cc:597] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:08:32.194746 22218 consensus_peers.cc:597] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:08:32.204849 21001 tablet_server.cc:179] TabletServer@127.20.130.67:0 shutting down...
W20260709 13:08:32.213526 22782 consensus_peers.cc:597] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:32.244035 22779 consensus_peers.cc:597] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:08:32.265132 22782 consensus_peers.cc:597] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.278842 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:32.279775 21001 tablet_replica.cc:333] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.280524 21001 raft_consensus.cc:2243] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.281095 21001 raft_consensus.cc:2272] T 12ac70b72e5d452ca6dd020f9ccb0541 P 765d912bde9e48959e50d9efec3c26b6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.283855 21001 tablet_replica.cc:333] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.284807 21001 raft_consensus.cc:2243] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.285720 21001 raft_consensus.cc:2272] T 6617a460ae364f94b826785a9e77ec86 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:32.287102 22782 consensus_peers.cc:597] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.288304 21001 tablet_replica.cc:333] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.288967 21001 raft_consensus.cc:2243] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.289597 21001 raft_consensus.cc:2272] T 383c9bd275674f7d8d5cdf16a1456960 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.292430 21001 tablet_replica.cc:333] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.293479 21001 raft_consensus.cc:2243] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.294255 21001 raft_consensus.cc:2272] T 6b965624a67d4adb87e9787782f1715c P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.296880 21001 tablet_replica.cc:333] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.297590 21001 raft_consensus.cc:2243] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.298368 21001 raft_consensus.cc:2272] T 394d042ced1042eb99ada43cc8ab55ba P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.301072 21001 tablet_replica.cc:333] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.301846 21001 raft_consensus.cc:2243] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.302553 21001 raft_consensus.cc:2272] T ee2b1eeb3bb341638b56bf74c37e2045 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.305331 21001 tablet_replica.cc:333] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.306113 21001 raft_consensus.cc:2243] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.307332 21001 raft_consensus.cc:2272] T 0f980cc59e6c41d7b5d29d438419c0d1 P 765d912bde9e48959e50d9efec3c26b6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.309852 21001 tablet_replica.cc:333] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.310712 21001 raft_consensus.cc:2243] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.311439 21001 raft_consensus.cc:2272] T a37c5a7045b24e5f8f89b17248cb9529 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.314157 21001 tablet_replica.cc:333] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.314987 21001 raft_consensus.cc:2243] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.315860 21001 raft_consensus.cc:2272] T ef905e474cc543dc9b0f2de05a3807c6 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.318655 21001 tablet_replica.cc:333] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.319419 21001 raft_consensus.cc:2243] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.320012 21001 raft_consensus.cc:2272] T 57adaf54eaf24c778165ac40cc629c38 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.322798 21001 tablet_replica.cc:333] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.323612 21001 raft_consensus.cc:2243] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.324637 21001 raft_consensus.cc:2272] T 6ac896e940b543ae8dc989463d3c33a8 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.327171 21001 tablet_replica.cc:333] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.327935 21001 raft_consensus.cc:2243] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.329254 21001 raft_consensus.cc:2272] T cbe9d18a693340a29f852081a41a74f1 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:32.330322 22782 consensus_peers.cc:597] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.332265 21001 tablet_replica.cc:333] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.333133 21001 raft_consensus.cc:2243] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.334221 21001 raft_consensus.cc:2272] T c42ecdbc6a0d4ed88048a3ea9bc6b893 P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.337004 21001 tablet_replica.cc:333] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.337790 21001 raft_consensus.cc:2243] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.338595 21001 raft_consensus.cc:2272] T f79004ff583f4b278afa2453c7088bf7 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.341166 21001 tablet_replica.cc:333] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.341956 21001 raft_consensus.cc:2243] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.342835 21001 raft_consensus.cc:2272] T 931a6490a0ea49419e07ac75f5c84030 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.345553 21001 tablet_replica.cc:333] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.346319 21001 raft_consensus.cc:2243] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.347375 21001 raft_consensus.cc:2272] T 00aee6f5c28c45b0841b480190d2c555 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:32.349570 22782 consensus_peers.cc:597] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.350000 21001 tablet_replica.cc:333] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.350816 21001 raft_consensus.cc:2243] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.351419 21001 raft_consensus.cc:2272] T d958965f6f1e46f7917ee6e8a28078ba P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.353900 21001 tablet_replica.cc:333] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.354637 21001 raft_consensus.cc:2243] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.355664 21001 raft_consensus.cc:2272] T 6d938b9c784244a59de8b48c3136eb3f P 765d912bde9e48959e50d9efec3c26b6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.358156 21001 tablet_replica.cc:333] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.358981 21001 raft_consensus.cc:2243] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.359515 21001 raft_consensus.cc:2272] T ea960f06fa1940d49afea738c7cd0e94 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.362183 21001 tablet_replica.cc:333] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.362986 21001 raft_consensus.cc:2243] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.364359 21001 raft_consensus.cc:2272] T 688b3a79146a41e2b683e0642b986d9a P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.366780 21001 tablet_replica.cc:333] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.367588 21001 raft_consensus.cc:2243] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.368641 21001 raft_consensus.cc:2272] T 252049d2bcdd4f329ca5015bf10c1b19 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.371230 21001 tablet_replica.cc:333] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.371989 21001 raft_consensus.cc:2243] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.373274 21001 raft_consensus.cc:2272] T 6b85b002ea7945719057edb66d543287 P 765d912bde9e48959e50d9efec3c26b6 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:32.374974 22782 consensus_peers.cc:597] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.376091 21001 tablet_replica.cc:333] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.376938 21001 raft_consensus.cc:2243] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.377951 21001 raft_consensus.cc:2272] T dd0d86a3e0d843d0a468840a4f90cbf4 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.380399 21001 tablet_replica.cc:333] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.381171 21001 raft_consensus.cc:2243] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.381820 21001 raft_consensus.cc:2272] T 62d62f92be1345e38ad2eeb98d958d91 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.386199 21001 tablet_replica.cc:333] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.387102 21001 raft_consensus.cc:2243] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.388489 21001 raft_consensus.cc:2272] T 7a567384a18d40a09c5a3e09e6c15ef6 P 765d912bde9e48959e50d9efec3c26b6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.391178 21001 tablet_replica.cc:333] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.391983 21001 raft_consensus.cc:2243] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.392670 21001 raft_consensus.cc:2272] T d38b6e6d2d3741e9b61d5a743ca099a2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.395310 21001 tablet_replica.cc:333] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.396013 21001 raft_consensus.cc:2243] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.396682 21001 raft_consensus.cc:2272] T 00e5bf29367f432285b4e873ecccea9e P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.399220 21001 tablet_replica.cc:333] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.399926 21001 raft_consensus.cc:2243] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.401103 21001 raft_consensus.cc:2272] T 79d645cd970b4b2789be5374cc2005aa P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.403975 21001 tablet_replica.cc:333] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.404727 21001 raft_consensus.cc:2243] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.406243 21001 raft_consensus.cc:2272] T 0232d828f8664f348df823432990379b P 765d912bde9e48959e50d9efec3c26b6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.408843 21001 tablet_replica.cc:333] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.409566 21001 raft_consensus.cc:2243] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.410621 21001 raft_consensus.cc:2272] T 7e0f44b43c1a477e9c7c66c034c8844a P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.412984 21001 tablet_replica.cc:333] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.413712 21001 raft_consensus.cc:2243] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.414839 21001 raft_consensus.cc:2272] T bbbed7673fb44214a4548960bdacf99b P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:32.416620 22782 consensus_peers.cc:597] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.417379 21001 tablet_replica.cc:333] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.418195 21001 raft_consensus.cc:2243] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.418787 21001 raft_consensus.cc:2272] T 5d674bb7c45c407e8aa9767c7438a39e P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.421435 21001 tablet_replica.cc:333] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.422173 21001 raft_consensus.cc:2243] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.423257 21001 raft_consensus.cc:2272] T 6f8407607d7441c7bdac45e1dadc700d P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.425948 21001 tablet_replica.cc:333] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.426659 21001 raft_consensus.cc:2243] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.427815 21001 raft_consensus.cc:2272] T b53b5061ddba43b7ae5a93ea344b61ca P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.430282 21001 tablet_replica.cc:333] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.431043 21001 raft_consensus.cc:2243] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.432060 21001 raft_consensus.cc:2272] T 5d3869ae617b42c89768d68043d44be2 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.434821 21001 tablet_replica.cc:333] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.435532 21001 raft_consensus.cc:2243] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.436671 21001 raft_consensus.cc:2272] T 8f5e08d4c24545e18b620e33800d39d3 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.439545 21001 tablet_replica.cc:333] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.440407 21001 raft_consensus.cc:2243] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.441358 21001 raft_consensus.cc:2272] T 38574701043e46cb978340cb6753faae P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.443996 21001 tablet_replica.cc:333] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.444694 21001 raft_consensus.cc:2243] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.445242 21001 raft_consensus.cc:2272] T 9235083e4800460ca0b4619abda2917b P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.447783 21001 tablet_replica.cc:333] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.448467 21001 raft_consensus.cc:2243] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.449498 21001 raft_consensus.cc:2272] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.451969 21001 tablet_replica.cc:333] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.452679 21001 raft_consensus.cc:2243] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.453732 21001 raft_consensus.cc:2272] T 9c6cd0878342413eb24e0e69b3a96aa0 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.456295 21001 tablet_replica.cc:333] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.456979 21001 raft_consensus.cc:2243] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.457726 21001 raft_consensus.cc:2272] T efc23a012ae0497797e82803613f3835 P 765d912bde9e48959e50d9efec3c26b6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.460348 21001 tablet_replica.cc:333] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.461066 21001 raft_consensus.cc:2243] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.461757 21001 raft_consensus.cc:2272] T 9be7e328170d4837bbaade0fb02dead2 P 765d912bde9e48959e50d9efec3c26b6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.464563 21001 tablet_replica.cc:333] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.465361 21001 raft_consensus.cc:2243] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.465942 21001 raft_consensus.cc:2272] T f27e0e0f167848adb3889027a46ee857 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:32.467135 22782 consensus_peers.cc:597] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.468480 21001 tablet_replica.cc:333] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.469229 21001 raft_consensus.cc:2243] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.470297 21001 raft_consensus.cc:2272] T ebf4c9a0fe314a8db203637fffd1dc52 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.473008 21001 tablet_replica.cc:333] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.473731 21001 raft_consensus.cc:2243] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.474642 21001 raft_consensus.cc:2272] T 2f8d3d512e804f4bbd58ae1baf74c000 P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:32.475834 22782 consensus_peers.cc:597] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.477387 21001 tablet_replica.cc:333] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.478113 21001 raft_consensus.cc:2243] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:32.479189 21001 raft_consensus.cc:2272] T 5ed3b0d7588c4652991dbe99eb204ae2 P 765d912bde9e48959e50d9efec3c26b6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.481858 21001 tablet_replica.cc:333] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
W20260709 13:08:32.482085 22782 consensus_peers.cc:597] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.482543 21001 raft_consensus.cc:2243] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.483337 21001 raft_consensus.cc:2272] T db1364cdaa794f9fb4739365dc79d393 P 765d912bde9e48959e50d9efec3c26b6 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:32.484359 22782 consensus_peers.cc:597] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.485958 21001 tablet_replica.cc:333] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.486676 21001 raft_consensus.cc:2243] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:32.487416 21001 raft_consensus.cc:2272] T 77137a3a1cee4b55ae36e0a368f7e363 P 765d912bde9e48959e50d9efec3c26b6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:32.489897 21001 tablet_replica.cc:333] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6: stopping tablet replica
I20260709 13:08:32.490530 21001 raft_consensus.cc:2243] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:08:32.490629 22779 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:32.492214 21001 raft_consensus.cc:2272] T 16e48ec055f940c49e01d5a5d77581aa P 765d912bde9e48959e50d9efec3c26b6 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:32.511302 22779 consensus_peers.cc:597] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:32.615726 22782 consensus_peers.cc:597] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.67:42273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:32.623557 22782 consensus_peers.cc:597] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.67:42273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:32.700440 22779 consensus_peers.cc:597] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:08:32.721391 22782 consensus_peers.cc:597] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Couldn't send request to peer 765d912bde9e48959e50d9efec3c26b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.67:42273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:32.840492 22781 consensus_peers.cc:597] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.918677 22781 consensus_peers.cc:597] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.929809 22779 consensus_peers.cc:597] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Couldn't send request to peer c0694f6572bf406a92d55f1f2ab46ef2. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:08:33.043728 22781 consensus_peers.cc:597] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.080856 22781 consensus_peers.cc:597] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:33.108635 27976 raft_consensus.cc:493] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:33.109220 27976 raft_consensus.cc:515] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:33.112334 27976 leader_election.cc:290] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:08:33.117393 22782 leader_election.cc:336] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Network error: Client connection negotiation failed: client connection to 127.20.130.67:42273: connect: Connection refused (error 111)
W20260709 13:08:33.121300 22781 leader_election.cc:336] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:33.121810 22781 leader_election.cc:304] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
W20260709 13:08:33.122291 22779 leader_election.cc:336] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:33.122767 27976 raft_consensus.cc:2749] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.184476 21001 tablet_server.cc:196] TabletServer@127.20.130.67:0 shutdown complete.
W20260709 13:08:33.184585 22782 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.130.67:42273: connect: Connection refused (error 111) [suppressed 641 similar messages]
W20260709 13:08:33.237073 22781 consensus_peers.cc:597] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.241333 22781 consensus_peers.cc:597] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:33.255760 27972 raft_consensus.cc:493] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79683575881f4334bd4dc6d9bdbb45c3)
I20260709 13:08:33.256357 27972 raft_consensus.cc:515] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } attrs { replace: true } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:33.259150 27972 leader_election.cc:290] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
W20260709 13:08:33.265169 22782 leader_election.cc:336] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Network error: Client connection negotiation failed: client connection to 127.20.130.67:42273: connect: Connection refused (error 111)
W20260709 13:08:33.267776 22781 leader_election.cc:336] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111)
I20260709 13:08:33.268280 22781 leader_election.cc:304] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, 79683575881f4334bd4dc6d9bdbb45c3
I20260709 13:08:33.269037 27972 raft_consensus.cc:2749] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:33.269820 22779 leader_election.cc:336] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:33.320132 21001 tablet_server.cc:179] TabletServer@127.20.130.68:0 shutting down...
W20260709 13:08:33.328136 22781 consensus_peers.cc:597] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:33.385802 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:33.386785 21001 tablet_replica.cc:333] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.388532 21001 raft_consensus.cc:2243] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.389288 21001 raft_consensus.cc:2272] T 16e48ec055f940c49e01d5a5d77581aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.391944 21001 tablet_replica.cc:333] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.392660 21001 raft_consensus.cc:2243] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEARNER]: Raft consensus shutting down.
I20260709 13:08:33.393080 21001 pending_rounds.cc:70] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: Trying to abort 1 pending ops.
I20260709 13:08:33.393291 21001 pending_rounds.cc:77] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275: Aborting op as it isn't in flight: id { term: 5 index: 4 } timestamp: 7305635460628066304 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "79d645cd970b4b2789be5374cc2005aa" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } } new_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "79683575881f4334bd4dc6d9bdbb45c3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 42399 } attrs { replace: true } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: NON_VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: true } } } }
I20260709 13:08:33.394068 21001 raft_consensus.cc:2917] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 LEARNER]: Aborting config change with OpId 5.4: Aborted: Op aborted
I20260709 13:08:33.394492 21001 raft_consensus.cc:2889] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:08:33.394774 21001 raft_consensus.cc:2272] T 79d645cd970b4b2789be5374cc2005aa P a07ca3d1b5b84f4bbcb907f709a69275 [term 6 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:08:33.397207 21001 tablet_replica.cc:333] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.397980 21001 raft_consensus.cc:2243] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.398545 21001 raft_consensus.cc:2272] T 9a4e641637cf41118865c96aec55b340 P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.400822 21001 tablet_replica.cc:333] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.401564 21001 raft_consensus.cc:2243] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.402171 21001 raft_consensus.cc:2272] T 6f8407607d7441c7bdac45e1dadc700d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.405180 21001 tablet_replica.cc:333] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.406157 21001 raft_consensus.cc:2243] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.406945 21001 raft_consensus.cc:2272] T 6b965624a67d4adb87e9787782f1715c P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.410094 21001 tablet_replica.cc:333] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.410765 21001 raft_consensus.cc:2243] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.411285 21001 raft_consensus.cc:2272] T 0911b6e64ffb48bd9fc4968f8f52860c P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:33.413822 22781 consensus_peers.cc:597] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:33.414148 21001 tablet_replica.cc:333] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.414875 21001 raft_consensus.cc:2243] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.415910 21001 raft_consensus.cc:2272] T 57adaf54eaf24c778165ac40cc629c38 P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.418654 21001 tablet_replica.cc:333] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.419387 21001 raft_consensus.cc:2243] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.419912 21001 raft_consensus.cc:2272] T cbe9d18a693340a29f852081a41a74f1 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.422072 21001 tablet_replica.cc:333] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.422646 21001 raft_consensus.cc:2243] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.423635 21001 raft_consensus.cc:2272] T 9be7e328170d4837bbaade0fb02dead2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.426143 21001 tablet_replica.cc:333] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.426716 21001 raft_consensus.cc:2243] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.427543 21001 raft_consensus.cc:2272] T 116931ff9e08478dadc7bdc9e917454a P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.429618 21001 tablet_replica.cc:333] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.430207 21001 raft_consensus.cc:2243] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.431077 21001 raft_consensus.cc:2272] T ef905e474cc543dc9b0f2de05a3807c6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.433269 21001 tablet_replica.cc:333] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.433818 21001 raft_consensus.cc:2243] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.434653 21001 raft_consensus.cc:2272] T 62d62f92be1345e38ad2eeb98d958d91 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.436951 21001 tablet_replica.cc:333] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.437572 21001 raft_consensus.cc:2243] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.438030 21001 raft_consensus.cc:2272] T 5f9abb5a83ca4007a03cd4613544f2eb P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.440164 21001 tablet_replica.cc:333] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.440721 21001 raft_consensus.cc:2243] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.441514 21001 raft_consensus.cc:2272] T 77137a3a1cee4b55ae36e0a368f7e363 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.443656 21001 tablet_replica.cc:333] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.444396 21001 raft_consensus.cc:2243] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.445312 21001 raft_consensus.cc:2272] T db1364cdaa794f9fb4739365dc79d393 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.446007 27972 raft_consensus.cc:493] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 765d912bde9e48959e50d9efec3c26b6)
I20260709 13:08:33.446504 27972 raft_consensus.cc:515] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c0694f6572bf406a92d55f1f2ab46ef2" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 33421 } } peers { permanent_uuid: "765d912bde9e48959e50d9efec3c26b6" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42273 } } peers { permanent_uuid: "a07ca3d1b5b84f4bbcb907f709a69275" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 35973 } attrs { promote: false } }
I20260709 13:08:33.448249 21001 tablet_replica.cc:333] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.449180 21001 raft_consensus.cc:2243] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.450968 21001 raft_consensus.cc:2272] T 394d042ced1042eb99ada43cc8ab55ba P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.453961 21001 tablet_replica.cc:333] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
W20260709 13:08:33.454463 22782 leader_election.cc:336] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273): Network error: Client connection negotiation failed: client connection to 127.20.130.67:42273: connect: Connection refused (error 111)
W20260709 13:08:33.454996 22779 leader_election.cc:336] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:33.455644 27972 leader_election.cc:290] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421), 765d912bde9e48959e50d9efec3c26b6 (127.20.130.67:42273)
I20260709 13:08:33.455698 22779 leader_election.cc:304] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07ca3d1b5b84f4bbcb907f709a69275; no voters: 765d912bde9e48959e50d9efec3c26b6, c0694f6572bf406a92d55f1f2ab46ef2
I20260709 13:08:33.456588 27972 raft_consensus.cc:2749] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.454982 21001 raft_consensus.cc:2243] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.457485 21001 raft_consensus.cc:2272] T 6d938b9c784244a59de8b48c3136eb3f P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.460446 21001 tablet_replica.cc:333] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.461076 21001 raft_consensus.cc:2243] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.461971 21001 raft_consensus.cc:2272] T 2f8d3d512e804f4bbd58ae1baf74c000 P a07ca3d1b5b84f4bbcb907f709a69275 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.464653 21001 tablet_replica.cc:333] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.465545 21001 raft_consensus.cc:2243] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.466338 21001 raft_consensus.cc:2272] T 931a6490a0ea49419e07ac75f5c84030 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:33.468467 22781 consensus_peers.cc:597] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 -> Peer 79683575881f4334bd4dc6d9bdbb45c3 (127.20.130.66:42399): Couldn't send request to peer 79683575881f4334bd4dc6d9bdbb45c3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:42399: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:33.469285 21001 tablet_replica.cc:333] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.469893 21001 raft_consensus.cc:2243] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.470678 21001 raft_consensus.cc:2272] T f79004ff583f4b278afa2453c7088bf7 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.472630 21001 tablet_replica.cc:333] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.473222 21001 raft_consensus.cc:2243] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.473658 21001 raft_consensus.cc:2272] T 688b3a79146a41e2b683e0642b986d9a P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.475617 21001 tablet_replica.cc:333] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.476181 21001 raft_consensus.cc:2243] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.476907 21001 raft_consensus.cc:2272] T 6b85b002ea7945719057edb66d543287 P a07ca3d1b5b84f4bbcb907f709a69275 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.479096 21001 tablet_replica.cc:333] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.479667 21001 raft_consensus.cc:2243] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.480141 21001 raft_consensus.cc:2272] T 252049d2bcdd4f329ca5015bf10c1b19 P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.482231 21001 tablet_replica.cc:333] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.482781 21001 raft_consensus.cc:2243] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.483690 21001 raft_consensus.cc:2272] T 96aa7e0b91bf482db9b8977df7574baf P a07ca3d1b5b84f4bbcb907f709a69275 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.485723 21001 tablet_replica.cc:333] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.486246 21001 raft_consensus.cc:2243] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.486776 21001 raft_consensus.cc:2272] T 03ed5952f28c46d8b66e87a9d1b03981 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.488716 21001 tablet_replica.cc:333] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.489264 21001 raft_consensus.cc:2243] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.490165 21001 raft_consensus.cc:2272] T c80e8c56632c46d9a35c63a2ca8a532f P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.492149 21001 tablet_replica.cc:333] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.492686 21001 raft_consensus.cc:2243] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.493150 21001 raft_consensus.cc:2272] T 3f1a2136ffa84255b65c2f9037b0e55d P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.495190 21001 tablet_replica.cc:333] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.495714 21001 raft_consensus.cc:2243] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.496460 21001 raft_consensus.cc:2272] T 383c9bd275674f7d8d5cdf16a1456960 P a07ca3d1b5b84f4bbcb907f709a69275 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.498373 21001 tablet_replica.cc:333] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.498906 21001 raft_consensus.cc:2243] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.499483 21001 raft_consensus.cc:2272] T 5ed3b0d7588c4652991dbe99eb204ae2 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.501386 21001 tablet_replica.cc:333] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.501878 21001 raft_consensus.cc:2243] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.502689 21001 raft_consensus.cc:2272] T a37c5a7045b24e5f8f89b17248cb9529 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.504570 21001 tablet_replica.cc:333] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.505074 21001 raft_consensus.cc:2243] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.505473 21001 raft_consensus.cc:2272] T 6ac896e940b543ae8dc989463d3c33a8 P a07ca3d1b5b84f4bbcb907f709a69275 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.507190 21001 tablet_replica.cc:333] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.507688 21001 raft_consensus.cc:2243] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.508400 21001 raft_consensus.cc:2272] T f27e0e0f167848adb3889027a46ee857 P a07ca3d1b5b84f4bbcb907f709a69275 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.510226 21001 tablet_replica.cc:333] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.510723 21001 raft_consensus.cc:2243] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.511471 21001 raft_consensus.cc:2272] T 12ac70b72e5d452ca6dd020f9ccb0541 P a07ca3d1b5b84f4bbcb907f709a69275 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.513659 21001 tablet_replica.cc:333] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.514216 21001 raft_consensus.cc:2243] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.514806 21001 raft_consensus.cc:2272] T f5e8334eaf044d0ba6d7817e7e9b2fd9 P a07ca3d1b5b84f4bbcb907f709a69275 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.516767 21001 tablet_replica.cc:333] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.517251 21001 raft_consensus.cc:2243] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.518240 21001 raft_consensus.cc:2272] T 5d6633743ea44146a5164f64185db9a6 P a07ca3d1b5b84f4bbcb907f709a69275 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.520512 21001 tablet_replica.cc:333] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.521035 21001 raft_consensus.cc:2243] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.521517 21001 raft_consensus.cc:2272] T 663cabb59b2041f98e811d0b49faf5da P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.523768 21001 tablet_replica.cc:333] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.524397 21001 raft_consensus.cc:2243] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:33.525108 21001 raft_consensus.cc:2272] T 0232d828f8664f348df823432990379b P a07ca3d1b5b84f4bbcb907f709a69275 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.527374 21001 tablet_replica.cc:333] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275: stopping tablet replica
I20260709 13:08:33.527878 21001 raft_consensus.cc:2243] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:33.528692 21001 raft_consensus.cc:2272] T 5d674bb7c45c407e8aa9767c7438a39e P a07ca3d1b5b84f4bbcb907f709a69275 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:33.825321 21001 tablet_server.cc:196] TabletServer@127.20.130.68:0 shutdown complete.
I20260709 13:08:33.896986 21001 master.cc:562] Master@127.20.130.126:34457 shutting down...
W20260709 13:08:33.937878 22052 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:08:33.938150 22052 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:08:33.938361 22052 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:08:39.576697 21988 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111) [suppressed 26 similar messages]
W20260709 13:08:39.580261 21988 catalog_manager.cc:4755] TS c0694f6572bf406a92d55f1f2ab46ef2 (127.20.130.65:33421): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 0232d828f8664f348df823432990379b: Network error: Client connection negotiation failed: client connection to 127.20.130.65:33421: connect: Connection refused (error 111)
I20260709 13:08:40.929960 21001 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:40.931109 21001 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.931550 21001 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7bace290edae4f6bba4eb0d6a5b7d8c9: stopping tablet replica
I20260709 13:08:41.115671 21001 master.cc:584] Master@127.20.130.126:34457 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (206199 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:08:41.235460 21001 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.130.126:34867
I20260709 13:08:41.237008 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:41.243404 27981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:41.243422 27982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:41.244019 27984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.244748 21001 server_base.cc:1061] running on GCE node
I20260709 13:08:41.247776 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:41.247977 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:41.248129 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602521248114 us; error 0 us; skew 500 ppm
I20260709 13:08:41.248678 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:41.251364 21001 webserver.cc:533] Webserver started at http://127.20.130.126:42433/ using document root <none> and password file <none>
I20260709 13:08:41.251868 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:41.252049 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:41.252329 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:41.253731 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/master-0-root/instance:
uuid: "f8d75479743548ee9e2bc9d589e05c73"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-csvd"
I20260709 13:08:41.259020 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.007s
I20260709 13:08:41.262599 27989 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.263424 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:08:41.263739 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/master-0-root
uuid: "f8d75479743548ee9e2bc9d589e05c73"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-csvd"
I20260709 13:08:41.264047 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:41.276970 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:41.278198 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:41.317947 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.126:34867
I20260709 13:08:41.318058 28040 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.126:34867 every 8 connection(s)
I20260709 13:08:41.322144 28041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.333921 28041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73: Bootstrap starting.
I20260709 13:08:41.338878 28041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:41.343413 28041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73: No bootstrap required, opened a new log
I20260709 13:08:41.345705 28041 raft_consensus.cc:359] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d75479743548ee9e2bc9d589e05c73" member_type: VOTER }
I20260709 13:08:41.346164 28041 raft_consensus.cc:385] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:41.346397 28041 raft_consensus.cc:740] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d75479743548ee9e2bc9d589e05c73, State: Initialized, Role: FOLLOWER
I20260709 13:08:41.347013 28041 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d75479743548ee9e2bc9d589e05c73" member_type: VOTER }
I20260709 13:08:41.347551 28041 raft_consensus.cc:399] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:41.347797 28041 raft_consensus.cc:493] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:41.348101 28041 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:41.353075 28041 raft_consensus.cc:515] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d75479743548ee9e2bc9d589e05c73" member_type: VOTER }
I20260709 13:08:41.353634 28041 leader_election.cc:304] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8d75479743548ee9e2bc9d589e05c73; no voters: 
I20260709 13:08:41.354804 28041 leader_election.cc:290] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:41.355149 28044 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:41.356600 28044 raft_consensus.cc:697] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [term 1 LEADER]: Becoming Leader. State: Replica: f8d75479743548ee9e2bc9d589e05c73, State: Running, Role: LEADER
I20260709 13:08:41.357362 28044 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d75479743548ee9e2bc9d589e05c73" member_type: VOTER }
I20260709 13:08:41.357841 28041 sys_catalog.cc:565] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:41.364712 28046 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8d75479743548ee9e2bc9d589e05c73. Latest consensus state: current_term: 1 leader_uuid: "f8d75479743548ee9e2bc9d589e05c73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d75479743548ee9e2bc9d589e05c73" member_type: VOTER } }
I20260709 13:08:41.364909 28045 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8d75479743548ee9e2bc9d589e05c73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d75479743548ee9e2bc9d589e05c73" member_type: VOTER } }
I20260709 13:08:41.365916 28045 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:41.365839 28046 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:41.368173 28053 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:41.376068 28053 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:41.377130 21001 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:41.385818 28053 catalog_manager.cc:1383] Generated new cluster ID: 6b6f41cdca194e7196b0f7dccc2e413a
I20260709 13:08:41.386101 28053 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:41.403434 28053 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:41.404745 28053 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:41.427938 28053 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73: Generated new TSK 0
I20260709 13:08:41.428539 28053 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:41.444020 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:41.450783 28062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:41.452113 28063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:41.453735 28065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.453977 21001 server_base.cc:1061] running on GCE node
I20260709 13:08:41.456266 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:41.456473 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:41.456595 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602521456585 us; error 0 us; skew 500 ppm
I20260709 13:08:41.457093 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:41.459652 21001 webserver.cc:533] Webserver started at http://127.20.130.65:45241/ using document root <none> and password file <none>
I20260709 13:08:41.460100 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:41.460275 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:41.460485 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:41.461686 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/instance:
uuid: "7d2bb5df3b55462682d0f2fce57709f1"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-csvd"
I20260709 13:08:41.466543 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:08:41.470424 28070 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.471359 21001 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:08:41.471670 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-0-root
uuid: "7d2bb5df3b55462682d0f2fce57709f1"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-csvd"
I20260709 13:08:41.471964 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:41.499811 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:41.501044 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:41.502588 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:41.504969 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:41.505167 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.505460 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:41.505632 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.548002 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.65:34859
I20260709 13:08:41.548175 28132 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.65:34859 every 8 connection(s)
I20260709 13:08:41.553236 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:41.561206 28137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:41.561664 28138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.565150 21001 server_base.cc:1061] running on GCE node
W20260709 13:08:41.565656 28141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.567685 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:41.567911 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:41.568091 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602521568072 us; error 0 us; skew 500 ppm
I20260709 13:08:41.568632 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:41.571543 21001 webserver.cc:533] Webserver started at http://127.20.130.66:42469/ using document root <none> and password file <none>
I20260709 13:08:41.572110 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:41.572359 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:41.572686 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:41.572813 28133 heartbeater.cc:344] Connected to a master server at 127.20.130.126:34867
I20260709 13:08:41.573230 28133 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:41.574079 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/instance:
uuid: "8938bce1e7864c1ab26755f60f708368"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-csvd"
I20260709 13:08:41.574187 28133 heartbeater.cc:507] Master 127.20.130.126:34867 requested a full tablet report, sending...
I20260709 13:08:41.576602 28006 ts_manager.cc:194] Registered new tserver with Master: 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:41.579221 28006 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41772
I20260709 13:08:41.580091 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.008s
I20260709 13:08:41.583655 28145 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.584399 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20260709 13:08:41.584693 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-1-root
uuid: "8938bce1e7864c1ab26755f60f708368"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-csvd"
I20260709 13:08:41.584987 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:41.614305 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:41.615717 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:41.617244 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:41.619627 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:41.619877 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.620117 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:41.620292 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.663631 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.66:34231
I20260709 13:08:41.663687 28207 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.66:34231 every 8 connection(s)
I20260709 13:08:41.668871 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:41.677986 28211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:41.679267 28212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.681321 28208 heartbeater.cc:344] Connected to a master server at 127.20.130.126:34867
I20260709 13:08:41.681815 28208 heartbeater.cc:461] Registering TS with master...
W20260709 13:08:41.681972 28214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.682106 21001 server_base.cc:1061] running on GCE node
I20260709 13:08:41.682793 28208 heartbeater.cc:507] Master 127.20.130.126:34867 requested a full tablet report, sending...
I20260709 13:08:41.683507 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:41.683818 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:41.684029 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602521684009 us; error 0 us; skew 500 ppm
I20260709 13:08:41.684675 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:41.685160 28006 ts_manager.cc:194] Registered new tserver with Master: 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:41.686848 28006 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41776
I20260709 13:08:41.687321 21001 webserver.cc:533] Webserver started at http://127.20.130.67:42811/ using document root <none> and password file <none>
I20260709 13:08:41.687981 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:41.688215 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:41.688472 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:41.689625 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-2-root/instance:
uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-csvd"
I20260709 13:08:41.693885 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:08:41.697125 28219 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.697846 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:08:41.698135 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-2-root
uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-csvd"
I20260709 13:08:41.698462 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:41.731580 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:41.732837 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:41.734341 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:41.736630 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:41.736857 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.737085 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:41.737248 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.780616 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.67:41757
I20260709 13:08:41.780720 28281 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.67:41757 every 8 connection(s)
I20260709 13:08:41.785595 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:41.793246 28285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:41.794003 28286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:41.797297 28289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.797435 21001 server_base.cc:1061] running on GCE node
I20260709 13:08:41.797866 28282 heartbeater.cc:344] Connected to a master server at 127.20.130.126:34867
I20260709 13:08:41.798391 28282 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:41.798785 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:41.799108 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:41.799250 28282 heartbeater.cc:507] Master 127.20.130.126:34867 requested a full tablet report, sending...
I20260709 13:08:41.799289 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602521799271 us; error 0 us; skew 500 ppm
I20260709 13:08:41.800357 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:41.801817 28006 ts_manager.cc:194] Registered new tserver with Master: cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:41.803119 21001 webserver.cc:533] Webserver started at http://127.20.130.68:35743/ using document root <none> and password file <none>
I20260709 13:08:41.803503 28006 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41782
I20260709 13:08:41.803654 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:41.803983 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:41.804251 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:41.805528 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-3-root/instance:
uuid: "60d640828dc841619730621ec09d4c64"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-csvd"
I20260709 13:08:41.810003 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:08:41.813514 28293 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.814231 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:08:41.814543 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-3-root
uuid: "60d640828dc841619730621ec09d4c64"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-csvd"
I20260709 13:08:41.814863 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:41.831373 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:41.832674 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:41.834170 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:41.836599 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:41.836848 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.837083 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:41.837255 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.885303 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.68:46171
I20260709 13:08:41.885478 28355 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.68:46171 every 8 connection(s)
I20260709 13:08:41.903815 28356 heartbeater.cc:344] Connected to a master server at 127.20.130.126:34867
I20260709 13:08:41.904291 28356 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:41.905469 28356 heartbeater.cc:507] Master 127.20.130.126:34867 requested a full tablet report, sending...
I20260709 13:08:41.908203 28006 ts_manager.cc:194] Registered new tserver with Master: 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:41.909379 21001 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.018807858s
I20260709 13:08:41.910018 28006 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41792
I20260709 13:08:41.942683 28006 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41806:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:08:42.201267 28098 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6b2213d1624e8ab60743daffa01749 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:42.204026 28097 tablet_service.cc:1511] Processing CreateTablet for tablet ca0b8ae0f3f4484081fbdb57587fbac2 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:42.206552 28096 tablet_service.cc:1511] Processing CreateTablet for tablet 64545454d8c2457bb4b0837f80555b00 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:42.208299 28095 tablet_service.cc:1511] Processing CreateTablet for tablet 5f13ee4d444e404288a43a09599419be (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:42.209154 28094 tablet_service.cc:1511] Processing CreateTablet for tablet b4bbaf9dd8a447f6bc1e1feeceb3008d (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:42.202786 28098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6b2213d1624e8ab60743daffa01749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.210624 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bbaf9dd8a447f6bc1e1feeceb3008d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.211666 28093 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed08161191348c6ba309a4b9338bb75 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:42.213204 28093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed08161191348c6ba309a4b9338bb75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.213973 28095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f13ee4d444e404288a43a09599419be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.214803 28096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64545454d8c2457bb4b0837f80555b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.215577 28097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca0b8ae0f3f4484081fbdb57587fbac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.229390 28092 tablet_service.cc:1511] Processing CreateTablet for tablet f6fcb865684d406f879509172e8279ff (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:42.230994 28092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fcb865684d406f879509172e8279ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.236261 28091 tablet_service.cc:1511] Processing CreateTablet for tablet 846616843e7743a6a799541dd5ea10fd (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:42.237808 28091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846616843e7743a6a799541dd5ea10fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.240156 28090 tablet_service.cc:1511] Processing CreateTablet for tablet f8a4e5a2e05b4a11b13b756a9fcd11a5 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:42.241694 28090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8a4e5a2e05b4a11b13b756a9fcd11a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.244172 28089 tablet_service.cc:1511] Processing CreateTablet for tablet f0d5182347b142749bd1d50ce09224a8 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:42.245587 28089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d5182347b142749bd1d50ce09224a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.257203 28321 tablet_service.cc:1511] Processing CreateTablet for tablet ca0b8ae0f3f4484081fbdb57587fbac2 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:42.258728 28321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca0b8ae0f3f4484081fbdb57587fbac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.264137 28316 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac04c15a2dc474b8def84d7d597afe1 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:42.265817 28316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac04c15a2dc474b8def84d7d597afe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.268307 28315 tablet_service.cc:1511] Processing CreateTablet for tablet 846616843e7743a6a799541dd5ea10fd (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:42.271006 28314 tablet_service.cc:1511] Processing CreateTablet for tablet f8a4e5a2e05b4a11b13b756a9fcd11a5 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:42.273602 28313 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf28c2ae4fd4bcdbcc0ebcf6090342a (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:42.276139 28312 tablet_service.cc:1511] Processing CreateTablet for tablet a7aff2f54c384028a34db3b71d560967 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:42.277482 28094 tablet_service.cc:1511] Processing CreateTablet for tablet a7aff2f54c384028a34db3b71d560967 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:42.262431 28317 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed08161191348c6ba309a4b9338bb75 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:42.279278 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7aff2f54c384028a34db3b71d560967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.260625 28318 tablet_service.cc:1511] Processing CreateTablet for tablet b4bbaf9dd8a447f6bc1e1feeceb3008d (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:42.262130 28319 tablet_service.cc:1511] Processing CreateTablet for tablet d920220c89994ca1bd5a7d4fcc7c7e10 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:42.260185 28320 tablet_service.cc:1511] Processing CreateTablet for tablet 64545454d8c2457bb4b0837f80555b00 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:42.282538 28315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846616843e7743a6a799541dd5ea10fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.283394 28319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d920220c89994ca1bd5a7d4fcc7c7e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.286633 28320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64545454d8c2457bb4b0837f80555b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.287317 28314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8a4e5a2e05b4a11b13b756a9fcd11a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.290388 28317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed08161191348c6ba309a4b9338bb75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.291261 28312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7aff2f54c384028a34db3b71d560967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.291893 28313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf28c2ae4fd4bcdbcc0ebcf6090342a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.295477 28318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bbaf9dd8a447f6bc1e1feeceb3008d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.295949 28093 tablet_service.cc:1511] Processing CreateTablet for tablet 213cfac76ce044dea3c787992d09120a (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:42.297540 28093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213cfac76ce044dea3c787992d09120a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.314000 28096 tablet_service.cc:1511] Processing CreateTablet for tablet 6ccac4bb40d14b6ead1be9a53f6189cd (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:42.312326 28376 tablet_bootstrap.cc:492] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:42.315560 28096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ccac4bb40d14b6ead1be9a53f6189cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.316430 28247 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6b2213d1624e8ab60743daffa01749 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:42.317926 28247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6b2213d1624e8ab60743daffa01749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.319065 28243 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed08161191348c6ba309a4b9338bb75 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:42.320622 28243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed08161191348c6ba309a4b9338bb75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.320247 28246 tablet_service.cc:1511] Processing CreateTablet for tablet 64545454d8c2457bb4b0837f80555b00 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:42.321712 28246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64545454d8c2457bb4b0837f80555b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.321718 28094 tablet_service.cc:1511] Processing CreateTablet for tablet 311b4ef735894403b3e8fccbe834bd77 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:42.323801 28242 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac04c15a2dc474b8def84d7d597afe1 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:42.324208 28245 tablet_service.cc:1511] Processing CreateTablet for tablet d920220c89994ca1bd5a7d4fcc7c7e10 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:42.325343 28242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac04c15a2dc474b8def84d7d597afe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.326725 28244 tablet_service.cc:1511] Processing CreateTablet for tablet 5f13ee4d444e404288a43a09599419be (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:42.328336 28244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f13ee4d444e404288a43a09599419be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.324235 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311b4ef735894403b3e8fccbe834bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.331543 28245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d920220c89994ca1bd5a7d4fcc7c7e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.342911 28089 tablet_service.cc:1511] Processing CreateTablet for tablet 7b0c3ca5b68a47259dd1c2672f3e4b70 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:42.344394 28089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0c3ca5b68a47259dd1c2672f3e4b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.349709 28376 tablet_bootstrap.cc:654] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.351172 28091 tablet_service.cc:1511] Processing CreateTablet for tablet 819e4cfb61d7498f997e955c8d2cc490 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:42.356002 28091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819e4cfb61d7498f997e955c8d2cc490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.355500 28241 tablet_service.cc:1511] Processing CreateTablet for tablet f6fcb865684d406f879509172e8279ff (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:42.357244 28241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fcb865684d406f879509172e8279ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.365067 28240 tablet_service.cc:1511] Processing CreateTablet for tablet f8a4e5a2e05b4a11b13b756a9fcd11a5 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:42.366744 28240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8a4e5a2e05b4a11b13b756a9fcd11a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:42.372087 28054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:42.379199 28094 tablet_service.cc:1511] Processing CreateTablet for tablet 1112009449724fb880c6bfbb99c54b3a (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:42.380722 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1112009449724fb880c6bfbb99c54b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.386416 28239 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf28c2ae4fd4bcdbcc0ebcf6090342a (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:42.388262 28239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf28c2ae4fd4bcdbcc0ebcf6090342a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.397148 28238 tablet_service.cc:1511] Processing CreateTablet for tablet f0d5182347b142749bd1d50ce09224a8 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:42.398844 28238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d5182347b142749bd1d50ce09224a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.424368 28173 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6b2213d1624e8ab60743daffa01749 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:42.425832 28173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6b2213d1624e8ab60743daffa01749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.426173 28170 tablet_service.cc:1511] Processing CreateTablet for tablet 5f13ee4d444e404288a43a09599419be (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:42.427819 28170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f13ee4d444e404288a43a09599419be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.428160 28172 tablet_service.cc:1511] Processing CreateTablet for tablet ca0b8ae0f3f4484081fbdb57587fbac2 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:42.429597 28172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca0b8ae0f3f4484081fbdb57587fbac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.432225 28171 tablet_service.cc:1511] Processing CreateTablet for tablet d920220c89994ca1bd5a7d4fcc7c7e10 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:42.433712 28171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d920220c89994ca1bd5a7d4fcc7c7e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.436956 28169 tablet_service.cc:1511] Processing CreateTablet for tablet b4bbaf9dd8a447f6bc1e1feeceb3008d (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:42.438539 28169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bbaf9dd8a447f6bc1e1feeceb3008d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.438791 28378 tablet_bootstrap.cc:492] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:42.449424 28318 tablet_service.cc:1511] Processing CreateTablet for tablet 1112009449724fb880c6bfbb99c54b3a (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:42.451040 28318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1112009449724fb880c6bfbb99c54b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.459110 28168 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac04c15a2dc474b8def84d7d597afe1 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:42.460130 28378 tablet_bootstrap.cc:654] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.460855 28168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac04c15a2dc474b8def84d7d597afe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.523370 28379 tablet_bootstrap.cc:492] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:42.536381 28244 tablet_service.cc:1511] Processing CreateTablet for tablet 70fb7c326e6d4798b42697699d03ba70 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:42.543417 28245 tablet_service.cc:1511] Processing CreateTablet for tablet 213cfac76ce044dea3c787992d09120a (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:42.544545 28167 tablet_service.cc:1511] Processing CreateTablet for tablet f6fcb865684d406f879509172e8279ff (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:42.545321 28246 tablet_service.cc:1511] Processing CreateTablet for tablet 6ccac4bb40d14b6ead1be9a53f6189cd (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:42.546061 28167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fcb865684d406f879509172e8279ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.530710 28317 tablet_service.cc:1511] Processing CreateTablet for tablet 213cfac76ce044dea3c787992d09120a (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:42.552462 28317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213cfac76ce044dea3c787992d09120a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.552007 28313 tablet_service.cc:1511] Processing CreateTablet for tablet 70fb7c326e6d4798b42697699d03ba70 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:42.553572 28313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70fb7c326e6d4798b42697699d03ba70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.553359 28166 tablet_service.cc:1511] Processing CreateTablet for tablet 846616843e7743a6a799541dd5ea10fd (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:42.557132 28379 tablet_bootstrap.cc:654] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.557236 28097 tablet_service.cc:1511] Processing CreateTablet for tablet ddbdcf3655d24af7b91441e5b9029d33 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:42.565900 28244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70fb7c326e6d4798b42697699d03ba70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.568646 28247 tablet_service.cc:1511] Processing CreateTablet for tablet 7b0c3ca5b68a47259dd1c2672f3e4b70 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:42.570060 28247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0c3ca5b68a47259dd1c2672f3e4b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.571902 28166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846616843e7743a6a799541dd5ea10fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.559059 28097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddbdcf3655d24af7b91441e5b9029d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.580840 28098 tablet_service.cc:1511] Processing CreateTablet for tablet ef17503e5d4343a8a3bd382a33be8508 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:42.582159 28133 heartbeater.cc:499] Master 127.20.130.126:34867 was elected leader, sending a full tablet report...
I20260709 13:08:42.589751 28315 tablet_service.cc:1511] Processing CreateTablet for tablet 311b4ef735894403b3e8fccbe834bd77 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:42.591773 28245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213cfac76ce044dea3c787992d09120a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.592679 28246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ccac4bb40d14b6ead1be9a53f6189cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.601017 28244 tablet_service.cc:1511] Processing CreateTablet for tablet 3958573ac72b4113b6cb6ee2303db8f9 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:42.602483 28244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3958573ac72b4113b6cb6ee2303db8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.606204 28321 tablet_service.cc:1511] Processing CreateTablet for tablet 7b0c3ca5b68a47259dd1c2672f3e4b70 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:42.607707 28376 tablet_bootstrap.cc:492] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:42.608299 28319 tablet_service.cc:1511] Processing CreateTablet for tablet 3958573ac72b4113b6cb6ee2303db8f9 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:42.614279 28095 tablet_service.cc:1511] Processing CreateTablet for tablet 77c8f62c26f74f9e82cb8f53544e0b2c (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:42.615419 28098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef17503e5d4343a8a3bd382a33be8508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.620224 28173 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf28c2ae4fd4bcdbcc0ebcf6090342a (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:42.627590 28173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf28c2ae4fd4bcdbcc0ebcf6090342a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.621210 28165 tablet_service.cc:1511] Processing CreateTablet for tablet a7aff2f54c384028a34db3b71d560967 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:42.631892 28165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7aff2f54c384028a34db3b71d560967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.621795 28171 tablet_service.cc:1511] Processing CreateTablet for tablet f0d5182347b142749bd1d50ce09224a8 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:42.635608 28171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d5182347b142749bd1d50ce09224a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.639394 28314 tablet_service.cc:1511] Processing CreateTablet for tablet 77c8f62c26f74f9e82cb8f53544e0b2c (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:42.595269 28315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311b4ef735894403b3e8fccbe834bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.623032 28164 tablet_service.cc:1511] Processing CreateTablet for tablet 70fb7c326e6d4798b42697699d03ba70 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:42.643270 28319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3958573ac72b4113b6cb6ee2303db8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.643926 28164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70fb7c326e6d4798b42697699d03ba70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.646955 28243 tablet_service.cc:1511] Processing CreateTablet for tablet ddbdcf3655d24af7b91441e5b9029d33 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:42.648331 28243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddbdcf3655d24af7b91441e5b9029d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.624068 28318 tablet_service.cc:1511] Processing CreateTablet for tablet 483dc2ac5ecf492087dcef4c6fa1770c (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:42.625540 28376 ts_tablet_manager.cc:1403] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.314s	user 0.059s	sys 0.036s
I20260709 13:08:42.618736 28320 tablet_service.cc:1511] Processing CreateTablet for tablet ddbdcf3655d24af7b91441e5b9029d33 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:42.660255 28095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c8f62c26f74f9e82cb8f53544e0b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.665845 28376 raft_consensus.cc:359] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:42.666646 28376 raft_consensus.cc:385] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.672039 28239 tablet_service.cc:1511] Processing CreateTablet for tablet 483dc2ac5ecf492087dcef4c6fa1770c (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:42.657320 28314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c8f62c26f74f9e82cb8f53544e0b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.683225 28318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 483dc2ac5ecf492087dcef4c6fa1770c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.684168 28242 tablet_service.cc:1511] Processing CreateTablet for tablet ef17503e5d4343a8a3bd382a33be8508 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:42.687340 28379 tablet_bootstrap.cc:492] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:42.687834 28379 ts_tablet_manager.cc:1403] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.165s	user 0.025s	sys 0.025s
I20260709 13:08:42.689410 28208 heartbeater.cc:499] Master 127.20.130.126:34867 was elected leader, sending a full tablet report...
I20260709 13:08:42.685320 28239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 483dc2ac5ecf492087dcef4c6fa1770c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.670444 28170 tablet_service.cc:1511] Processing CreateTablet for tablet ef17503e5d4343a8a3bd382a33be8508 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:42.694716 28242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef17503e5d4343a8a3bd382a33be8508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.695349 28320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddbdcf3655d24af7b91441e5b9029d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.699250 28321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0c3ca5b68a47259dd1c2672f3e4b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.676728 28376 raft_consensus.cc:740] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.637571 28240 tablet_service.cc:1511] Processing CreateTablet for tablet 819e4cfb61d7498f997e955c8d2cc490 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:42.707346 28240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819e4cfb61d7498f997e955c8d2cc490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.716185 28379 raft_consensus.cc:359] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:42.717020 28379 raft_consensus.cc:385] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.717401 28379 raft_consensus.cc:740] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.718359 28379 consensus_queue.cc:260] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:42.723511 28376 consensus_queue.cc:260] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:42.725315 28170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef17503e5d4343a8a3bd382a33be8508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.742753 28317 tablet_service.cc:1511] Processing CreateTablet for tablet ef7f29ee868b4774be667c0c3791aa0d (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:42.744179 28317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7f29ee868b4774be667c0c3791aa0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.750178 28378 tablet_bootstrap.cc:492] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:42.753031 28378 ts_tablet_manager.cc:1403] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.315s	user 0.016s	sys 0.025s
I20260709 13:08:42.763533 28245 tablet_service.cc:1511] Processing CreateTablet for tablet ef7f29ee868b4774be667c0c3791aa0d (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:42.765702 28245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7f29ee868b4774be667c0c3791aa0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.766593 28166 tablet_service.cc:1511] Processing CreateTablet for tablet 3958573ac72b4113b6cb6ee2303db8f9 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:42.767944 28166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3958573ac72b4113b6cb6ee2303db8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.767674 28378 raft_consensus.cc:359] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:42.768460 28378 raft_consensus.cc:385] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.768782 28378 raft_consensus.cc:740] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.760008 28376 ts_tablet_manager.cc:1434] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.104s	user 0.001s	sys 0.008s
I20260709 13:08:42.774677 28376 tablet_bootstrap.cc:492] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:42.780093 28167 tablet_service.cc:1511] Processing CreateTablet for tablet 311b4ef735894403b3e8fccbe834bd77 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:42.781494 28167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311b4ef735894403b3e8fccbe834bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.784855 28166 tablet_service.cc:1511] Processing CreateTablet for tablet 1112009449724fb880c6bfbb99c54b3a (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:42.786201 28166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1112009449724fb880c6bfbb99c54b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.789812 28168 tablet_service.cc:1511] Processing CreateTablet for tablet 483dc2ac5ecf492087dcef4c6fa1770c (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:42.792325 28172 tablet_service.cc:1511] Processing CreateTablet for tablet 6ccac4bb40d14b6ead1be9a53f6189cd (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:42.752290 28381 tablet_bootstrap.cc:492] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:42.793337 28240 tablet_service.cc:1511] Processing CreateTablet for tablet 35580b937e5c492e9ad0e2bcaa176e96 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:42.794166 28378 consensus_queue.cc:260] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:42.795429 28165 tablet_service.cc:1511] Processing CreateTablet for tablet 819e4cfb61d7498f997e955c8d2cc490 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:42.801793 28376 tablet_bootstrap.cc:654] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.801445 28094 tablet_service.cc:1511] Processing CreateTablet for tablet ef7f29ee868b4774be667c0c3791aa0d (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
W20260709 13:08:42.805485 28134 tablet.cc:2406] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:08:42.823608 28240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35580b937e5c492e9ad0e2bcaa176e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.806124 28282 heartbeater.cc:499] Master 127.20.130.126:34867 was elected leader, sending a full tablet report...
I20260709 13:08:42.824281 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7f29ee868b4774be667c0c3791aa0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.806042 28166 tablet_service.cc:1511] Processing CreateTablet for tablet 77c8f62c26f74f9e82cb8f53544e0b2c (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:42.807968 28091 tablet_service.cc:1511] Processing CreateTablet for tablet b594683784854e99994376f255918d99 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:42.827839 28091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b594683784854e99994376f255918d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.813516 28169 tablet_service.cc:1511] Processing CreateTablet for tablet 35580b937e5c492e9ad0e2bcaa176e96 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:42.811838 28316 tablet_service.cc:1511] Processing CreateTablet for tablet 35580b937e5c492e9ad0e2bcaa176e96 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:42.844550 28316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35580b937e5c492e9ad0e2bcaa176e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.856827 28383 raft_consensus.cc:493] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.857578 28383 raft_consensus.cc:515] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:42.879621 28167 tablet_service.cc:1511] Processing CreateTablet for tablet b594683784854e99994376f255918d99 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:42.882562 28381 tablet_bootstrap.cc:654] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.890694 28098 tablet_service.cc:1511] Processing CreateTablet for tablet 54d36af7735d4ca5bd3119a4f8411e18 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:42.892894 28098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d36af7735d4ca5bd3119a4f8411e18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.898604 28240 tablet_service.cc:1511] Processing CreateTablet for tablet b594683784854e99994376f255918d99 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:42.901244 28240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b594683784854e99994376f255918d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.902422 28168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 483dc2ac5ecf492087dcef4c6fa1770c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.908246 28171 tablet_service.cc:1511] Processing CreateTablet for tablet 54d36af7735d4ca5bd3119a4f8411e18 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:42.908293 28169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35580b937e5c492e9ad0e2bcaa176e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.913136 28166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c8f62c26f74f9e82cb8f53544e0b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.913642 28356 heartbeater.cc:499] Master 127.20.130.126:34867 was elected leader, sending a full tablet report...
I20260709 13:08:42.914336 28172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ccac4bb40d14b6ead1be9a53f6189cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.915493 28383 leader_election.cc:290] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:42.929487 28171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d36af7735d4ca5bd3119a4f8411e18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.888715 28317 tablet_service.cc:1511] Processing CreateTablet for tablet 54d36af7735d4ca5bd3119a4f8411e18 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:42.934306 28244 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec0b05c6a554a24a2576d6308dd6861 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:42.971738 28376 tablet_bootstrap.cc:492] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:42.972321 28376 ts_tablet_manager.cc:1403] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.198s	user 0.038s	sys 0.034s
I20260709 13:08:42.968722 28165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819e4cfb61d7498f997e955c8d2cc490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.979408 28379 ts_tablet_manager.cc:1434] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.291s	user 0.026s	sys 0.036s
I20260709 13:08:42.980254 28167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b594683784854e99994376f255918d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.980645 28379 tablet_bootstrap.cc:492] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:42.987164 28376 raft_consensus.cc:359] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:42.988097 28376 raft_consensus.cc:385] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.988413 28376 raft_consensus.cc:740] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.989311 28170 tablet_service.cc:1511] Processing CreateTablet for tablet 44fffb1e4048464bbca5a6415161d48c (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:42.989095 28238 tablet_service.cc:1511] Processing CreateTablet for tablet 44fffb1e4048464bbca5a6415161d48c (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:42.990803 28238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fffb1e4048464bbca5a6415161d48c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.992368 28321 tablet_service.cc:1511] Processing CreateTablet for tablet 44fffb1e4048464bbca5a6415161d48c (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:42.990803 28170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fffb1e4048464bbca5a6415161d48c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.001201 28173 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4a4fa897ce40ed86eb46b892297b2c (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:43.003509 28384 raft_consensus.cc:493] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.003882 28314 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec0b05c6a554a24a2576d6308dd6861 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:43.004124 28384 raft_consensus.cc:515] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:43.006081 28173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4a4fa897ce40ed86eb46b892297b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.006654 28246 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4a4fa897ce40ed86eb46b892297b2c (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:43.010203 28317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d36af7735d4ca5bd3119a4f8411e18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.022563 28384 leader_election.cc:290] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:43.033082 28378 ts_tablet_manager.cc:1434] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.273s	user 0.023s	sys 0.007s
I20260709 13:08:43.034988 28315 tablet_service.cc:1511] Processing CreateTablet for tablet 9d3cddbcf51c4690badc33c2cd58e0aa (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:43.051887 28164 tablet_service.cc:1511] Processing CreateTablet for tablet 9d3cddbcf51c4690badc33c2cd58e0aa (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:43.053208 28164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d3cddbcf51c4690badc33c2cd58e0aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.055864 28320 tablet_service.cc:1511] Processing CreateTablet for tablet 9c25595e441a47e5bb6f0f694cb3eed9 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:42.989169 28376 consensus_queue.cc:260] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:43.059737 28378 tablet_bootstrap.cc:492] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:43.065016 28376 ts_tablet_manager.cc:1434] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.000s
I20260709 13:08:43.073626 28246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4a4fa897ce40ed86eb46b892297b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.074766 28244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec0b05c6a554a24a2576d6308dd6861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.093415 28376 tablet_bootstrap.cc:492] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:43.102145 28094 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec0b05c6a554a24a2576d6308dd6861 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:43.107667 28381 tablet_bootstrap.cc:492] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:43.099283 28314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec0b05c6a554a24a2576d6308dd6861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.112268 28381 ts_tablet_manager.cc:1403] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.374s	user 0.015s	sys 0.017s
I20260709 13:08:43.114578 28095 tablet_service.cc:1511] Processing CreateTablet for tablet 9d3cddbcf51c4690badc33c2cd58e0aa (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:43.128289 28384 raft_consensus.cc:493] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.128772 28097 tablet_service.cc:1511] Processing CreateTablet for tablet 9c25595e441a47e5bb6f0f694cb3eed9 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:43.128970 28384 raft_consensus.cc:515] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:43.120188 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec0b05c6a554a24a2576d6308dd6861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.138515 28089 tablet_service.cc:1511] Processing CreateTablet for tablet 7d2012efcebb4e8d9dc7839fdb5927fb (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:43.139731 28315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d3cddbcf51c4690badc33c2cd58e0aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.142083 28172 tablet_service.cc:1511] Processing CreateTablet for tablet e4e2fa350a754b899e6ce07a88e62ba5 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:43.134857 28243 tablet_service.cc:1511] Processing CreateTablet for tablet e4e2fa350a754b899e6ce07a88e62ba5 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:43.144153 28243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4e2fa350a754b899e6ce07a88e62ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.144974 28321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fffb1e4048464bbca5a6415161d48c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.156288 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f13ee4d444e404288a43a09599419be" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:43.145236 28385 raft_consensus.cc:493] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.157793 28385 raft_consensus.cc:515] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:43.161258 28379 tablet_bootstrap.cc:654] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.128283 28313 tablet_service.cc:1511] Processing CreateTablet for tablet e4e2fa350a754b899e6ce07a88e62ba5 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 13:08:43.168072 28223 leader_election.cc:343] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:43.148075 28091 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4a4fa897ce40ed86eb46b892297b2c (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:43.151594 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f13ee4d444e404288a43a09599419be" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:43.155097 28172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4e2fa350a754b899e6ce07a88e62ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.155483 28384 leader_election.cc:290] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:43.179733 28245 tablet_service.cc:1511] Processing CreateTablet for tablet 9c25595e441a47e5bb6f0f694cb3eed9 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:43.182969 28089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2012efcebb4e8d9dc7839fdb5927fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:43.172454 28221 leader_election.cc:343] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:43.190454 28313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4e2fa350a754b899e6ce07a88e62ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.191192 28245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c25595e441a47e5bb6f0f694cb3eed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.197175 28221 leader_election.cc:304] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:43.198261 28378 tablet_bootstrap.cc:654] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.198328 28387 raft_consensus.cc:2749] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:43.209978 28385 leader_election.cc:290] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:43.212126 28381 raft_consensus.cc:359] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:43.213119 28381 raft_consensus.cc:385] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.213527 28381 raft_consensus.cc:740] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.214643 28381 consensus_queue.cc:260] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:43.223510 28320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c25595e441a47e5bb6f0f694cb3eed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.235275 28097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c25595e441a47e5bb6f0f694cb3eed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.281821 28164 tablet_service.cc:1511] Processing CreateTablet for tablet 7d2012efcebb4e8d9dc7839fdb5927fb (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:43.283244 28164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2012efcebb4e8d9dc7839fdb5927fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.284379 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bbaf9dd8a447f6bc1e1feeceb3008d" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:43.288147 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64545454d8c2457bb4b0837f80555b00" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:43.289229 28240 tablet_service.cc:1511] Processing CreateTablet for tablet 7d2012efcebb4e8d9dc7839fdb5927fb (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:43.290551 28240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2012efcebb4e8d9dc7839fdb5927fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:43.291499 28074 leader_election.cc:343] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:43.292256 28074 leader_election.cc:343] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:43.305438 28098 tablet_service.cc:1511] Processing CreateTablet for tablet 337d2a0753f34dd08c1b1eb5e708d7ff (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:43.308287 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bbaf9dd8a447f6bc1e1feeceb3008d" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:43.309105 28108 raft_consensus.cc:2468] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:43.311347 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64545454d8c2457bb4b0837f80555b00" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:43.312294 28295 leader_election.cc:304] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 
I20260709 13:08:43.313186 28385 raft_consensus.cc:2804] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:43.313206 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bbaf9dd8a447f6bc1e1feeceb3008d" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:43.313647 28385 raft_consensus.cc:493] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.314231 28385 raft_consensus.cc:3060] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:43.313611 28072 leader_election.cc:343] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:43.315198 28072 leader_election.cc:304] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:43.316512 28384 raft_consensus.cc:2749] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:43.317663 28316 tablet_service.cc:1511] Processing CreateTablet for tablet 337d2a0753f34dd08c1b1eb5e708d7ff (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:43.296593 28095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d3cddbcf51c4690badc33c2cd58e0aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.324784 28316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337d2a0753f34dd08c1b1eb5e708d7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.326242 28166 tablet_service.cc:1511] Processing CreateTablet for tablet 337d2a0753f34dd08c1b1eb5e708d7ff (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:43.327586 28166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337d2a0753f34dd08c1b1eb5e708d7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.336841 28378 tablet_bootstrap.cc:492] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:43.337446 28378 ts_tablet_manager.cc:1403] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.278s	user 0.024s	sys 0.009s
I20260709 13:08:43.340960 28098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337d2a0753f34dd08c1b1eb5e708d7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.344509 28381 ts_tablet_manager.cc:1434] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.224s	user 0.011s	sys 0.011s
I20260709 13:08:43.346191 28381 tablet_bootstrap.cc:492] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:43.347815 28091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4a4fa897ce40ed86eb46b892297b2c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:43.376049 28054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:43.377664 28244 tablet_service.cc:1511] Processing CreateTablet for tablet 87613dbe33ad4d7da42e38250a2d9c5e (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:43.379153 28244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87613dbe33ad4d7da42e38250a2d9c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.380785 28385 raft_consensus.cc:515] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:43.378082 28379 tablet_bootstrap.cc:492] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:43.381984 28379 ts_tablet_manager.cc:1403] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.402s	user 0.027s	sys 0.035s
I20260709 13:08:43.382262 28330 raft_consensus.cc:2393] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d2bb5df3b55462682d0f2fce57709f1 in current term 1: Already voted for candidate 60d640828dc841619730621ec09d4c64 in this term.
I20260709 13:08:43.386229 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bbaf9dd8a447f6bc1e1feeceb3008d" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:43.386879 28108 raft_consensus.cc:3060] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.389603 28379 raft_consensus.cc:359] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:43.391619 28072 leader_election.cc:304] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:43.391726 28379 raft_consensus.cc:385] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.394462 28379 raft_consensus.cc:740] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.395143 28402 raft_consensus.cc:493] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.392086 28376 tablet_bootstrap.cc:654] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.399519 28379 consensus_queue.cc:260] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:43.404024 28379 ts_tablet_manager.cc:1434] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.006s
I20260709 13:08:43.406247 28108 raft_consensus.cc:2468] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:43.409580 28384 raft_consensus.cc:2749] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:43.411123 28295 leader_election.cc:304] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 
I20260709 13:08:43.407527 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bbaf9dd8a447f6bc1e1feeceb3008d" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:43.408342 28385 leader_election.cc:290] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:43.408689 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bbaf9dd8a447f6bc1e1feeceb3008d" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:43.411712 28381 tablet_bootstrap.cc:654] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.395885 28402 raft_consensus.cc:515] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:43.415272 28314 tablet_service.cc:1511] Processing CreateTablet for tablet 87613dbe33ad4d7da42e38250a2d9c5e (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:43.420099 28314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87613dbe33ad4d7da42e38250a2d9c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.421510 28402 leader_election.cc:290] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:43.423074 28385 raft_consensus.cc:2804] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:43.430586 28093 tablet_service.cc:1511] Processing CreateTablet for tablet 87613dbe33ad4d7da42e38250a2d9c5e (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:43.432049 28093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87613dbe33ad4d7da42e38250a2d9c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.437566 28172 tablet_service.cc:1511] Processing CreateTablet for tablet 18c5064efb8c493c8abc76212d9eaf59 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:43.439014 28172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c5064efb8c493c8abc76212d9eaf59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.439867 28379 tablet_bootstrap.cc:492] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:43.449609 28317 tablet_service.cc:1511] Processing CreateTablet for tablet 18c5064efb8c493c8abc76212d9eaf59 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:43.452316 28317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c5064efb8c493c8abc76212d9eaf59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.461728 28378 raft_consensus.cc:359] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:43.471719 28165 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff6fe3b72cb46e6bbdbea8e0f38cba7 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:43.473335 28165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff6fe3b72cb46e6bbdbea8e0f38cba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.473589 28245 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff6fe3b72cb46e6bbdbea8e0f38cba7 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:43.474835 28245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff6fe3b72cb46e6bbdbea8e0f38cba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.475318 28094 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff6fe3b72cb46e6bbdbea8e0f38cba7 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:43.476591 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff6fe3b72cb46e6bbdbea8e0f38cba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.478730 28379 tablet_bootstrap.cc:654] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.467914 28378 raft_consensus.cc:385] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.493227 28240 tablet_service.cc:1511] Processing CreateTablet for tablet 18c5064efb8c493c8abc76212d9eaf59 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:43.495343 28316 tablet_service.cc:1511] Processing CreateTablet for tablet 7084d0da22fc408c861229f3e9cbdb94 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:43.496922 28091 tablet_service.cc:1511] Processing CreateTablet for tablet 7084d0da22fc408c861229f3e9cbdb94 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:43.516209 28316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7084d0da22fc408c861229f3e9cbdb94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.508514 28385 raft_consensus.cc:697] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:43.518793 28166 tablet_service.cc:1511] Processing CreateTablet for tablet 7084d0da22fc408c861229f3e9cbdb94 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:43.520740 28166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7084d0da22fc408c861229f3e9cbdb94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.520790 28245 tablet_service.cc:1511] Processing CreateTablet for tablet 452dc71d60db4a3f9c0b98d246bfc818 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:43.522281 28091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7084d0da22fc408c861229f3e9cbdb94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.524096 28320 tablet_service.cc:1511] Processing CreateTablet for tablet 452dc71d60db4a3f9c0b98d246bfc818 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:43.525965 28320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452dc71d60db4a3f9c0b98d246bfc818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.508967 28378 raft_consensus.cc:740] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.524145 28240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c5064efb8c493c8abc76212d9eaf59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.528986 28245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452dc71d60db4a3f9c0b98d246bfc818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.518986 28385 consensus_queue.cc:237] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
W20260709 13:08:43.546794 28297 leader_election.cc:343] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:43.548681 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0b8ae0f3f4484081fbdb57587fbac2" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:43.527616 28378 consensus_queue.cc:260] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
W20260709 13:08:43.555068 28147 leader_election.cc:343] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:43.556169 28378 ts_tablet_manager.cc:1434] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.218s	user 0.007s	sys 0.003s
I20260709 13:08:43.557462 28378 tablet_bootstrap.cc:492] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:43.559188 28095 tablet_service.cc:1511] Processing CreateTablet for tablet 452dc71d60db4a3f9c0b98d246bfc818 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:43.561498 28164 tablet_service.cc:1511] Processing CreateTablet for tablet 2b08edfd918443739d94d5586ac7a46b (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:43.568305 28164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b08edfd918443739d94d5586ac7a46b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.569275 28095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452dc71d60db4a3f9c0b98d246bfc818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.563966 28313 tablet_service.cc:1511] Processing CreateTablet for tablet 2b08edfd918443739d94d5586ac7a46b (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:43.571712 28313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b08edfd918443739d94d5586ac7a46b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.576649 28381 tablet_bootstrap.cc:492] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:43.563958 28244 tablet_service.cc:1511] Processing CreateTablet for tablet 2b08edfd918443739d94d5586ac7a46b (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:43.582371 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0b8ae0f3f4484081fbdb57587fbac2" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
W20260709 13:08:43.584087 28147 leader_election.cc:343] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:43.584651 28147 leader_election.cc:304] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:43.585574 28404 raft_consensus.cc:2749] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:43.588219 28376 tablet_bootstrap.cc:492] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:43.588800 28376 ts_tablet_manager.cc:1403] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.523s	user 0.036s	sys 0.012s
I20260709 13:08:43.590233 28098 tablet_service.cc:1511] Processing CreateTablet for tablet 8ddfe000e4a34d3e988447d289961873 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:43.591034 28172 tablet_service.cc:1511] Processing CreateTablet for tablet 8ddfe000e4a34d3e988447d289961873 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:43.591677 28098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ddfe000e4a34d3e988447d289961873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.580157 28381 ts_tablet_manager.cc:1403] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.234s	user 0.019s	sys 0.031s
I20260709 13:08:43.592327 28172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ddfe000e4a34d3e988447d289961873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.595527 28244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b08edfd918443739d94d5586ac7a46b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.588235 28003 catalog_manager.cc:5697] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.598178 28387 raft_consensus.cc:493] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.598768 28387 raft_consensus.cc:515] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:43.601512 28387 leader_election.cc:290] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:43.605706 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64545454d8c2457bb4b0837f80555b00" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:43.606403 28108 raft_consensus.cc:2468] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:43.606957 28376 raft_consensus.cc:359] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:43.605751 28381 raft_consensus.cc:359] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:43.607795 28376 raft_consensus.cc:385] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.607918 28381 raft_consensus.cc:385] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.608181 28376 raft_consensus.cc:740] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.609398 28221 leader_election.cc:304] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:43.610329 28387 raft_consensus.cc:2804] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:43.610687 28387 raft_consensus.cc:493] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.611043 28387 raft_consensus.cc:3060] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.613404 28378 tablet_bootstrap.cc:654] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.608318 28381 raft_consensus.cc:740] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.609200 28376 consensus_queue.cc:260] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:43.615368 28381 consensus_queue.cc:260] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:43.619637 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64545454d8c2457bb4b0837f80555b00" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
W20260709 13:08:43.621137 28221 leader_election.cc:343] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:43.622642 28376 ts_tablet_manager.cc:1434] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:08:43.623739 28376 tablet_bootstrap.cc:492] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:43.626653 28317 tablet_service.cc:1511] Processing CreateTablet for tablet 8778ebb28d774473bbe1042cbb1c6721 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:43.628041 28317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8778ebb28d774473bbe1042cbb1c6721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.636981 28376 tablet_bootstrap.cc:654] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.640828 28381 ts_tablet_manager.cc:1434] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:08:43.642334 28381 tablet_bootstrap.cc:492] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:43.663319 28245 tablet_service.cc:1511] Processing CreateTablet for tablet 8ddfe000e4a34d3e988447d289961873 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:43.665248 28245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ddfe000e4a34d3e988447d289961873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.679494 28094 tablet_service.cc:1511] Processing CreateTablet for tablet 8778ebb28d774473bbe1042cbb1c6721 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:43.680858 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8778ebb28d774473bbe1042cbb1c6721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.687891 28172 tablet_service.cc:1511] Processing CreateTablet for tablet 8778ebb28d774473bbe1042cbb1c6721 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:43.689173 28172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8778ebb28d774473bbe1042cbb1c6721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.695802 28379 tablet_bootstrap.cc:492] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:43.696338 28379 ts_tablet_manager.cc:1403] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.257s	user 0.027s	sys 0.026s
I20260709 13:08:43.692196 28404 raft_consensus.cc:493] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.698323 28404 raft_consensus.cc:515] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:43.700179 28379 raft_consensus.cc:359] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:43.700868 28404 leader_election.cc:290] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:43.701102 28379 raft_consensus.cc:385] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.701467 28379 raft_consensus.cc:740] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.702293 28379 consensus_queue.cc:260] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:43.707110 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d920220c89994ca1bd5a7d4fcc7c7e10" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:43.708057 28381 tablet_bootstrap.cc:654] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:43.708637 28147 leader_election.cc:343] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:43.712127 28387 raft_consensus.cc:515] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:43.717273 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64545454d8c2457bb4b0837f80555b00" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
W20260709 13:08:43.718742 28221 leader_election.cc:343] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:43.720321 28387 leader_election.cc:290] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:43.722648 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d920220c89994ca1bd5a7d4fcc7c7e10" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:43.720656 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64545454d8c2457bb4b0837f80555b00" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:43.724283 28257 raft_consensus.cc:2468] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
I20260709 13:08:43.727937 28149 leader_election.cc:304] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 60d640828dc841619730621ec09d4c64
I20260709 13:08:43.728477 28313 tablet_service.cc:1511] Processing CreateTablet for tablet 21657d67f652457cb8eef62fd181935f (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:43.729691 28404 raft_consensus.cc:2804] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:43.730291 28404 raft_consensus.cc:493] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.730769 28404 raft_consensus.cc:3060] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.735050 28108 raft_consensus.cc:3060] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.729882 28313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21657d67f652457cb8eef62fd181935f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.754068 28240 tablet_service.cc:1511] Processing CreateTablet for tablet 21657d67f652457cb8eef62fd181935f (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:43.761478 28378 tablet_bootstrap.cc:492] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:43.750756 28108 raft_consensus.cc:2468] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:43.762048 28378 ts_tablet_manager.cc:1403] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.205s	user 0.011s	sys 0.007s
I20260709 13:08:43.759879 28240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21657d67f652457cb8eef62fd181935f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.766782 28221 leader_election.cc:304] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 60d640828dc841619730621ec09d4c64
I20260709 13:08:43.767935 28387 raft_consensus.cc:2804] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:43.768167 28379 ts_tablet_manager.cc:1434] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.072s	user 0.014s	sys 0.017s
I20260709 13:08:43.769804 28379 tablet_bootstrap.cc:492] T 5e6b2213d1624e8ab60743daffa01749 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:43.768765 28387 raft_consensus.cc:697] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:43.772076 28387 consensus_queue.cc:237] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:43.773073 28378 raft_consensus.cc:359] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:43.773805 28378 raft_consensus.cc:385] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.770059 28098 tablet_service.cc:1511] Processing CreateTablet for tablet 21657d67f652457cb8eef62fd181935f (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:43.775337 28098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21657d67f652457cb8eef62fd181935f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.778941 28378 raft_consensus.cc:740] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.780153 28378 consensus_queue.cc:260] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:43.795559 28166 tablet_service.cc:1511] Processing CreateTablet for tablet 0ebe992abe014550bcd49e684e26c59f (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:43.797520 28166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ebe992abe014550bcd49e684e26c59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.796995 28404 raft_consensus.cc:515] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:43.799700 28404 leader_election.cc:290] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:43.800536 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d920220c89994ca1bd5a7d4fcc7c7e10" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:43.801174 28257 raft_consensus.cc:3060] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.801031 28317 tablet_service.cc:1511] Processing CreateTablet for tablet 0ebe992abe014550bcd49e684e26c59f (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:43.805720 28245 tablet_service.cc:1511] Processing CreateTablet for tablet 0ebe992abe014550bcd49e684e26c59f (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:43.807183 28317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ebe992abe014550bcd49e684e26c59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.808952 28378 ts_tablet_manager.cc:1434] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.004s
I20260709 13:08:43.809804 28245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ebe992abe014550bcd49e684e26c59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.814141 28094 tablet_service.cc:1511] Processing CreateTablet for tablet e60c507c906b4393aac2708e46f9bade (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:43.815436 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60c507c906b4393aac2708e46f9bade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.817297 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d920220c89994ca1bd5a7d4fcc7c7e10" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
W20260709 13:08:43.818790 28147 leader_election.cc:343] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:43.820052 28378 tablet_bootstrap.cc:492] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:43.823012 28379 tablet_bootstrap.cc:654] T 5e6b2213d1624e8ab60743daffa01749 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.831354 28376 tablet_bootstrap.cc:492] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:43.831586 28378 tablet_bootstrap.cc:654] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.830881 28006 catalog_manager.cc:5697] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 1 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.832034 28376 ts_tablet_manager.cc:1403] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.209s	user 0.023s	sys 0.018s
I20260709 13:08:43.846031 28376 raft_consensus.cc:359] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:43.830907 28257 raft_consensus.cc:2468] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:43.836896 28385 raft_consensus.cc:493] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.849015 28172 tablet_service.cc:1511] Processing CreateTablet for tablet e60c507c906b4393aac2708e46f9bade (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:43.849361 28149 leader_election.cc:304] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 60d640828dc841619730621ec09d4c64
I20260709 13:08:43.849985 28376 raft_consensus.cc:385] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.849185 28385 raft_consensus.cc:515] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:43.850406 28172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60c507c906b4393aac2708e46f9bade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.850608 28404 raft_consensus.cc:2804] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:43.851382 28404 raft_consensus.cc:697] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:43.852216 28404 consensus_queue.cc:237] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:43.852896 28381 tablet_bootstrap.cc:492] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:43.853451 28381 ts_tablet_manager.cc:1403] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.211s	user 0.012s	sys 0.035s
I20260709 13:08:43.850262 28244 tablet_service.cc:1511] Processing CreateTablet for tablet e60c507c906b4393aac2708e46f9bade (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:43.856385 28244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60c507c906b4393aac2708e46f9bade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.856637 28381 raft_consensus.cc:359] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:43.857369 28381 raft_consensus.cc:385] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.857645 28381 raft_consensus.cc:740] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.857779 28385 leader_election.cc:290] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:43.850395 28376 raft_consensus.cc:740] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.859920 28376 consensus_queue.cc:260] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:43.864163 28381 consensus_queue.cc:260] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:43.866103 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf28c2ae4fd4bcdbcc0ebcf6090342a" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:43.873646 28320 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec1905dc240442ab4df69ac1951ce28 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:08:43.875976 28297 leader_election.cc:343] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:43.879511 28376 ts_tablet_manager.cc:1434] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 13:08:43.883822 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf28c2ae4fd4bcdbcc0ebcf6090342a" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:43.885102 28376 tablet_bootstrap.cc:492] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
W20260709 13:08:43.886294 28297 leader_election.cc:343] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:43.891299 28297 leader_election.cc:304] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:43.876186 28320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec1905dc240442ab4df69ac1951ce28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.897396 28094 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec1905dc240442ab4df69ac1951ce28 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:43.897831 28381 ts_tablet_manager.cc:1434] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.002s
I20260709 13:08:43.896327 28385 raft_consensus.cc:2749] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:43.898770 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec1905dc240442ab4df69ac1951ce28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.899071 28381 tablet_bootstrap.cc:492] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:43.915310 28378 tablet_bootstrap.cc:492] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:43.915975 28378 ts_tablet_manager.cc:1403] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.010s
I20260709 13:08:43.915818 28098 tablet_service.cc:1511] Processing CreateTablet for tablet f776edf45fe042b994923a680048889b (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:43.917176 28098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f776edf45fe042b994923a680048889b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.917927 28164 tablet_service.cc:1511] Processing CreateTablet for tablet 09d32680280443ecb859c6deb72a5cc3 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:43.920923 28378 raft_consensus.cc:359] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:43.921670 28378 raft_consensus.cc:385] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.921985 28378 raft_consensus.cc:740] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.921846 28313 tablet_service.cc:1511] Processing CreateTablet for tablet f776edf45fe042b994923a680048889b (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:43.903020 28166 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec1905dc240442ab4df69ac1951ce28 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:43.923215 28313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f776edf45fe042b994923a680048889b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.922816 28378 consensus_queue.cc:260] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:43.923753 28166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec1905dc240442ab4df69ac1951ce28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.927078 28244 tablet_service.cc:1511] Processing CreateTablet for tablet 09d32680280443ecb859c6deb72a5cc3 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:43.927999 28240 tablet_service.cc:1511] Processing CreateTablet for tablet f776edf45fe042b994923a680048889b (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:43.928382 28244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09d32680280443ecb859c6deb72a5cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.929373 28240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f776edf45fe042b994923a680048889b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.931232 28164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09d32680280443ecb859c6deb72a5cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.931253 28378 ts_tablet_manager.cc:1434] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:08:43.935295 28378 tablet_bootstrap.cc:492] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:43.951453 28378 tablet_bootstrap.cc:654] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.960135 28005 catalog_manager.cc:5697] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.962446 28094 tablet_service.cc:1511] Processing CreateTablet for tablet c9ea6103de0047339ed0e7e5d460ee53 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:43.963768 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ea6103de0047339ed0e7e5d460ee53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.965605 28317 tablet_service.cc:1511] Processing CreateTablet for tablet 09d32680280443ecb859c6deb72a5cc3 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:43.966912 28317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09d32680280443ecb859c6deb72a5cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:43.968675 28379 tablet_bootstrap.cc:492] T 5e6b2213d1624e8ab60743daffa01749 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:43.969342 28379 ts_tablet_manager.cc:1403] T 5e6b2213d1624e8ab60743daffa01749 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.200s	user 0.014s	sys 0.018s
I20260709 13:08:43.972432 28379 raft_consensus.cc:359] T 5e6b2213d1624e8ab60743daffa01749 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:43.973820 28379 raft_consensus.cc:385] T 5e6b2213d1624e8ab60743daffa01749 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.973994 28381 tablet_bootstrap.cc:654] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.973738 28385 consensus_queue.cc:1048] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:43.974359 28379 raft_consensus.cc:740] T 5e6b2213d1624e8ab60743daffa01749 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.978049 28378 tablet_bootstrap.cc:492] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:43.978603 28378 ts_tablet_manager.cc:1403] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.005s
I20260709 13:08:43.981719 28378 raft_consensus.cc:359] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:43.984889 28378 raft_consensus.cc:385] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.985272 28378 raft_consensus.cc:740] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.985827 28379 consensus_queue.cc:260] T 5e6b2213d1624e8ab60743daffa01749 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:43.994254 28379 ts_tablet_manager.cc:1434] T 5e6b2213d1624e8ab60743daffa01749 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.002s
I20260709 13:08:43.995366 28379 tablet_bootstrap.cc:492] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:43.995864 28378 consensus_queue.cc:260] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.002828 28378 ts_tablet_manager.cc:1434] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:08:44.005285 28378 tablet_bootstrap.cc:492] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:44.007256 28385 raft_consensus.cc:493] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.007990 28385 raft_consensus.cc:515] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.010707 28385 leader_election.cc:290] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:44.011686 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed08161191348c6ba309a4b9338bb75" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:44.013617 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed08161191348c6ba309a4b9338bb75" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:44.007251 28381 tablet_bootstrap.cc:492] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:44.014329 28107 raft_consensus.cc:2468] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
W20260709 13:08:44.015341 28297 consensus_peers.cc:597] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:44.016052 28297 leader_election.cc:343] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.016678 28379 tablet_bootstrap.cc:654] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.018083 28378 tablet_bootstrap.cc:654] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.014477 28381 ts_tablet_manager.cc:1403] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.116s	user 0.024s	sys 0.009s
I20260709 13:08:44.017908 28295 leader_election.cc:304] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:44.021960 28384 raft_consensus.cc:493] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.022527 28384 raft_consensus.cc:515] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.023518 28381 raft_consensus.cc:359] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.024297 28381 raft_consensus.cc:385] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.024601 28381 raft_consensus.cc:740] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.025404 28378 tablet_bootstrap.cc:492] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:44.025460 28381 consensus_queue.cc:260] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.026674 28378 ts_tablet_manager.cc:1403] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.008s
I20260709 13:08:44.025683 28384 leader_election.cc:290] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:44.027060 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aff2f54c384028a34db3b71d560967" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:44.028546 28381 ts_tablet_manager.cc:1434] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
W20260709 13:08:44.028702 28074 leader_election.cc:343] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.029711 28381 tablet_bootstrap.cc:492] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:44.029757 28406 raft_consensus.cc:2804] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:44.030301 28406 raft_consensus.cc:493] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.030682 28406 raft_consensus.cc:3060] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.031991 28378 raft_consensus.cc:359] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.033213 28378 raft_consensus.cc:385] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.033675 28378 raft_consensus.cc:740] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.034960 28378 consensus_queue.cc:260] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.038337 28378 ts_tablet_manager.cc:1434] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:08:44.040055 28378 tablet_bootstrap.cc:492] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:44.052496 28166 tablet_service.cc:1511] Processing CreateTablet for tablet c9ea6103de0047339ed0e7e5d460ee53 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:44.054059 28166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ea6103de0047339ed0e7e5d460ee53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.056666 28406 raft_consensus.cc:515] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.049029 28378 tablet_bootstrap.cc:654] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.067189 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aff2f54c384028a34db3b71d560967" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
W20260709 13:08:44.068547 28072 leader_election.cc:343] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.069032 28072 leader_election.cc:304] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:44.070204 28384 raft_consensus.cc:2749] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:44.073542 28406 leader_election.cc:290] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:44.045840 28376 tablet_bootstrap.cc:654] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.076257 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed08161191348c6ba309a4b9338bb75" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
W20260709 13:08:44.078217 28297 leader_election.cc:343] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.082132 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed08161191348c6ba309a4b9338bb75" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:44.082442 28240 tablet_service.cc:1511] Processing CreateTablet for tablet c9ea6103de0047339ed0e7e5d460ee53 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:44.082810 28108 raft_consensus.cc:3060] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.083719 28240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ea6103de0047339ed0e7e5d460ee53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.088644 28094 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8fd7e0c5ab432ba3165dca1ee9f151 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:44.089365 28381 tablet_bootstrap.cc:654] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.089833 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8fd7e0c5ab432ba3165dca1ee9f151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.096628 28244 tablet_service.cc:1511] Processing CreateTablet for tablet 17113c03409f4c19ae665da8835dc3b2 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:44.089787 28108 raft_consensus.cc:2468] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:44.097847 28244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17113c03409f4c19ae665da8835dc3b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.098568 28295 leader_election.cc:304] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:44.099934 28385 raft_consensus.cc:2804] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:44.100463 28385 raft_consensus.cc:697] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:44.101392 28385 consensus_queue.cc:237] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.105996 28172 tablet_service.cc:1511] Processing CreateTablet for tablet 8c732366d5f34a4b98ac0508c4b7ef10 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:44.107374 28172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c732366d5f34a4b98ac0508c4b7ef10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.107537 28378 tablet_bootstrap.cc:492] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:44.108016 28378 ts_tablet_manager.cc:1403] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.001s
I20260709 13:08:44.109692 28379 tablet_bootstrap.cc:492] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:44.110397 28379 ts_tablet_manager.cc:1403] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.115s	user 0.021s	sys 0.047s
I20260709 13:08:44.113655 28381 tablet_bootstrap.cc:492] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:44.114279 28381 ts_tablet_manager.cc:1403] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.007s
I20260709 13:08:44.113924 28379 raft_consensus.cc:359] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.114734 28379 raft_consensus.cc:385] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.115093 28379 raft_consensus.cc:740] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.115396 28378 raft_consensus.cc:359] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.116952 28378 raft_consensus.cc:385] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.117288 28378 raft_consensus.cc:740] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.117437 28098 tablet_service.cc:1511] Processing CreateTablet for tablet 17113c03409f4c19ae665da8835dc3b2 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:44.117522 28381 raft_consensus.cc:359] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.115931 28379 consensus_queue.cc:260] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.118968 28098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17113c03409f4c19ae665da8835dc3b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.118721 28095 tablet_service.cc:1511] Processing CreateTablet for tablet 611bd39403164ea08b13d40dbc3c05a8 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:44.119455 28378 consensus_queue.cc:260] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.120188 28095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611bd39403164ea08b13d40dbc3c05a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.123588 28432 raft_consensus.cc:493] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.124101 28432 raft_consensus.cc:515] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.125013 28313 tablet_service.cc:1511] Processing CreateTablet for tablet 17113c03409f4c19ae665da8835dc3b2 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:44.126140 28432 leader_election.cc:290] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:44.126344 28313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17113c03409f4c19ae665da8835dc3b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.127617 28316 tablet_service.cc:1511] Processing CreateTablet for tablet 8c732366d5f34a4b98ac0508c4b7ef10 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:44.128871 28316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c732366d5f34a4b98ac0508c4b7ef10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.131196 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1112009449724fb880c6bfbb99c54b3a" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
W20260709 13:08:44.132582 28295 leader_election.cc:343] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.134153 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1112009449724fb880c6bfbb99c54b3a" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
W20260709 13:08:44.135775 28297 leader_election.cc:343] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.136234 28297 leader_election.cc:304] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:44.137310 28432 raft_consensus.cc:2749] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:44.140060 28243 tablet_service.cc:1511] Processing CreateTablet for tablet 1568c5c6e6a5495fa8c5550c03721b67 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:44.141412 28243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1568c5c6e6a5495fa8c5550c03721b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.143788 28245 tablet_service.cc:1511] Processing CreateTablet for tablet 611bd39403164ea08b13d40dbc3c05a8 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:44.145007 28245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611bd39403164ea08b13d40dbc3c05a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.144912 28091 tablet_service.cc:1511] Processing CreateTablet for tablet 2d5af1d945a248cabc1f6f5dbddc6098 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:44.118788 28381 raft_consensus.cc:385] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.145841 28381 raft_consensus.cc:740] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.146221 28091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5af1d945a248cabc1f6f5dbddc6098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.138851 28165 tablet_service.cc:1511] Processing CreateTablet for tablet 2d5af1d945a248cabc1f6f5dbddc6098 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:44.146831 28381 consensus_queue.cc:260] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.148244 28379 ts_tablet_manager.cc:1434] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.006s
I20260709 13:08:44.148348 28165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5af1d945a248cabc1f6f5dbddc6098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.149348 28379 tablet_bootstrap.cc:492] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:44.158664 28379 tablet_bootstrap.cc:654] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.085683 28320 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8fd7e0c5ab432ba3165dca1ee9f151 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:44.161036 28381 ts_tablet_manager.cc:1434] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.046s	user 0.003s	sys 0.003s
I20260709 13:08:44.174588 28320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8fd7e0c5ab432ba3165dca1ee9f151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.174759 28381 tablet_bootstrap.cc:492] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:44.180517 28166 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8fd7e0c5ab432ba3165dca1ee9f151 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:44.182204 28166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8fd7e0c5ab432ba3165dca1ee9f151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.191943 28164 tablet_service.cc:1511] Processing CreateTablet for tablet 611bd39403164ea08b13d40dbc3c05a8 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:44.182075 28240 tablet_service.cc:1511] Processing CreateTablet for tablet 8c732366d5f34a4b98ac0508c4b7ef10 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:44.197916 28240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c732366d5f34a4b98ac0508c4b7ef10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.205621 28164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611bd39403164ea08b13d40dbc3c05a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.203346 28378 ts_tablet_manager.cc:1434] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.095s	user 0.003s	sys 0.006s
I20260709 13:08:44.212303 28378 tablet_bootstrap.cc:492] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:44.217106 28317 tablet_service.cc:1511] Processing CreateTablet for tablet 2d5af1d945a248cabc1f6f5dbddc6098 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:44.218492 28317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5af1d945a248cabc1f6f5dbddc6098. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:44.226285 28221 consensus_peers.cc:597] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171): Couldn't send request to peer 60d640828dc841619730621ec09d4c64. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:44.236441 28378 tablet_bootstrap.cc:654] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.241834 28316 tablet_service.cc:1511] Processing CreateTablet for tablet 1568c5c6e6a5495fa8c5550c03721b67 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:44.243687 28316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1568c5c6e6a5495fa8c5550c03721b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.249217 28094 tablet_service.cc:1511] Processing CreateTablet for tablet 1568c5c6e6a5495fa8c5550c03721b67 (DEFAULT_TABLE table=test-workload [id=c7db86641a3746218d37796393e8349a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:44.250476 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1568c5c6e6a5495fa8c5550c03721b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.250849 28381 tablet_bootstrap.cc:654] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.267159 28003 catalog_manager.cc:5697] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:44.280673 28147 consensus_peers.cc:597] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 -> Peer 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171): Couldn't send request to peer 60d640828dc841619730621ec09d4c64. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:44.283231 28376 tablet_bootstrap.cc:492] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:44.283799 28376 ts_tablet_manager.cc:1403] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.399s	user 0.018s	sys 0.031s
I20260709 13:08:44.286868 28376 raft_consensus.cc:359] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.287604 28376 raft_consensus.cc:385] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.287905 28376 raft_consensus.cc:740] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.288817 28404 raft_consensus.cc:493] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.288893 28414 consensus_queue.cc:1048] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:44.289438 28404 raft_consensus.cc:515] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.291646 28404 leader_election.cc:290] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:44.293274 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6b2213d1624e8ab60743daffa01749" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:44.293955 28257 raft_consensus.cc:2468] T 5e6b2213d1624e8ab60743daffa01749 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
I20260709 13:08:44.309403 28379 tablet_bootstrap.cc:492] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:44.312585 28379 ts_tablet_manager.cc:1403] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.163s	user 0.033s	sys 0.031s
I20260709 13:08:44.316792 28379 raft_consensus.cc:359] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.317771 28379 raft_consensus.cc:385] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.318153 28379 raft_consensus.cc:740] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.319133 28379 consensus_queue.cc:260] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.320680 28149 leader_election.cc:304] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:44.322086 28379 ts_tablet_manager.cc:1434] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:08:44.322228 28378 tablet_bootstrap.cc:492] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:44.322629 28404 raft_consensus.cc:2804] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:44.322857 28378 ts_tablet_manager.cc:1403] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.111s	user 0.032s	sys 0.042s
I20260709 13:08:44.323084 28404 raft_consensus.cc:493] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.323532 28404 raft_consensus.cc:3060] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.326818 28378 raft_consensus.cc:359] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.332108 28378 raft_consensus.cc:385] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.332489 28378 raft_consensus.cc:740] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.330526 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6b2213d1624e8ab60743daffa01749" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:44.330947 28376 consensus_queue.cc:260] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
W20260709 13:08:44.335502 28147 leader_election.cc:343] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.336297 28404 raft_consensus.cc:515] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.337488 28376 ts_tablet_manager.cc:1434] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 13:08:44.337939 28379 tablet_bootstrap.cc:492] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:44.338734 28376 tablet_bootstrap.cc:492] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:44.333395 28378 consensus_queue.cc:260] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.343632 28378 ts_tablet_manager.cc:1434] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:08:44.344532 28378 tablet_bootstrap.cc:492] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:44.345854 28379 tablet_bootstrap.cc:654] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.331751 28381 tablet_bootstrap.cc:492] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:44.347306 28381 ts_tablet_manager.cc:1403] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.173s	user 0.022s	sys 0.004s
I20260709 13:08:44.348548 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6b2213d1624e8ab60743daffa01749" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:44.352949 28381 raft_consensus.cc:359] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.353926 28381 raft_consensus.cc:385] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:08:44.354001 28147 leader_election.cc:343] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.354336 28381 raft_consensus.cc:740] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.359887 28381 consensus_queue.cc:260] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.361922 28378 tablet_bootstrap.cc:654] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.362699 28381 ts_tablet_manager.cc:1434] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:08:44.364616 28376 tablet_bootstrap.cc:654] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.365895 28381 tablet_bootstrap.cc:492] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:44.368647 28385 raft_consensus.cc:493] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.369330 28385 raft_consensus.cc:515] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.373708 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a4e5a2e05b4a11b13b756a9fcd11a5" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
W20260709 13:08:44.378724 28054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:08:44.379626 28297 leader_election.cc:343] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.381031 28385 leader_election.cc:290] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:44.384099 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6b2213d1624e8ab60743daffa01749" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:44.385040 28257 raft_consensus.cc:3060] T 5e6b2213d1624e8ab60743daffa01749 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.384096 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a4e5a2e05b4a11b13b756a9fcd11a5" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:44.391693 28402 consensus_queue.cc:1048] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:44.396585 28385 raft_consensus.cc:493] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.397164 28385 raft_consensus.cc:515] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
W20260709 13:08:44.398059 28295 leader_election.cc:343] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.398533 28295 leader_election.cc:304] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:44.399665 28432 raft_consensus.cc:2749] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:44.400245 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d920220c89994ca1bd5a7d4fcc7c7e10" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:44.400718 28385 leader_election.cc:290] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:44.402988 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d920220c89994ca1bd5a7d4fcc7c7e10" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:44.405265 28297 leader_election.cc:304] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:44.406405 28432 raft_consensus.cc:2749] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:44.413053 28404 leader_election.cc:290] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:44.414151 28378 tablet_bootstrap.cc:492] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:44.414760 28378 ts_tablet_manager.cc:1403] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.015s
I20260709 13:08:44.414793 28257 raft_consensus.cc:2468] T 5e6b2213d1624e8ab60743daffa01749 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:44.416062 28376 tablet_bootstrap.cc:492] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:44.416234 28149 leader_election.cc:304] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:44.416677 28376 ts_tablet_manager.cc:1403] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.002s
I20260709 13:08:44.417764 28402 raft_consensus.cc:2804] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:44.417830 28378 raft_consensus.cc:359] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.418632 28378 raft_consensus.cc:385] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.418888 28378 raft_consensus.cc:740] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.419661 28376 raft_consensus.cc:359] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.419781 28378 consensus_queue.cc:260] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.420439 28376 raft_consensus.cc:385] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.420795 28376 raft_consensus.cc:740] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.421481 28376 consensus_queue.cc:260] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.422524 28381 tablet_bootstrap.cc:654] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.422662 28379 tablet_bootstrap.cc:492] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:44.423391 28379 ts_tablet_manager.cc:1403] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.086s	user 0.032s	sys 0.019s
I20260709 13:08:44.424662 28378 ts_tablet_manager.cc:1434] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:44.425662 28378 tablet_bootstrap.cc:492] T 64545454d8c2457bb4b0837f80555b00 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:44.426527 28379 raft_consensus.cc:359] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.427615 28379 raft_consensus.cc:385] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.427977 28379 raft_consensus.cc:740] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.428841 28379 consensus_queue.cc:260] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.430183 28376 ts_tablet_manager.cc:1434] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:08:44.431241 28379 ts_tablet_manager.cc:1434] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:44.431303 28376 tablet_bootstrap.cc:492] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:44.434130 28378 tablet_bootstrap.cc:654] T 64545454d8c2457bb4b0837f80555b00 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.434957 28379 tablet_bootstrap.cc:492] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:44.435164 28404 raft_consensus.cc:493] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.435745 28404 raft_consensus.cc:515] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.437949 28404 leader_election.cc:290] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:44.439128 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f13ee4d444e404288a43a09599419be" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
W20260709 13:08:44.441949 28147 leader_election.cc:343] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.449687 28402 raft_consensus.cc:697] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:44.450775 28402 consensus_queue.cc:237] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.452797 28381 tablet_bootstrap.cc:492] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:44.457862 28381 ts_tablet_manager.cc:1403] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.092s	user 0.025s	sys 0.000s
I20260709 13:08:44.460441 28379 tablet_bootstrap.cc:654] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.460832 28381 raft_consensus.cc:359] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.461697 28381 raft_consensus.cc:385] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.461971 28381 raft_consensus.cc:740] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.464944 28385 raft_consensus.cc:493] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.465718 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f13ee4d444e404288a43a09599419be" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:44.465623 28385 raft_consensus.cc:515] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.466464 28257 raft_consensus.cc:2468] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
I20260709 13:08:44.469303 28149 leader_election.cc:304] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:44.484030 28385 leader_election.cc:290] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:44.485224 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846616843e7743a6a799541dd5ea10fd" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:44.487540 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846616843e7743a6a799541dd5ea10fd" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:44.462718 28381 consensus_queue.cc:260] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.494819 28381 ts_tablet_manager.cc:1434] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.002s
I20260709 13:08:44.495472 28182 raft_consensus.cc:2468] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:44.496227 28381 tablet_bootstrap.cc:492] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:44.492355 28384 raft_consensus.cc:493] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.497176 28384 raft_consensus.cc:515] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.477546 28432 raft_consensus.cc:493] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.499300 28432 raft_consensus.cc:515] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.502184 28432 leader_election.cc:290] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:44.505702 28376 tablet_bootstrap.cc:654] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:44.503118 28295 leader_election.cc:343] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.511145 28448 raft_consensus.cc:2804] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:44.511639 28384 leader_election.cc:290] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:44.513983 28378 tablet_bootstrap.cc:492] T 64545454d8c2457bb4b0837f80555b00 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:44.507431 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aff2f54c384028a34db3b71d560967" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:44.513513 28448 raft_consensus.cc:493] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.515992 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aff2f54c384028a34db3b71d560967" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:44.516575 28448 raft_consensus.cc:3060] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:44.516830 28297 leader_election.cc:343] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.514737 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fcb865684d406f879509172e8279ff" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:44.517724 28181 raft_consensus.cc:2468] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 0.
I20260709 13:08:44.516830 28107 raft_consensus.cc:2468] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:44.519098 28074 leader_election.cc:304] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:08:44.520051 28384 raft_consensus.cc:2804] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:44.520440 28384 raft_consensus.cc:493] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.520766 28384 raft_consensus.cc:3060] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.522316 28297 leader_election.cc:304] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:44.522652 28295 leader_election.cc:304] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:44.523757 28379 tablet_bootstrap.cc:492] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:44.523861 28406 raft_consensus.cc:2804] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:44.524163 28385 raft_consensus.cc:2804] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:44.524358 28406 raft_consensus.cc:493] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.524619 28385 raft_consensus.cc:493] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.524816 28406 raft_consensus.cc:3060] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.524986 28385 raft_consensus.cc:3060] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.524353 28379 ts_tablet_manager.cc:1403] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.092s	user 0.019s	sys 0.025s
I20260709 13:08:44.516004 28378 ts_tablet_manager.cc:1403] T 64545454d8c2457bb4b0837f80555b00 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.003s
I20260709 13:08:44.514570 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fcb865684d406f879509172e8279ff" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:44.529840 28379 raft_consensus.cc:359] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.530529 28379 raft_consensus.cc:385] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.530802 28379 raft_consensus.cc:740] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
W20260709 13:08:44.532037 28074 leader_election.cc:343] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.512228 28381 tablet_bootstrap.cc:654] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.535362 28379 consensus_queue.cc:260] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.533486 28451 raft_consensus.cc:493] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.537807 28378 raft_consensus.cc:359] T 64545454d8c2457bb4b0837f80555b00 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.537993 28451 raft_consensus.cc:515] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.538540 28378 raft_consensus.cc:385] T 64545454d8c2457bb4b0837f80555b00 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.538976 28378 raft_consensus.cc:740] T 64545454d8c2457bb4b0837f80555b00 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.539840 28378 consensus_queue.cc:260] T 64545454d8c2457bb4b0837f80555b00 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.541299 28448 raft_consensus.cc:515] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.542948 28384 raft_consensus.cc:515] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.544127 28005 catalog_manager.cc:5697] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.545827 28384 leader_election.cc:290] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:44.546963 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fcb865684d406f879509172e8279ff" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
W20260709 13:08:44.548859 28074 leader_election.cc:343] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.547334 28378 ts_tablet_manager.cc:1434] T 64545454d8c2457bb4b0837f80555b00 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:08:44.550587 28378 tablet_bootstrap.cc:492] T 70fb7c326e6d4798b42697699d03ba70 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:44.539960 28406 raft_consensus.cc:515] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.550522 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fcb865684d406f879509172e8279ff" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:44.551210 28379 ts_tablet_manager.cc:1434] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:08:44.565084 28182 raft_consensus.cc:3060] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.565804 28379 tablet_bootstrap.cc:492] T 213cfac76ce044dea3c787992d09120a P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:44.565106 28384 raft_consensus.cc:493] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.568899 28384 raft_consensus.cc:515] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.571799 28384 leader_election.cc:290] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:44.573922 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5182347b142749bd1d50ce09224a8" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:44.575352 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5182347b142749bd1d50ce09224a8" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:44.575551 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846616843e7743a6a799541dd5ea10fd" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
W20260709 13:08:44.577175 28074 leader_election.cc:343] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:44.577857 28074 leader_election.cc:343] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.578269 28074 leader_election.cc:304] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
W20260709 13:08:44.578776 28295 leader_election.cc:343] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.580224 28384 raft_consensus.cc:2749] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:44.581470 28432 raft_consensus.cc:493] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.585708 28432 raft_consensus.cc:515] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.587374 28451 leader_election.cc:290] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:44.583940 28257 raft_consensus.cc:3060] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.587905 28432 leader_election.cc:290] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:44.589828 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0b8ae0f3f4484081fbdb57587fbac2" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:44.590271 28406 leader_election.cc:290] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:44.583344 28385 raft_consensus.cc:515] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
W20260709 13:08:44.591751 28295 leader_election.cc:343] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.591877 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed08161191348c6ba309a4b9338bb75" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:44.592842 28182 raft_consensus.cc:2468] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 1.
I20260709 13:08:44.593297 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed08161191348c6ba309a4b9338bb75" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:44.594091 28108 raft_consensus.cc:2393] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd66bd010fa04c4c8d0a668a77bd4c6d in current term 1: Already voted for candidate 60d640828dc841619730621ec09d4c64 in this term.
I20260709 13:08:44.594205 28074 leader_election.cc:304] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368; no voters: cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:44.594465 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aff2f54c384028a34db3b71d560967" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:44.595062 28107 raft_consensus.cc:3060] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.595469 28384 raft_consensus.cc:2804] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:44.596336 28379 tablet_bootstrap.cc:654] T 213cfac76ce044dea3c787992d09120a P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.596731 28221 leader_election.cc:304] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:44.599035 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0b8ae0f3f4484081fbdb57587fbac2" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:44.599577 28448 leader_election.cc:290] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:44.601058 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846616843e7743a6a799541dd5ea10fd" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:44.601639 28183 raft_consensus.cc:3060] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.602217 28378 tablet_bootstrap.cc:654] T 70fb7c326e6d4798b42697699d03ba70 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.599706 28181 raft_consensus.cc:2468] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:44.610353 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f13ee4d444e404288a43a09599419be" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:44.611263 28256 raft_consensus.cc:3060] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.617709 28297 leader_election.cc:304] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:44.619066 28406 raft_consensus.cc:2804] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:44.619557 28406 raft_consensus.cc:493] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.619980 28406 raft_consensus.cc:3060] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.619772 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f13ee4d444e404288a43a09599419be" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:44.620292 28448 raft_consensus.cc:493] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.620780 28448 raft_consensus.cc:515] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.624930 28448 leader_election.cc:290] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:44.626104 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04c15a2dc474b8def84d7d597afe1" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
W20260709 13:08:44.627247 28147 leader_election.cc:343] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:44.628238 28149 leader_election.cc:343] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.630069 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04c15a2dc474b8def84d7d597afe1" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:44.637663 28432 consensus_queue.cc:1048] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:44.644451 28107 raft_consensus.cc:2468] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:44.633919 28451 raft_consensus.cc:2749] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:44.651000 28183 raft_consensus.cc:2468] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:44.633277 28384 raft_consensus.cc:697] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
W20260709 13:08:44.654083 28147 leader_election.cc:343] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.655654 28147 leader_election.cc:304] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:44.657809 28448 raft_consensus.cc:2749] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:44.658588 28256 raft_consensus.cc:2468] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:44.659090 28384 consensus_queue.cc:237] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.660905 28149 leader_election.cc:304] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:44.662496 28448 raft_consensus.cc:2804] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:44.663803 28385 leader_election.cc:290] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:44.658258 28297 leader_election.cc:304] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:44.664216 28448 raft_consensus.cc:697] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:44.665642 28385 raft_consensus.cc:2804] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:44.665799 28448 consensus_queue.cc:237] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.666419 28376 tablet_bootstrap.cc:492] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:44.666380 28385 raft_consensus.cc:697] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:44.667188 28376 ts_tablet_manager.cc:1403] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.236s	user 0.020s	sys 0.016s
I20260709 13:08:44.667433 28385 consensus_queue.cc:237] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.662472 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aff2f54c384028a34db3b71d560967" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:44.671378 28378 tablet_bootstrap.cc:492] T 70fb7c326e6d4798b42697699d03ba70 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:44.671881 28378 ts_tablet_manager.cc:1403] T 70fb7c326e6d4798b42697699d03ba70 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.000s
W20260709 13:08:44.672223 28297 leader_election.cc:343] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.672886 28451 raft_consensus.cc:493] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.673502 28451 raft_consensus.cc:515] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.675019 28376 raft_consensus.cc:359] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.675834 28376 raft_consensus.cc:385] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.676138 28376 raft_consensus.cc:740] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.676566 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a4e5a2e05b4a11b13b756a9fcd11a5" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:44.677220 28330 raft_consensus.cc:2468] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:44.677753 28378 raft_consensus.cc:359] T 70fb7c326e6d4798b42697699d03ba70 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.678440 28378 raft_consensus.cc:385] T 70fb7c326e6d4798b42697699d03ba70 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.678730 28378 raft_consensus.cc:740] T 70fb7c326e6d4798b42697699d03ba70 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.678544 28221 leader_election.cc:304] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:44.678958 28381 tablet_bootstrap.cc:492] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:44.679641 28414 raft_consensus.cc:2804] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:44.680033 28414 raft_consensus.cc:493] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.680377 28414 raft_consensus.cc:3060] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.680902 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a4e5a2e05b4a11b13b756a9fcd11a5" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
W20260709 13:08:44.682468 28221 leader_election.cc:343] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.683140 28451 leader_election.cc:290] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:44.679656 28381 ts_tablet_manager.cc:1403] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.184s	user 0.023s	sys 0.029s
I20260709 13:08:44.686465 28406 raft_consensus.cc:515] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.687952 28005 catalog_manager.cc:5697] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.688680 28381 raft_consensus.cc:359] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.689368 28381 raft_consensus.cc:385] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.689649 28295 leader_election.cc:304] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:44.689656 28381 raft_consensus.cc:740] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.696303 28376 consensus_queue.cc:260] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.723280 28381 consensus_queue.cc:260] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.725801 28376 ts_tablet_manager.cc:1434] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
I20260709 13:08:44.726069 28381 ts_tablet_manager.cc:1434] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.025s
I20260709 13:08:44.727517 28432 consensus_queue.cc:1048] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:44.727962 28379 tablet_bootstrap.cc:492] T 213cfac76ce044dea3c787992d09120a P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:44.728463 28379 ts_tablet_manager.cc:1403] T 213cfac76ce044dea3c787992d09120a P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.163s	user 0.032s	sys 0.034s
I20260709 13:08:44.728179 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0b8ae0f3f4484081fbdb57587fbac2" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:44.729069 28183 raft_consensus.cc:3060] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.730693 28006 catalog_manager.cc:5697] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.731357 28379 raft_consensus.cc:359] T 213cfac76ce044dea3c787992d09120a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.732089 28379 raft_consensus.cc:385] T 213cfac76ce044dea3c787992d09120a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.732378 28379 raft_consensus.cc:740] T 213cfac76ce044dea3c787992d09120a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.717172 28461 raft_consensus.cc:2804] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:44.701000 28414 raft_consensus.cc:515] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.734882 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0b8ae0f3f4484081fbdb57587fbac2" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:44.735306 28381 tablet_bootstrap.cc:492] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
W20260709 13:08:44.737564 28295 leader_election.cc:343] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.740988 28378 consensus_queue.cc:260] T 70fb7c326e6d4798b42697699d03ba70 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.743527 28378 ts_tablet_manager.cc:1434] T 70fb7c326e6d4798b42697699d03ba70 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.071s	user 0.004s	sys 0.010s
I20260709 13:08:44.744787 28378 tablet_bootstrap.cc:492] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:44.744838 28381 tablet_bootstrap.cc:654] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.747005 28331 raft_consensus.cc:3060] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.748061 28379 consensus_queue.cc:260] T 213cfac76ce044dea3c787992d09120a P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.736410 28451 raft_consensus.cc:493] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.751869 28451 raft_consensus.cc:515] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.752456 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a4e5a2e05b4a11b13b756a9fcd11a5" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
W20260709 13:08:44.753983 28221 leader_election.cc:343] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.736297 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a4e5a2e05b4a11b13b756a9fcd11a5" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:44.754715 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fb7c326e6d4798b42697699d03ba70" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:44.754987 28414 leader_election.cc:290] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:44.754891 28330 raft_consensus.cc:3060] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.756734 28376 tablet_bootstrap.cc:492] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
W20260709 13:08:44.757436 28223 leader_election.cc:343] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.736857 28461 raft_consensus.cc:697] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:44.765815 28461 consensus_queue.cc:237] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.768800 28451 leader_election.cc:290] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:44.770954 28329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fb7c326e6d4798b42697699d03ba70" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:44.736953 28406 leader_election.cc:290] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:44.771958 28329 raft_consensus.cc:2468] T 70fb7c326e6d4798b42697699d03ba70 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:44.770233 28379 ts_tablet_manager.cc:1434] T 213cfac76ce044dea3c787992d09120a P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 13:08:44.778174 28379 tablet_bootstrap.cc:492] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:44.773869 28003 catalog_manager.cc:5697] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.736296 28183 raft_consensus.cc:2468] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:44.791297 28297 leader_election.cc:304] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:44.783056 28221 leader_election.cc:304] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:44.798027 28414 raft_consensus.cc:2804] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:44.798451 28414 raft_consensus.cc:493] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.798804 28414 raft_consensus.cc:3060] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.803141 28379 tablet_bootstrap.cc:654] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.803870 28330 raft_consensus.cc:2468] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:44.806460 28221 leader_election.cc:304] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:44.808686 28451 raft_consensus.cc:2804] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:44.809365 28451 raft_consensus.cc:697] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:44.810206 28451 consensus_queue.cc:237] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.795974 28385 raft_consensus.cc:2804] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:44.812429 28378 tablet_bootstrap.cc:654] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.812534 28330 raft_consensus.cc:3060] T 64545454d8c2457bb4b0837f80555b00 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.814816 28385 raft_consensus.cc:697] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:44.816978 28376 tablet_bootstrap.cc:654] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.830840 28385 consensus_queue.cc:237] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.837975 28381 tablet_bootstrap.cc:492] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:44.838536 28381 ts_tablet_manager.cc:1403] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.103s	user 0.018s	sys 0.004s
I20260709 13:08:44.848465 28376 tablet_bootstrap.cc:492] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:44.849212 28376 ts_tablet_manager.cc:1403] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.093s	user 0.001s	sys 0.015s
I20260709 13:08:44.843633 28414 raft_consensus.cc:515] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.854012 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fb7c326e6d4798b42697699d03ba70" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:44.854260 28381 raft_consensus.cc:359] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.855043 28381 raft_consensus.cc:385] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.855348 28381 raft_consensus.cc:740] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.856031 28381 consensus_queue.cc:260] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
W20260709 13:08:44.857278 28223 leader_election.cc:343] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.859046 28381 ts_tablet_manager.cc:1434] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:08:44.860036 28381 tablet_bootstrap.cc:492] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:44.870174 28379 tablet_bootstrap.cc:492] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:44.870074 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fb7c326e6d4798b42697699d03ba70" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:44.870765 28379 ts_tablet_manager.cc:1403] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.011s
I20260709 13:08:44.870807 28331 raft_consensus.cc:3060] T 70fb7c326e6d4798b42697699d03ba70 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.873709 28414 leader_election.cc:290] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:44.881506 28331 raft_consensus.cc:2468] T 70fb7c326e6d4798b42697699d03ba70 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:44.882442 28378 tablet_bootstrap.cc:492] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:44.883011 28378 ts_tablet_manager.cc:1403] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.139s	user 0.020s	sys 0.017s
I20260709 13:08:44.882951 28221 leader_election.cc:304] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:44.885417 28414 raft_consensus.cc:2804] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:44.885815 28381 tablet_bootstrap.cc:654] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.885984 28414 raft_consensus.cc:697] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:44.873796 28379 raft_consensus.cc:359] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.887147 28379 raft_consensus.cc:385] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.876451 28376 raft_consensus.cc:359] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.886077 28378 raft_consensus.cc:359] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.873247 28006 catalog_manager.cc:5697] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 1 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.887465 28379 raft_consensus.cc:740] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.887320 28414 consensus_queue.cc:237] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.888350 28379 consensus_queue.cc:260] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.887614 28376 raft_consensus.cc:385] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.889636 28376 raft_consensus.cc:740] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.890152 28379 ts_tablet_manager.cc:1434] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.001s
I20260709 13:08:44.890417 28376 consensus_queue.cc:260] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:44.891222 28379 tablet_bootstrap.cc:492] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:44.891979 28378 raft_consensus.cc:385] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.892347 28378 raft_consensus.cc:740] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.893129 28378 consensus_queue.cc:260] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.895430 28378 ts_tablet_manager.cc:1434] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:08:44.896461 28378 tablet_bootstrap.cc:492] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:44.902616 28378 tablet_bootstrap.cc:654] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.905431 28379 tablet_bootstrap.cc:654] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.906054 28003 catalog_manager.cc:5697] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.911710 28003 catalog_manager.cc:5697] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.914224 28378 tablet_bootstrap.cc:492] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:44.914783 28378 ts_tablet_manager.cc:1403] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:08:44.918993 28379 tablet_bootstrap.cc:492] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:44.919762 28379 ts_tablet_manager.cc:1403] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.009s
I20260709 13:08:44.923666 28379 raft_consensus.cc:359] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.924582 28379 raft_consensus.cc:385] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.924932 28379 raft_consensus.cc:740] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.925191 28378 raft_consensus.cc:359] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.925940 28378 raft_consensus.cc:385] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.926738 28376 ts_tablet_manager.cc:1434] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.000s
I20260709 13:08:44.926152 28379 consensus_queue.cc:260] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.930069 28379 ts_tablet_manager.cc:1434] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:44.926215 28378 raft_consensus.cc:740] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.931144 28379 tablet_bootstrap.cc:492] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:44.932076 28376 tablet_bootstrap.cc:492] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:44.931679 28378 consensus_queue.cc:260] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:44.934079 28378 ts_tablet_manager.cc:1434] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 13:08:44.937933 28378 tablet_bootstrap.cc:492] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:44.938570 28379 tablet_bootstrap.cc:654] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.940488 28451 raft_consensus.cc:493] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.940985 28451 raft_consensus.cc:515] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.944734 28378 tablet_bootstrap.cc:654] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.944628 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf28c2ae4fd4bcdbcc0ebcf6090342a" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:44.945325 28330 raft_consensus.cc:2468] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:44.947069 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf28c2ae4fd4bcdbcc0ebcf6090342a" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
W20260709 13:08:44.948479 28223 leader_election.cc:343] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.949257 28221 leader_election.cc:304] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:44.950518 28441 raft_consensus.cc:2804] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:44.950948 28441 raft_consensus.cc:493] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.951372 28441 raft_consensus.cc:3060] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.955644 28448 consensus_queue.cc:1048] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:44.959882 28451 leader_election.cc:290] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:44.959491 28005 catalog_manager.cc:5697] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 1 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.967268 28376 tablet_bootstrap.cc:654] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.972174 28381 tablet_bootstrap.cc:492] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:44.972954 28381 ts_tablet_manager.cc:1403] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.113s	user 0.044s	sys 0.028s
I20260709 13:08:44.976115 28381 raft_consensus.cc:359] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.977043 28381 raft_consensus.cc:385] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.977324 28381 raft_consensus.cc:740] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.978089 28381 consensus_queue.cc:260] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.979187 28441 raft_consensus.cc:515] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:44.981405 28441 leader_election.cc:290] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:44.981906 28378 tablet_bootstrap.cc:492] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:44.982403 28378 ts_tablet_manager.cc:1403] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.007s
I20260709 13:08:44.982656 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf28c2ae4fd4bcdbcc0ebcf6090342a" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:44.984014 28381 ts_tablet_manager.cc:1434] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:08:44.984545 28384 raft_consensus.cc:493] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.985301 28381 tablet_bootstrap.cc:492] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:44.985085 28384 raft_consensus.cc:515] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.988209 28384 leader_election.cc:290] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:44.988127 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846616843e7743a6a799541dd5ea10fd" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:44.990118 28378 raft_consensus.cc:359] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.990813 28378 raft_consensus.cc:385] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:44.991077 28378 raft_consensus.cc:740] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:44.991890 28378 consensus_queue.cc:260] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:44.992518 28381 tablet_bootstrap.cc:654] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:44.994081 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846616843e7743a6a799541dd5ea10fd" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:44.994881 28183 raft_consensus.cc:2393] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d2bb5df3b55462682d0f2fce57709f1 in current term 1: Already voted for candidate 60d640828dc841619730621ec09d4c64 in this term.
I20260709 13:08:44.994946 28379 tablet_bootstrap.cc:492] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:44.982765 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf28c2ae4fd4bcdbcc0ebcf6090342a" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:44.996438 28330 raft_consensus.cc:3060] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:44.996524 28074 leader_election.cc:304] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:44.997717 28384 raft_consensus.cc:3060] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:44.999678 28223 leader_election.cc:343] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:44.995651 28379 ts_tablet_manager.cc:1403] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.000s
I20260709 13:08:45.004828 28384 raft_consensus.cc:2749] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:45.006074 28379 raft_consensus.cc:359] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:45.006842 28378 ts_tablet_manager.cc:1434] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:08:45.013561 28378 tablet_bootstrap.cc:492] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:45.009204 28376 tablet_bootstrap.cc:492] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:45.009661 28330 raft_consensus.cc:2468] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:45.017920 28376 ts_tablet_manager.cc:1403] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.007s
I20260709 13:08:45.019872 28221 leader_election.cc:304] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:45.021024 28376 raft_consensus.cc:359] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.021831 28376 raft_consensus.cc:385] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.021859 28484 raft_consensus.cc:2804] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:45.012337 28379 raft_consensus.cc:385] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.022786 28484 raft_consensus.cc:697] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:45.025456 28378 tablet_bootstrap.cc:654] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.029853 28381 tablet_bootstrap.cc:492] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:45.030335 28381 ts_tablet_manager.cc:1403] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.010s
I20260709 13:08:45.024062 28484 consensus_queue.cc:237] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:45.033267 28381 raft_consensus.cc:359] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.034219 28381 raft_consensus.cc:385] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.034660 28381 raft_consensus.cc:740] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.035717 28381 consensus_queue.cc:260] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.039084 28381 ts_tablet_manager.cc:1434] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:08:45.040218 28381 tablet_bootstrap.cc:492] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:45.022790 28379 raft_consensus.cc:740] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.043999 28379 consensus_queue.cc:260] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
W20260709 13:08:45.044524 28147 consensus_peers.cc:597] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:45.046065 28379 ts_tablet_manager.cc:1434] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.044s	user 0.000s	sys 0.005s
I20260709 13:08:45.047123 28379 tablet_bootstrap.cc:492] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:45.051782 28003 catalog_manager.cc:5697] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 1 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.054767 28381 tablet_bootstrap.cc:654] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.057405 28378 tablet_bootstrap.cc:492] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:45.057868 28379 tablet_bootstrap.cc:654] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.057462 28447 consensus_queue.cc:1048] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:45.058058 28378 ts_tablet_manager.cc:1403] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.002s
I20260709 13:08:45.059068 28447 raft_consensus.cc:493] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.059551 28447 raft_consensus.cc:515] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.062256 28447 leader_election.cc:290] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:45.062875 28378 raft_consensus.cc:359] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:45.063853 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aff2f54c384028a34db3b71d560967" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:45.022183 28376 raft_consensus.cc:740] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.065222 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aff2f54c384028a34db3b71d560967" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:45.066046 28107 raft_consensus.cc:2393] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8938bce1e7864c1ab26755f60f708368 in current term 1: Already voted for candidate 60d640828dc841619730621ec09d4c64 in this term.
I20260709 13:08:45.065801 28376 consensus_queue.cc:260] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.068051 28147 leader_election.cc:304] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:45.063872 28378 raft_consensus.cc:385] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.069377 28376 ts_tablet_manager.cc:1434] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:08:45.069543 28378 raft_consensus.cc:740] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.073999 28385 raft_consensus.cc:493] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.070652 28376 tablet_bootstrap.cc:492] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:45.074316 28378 consensus_queue.cc:260] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:45.075294 28406 consensus_queue.cc:1048] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:45.076717 28378 ts_tablet_manager.cc:1434] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 13:08:45.077437 28448 raft_consensus.cc:3060] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.082597 28376 tablet_bootstrap.cc:654] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:45.083113 28074 consensus_peers.cc:597] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 -> Peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Couldn't send request to peer cd66bd010fa04c4c8d0a668a77bd4c6d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:45.074555 28385 raft_consensus.cc:515] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.087512 28385 leader_election.cc:290] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:45.089480 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213cfac76ce044dea3c787992d09120a" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
W20260709 13:08:45.091180 28295 leader_election.cc:343] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.093961 28448 raft_consensus.cc:2749] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:45.099602 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213cfac76ce044dea3c787992d09120a" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:45.100557 28257 raft_consensus.cc:2468] T 213cfac76ce044dea3c787992d09120a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:45.101634 28297 leader_election.cc:304] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:45.102768 28385 raft_consensus.cc:2804] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:45.103178 28385 raft_consensus.cc:493] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.103535 28385 raft_consensus.cc:3060] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:45.104832 28147 consensus_peers.cc:597] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:45.107944 28378 tablet_bootstrap.cc:492] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:45.117432 28379 tablet_bootstrap.cc:492] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:45.117990 28379 ts_tablet_manager.cc:1403] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.024s
I20260709 13:08:45.120569 28378 tablet_bootstrap.cc:654] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.120739 28379 raft_consensus.cc:359] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.121490 28379 raft_consensus.cc:385] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.121770 28379 raft_consensus.cc:740] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.124413 28381 tablet_bootstrap.cc:492] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:45.124910 28381 ts_tablet_manager.cc:1403] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.018s
I20260709 13:08:45.126821 28379 consensus_queue.cc:260] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.128862 28381 raft_consensus.cc:359] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.129590 28381 raft_consensus.cc:385] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.133108 28376 tablet_bootstrap.cc:492] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:45.133646 28376 ts_tablet_manager.cc:1403] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.003s
I20260709 13:08:45.129844 28381 raft_consensus.cc:740] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.135598 28381 consensus_queue.cc:260] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.136555 28376 raft_consensus.cc:359] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.137157 28441 raft_consensus.cc:493] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.137742 28441 raft_consensus.cc:515] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:45.140417 28379 ts_tablet_manager.cc:1434] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:08:45.142155 28381 ts_tablet_manager.cc:1434] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 13:08:45.142215 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483dc2ac5ecf492087dcef4c6fa1770c" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:45.140935 28441 leader_election.cc:290] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:45.142645 28379 tablet_bootstrap.cc:492] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:45.141562 28447 raft_consensus.cc:493] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.143640 28381 tablet_bootstrap.cc:492] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
W20260709 13:08:45.143929 28223 leader_election.cc:343] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.144068 28447 raft_consensus.cc:515] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:45.137292 28376 raft_consensus.cc:385] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.141371 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483dc2ac5ecf492087dcef4c6fa1770c" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:45.145924 28376 raft_consensus.cc:740] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.151871 28381 tablet_bootstrap.cc:654] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.152185 28376 consensus_queue.cc:260] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.152386 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3958573ac72b4113b6cb6ee2303db8f9" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:45.152478 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3958573ac72b4113b6cb6ee2303db8f9" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:45.154172 28461 raft_consensus.cc:493] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:45.147151 28221 leader_election.cc:343] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.155145 28221 leader_election.cc:304] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:45.154873 28461 raft_consensus.cc:515] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.156586 28484 raft_consensus.cc:2749] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:45.151314 28447 leader_election.cc:290] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:45.159057 28461 leader_election.cc:290] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:45.159790 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbdcf3655d24af7b91441e5b9029d33" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:45.160451 28379 tablet_bootstrap.cc:654] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:45.161343 28297 leader_election.cc:343] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.161222 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbdcf3655d24af7b91441e5b9029d33" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:45.154356 28376 ts_tablet_manager.cc:1434] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
W20260709 13:08:45.163185 28147 leader_election.cc:343] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:45.163439 28295 leader_election.cc:343] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.151942 28441 raft_consensus.cc:493] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.164057 28295 leader_election.cc:304] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:45.165027 28441 raft_consensus.cc:515] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.165766 28461 raft_consensus.cc:2749] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:45.164273 28376 tablet_bootstrap.cc:492] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:45.169828 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fcb865684d406f879509172e8279ff" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:45.177346 28376 tablet_bootstrap.cc:654] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.180614 28379 tablet_bootstrap.cc:492] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:45.181282 28379 ts_tablet_manager.cc:1403] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.000s
W20260709 13:08:45.183954 28149 leader_election.cc:343] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.184464 28149 leader_election.cc:304] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:45.184381 28379 raft_consensus.cc:359] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.185443 28447 raft_consensus.cc:2749] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:45.185415 28379 raft_consensus.cc:385] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.186561 28379 raft_consensus.cc:740] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.187633 28379 consensus_queue.cc:260] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.191615 28376 tablet_bootstrap.cc:492] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:45.192343 28376 ts_tablet_manager.cc:1403] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.002s
I20260709 13:08:45.190837 28379 ts_tablet_manager.cc:1434] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:08:45.194017 28379 tablet_bootstrap.cc:492] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:45.196815 28376 raft_consensus.cc:359] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.197906 28376 raft_consensus.cc:385] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.198292 28376 raft_consensus.cc:740] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.206319 28379 tablet_bootstrap.cc:654] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.205798 28461 consensus_queue.cc:1048] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:45.212466 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fcb865684d406f879509172e8279ff" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:45.213515 28181 raft_consensus.cc:2393] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd66bd010fa04c4c8d0a668a77bd4c6d in current term 1: Already voted for candidate 7d2bb5df3b55462682d0f2fce57709f1 in this term.
I20260709 13:08:45.215565 28223 leader_election.cc:304] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:45.216699 28484 raft_consensus.cc:3060] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.199371 28376 consensus_queue.cc:260] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.220650 28458 consensus_queue.cc:1048] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:45.229351 28376 ts_tablet_manager.cc:1434] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.006s
I20260709 13:08:45.230621 28376 tablet_bootstrap.cc:492] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:45.246956 28376 tablet_bootstrap.cc:654] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.256779 28441 leader_election.cc:290] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:45.261190 28385 raft_consensus.cc:515] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.270475 28484 raft_consensus.cc:2749] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:45.287015 28504 raft_consensus.cc:493] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.287782 28504 raft_consensus.cc:515] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.293246 28470 consensus_queue.cc:1048] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:45.296846 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0b8ae0f3f4484081fbdb57587fbac2" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:45.304409 28376 tablet_bootstrap.cc:492] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:45.304721 28470 consensus_queue.cc:1048] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:45.305184 28376 ts_tablet_manager.cc:1403] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.002s
I20260709 13:08:45.317449 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213cfac76ce044dea3c787992d09120a" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:45.318358 28257 raft_consensus.cc:3060] T 213cfac76ce044dea3c787992d09120a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.327592 28504 leader_election.cc:290] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:45.329792 28376 raft_consensus.cc:359] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.330521 28376 raft_consensus.cc:385] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.330789 28376 raft_consensus.cc:740] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.337670 28432 consensus_queue.cc:1048] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:45.342540 28376 consensus_queue.cc:260] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.343832 28384 raft_consensus.cc:493] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.344170 28504 raft_consensus.cc:493] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.344542 28384 raft_consensus.cc:515] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.345279 28504 raft_consensus.cc:515] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.348387 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccac4bb40d14b6ead1be9a53f6189cd" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:45.349539 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccac4bb40d14b6ead1be9a53f6189cd" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
W20260709 13:08:45.349833 28074 leader_election.cc:343] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:45.351042 28074 leader_election.cc:343] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.351478 28074 leader_election.cc:304] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:45.352564 28505 raft_consensus.cc:2749] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:45.353374 28504 leader_election.cc:290] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:45.354655 28384 leader_election.cc:290] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:45.356281 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213cfac76ce044dea3c787992d09120a" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:45.357317 28330 raft_consensus.cc:2393] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d2bb5df3b55462682d0f2fce57709f1 in current term 1: Already voted for candidate 60d640828dc841619730621ec09d4c64 in this term.
I20260709 13:08:45.359241 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213cfac76ce044dea3c787992d09120a" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:45.361378 28074 leader_election.cc:304] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:45.362768 28384 raft_consensus.cc:3060] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.363649 28376 ts_tablet_manager.cc:1434] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:08:45.364583 28376 tablet_bootstrap.cc:492] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:45.372614 28441 raft_consensus.cc:493] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.373294 28441 raft_consensus.cc:515] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:45.377230 28441 leader_election.cc:290] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:45.391158 28379 tablet_bootstrap.cc:492] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:45.391054 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0b8ae0f3f4484081fbdb57587fbac2" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:45.393369 28074 leader_election.cc:304] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:45.393607 28379 ts_tablet_manager.cc:1403] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.200s	user 0.034s	sys 0.050s
I20260709 13:08:45.394673 28458 raft_consensus.cc:2749] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:45.398061 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04c15a2dc474b8def84d7d597afe1" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:45.399106 28181 raft_consensus.cc:2468] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:45.403816 28223 leader_election.cc:304] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:45.424741 28484 raft_consensus.cc:2804] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:45.404942 28432 raft_consensus.cc:493] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.425189 28484 raft_consensus.cc:493] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.425817 28484 raft_consensus.cc:3060] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.425868 28432 raft_consensus.cc:515] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.405283 28447 raft_consensus.cc:493] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.430047 28447 raft_consensus.cc:515] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.430598 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311b4ef735894403b3e8fccbe834bd77" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:45.431636 28108 raft_consensus.cc:2468] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:45.432502 28447 leader_election.cc:290] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:45.433130 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311b4ef735894403b3e8fccbe834bd77" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:45.434053 28432 leader_election.cc:290] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
W20260709 13:08:45.438408 28223 consensus_peers.cc:597] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:45.438860 28414 consensus_queue.cc:1048] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:45.402849 28257 raft_consensus.cc:2468] T 213cfac76ce044dea3c787992d09120a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:45.434000 28182 raft_consensus.cc:2468] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:45.446153 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bbaf9dd8a447f6bc1e1feeceb3008d" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:45.447273 28376 tablet_bootstrap.cc:654] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.434666 28484 raft_consensus.cc:515] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:45.435173 28295 leader_election.cc:304] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 
I20260709 13:08:45.437093 28329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bbaf9dd8a447f6bc1e1feeceb3008d" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:45.452510 28470 raft_consensus.cc:2804] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:45.452589 28147 leader_election.cc:304] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:45.453155 28470 raft_consensus.cc:493] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.453608 28470 raft_consensus.cc:3060] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.454046 28447 raft_consensus.cc:2749] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:45.456518 28106 raft_consensus.cc:3060] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.452806 28297 leader_election.cc:304] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:45.463847 28108 raft_consensus.cc:3060] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.466818 28461 raft_consensus.cc:2804] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:45.467458 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04c15a2dc474b8def84d7d597afe1" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:45.467612 28461 raft_consensus.cc:697] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:45.468248 28183 raft_consensus.cc:3060] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.468919 28461 consensus_queue.cc:237] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.474244 28414 consensus_queue.cc:1048] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:45.413383 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04c15a2dc474b8def84d7d597afe1" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:45.479460 28330 raft_consensus.cc:2468] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:45.413597 28385 leader_election.cc:290] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:45.415047 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213cfac76ce044dea3c787992d09120a" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:45.484366 28183 raft_consensus.cc:2468] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:45.485723 28223 leader_election.cc:304] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:45.486017 28484 leader_election.cc:290] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:45.423187 28402 raft_consensus.cc:493] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.423244 28441 raft_consensus.cc:493] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.495517 28441 raft_consensus.cc:515] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.498415 28441 leader_election.cc:290] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:45.488058 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04c15a2dc474b8def84d7d597afe1" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:45.419176 28384 raft_consensus.cc:2749] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:45.494185 28402 raft_consensus.cc:515] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.502883 28331 raft_consensus.cc:3060] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.509996 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1112009449724fb880c6bfbb99c54b3a" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:45.511655 28402 leader_election.cc:290] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
W20260709 13:08:45.512564 28147 leader_election.cc:343] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.515034 28329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1112009449724fb880c6bfbb99c54b3a" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:45.515791 28329 raft_consensus.cc:2468] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
I20260709 13:08:45.487846 28414 raft_consensus.cc:2804] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:45.517273 28147 leader_election.cc:304] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:45.517460 28414 raft_consensus.cc:697] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:45.518702 28402 raft_consensus.cc:2804] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:45.519289 28402 raft_consensus.cc:493] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.519922 28402 raft_consensus.cc:3060] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.518801 28414 consensus_queue.cc:237] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:45.412597 28379 raft_consensus.cc:359] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.526708 28379 raft_consensus.cc:385] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.526448 28329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0c3ca5b68a47259dd1c2672f3e4b70" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:45.528321 28107 raft_consensus.cc:2468] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:45.533854 28379 raft_consensus.cc:740] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.542083 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0c3ca5b68a47259dd1c2672f3e4b70" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:45.545920 28470 raft_consensus.cc:515] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.552582 28331 raft_consensus.cc:2468] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:45.553288 28379 consensus_queue.cc:260] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
W20260709 13:08:45.563045 28054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:08:45.563174 28221 leader_election.cc:343] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:45.564543 28221 leader_election.cc:343] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.564991 28221 leader_election.cc:304] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:45.565441 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311b4ef735894403b3e8fccbe834bd77" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:45.566151 28458 raft_consensus.cc:493] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.566802 28458 raft_consensus.cc:515] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.566170 28183 raft_consensus.cc:3060] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.572036 28376 tablet_bootstrap.cc:492] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:45.572429 28376 ts_tablet_manager.cc:1403] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.208s	user 0.011s	sys 0.005s
I20260709 13:08:45.559612 28461 consensus_queue.cc:1048] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:08:45.570003 28470 leader_election.cc:290] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:45.578229 28378 tablet_bootstrap.cc:492] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:45.578696 28378 ts_tablet_manager.cc:1403] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.471s	user 0.177s	sys 0.168s
I20260709 13:08:45.575596 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311b4ef735894403b3e8fccbe834bd77" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:45.581403 28379 ts_tablet_manager.cc:1434] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.187s	user 0.009s	sys 0.000s
I20260709 13:08:45.581631 28105 raft_consensus.cc:3060] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.582773 28182 raft_consensus.cc:3060] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.584589 28378 raft_consensus.cc:359] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.585391 28378 raft_consensus.cc:385] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.585677 28378 raft_consensus.cc:740] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.575641 28484 raft_consensus.cc:2749] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:45.586810 28378 consensus_queue.cc:260] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.589545 28378 ts_tablet_manager.cc:1434] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:08:45.591815 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a4e5a2e05b4a11b13b756a9fcd11a5" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:45.592796 28458 leader_election.cc:290] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:45.579454 28402 raft_consensus.cc:515] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.604419 28484 raft_consensus.cc:493] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.605201 28484 raft_consensus.cc:515] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.608192 28484 leader_election.cc:290] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:45.611950 28379 tablet_bootstrap.cc:492] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:45.612321 28378 tablet_bootstrap.cc:492] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:45.615705 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1112009449724fb880c6bfbb99c54b3a" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
W20260709 13:08:45.617291 28147 leader_election.cc:343] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.617208 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819e4cfb61d7498f997e955c8d2cc490" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:45.613600 28402 leader_election.cc:290] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:45.626031 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819e4cfb61d7498f997e955c8d2cc490" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:45.627179 28516 consensus_queue.cc:1048] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:45.627547 28223 leader_election.cc:343] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:45.629988 28223 consensus_peers.cc:597] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:45.633210 28221 leader_election.cc:343] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.638325 28221 leader_election.cc:304] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:45.644460 28378 tablet_bootstrap.cc:654] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.644137 28183 raft_consensus.cc:2468] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:45.646970 28376 raft_consensus.cc:359] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.647831 28376 raft_consensus.cc:385] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.647996 28379 tablet_bootstrap.cc:654] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.647149 28297 leader_election.cc:304] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:08:45.655717 28432 raft_consensus.cc:2804] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:45.656306 28432 raft_consensus.cc:697] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:45.657289 28432 consensus_queue.cc:237] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.658967 28327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1112009449724fb880c6bfbb99c54b3a" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:45.659749 28327 raft_consensus.cc:3060] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.661335 28515 consensus_queue.cc:1048] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:45.651021 28376 raft_consensus.cc:740] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.666215 28376 consensus_queue.cc:260] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.669072 28376 ts_tablet_manager.cc:1434] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
I20260709 13:08:45.670205 28376 tablet_bootstrap.cc:492] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:45.648268 28484 raft_consensus.cc:2749] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:45.673130 28105 raft_consensus.cc:2468] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:45.677438 28006 catalog_manager.cc:5697] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.682425 28002 catalog_manager.cc:5697] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 1 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.690382 28328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a4e5a2e05b4a11b13b756a9fcd11a5" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:45.692451 28072 leader_election.cc:304] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
W20260709 13:08:45.694177 28381 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.052s	sys 0.110s
W20260709 13:08:45.694553 28381 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.052s	sys 0.110s
I20260709 13:08:45.698138 28327 raft_consensus.cc:2468] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:45.701503 28147 leader_election.cc:304] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:45.703155 28402 raft_consensus.cc:2804] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:45.703840 28402 raft_consensus.cc:697] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:45.705385 28402 consensus_queue.cc:237] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:45.719405 28381 tablet_bootstrap.cc:492] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:45.720055 28381 ts_tablet_manager.cc:1403] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.577s	user 0.063s	sys 0.111s
I20260709 13:08:45.725957 28381 raft_consensus.cc:359] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.726598 28381 raft_consensus.cc:385] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.726868 28381 raft_consensus.cc:740] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.730136 28376 tablet_bootstrap.cc:654] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.731240 28381 consensus_queue.cc:260] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.732080 28378 tablet_bootstrap.cc:492] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:45.732703 28378 ts_tablet_manager.cc:1403] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.121s	user 0.009s	sys 0.016s
I20260709 13:08:45.725574 28458 raft_consensus.cc:2749] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:45.740445 28381 ts_tablet_manager.cc:1434] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:08:45.741257 28381 tablet_bootstrap.cc:492] T 70fb7c326e6d4798b42697699d03ba70 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:45.742645 28378 raft_consensus.cc:359] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.743422 28378 raft_consensus.cc:385] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.743631 28378 raft_consensus.cc:740] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.750640 28379 tablet_bootstrap.cc:492] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:45.752174 28381 tablet_bootstrap.cc:654] T 70fb7c326e6d4798b42697699d03ba70 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.755365 28379 ts_tablet_manager.cc:1403] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.144s	user 0.026s	sys 0.002s
I20260709 13:08:45.759081 28379 raft_consensus.cc:359] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.759887 28379 raft_consensus.cc:385] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.760257 28379 raft_consensus.cc:740] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.765461 28379 consensus_queue.cc:260] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.768090 28379 ts_tablet_manager.cc:1434] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:08:45.775338 28379 tablet_bootstrap.cc:492] T f0d5182347b142749bd1d50ce09224a8 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
W20260709 13:08:45.783823 28149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:41757, user_credentials={real_user=slave}} blocked reactor thread for 44139.4us
I20260709 13:08:45.786164 28379 tablet_bootstrap.cc:654] T f0d5182347b142749bd1d50ce09224a8 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.795928 28378 consensus_queue.cc:260] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.796561 28003 catalog_manager.cc:5697] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.840675 28378 ts_tablet_manager.cc:1434] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.002s
I20260709 13:08:45.842871 28378 tablet_bootstrap.cc:492] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:45.838723 28447 raft_consensus.cc:493] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.844360 28447 raft_consensus.cc:515] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.845691 28381 tablet_bootstrap.cc:492] T 70fb7c326e6d4798b42697699d03ba70 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:45.846266 28381 ts_tablet_manager.cc:1403] T 70fb7c326e6d4798b42697699d03ba70 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.008s
I20260709 13:08:45.846587 28447 leader_election.cc:290] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:45.847410 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5182347b142749bd1d50ce09224a8" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:45.851750 28108 raft_consensus.cc:2468] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
I20260709 13:08:45.848011 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5182347b142749bd1d50ce09224a8" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:45.852839 28376 tablet_bootstrap.cc:492] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:45.849310 28381 raft_consensus.cc:359] T 70fb7c326e6d4798b42697699d03ba70 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:45.853938 28381 raft_consensus.cc:385] T 70fb7c326e6d4798b42697699d03ba70 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.854307 28381 raft_consensus.cc:740] T 70fb7c326e6d4798b42697699d03ba70 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.853638 28376 ts_tablet_manager.cc:1403] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.184s	user 0.017s	sys 0.031s
I20260709 13:08:45.856395 28147 leader_election.cc:304] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:08:45.856462 28381 consensus_queue.cc:260] T 70fb7c326e6d4798b42697699d03ba70 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:45.857352 28447 raft_consensus.cc:2804] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:45.858598 28447 raft_consensus.cc:493] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.860242 28447 raft_consensus.cc:3060] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:45.857813 28149 leader_election.cc:343] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.866539 28378 tablet_bootstrap.cc:654] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.868853 28447 raft_consensus.cc:515] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.869887 28376 raft_consensus.cc:359] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.872485 28376 raft_consensus.cc:385] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.873853 28376 raft_consensus.cc:740] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.872381 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5182347b142749bd1d50ce09224a8" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:45.875909 28108 raft_consensus.cc:3060] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.876667 28376 consensus_queue.cc:260] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.879551 28381 ts_tablet_manager.cc:1434] T 70fb7c326e6d4798b42697699d03ba70 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.003s
I20260709 13:08:45.880592 28381 tablet_bootstrap.cc:492] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:45.882468 28376 ts_tablet_manager.cc:1434] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
I20260709 13:08:45.884986 28376 tablet_bootstrap.cc:492] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:45.886555 28381 tablet_bootstrap.cc:654] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.887027 28447 leader_election.cc:290] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:45.889166 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5182347b142749bd1d50ce09224a8" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
W20260709 13:08:45.892853 28149 leader_election.cc:343] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.900511 28441 raft_consensus.cc:493] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.901087 28441 raft_consensus.cc:515] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.901583 28108 raft_consensus.cc:2468] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:45.902855 28147 leader_election.cc:304] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368; no voters: cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:45.903461 28441 leader_election.cc:290] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:45.904017 28447 raft_consensus.cc:2804] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:45.904701 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbdcf3655d24af7b91441e5b9029d33" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:45.904768 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbdcf3655d24af7b91441e5b9029d33" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:45.905139 28385 raft_consensus.cc:493] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.905567 28331 raft_consensus.cc:2468] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:45.905927 28385 raft_consensus.cc:515] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
W20260709 13:08:45.906464 28221 leader_election.cc:343] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.907079 28447 raft_consensus.cc:697] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:45.907406 28221 leader_election.cc:304] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:45.908013 28447 consensus_queue.cc:237] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.909978 28385 leader_election.cc:290] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:45.911389 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0c3ca5b68a47259dd1c2672f3e4b70" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:45.912047 28107 raft_consensus.cc:2468] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:45.913210 28441 raft_consensus.cc:2804] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:45.913664 28441 raft_consensus.cc:493] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.914650 28441 raft_consensus.cc:3060] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.914460 28295 leader_election.cc:304] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 
I20260709 13:08:45.919080 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0c3ca5b68a47259dd1c2672f3e4b70" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:45.920001 28257 raft_consensus.cc:2468] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:45.922379 28385 raft_consensus.cc:2804] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:45.922972 28385 raft_consensus.cc:493] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.923439 28385 raft_consensus.cc:3060] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.934682 28376 tablet_bootstrap.cc:654] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:45.933828 28182 raft_consensus.cc:3060] T 70fb7c326e6d4798b42697699d03ba70 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.944664 28458 raft_consensus.cc:493] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.963200 28458 raft_consensus.cc:515] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.963991 28378 tablet_bootstrap.cc:492] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:45.964488 28378 ts_tablet_manager.cc:1403] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.123s	user 0.017s	sys 0.000s
I20260709 13:08:45.965339 28458 leader_election.cc:290] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:45.966177 28470 raft_consensus.cc:493] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.966677 28470 raft_consensus.cc:515] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.967880 28451 raft_consensus.cc:493] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.968372 28451 raft_consensus.cc:515] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.968803 28470 leader_election.cc:290] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:45.968924 28385 raft_consensus.cc:515] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.970438 28451 leader_election.cc:290] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:45.971258 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6b2213d1624e8ab60743daffa01749" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:45.971930 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef17503e5d4343a8a3bd382a33be8508" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:45.972940 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef17503e5d4343a8a3bd382a33be8508" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
W20260709 13:08:45.973572 28223 leader_election.cc:343] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.970608 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6b2213d1624e8ab60743daffa01749" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
W20260709 13:08:45.975663 28221 leader_election.cc:343] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.976122 28221 leader_election.cc:304] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:45.976214 28074 leader_election.cc:304] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:45.976735 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7f29ee868b4774be667c0c3791aa0d" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:45.977056 28385 leader_election.cc:290] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:45.977910 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0c3ca5b68a47259dd1c2672f3e4b70" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
W20260709 13:08:45.978205 28295 leader_election.cc:343] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.978521 28108 raft_consensus.cc:3060] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.978735 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7f29ee868b4774be667c0c3791aa0d" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:45.979769 28451 raft_consensus.cc:2749] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:45.980706 28297 leader_election.cc:343] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:45.981174 28297 leader_election.cc:304] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:45.982000 28458 raft_consensus.cc:2749] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:45.978121 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0c3ca5b68a47259dd1c2672f3e4b70" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:45.982821 28256 raft_consensus.cc:3060] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:45.985229 28108 raft_consensus.cc:2468] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:45.985532 28381 tablet_bootstrap.cc:492] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:45.986084 28381 ts_tablet_manager.cc:1403] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.106s	user 0.008s	sys 0.008s
I20260709 13:08:45.987090 28295 leader_election.cc:304] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 
I20260709 13:08:45.988327 28406 raft_consensus.cc:2804] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:45.988830 28406 raft_consensus.cc:697] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:45.988605 28470 consensus_queue.cc:1048] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:45.989035 28381 raft_consensus.cc:359] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:45.989723 28406 consensus_queue.cc:237] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:45.990651 28256 raft_consensus.cc:2468] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:45.989732 28381 raft_consensus.cc:385] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:45.992955 28381 raft_consensus.cc:740] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:45.991261 28385 raft_consensus.cc:2749] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:45.999444 28376 tablet_bootstrap.cc:492] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:45.999997 28376 ts_tablet_manager.cc:1403] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.115s	user 0.025s	sys 0.023s
I20260709 13:08:46.001963 28441 raft_consensus.cc:515] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:46.002854 28376 raft_consensus.cc:359] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.003644 28376 raft_consensus.cc:385] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.003968 28376 raft_consensus.cc:740] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.004912 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbdcf3655d24af7b91441e5b9029d33" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:46.005048 28376 consensus_queue.cc:260] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.005555 28331 raft_consensus.cc:3060] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.005393 28378 raft_consensus.cc:359] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.006120 28378 raft_consensus.cc:385] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.006400 28378 raft_consensus.cc:740] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.007838 28376 ts_tablet_manager.cc:1434] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:46.008988 28376 tablet_bootstrap.cc:492] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:46.010617 28385 consensus_queue.cc:1048] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:46.004077 28002 catalog_manager.cc:5697] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.014147 28379 tablet_bootstrap.cc:492] T f0d5182347b142749bd1d50ce09224a8 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:46.014662 28379 ts_tablet_manager.cc:1403] T f0d5182347b142749bd1d50ce09224a8 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.240s	user 0.030s	sys 0.028s
I20260709 13:08:46.018885 28441 leader_election.cc:290] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:45.993635 28381 consensus_queue.cc:260] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.020100 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbdcf3655d24af7b91441e5b9029d33" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:46.021344 28381 ts_tablet_manager.cc:1434] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.035s	user 0.000s	sys 0.004s
W20260709 13:08:46.021589 28221 leader_election.cc:343] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.021824 28378 consensus_queue.cc:260] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.022408 28331 raft_consensus.cc:2468] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:46.023757 28381 tablet_bootstrap.cc:492] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:46.023727 28221 leader_election.cc:304] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:46.025580 28515 raft_consensus.cc:2804] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:46.026041 28515 raft_consensus.cc:697] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:46.026286 28379 raft_consensus.cc:359] T f0d5182347b142749bd1d50ce09224a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.027051 28379 raft_consensus.cc:385] T f0d5182347b142749bd1d50ce09224a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.027315 28379 raft_consensus.cc:740] T f0d5182347b142749bd1d50ce09224a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.027923 28515 consensus_queue.cc:237] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:46.030867 28376 tablet_bootstrap.cc:654] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.029629 28379 consensus_queue.cc:260] T f0d5182347b142749bd1d50ce09224a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.033910 28381 tablet_bootstrap.cc:654] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.046480 28414 consensus_queue.cc:1048] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:46.051347 28378 ts_tablet_manager.cc:1434] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.002s
I20260709 13:08:46.052757 28378 tablet_bootstrap.cc:492] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:46.068790 28378 tablet_bootstrap.cc:654] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.073553 28432 raft_consensus.cc:493] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.082336 28379 ts_tablet_manager.cc:1434] T f0d5182347b142749bd1d50ce09224a8 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:08:46.083901 28379 tablet_bootstrap.cc:492] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:46.085387 28006 catalog_manager.cc:5697] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.080148 28432 raft_consensus.cc:515] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.098208 28432 leader_election.cc:290] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:46.099004 28432 consensus_queue.cc:1048] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:46.101424 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c8f62c26f74f9e82cb8f53544e0b2c" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:46.102352 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c8f62c26f74f9e82cb8f53544e0b2c" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
W20260709 13:08:46.102967 28297 leader_election.cc:343] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:46.103832 28295 leader_election.cc:343] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.104290 28295 leader_election.cc:304] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:46.107455 28406 raft_consensus.cc:2749] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:46.119484 28381 tablet_bootstrap.cc:492] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:46.122399 28381 ts_tablet_manager.cc:1403] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.099s	user 0.035s	sys 0.032s
W20260709 13:08:46.120417 28147 consensus_peers.cc:597] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:46.127035 28529 consensus_queue.cc:1048] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:46.150504 28381 raft_consensus.cc:359] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.151319 28381 raft_consensus.cc:385] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.151598 28381 raft_consensus.cc:740] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.138798 28379 tablet_bootstrap.cc:654] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.157050 28381 consensus_queue.cc:260] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.160986 28381 ts_tablet_manager.cc:1434] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:08:46.161972 28381 tablet_bootstrap.cc:492] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:46.164819 28108 raft_consensus.cc:3060] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.117807 28002 catalog_manager.cc:5697] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.171627 28451 consensus_queue.cc:1048] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:46.207769 28470 consensus_queue.cc:1048] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:46.214329 28381 tablet_bootstrap.cc:654] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.232754 28376 tablet_bootstrap.cc:492] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:46.233330 28376 ts_tablet_manager.cc:1403] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.225s	user 0.017s	sys 0.032s
I20260709 13:08:46.232754 28378 tablet_bootstrap.cc:492] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:46.238662 28378 ts_tablet_manager.cc:1403] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.186s	user 0.018s	sys 0.009s
I20260709 13:08:46.248812 28376 raft_consensus.cc:359] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.249482 28376 raft_consensus.cc:385] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.249709 28376 raft_consensus.cc:740] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.256639 28006 catalog_manager.cc:5697] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 1 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.274854 28376 consensus_queue.cc:260] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.276371 28384 raft_consensus.cc:493] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.278707 28384 raft_consensus.cc:515] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.282500 28384 leader_election.cc:290] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:46.283653 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1112009449724fb880c6bfbb99c54b3a" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:46.284389 28328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1112009449724fb880c6bfbb99c54b3a" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:46.287465 28379 tablet_bootstrap.cc:492] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:46.287981 28379 ts_tablet_manager.cc:1403] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.204s	user 0.018s	sys 0.000s
I20260709 13:08:46.290788 28379 raft_consensus.cc:359] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.291483 28379 raft_consensus.cc:385] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.291754 28379 raft_consensus.cc:740] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.296973 28072 leader_election.cc:304] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:46.297884 28384 raft_consensus.cc:2749] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:46.298843 28379 consensus_queue.cc:260] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.305094 28379 ts_tablet_manager.cc:1434] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:08:46.306120 28379 tablet_bootstrap.cc:492] T 3958573ac72b4113b6cb6ee2303db8f9 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:46.307379 28378 raft_consensus.cc:359] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.308182 28378 raft_consensus.cc:385] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.308466 28378 raft_consensus.cc:740] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.320328 28376 ts_tablet_manager.cc:1434] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.087s	user 0.005s	sys 0.002s
I20260709 13:08:46.321399 28376 tablet_bootstrap.cc:492] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:46.331832 28381 tablet_bootstrap.cc:492] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:46.332376 28381 ts_tablet_manager.cc:1403] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.171s	user 0.027s	sys 0.028s
I20260709 13:08:46.333244 28379 tablet_bootstrap.cc:654] T 3958573ac72b4113b6cb6ee2303db8f9 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.333974 28529 raft_consensus.cc:493] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.334510 28529 raft_consensus.cc:515] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.334635 28378 consensus_queue.cc:260] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.336640 28529 leader_election.cc:290] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:46.337127 28378 ts_tablet_manager.cc:1434] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.000s
I20260709 13:08:46.338403 28378 tablet_bootstrap.cc:492] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:46.339082 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf28c2ae4fd4bcdbcc0ebcf6090342a" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:46.340507 28327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf28c2ae4fd4bcdbcc0ebcf6090342a" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:46.342902 28149 leader_election.cc:304] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:46.344143 28447 raft_consensus.cc:2749] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:46.351982 28381 raft_consensus.cc:359] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.353050 28381 raft_consensus.cc:385] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.353410 28381 raft_consensus.cc:740] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.353790 28447 raft_consensus.cc:493] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.354334 28447 raft_consensus.cc:515] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.354426 28381 consensus_queue.cc:260] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.356750 28447 leader_election.cc:290] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:46.358727 28378 tablet_bootstrap.cc:654] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.360105 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef17503e5d4343a8a3bd382a33be8508" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:46.362825 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef17503e5d4343a8a3bd382a33be8508" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:46.363562 28256 raft_consensus.cc:2468] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
I20260709 13:08:46.365064 28257 raft_consensus.cc:3060] T f0d5182347b142749bd1d50ce09224a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.360127 28376 tablet_bootstrap.cc:654] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.370709 28381 ts_tablet_manager.cc:1434] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.001s
W20260709 13:08:46.371708 28147 leader_election.cc:343] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.375553 28149 leader_election.cc:304] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:46.371718 28381 tablet_bootstrap.cc:492] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:46.377702 28447 raft_consensus.cc:2804] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:46.378079 28447 raft_consensus.cc:493] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.378414 28447 raft_consensus.cc:3060] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.380954 28529 consensus_queue.cc:1048] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:46.385924 28381 tablet_bootstrap.cc:654] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.386962 28447 raft_consensus.cc:515] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.392572 28378 tablet_bootstrap.cc:492] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:46.392998 28378 ts_tablet_manager.cc:1403] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 13:08:46.391793 28447 leader_election.cc:290] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:46.394529 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef17503e5d4343a8a3bd382a33be8508" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:46.395217 28256 raft_consensus.cc:3060] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.397213 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef17503e5d4343a8a3bd382a33be8508" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:46.397554 28378 raft_consensus.cc:359] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.398624 28378 raft_consensus.cc:385] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.399078 28378 raft_consensus.cc:740] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
W20260709 13:08:46.399577 28147 leader_election.cc:343] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.402156 28378 consensus_queue.cc:260] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.400209 28379 tablet_bootstrap.cc:492] T 3958573ac72b4113b6cb6ee2303db8f9 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:46.403545 28379 ts_tablet_manager.cc:1403] T 3958573ac72b4113b6cb6ee2303db8f9 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.013s
I20260709 13:08:46.406476 28378 ts_tablet_manager.cc:1434] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:08:46.407600 28378 tablet_bootstrap.cc:492] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:46.406492 28379 raft_consensus.cc:359] T 3958573ac72b4113b6cb6ee2303db8f9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.411180 28379 raft_consensus.cc:385] T 3958573ac72b4113b6cb6ee2303db8f9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.411463 28379 raft_consensus.cc:740] T 3958573ac72b4113b6cb6ee2303db8f9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.412829 28379 consensus_queue.cc:260] T 3958573ac72b4113b6cb6ee2303db8f9 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.417058 28447 consensus_queue.cc:1048] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:46.419471 28378 tablet_bootstrap.cc:654] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.419912 28379 ts_tablet_manager.cc:1434] T 3958573ac72b4113b6cb6ee2303db8f9 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:08:46.420945 28379 tablet_bootstrap.cc:492] T 6ccac4bb40d14b6ead1be9a53f6189cd P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:46.419473 28376 tablet_bootstrap.cc:492] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:46.422565 28376 ts_tablet_manager.cc:1403] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.101s	user 0.008s	sys 0.003s
I20260709 13:08:46.410187 28256 raft_consensus.cc:2468] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:46.424520 28555 raft_consensus.cc:493] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.424989 28555 raft_consensus.cc:515] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.426107 28149 leader_election.cc:304] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:46.425817 28376 raft_consensus.cc:359] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.426831 28376 raft_consensus.cc:385] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.427209 28376 raft_consensus.cc:740] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.429234 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819e4cfb61d7498f997e955c8d2cc490" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:46.430306 28381 tablet_bootstrap.cc:492] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
W20260709 13:08:46.430881 28074 leader_election.cc:343] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.430982 28381 ts_tablet_manager.cc:1403] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.016s
I20260709 13:08:46.431783 28555 leader_election.cc:290] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:46.433513 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819e4cfb61d7498f997e955c8d2cc490" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:46.434245 28256 raft_consensus.cc:2468] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 0.
I20260709 13:08:46.435026 28381 raft_consensus.cc:359] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.435489 28074 leader_election.cc:304] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:46.435995 28381 raft_consensus.cc:385] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.436611 28381 raft_consensus.cc:740] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.436831 28555 raft_consensus.cc:2804] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:46.437352 28557 raft_consensus.cc:2804] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:46.437352 28555 raft_consensus.cc:493] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.438400 28555 raft_consensus.cc:3060] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.438040 28381 consensus_queue.cc:260] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.438767 28379 tablet_bootstrap.cc:654] T 6ccac4bb40d14b6ead1be9a53f6189cd P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.428200 28376 consensus_queue.cc:260] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.441830 28376 ts_tablet_manager.cc:1434] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:08:46.444629 28376 tablet_bootstrap.cc:492] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:46.441515 28557 raft_consensus.cc:697] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:46.447809 28557 consensus_queue.cc:237] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.450109 28381 ts_tablet_manager.cc:1434] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:08:46.450332 28406 raft_consensus.cc:493] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.450850 28406 raft_consensus.cc:515] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.451285 28381 tablet_bootstrap.cc:492] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:46.449981 28105 raft_consensus.cc:3060] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.455853 28406 leader_election.cc:290] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:46.464401 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3958573ac72b4113b6cb6ee2303db8f9" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:46.465103 28256 raft_consensus.cc:2468] T 3958573ac72b4113b6cb6ee2303db8f9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:46.457149 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3958573ac72b4113b6cb6ee2303db8f9" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:46.466889 28182 raft_consensus.cc:2468] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:46.479264 28378 tablet_bootstrap.cc:492] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:46.480014 28378 ts_tablet_manager.cc:1403] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.000s
I20260709 13:08:46.484519 28297 leader_election.cc:304] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:08:46.486833 28470 raft_consensus.cc:2804] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:46.487373 28470 raft_consensus.cc:493] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:46.487464 28221 consensus_peers.cc:597] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:46.487867 28470 raft_consensus.cc:3060] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.488425 28406 consensus_queue.cc:1048] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:46.497650 28378 raft_consensus.cc:359] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.498358 28378 raft_consensus.cc:385] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.498641 28378 raft_consensus.cc:740] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.499296 28378 consensus_queue.cc:260] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.503633 28378 ts_tablet_manager.cc:1434] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:08:46.504588 28378 tablet_bootstrap.cc:492] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:46.504487 28107 raft_consensus.cc:3060] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.509574 28381 tablet_bootstrap.cc:654] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.540437 28378 tablet_bootstrap.cc:654] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.543097 28555 raft_consensus.cc:515] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.546168 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819e4cfb61d7498f997e955c8d2cc490" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
W20260709 13:08:46.547670 28074 leader_election.cc:343] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.548377 28379 tablet_bootstrap.cc:492] T 6ccac4bb40d14b6ead1be9a53f6189cd P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:46.548906 28379 ts_tablet_manager.cc:1403] T 6ccac4bb40d14b6ead1be9a53f6189cd P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.128s	user 0.024s	sys 0.018s
I20260709 13:08:46.551926 28470 raft_consensus.cc:515] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.553858 28379 raft_consensus.cc:359] T 6ccac4bb40d14b6ead1be9a53f6189cd P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.556210 28379 raft_consensus.cc:385] T 6ccac4bb40d14b6ead1be9a53f6189cd P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.556468 28379 raft_consensus.cc:740] T 6ccac4bb40d14b6ead1be9a53f6189cd P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.557346 28003 catalog_manager.cc:5697] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.559711 28379 consensus_queue.cc:260] T 6ccac4bb40d14b6ead1be9a53f6189cd P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.563947 28470 leader_election.cc:290] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:46.569844 28555 leader_election.cc:290] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:46.571026 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819e4cfb61d7498f997e955c8d2cc490" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:46.571308 28381 tablet_bootstrap.cc:492] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:46.571653 28256 raft_consensus.cc:3060] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.571843 28381 ts_tablet_manager.cc:1403] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.121s	user 0.014s	sys 0.007s
I20260709 13:08:46.574784 28381 raft_consensus.cc:359] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.575526 28381 raft_consensus.cc:385] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.575778 28381 raft_consensus.cc:740] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.576388 28381 consensus_queue.cc:260] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.578672 28381 ts_tablet_manager.cc:1434] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:46.565178 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3958573ac72b4113b6cb6ee2303db8f9" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:46.578959 28256 raft_consensus.cc:2468] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 1.
I20260709 13:08:46.579526 28182 raft_consensus.cc:3060] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.579710 28381 tablet_bootstrap.cc:492] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:46.580281 28074 leader_election.cc:304] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:46.582829 28555 raft_consensus.cc:2804] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:46.583401 28555 raft_consensus.cc:697] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:08:46.584226 28555 consensus_queue.cc:237] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.586880 28381 tablet_bootstrap.cc:654] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.592065 28414 consensus_queue.cc:1048] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:46.596642 28379 ts_tablet_manager.cc:1434] T 6ccac4bb40d14b6ead1be9a53f6189cd P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.047s	user 0.002s	sys 0.005s
I20260709 13:08:46.597558 28379 tablet_bootstrap.cc:492] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:46.601361 28376 tablet_bootstrap.cc:654] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.613140 28385 consensus_queue.cc:1048] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:46.616019 28183 raft_consensus.cc:3060] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.637856 28182 raft_consensus.cc:2468] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:46.645426 28406 raft_consensus.cc:493] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.647441 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3958573ac72b4113b6cb6ee2303db8f9" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:46.666451 28378 tablet_bootstrap.cc:492] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:46.667150 28378 ts_tablet_manager.cc:1403] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.163s	user 0.017s	sys 0.002s
I20260709 13:08:46.662529 28256 raft_consensus.cc:3060] T 3958573ac72b4113b6cb6ee2303db8f9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.663692 28432 raft_consensus.cc:493] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.684903 28432 raft_consensus.cc:515] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.661823 28297 leader_election.cc:304] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:08:46.687711 28385 raft_consensus.cc:2804] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:46.658586 28406 raft_consensus.cc:515] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.688413 28381 tablet_bootstrap.cc:492] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:46.689018 28381 ts_tablet_manager.cc:1403] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.109s	user 0.020s	sys 0.030s
I20260709 13:08:46.691879 28381 raft_consensus.cc:359] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.692543 28381 raft_consensus.cc:385] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.692642 28406 leader_election.cc:290] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:46.692828 28381 raft_consensus.cc:740] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.693689 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3cddbcf51c4690badc33c2cd58e0aa" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:46.693710 28381 consensus_queue.cc:260] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
W20260709 13:08:46.695398 28297 leader_election.cc:343] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.695271 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3cddbcf51c4690badc33c2cd58e0aa" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:46.696939 28381 ts_tablet_manager.cc:1434] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:08:46.697911 28381 tablet_bootstrap.cc:492] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:46.703131 28379 tablet_bootstrap.cc:654] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.707425 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483dc2ac5ecf492087dcef4c6fa1770c" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:46.708148 28182 raft_consensus.cc:2468] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:46.709333 28432 leader_election.cc:290] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
W20260709 13:08:46.709892 28054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:46.711024 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483dc2ac5ecf492087dcef4c6fa1770c" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
W20260709 13:08:46.711647 28295 leader_election.cc:343] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.716952 28557 raft_consensus.cc:493] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.721326 28257 raft_consensus.cc:2468] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:46.721349 28295 leader_election.cc:304] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:46.719103 28378 raft_consensus.cc:359] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.722690 28378 raft_consensus.cc:385] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.722980 28378 raft_consensus.cc:740] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.723405 28432 raft_consensus.cc:2749] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:46.723762 28378 consensus_queue.cc:260] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.727972 28378 ts_tablet_manager.cc:1434] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:08:46.727281 28002 catalog_manager.cc:5697] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.721696 28557 raft_consensus.cc:515] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.720695 28297 leader_election.cc:304] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:08:46.732561 28378 tablet_bootstrap.cc:492] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:46.734553 28376 tablet_bootstrap.cc:492] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:46.735127 28376 ts_tablet_manager.cc:1403] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.292s	user 0.030s	sys 0.012s
I20260709 13:08:46.742138 28470 raft_consensus.cc:2804] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:46.749337 28470 raft_consensus.cc:493] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.749703 28470 raft_consensus.cc:3060] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.748118 28385 raft_consensus.cc:697] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:46.755707 28557 leader_election.cc:290] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:46.760605 28327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d36af7735d4ca5bd3119a4f8411e18" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:46.761560 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d36af7735d4ca5bd3119a4f8411e18" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:46.763581 28441 raft_consensus.cc:493] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.764070 28441 raft_consensus.cc:515] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
W20260709 13:08:46.763041 28147 leader_election.cc:343] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.772972 28441 leader_election.cc:290] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:46.774830 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35580b937e5c492e9ad0e2bcaa176e96" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:46.776628 28381 tablet_bootstrap.cc:654] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.777640 28432 raft_consensus.cc:493] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:46.777923 28223 leader_election.cc:343] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.778200 28432 raft_consensus.cc:515] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.779217 28327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35580b937e5c492e9ad0e2bcaa176e96" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:46.779865 28327 raft_consensus.cc:2468] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:46.780373 28432 leader_election.cc:290] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
W20260709 13:08:46.778481 28147 leader_election.cc:343] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.789280 28147 leader_election.cc:304] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:46.770498 28376 raft_consensus.cc:359] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:46.785621 28256 raft_consensus.cc:2468] T 3958573ac72b4113b6cb6ee2303db8f9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:46.790163 28557 raft_consensus.cc:2749] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:46.787334 28221 leader_election.cc:304] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:46.790956 28376 raft_consensus.cc:385] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.808168 28376 raft_consensus.cc:740] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.809262 28376 consensus_queue.cc:260] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:46.812382 28376 ts_tablet_manager.cc:1434] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260709 13:08:46.813773 28376 tablet_bootstrap.cc:492] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:46.788816 28378 tablet_bootstrap.cc:654] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.785923 28470 raft_consensus.cc:515] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.785817 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35580b937e5c492e9ad0e2bcaa176e96" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:46.791497 28441 raft_consensus.cc:2804] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:46.815496 28441 raft_consensus.cc:493] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.815891 28441 raft_consensus.cc:3060] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.820195 28470 leader_election.cc:290] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:46.823487 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483dc2ac5ecf492087dcef4c6fa1770c" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:46.824108 28256 raft_consensus.cc:3060] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.827682 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483dc2ac5ecf492087dcef4c6fa1770c" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:46.828362 28182 raft_consensus.cc:3060] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.830185 28557 raft_consensus.cc:493] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.830694 28557 raft_consensus.cc:515] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
W20260709 13:08:46.845297 28147 consensus_peers.cc:597] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:46.860644 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccac4bb40d14b6ead1be9a53f6189cd" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:46.861364 28107 raft_consensus.cc:2468] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
I20260709 13:08:46.862862 28147 leader_election.cc:304] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:08:46.863507 28376 tablet_bootstrap.cc:654] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.864015 28378 tablet_bootstrap.cc:492] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:46.864539 28378 ts_tablet_manager.cc:1403] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.133s	user 0.011s	sys 0.009s
I20260709 13:08:46.864650 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccac4bb40d14b6ead1be9a53f6189cd" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:46.865386 28255 raft_consensus.cc:2468] T 6ccac4bb40d14b6ead1be9a53f6189cd P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
I20260709 13:08:46.867192 28576 raft_consensus.cc:2804] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:46.867609 28576 raft_consensus.cc:493] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.867432 28378 raft_consensus.cc:359] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.867992 28576 raft_consensus.cc:3060] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.868142 28378 raft_consensus.cc:385] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.868513 28378 raft_consensus.cc:740] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.869120 28378 consensus_queue.cc:260] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.861375 28557 leader_election.cc:290] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:46.792047 28379 tablet_bootstrap.cc:492] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:46.792603 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35580b937e5c492e9ad0e2bcaa176e96" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:46.767303 28385 consensus_queue.cc:237] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.871110 28379 ts_tablet_manager.cc:1403] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.274s	user 0.006s	sys 0.015s
I20260709 13:08:46.871613 28378 ts_tablet_manager.cc:1434] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:08:46.872601 28378 tablet_bootstrap.cc:492] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:46.875458 28441 raft_consensus.cc:515] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.878362 28256 raft_consensus.cc:2468] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:46.879278 28376 tablet_bootstrap.cc:492] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:46.879542 28257 raft_consensus.cc:2393] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 60d640828dc841619730621ec09d4c64 in current term 1: Already voted for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in this term.
I20260709 13:08:46.879956 28376 ts_tablet_manager.cc:1403] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.000s
I20260709 13:08:46.881270 28381 tablet_bootstrap.cc:492] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:46.886214 28381 ts_tablet_manager.cc:1403] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.189s	user 0.010s	sys 0.014s
I20260709 13:08:46.885794 28376 raft_consensus.cc:359] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.884322 28182 raft_consensus.cc:2468] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:46.887108 28376 raft_consensus.cc:385] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.887418 28297 leader_election.cc:304] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:46.887648 28376 raft_consensus.cc:740] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.885494 28379 raft_consensus.cc:359] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:46.888558 28379 raft_consensus.cc:385] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.888939 28379 raft_consensus.cc:740] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.888600 28376 consensus_queue.cc:260] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:46.889626 28379 consensus_queue.cc:260] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:46.878394 28378 tablet_bootstrap.cc:654] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.891676 28379 ts_tablet_manager.cc:1434] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
W20260709 13:08:46.893956 28297 leader_election.cc:343] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.894423 28297 leader_election.cc:304] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:46.895169 28470 raft_consensus.cc:2804] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:46.895702 28470 raft_consensus.cc:697] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:46.895735 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35580b937e5c492e9ad0e2bcaa176e96" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:46.897586 28578 raft_consensus.cc:3060] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.898151 28005 catalog_manager.cc:5697] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:46.899009 28378 tablet_bootstrap.cc:492] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:46.899539 28378 ts_tablet_manager.cc:1403] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.005s
I20260709 13:08:46.900940 28441 leader_election.cc:290] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
W20260709 13:08:46.902716 28223 leader_election.cc:343] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.902583 28378 raft_consensus.cc:359] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.902833 28381 raft_consensus.cc:359] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.903632 28381 raft_consensus.cc:385] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.903931 28381 raft_consensus.cc:740] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.904166 28327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35580b937e5c492e9ad0e2bcaa176e96" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:46.896611 28470 consensus_queue.cc:237] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.903318 28378 raft_consensus.cc:385] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.907060 28378 raft_consensus.cc:740] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.907888 28378 consensus_queue.cc:260] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.910216 28378 ts_tablet_manager.cc:1434] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:46.911140 28378 tablet_bootstrap.cc:492] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:46.916565 28376 ts_tablet_manager.cc:1434] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:08:46.916843 28379 tablet_bootstrap.cc:492] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:46.919301 28557 raft_consensus.cc:493] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.919835 28557 raft_consensus.cc:515] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.922292 28557 leader_election.cc:290] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:46.923192 28381 consensus_queue.cc:260] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.923791 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fffb1e4048464bbca5a6415161d48c" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
W20260709 13:08:46.925175 28149 leader_election.cc:343] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.925972 28378 tablet_bootstrap.cc:654] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.926287 28376 tablet_bootstrap.cc:492] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:46.926415 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fffb1e4048464bbca5a6415161d48c" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:46.927120 28331 raft_consensus.cc:2468] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
I20260709 13:08:46.928489 28381 ts_tablet_manager.cc:1434] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:08:46.929104 28147 leader_election.cc:304] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:46.929513 28381 tablet_bootstrap.cc:492] T b594683784854e99994376f255918d99 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:46.929913 28557 raft_consensus.cc:2804] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:46.930276 28557 raft_consensus.cc:493] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.930614 28557 raft_consensus.cc:3060] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.933009 28578 raft_consensus.cc:2749] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:46.937799 28376 tablet_bootstrap.cc:654] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.939321 28557 raft_consensus.cc:515] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.942076 28327 raft_consensus.cc:2468] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:46.942243 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fffb1e4048464bbca5a6415161d48c" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
W20260709 13:08:46.944048 28149 leader_election.cc:343] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.946072 28378 tablet_bootstrap.cc:492] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:46.946744 28378 ts_tablet_manager.cc:1403] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.003s
I20260709 13:08:46.949365 28379 tablet_bootstrap.cc:654] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.950452 28378 raft_consensus.cc:359] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.951220 28378 raft_consensus.cc:385] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.951454 28557 leader_election.cc:290] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:46.954536 28381 tablet_bootstrap.cc:654] T b594683784854e99994376f255918d99 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:46.951493 28378 raft_consensus.cc:740] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.955734 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fffb1e4048464bbca5a6415161d48c" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:46.956393 28331 raft_consensus.cc:3060] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:46.959198 28376 tablet_bootstrap.cc:492] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:46.960078 28376 ts_tablet_manager.cc:1403] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.008s
I20260709 13:08:46.962984 28376 raft_consensus.cc:359] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.963852 28376 raft_consensus.cc:385] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:46.964188 28376 raft_consensus.cc:740] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:46.965426 28331 raft_consensus.cc:2468] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:46.967437 28147 leader_election.cc:304] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:46.955726 28378 consensus_queue.cc:260] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.968979 28557 raft_consensus.cc:2804] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:46.969588 28557 raft_consensus.cc:697] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:46.970490 28557 consensus_queue.cc:237] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.971072 28221 leader_election.cc:304] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:46.965003 28376 consensus_queue.cc:260] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:46.972594 28451 raft_consensus.cc:2804] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:46.973206 28451 raft_consensus.cc:697] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:46.974287 28451 consensus_queue.cc:237] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:46.978653 28447 consensus_queue.cc:1048] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:46.980396 28441 raft_consensus.cc:493] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.981081 28441 raft_consensus.cc:515] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:46.982986 28376 ts_tablet_manager.cc:1434] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:08:46.986992 28441 leader_election.cc:290] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:46.987380 28378 ts_tablet_manager.cc:1434] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:08:46.988891 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7f29ee868b4774be667c0c3791aa0d" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
W20260709 13:08:46.990716 28221 leader_election.cc:343] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:46.992208 28378 tablet_bootstrap.cc:492] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:46.994871 28376 tablet_bootstrap.cc:492] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:46.997118 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7f29ee868b4774be667c0c3791aa0d" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:46.997819 28331 raft_consensus.cc:2468] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:46.999207 28221 leader_election.cc:304] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:47.000656 28441 raft_consensus.cc:2804] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:47.001160 28441 raft_consensus.cc:493] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.001605 28441 raft_consensus.cc:3060] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.006522 28376 tablet_bootstrap.cc:654] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.012341 28379 tablet_bootstrap.cc:492] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:47.013520 28379 ts_tablet_manager.cc:1403] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.006s
I20260709 13:08:46.946367 28576 raft_consensus.cc:515] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.025699 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccac4bb40d14b6ead1be9a53f6189cd" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:47.026304 28105 raft_consensus.cc:3060] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.028677 28578 raft_consensus.cc:493] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.029187 28578 raft_consensus.cc:515] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:47.031157 28005 catalog_manager.cc:5697] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.032058 28578 leader_election.cc:290] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:47.034499 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e2fa350a754b899e6ce07a88e62ba5" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:47.035620 28555 raft_consensus.cc:493] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.036190 28555 raft_consensus.cc:515] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
W20260709 13:08:47.037312 28297 leader_election.cc:343] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:47.035516 28379 raft_consensus.cc:359] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:47.038395 28379 raft_consensus.cc:385] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.039402 28379 raft_consensus.cc:740] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.040222 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbdcf3655d24af7b91441e5b9029d33" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:47.041579 28379 consensus_queue.cc:260] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:47.042366 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e2fa350a754b899e6ce07a88e62ba5" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:47.043393 28557 raft_consensus.cc:493] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.046092 28557 raft_consensus.cc:515] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:47.047443 28327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbdcf3655d24af7b91441e5b9029d33" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
W20260709 13:08:47.048096 28297 leader_election.cc:343] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:47.049013 28074 consensus_peers.cc:597] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:47.049295 28297 leader_election.cc:304] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:47.038579 28555 leader_election.cc:290] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:47.050597 28385 raft_consensus.cc:2749] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:47.048297 28381 tablet_bootstrap.cc:492] T b594683784854e99994376f255918d99 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:47.051353 28557 leader_election.cc:290] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:47.051496 28381 ts_tablet_manager.cc:1403] T b594683784854e99994376f255918d99 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.122s	user 0.009s	sys 0.007s
I20260709 13:08:47.052788 28105 raft_consensus.cc:2468] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:47.054143 28147 leader_election.cc:304] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:08:47.055454 28072 leader_election.cc:304] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:47.057379 28384 raft_consensus.cc:2749] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:47.058015 28379 ts_tablet_manager.cc:1434] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:08:47.059167 28529 raft_consensus.cc:2804] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:47.060403 28529 raft_consensus.cc:697] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:47.061565 28379 tablet_bootstrap.cc:492] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:47.064869 28378 tablet_bootstrap.cc:654] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.058944 28381 raft_consensus.cc:359] T b594683784854e99994376f255918d99 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.061357 28529 consensus_queue.cc:237] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.066326 28381 raft_consensus.cc:385] T b594683784854e99994376f255918d99 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.067577 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccac4bb40d14b6ead1be9a53f6189cd" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:47.067162 28376 tablet_bootstrap.cc:492] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:47.068207 28256 raft_consensus.cc:3060] T 6ccac4bb40d14b6ead1be9a53f6189cd P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.068885 28376 ts_tablet_manager.cc:1403] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.008s
I20260709 13:08:47.069407 28327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35580b937e5c492e9ad0e2bcaa176e96" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:47.070374 28327 raft_consensus.cc:2393] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8938bce1e7864c1ab26755f60f708368 in current term 1: Already voted for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in this term.
I20260709 13:08:47.071295 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35580b937e5c492e9ad0e2bcaa176e96" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:47.072685 28149 leader_election.cc:304] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:47.073992 28557 raft_consensus.cc:3060] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.078662 28379 tablet_bootstrap.cc:654] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.081792 28256 raft_consensus.cc:2468] T 6ccac4bb40d14b6ead1be9a53f6189cd P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:47.080221 28376 raft_consensus.cc:359] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.086285 28376 raft_consensus.cc:385] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.086671 28376 raft_consensus.cc:740] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.086958 28441 raft_consensus.cc:515] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.082309 28576 leader_election.cc:290] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:47.088315 28376 consensus_queue.cc:260] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.067615 28381 raft_consensus.cc:740] T b594683784854e99994376f255918d99 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.095959 28381 consensus_queue.cc:260] T b594683784854e99994376f255918d99 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.099988 28376 ts_tablet_manager.cc:1434] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:08:47.101547 28376 tablet_bootstrap.cc:492] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:47.107978 28376 tablet_bootstrap.cc:654] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.112385 28381 ts_tablet_manager.cc:1434] T b594683784854e99994376f255918d99 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.000s
I20260709 13:08:47.113510 28381 tablet_bootstrap.cc:492] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:47.124789 28376 tablet_bootstrap.cc:492] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:47.127712 28376 ts_tablet_manager.cc:1403] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 13:08:47.127127 28379 tablet_bootstrap.cc:492] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:47.129145 28379 ts_tablet_manager.cc:1403] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.007s
I20260709 13:08:47.131387 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7f29ee868b4774be667c0c3791aa0d" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:47.127704 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7f29ee868b4774be667c0c3791aa0d" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:47.132635 28331 raft_consensus.cc:3060] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.132838 28107 raft_consensus.cc:3060] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.122156 28005 catalog_manager.cc:5697] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.139901 28378 tablet_bootstrap.cc:492] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:47.140588 28379 raft_consensus.cc:359] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.126542 28441 leader_election.cc:290] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:47.141716 28379 raft_consensus.cc:385] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.142242 28381 tablet_bootstrap.cc:654] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.141235 28378 ts_tablet_manager.cc:1403] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.149s	user 0.011s	sys 0.002s
I20260709 13:08:47.142204 28379 raft_consensus.cc:740] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.147526 28379 consensus_queue.cc:260] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.150563 28379 ts_tablet_manager.cc:1434] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
W20260709 13:08:47.151068 28221 leader_election.cc:343] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:47.146171 28378 raft_consensus.cc:359] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.151585 28557 raft_consensus.cc:2749] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:47.152797 28378 raft_consensus.cc:385] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.154230 28003 catalog_manager.cc:5697] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 1 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.157430 28376 raft_consensus.cc:359] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.160043 28378 raft_consensus.cc:740] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.160485 28376 raft_consensus.cc:385] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.161238 28376 raft_consensus.cc:740] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.163621 28376 consensus_queue.cc:260] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.166136 28376 ts_tablet_manager.cc:1434] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.004s
I20260709 13:08:47.167359 28379 tablet_bootstrap.cc:492] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:47.168002 28378 consensus_queue.cc:260] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.169823 28378 ts_tablet_manager.cc:1434] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:08:47.170168 28596 raft_consensus.cc:493] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.170778 28378 tablet_bootstrap.cc:492] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:47.170689 28596 raft_consensus.cc:515] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.171634 28555 raft_consensus.cc:493] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.172142 28555 raft_consensus.cc:515] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.173813 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b594683784854e99994376f255918d99" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:47.174328 28555 leader_election.cc:290] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:47.174551 28376 tablet_bootstrap.cc:492] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:47.174520 28105 raft_consensus.cc:2468] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:47.174798 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b594683784854e99994376f255918d99" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:47.175664 28183 raft_consensus.cc:2468] T b594683784854e99994376f255918d99 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:47.176486 28328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c8f62c26f74f9e82cb8f53544e0b2c" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:47.176628 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c8f62c26f74f9e82cb8f53544e0b2c" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:47.177160 28328 raft_consensus.cc:2468] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 0.
I20260709 13:08:47.178169 28223 leader_election.cc:304] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:47.179083 28600 raft_consensus.cc:2804] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:47.179163 28072 leader_election.cc:304] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 
I20260709 13:08:47.179507 28600 raft_consensus.cc:493] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.179876 28600 raft_consensus.cc:3060] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.180238 28384 raft_consensus.cc:2804] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:47.180636 28384 raft_consensus.cc:493] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.180967 28384 raft_consensus.cc:3060] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.181137 28376 tablet_bootstrap.cc:654] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:47.183709 28074 leader_election.cc:343] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:47.185525 28331 raft_consensus.cc:2468] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:47.190464 28006 catalog_manager.cc:5697] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.188772 28596 leader_election.cc:290] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:47.195454 28378 tablet_bootstrap.cc:654] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.197903 28381 tablet_bootstrap.cc:492] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:47.198370 28381 ts_tablet_manager.cc:1403] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.003s
I20260709 13:08:47.213254 28384 raft_consensus.cc:515] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.214784 28379 tablet_bootstrap.cc:654] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.221791 28600 raft_consensus.cc:515] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.222335 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c8f62c26f74f9e82cb8f53544e0b2c" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:47.218858 28555 consensus_queue.cc:1048] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:08:47.222995 28331 raft_consensus.cc:3060] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.227097 28600 leader_election.cc:290] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:47.227977 28221 leader_election.cc:304] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:47.228261 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b594683784854e99994376f255918d99" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:47.228845 28182 raft_consensus.cc:3060] T b594683784854e99994376f255918d99 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.231829 28331 raft_consensus.cc:2468] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 1.
I20260709 13:08:47.234206 28381 raft_consensus.cc:359] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.235539 28381 raft_consensus.cc:385] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.235812 28381 raft_consensus.cc:740] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.231587 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b594683784854e99994376f255918d99" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:47.236522 28107 raft_consensus.cc:3060] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.236470 28381 consensus_queue.cc:260] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.240787 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c8f62c26f74f9e82cb8f53544e0b2c" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
W20260709 13:08:47.242274 28074 leader_election.cc:343] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:47.242892 28384 leader_election.cc:290] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:47.231348 28600 raft_consensus.cc:2804] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:47.243222 28072 leader_election.cc:304] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:47.244484 28555 raft_consensus.cc:2804] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:47.244525 28600 raft_consensus.cc:697] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:47.245064 28384 raft_consensus.cc:493] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.245936 28600 consensus_queue.cc:237] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.239435 28381 ts_tablet_manager.cc:1434] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 13:08:47.253016 28381 tablet_bootstrap.cc:492] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:47.255092 28384 raft_consensus.cc:515] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.257251 28384 leader_election.cc:290] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:47.258301 28378 tablet_bootstrap.cc:492] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:47.258829 28378 ts_tablet_manager.cc:1403] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.010s
I20260709 13:08:47.261214 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef17503e5d4343a8a3bd382a33be8508" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:47.262645 28376 tablet_bootstrap.cc:492] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:47.261210 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef17503e5d4343a8a3bd382a33be8508" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:47.264292 28376 ts_tablet_manager.cc:1403] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.097s	user 0.029s	sys 0.006s
I20260709 13:08:47.264616 28074 leader_election.cc:304] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:47.265770 28384 raft_consensus.cc:2749] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:47.267376 28376 raft_consensus.cc:359] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.268049 28376 raft_consensus.cc:385] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.268327 28376 raft_consensus.cc:740] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.269022 28376 consensus_queue.cc:260] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.270473 28376 ts_tablet_manager.cc:1434] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:08:47.271992 28376 tablet_bootstrap.cc:492] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:47.272616 28378 raft_consensus.cc:359] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.273396 28378 raft_consensus.cc:385] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.273665 28378 raft_consensus.cc:740] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.276906 28378 consensus_queue.cc:260] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.280776 28470 raft_consensus.cc:493] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.281279 28470 raft_consensus.cc:515] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.284778 28378 ts_tablet_manager.cc:1434] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:08:47.287837 28378 tablet_bootstrap.cc:492] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:47.274659 28107 raft_consensus.cc:2468] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:47.289712 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d36af7735d4ca5bd3119a4f8411e18" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:47.289994 28221 leader_election.cc:304] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:47.290397 28105 raft_consensus.cc:2468] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:47.291095 28441 raft_consensus.cc:2804] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:47.291612 28441 raft_consensus.cc:697] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:47.291734 28295 leader_election.cc:304] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 
I20260709 13:08:47.289912 28381 tablet_bootstrap.cc:654] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.292464 28441 consensus_queue.cc:237] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.293244 28432 raft_consensus.cc:2804] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:47.293375 28385 consensus_queue.cc:1048] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:47.293700 28432 raft_consensus.cc:493] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.294070 28432 raft_consensus.cc:3060] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.297755 28470 leader_election.cc:290] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:47.299309 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d36af7735d4ca5bd3119a4f8411e18" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:47.300119 28180 raft_consensus.cc:2468] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:47.300320 28182 raft_consensus.cc:2468] T b594683784854e99994376f255918d99 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:47.288570 28555 raft_consensus.cc:697] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:08:47.305462 28596 raft_consensus.cc:493] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.306051 28596 raft_consensus.cc:515] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:47.321485 28555 consensus_queue.cc:237] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.323459 28432 raft_consensus.cc:515] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.339164 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fffb1e4048464bbca5a6415161d48c" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:47.330013 28596 leader_election.cc:290] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:47.344478 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fffb1e4048464bbca5a6415161d48c" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:47.345685 28331 raft_consensus.cc:2393] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd66bd010fa04c4c8d0a668a77bd4c6d in current term 1: Already voted for candidate 8938bce1e7864c1ab26755f60f708368 in this term.
I20260709 13:08:47.348448 28223 leader_election.cc:304] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:47.351428 28414 raft_consensus.cc:3060] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.353360 28470 consensus_queue.cc:1048] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:47.356539 28376 tablet_bootstrap.cc:654] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.361814 28470 consensus_queue.cc:1048] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:47.367959 28379 tablet_bootstrap.cc:492] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:47.368589 28379 ts_tablet_manager.cc:1403] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.208s	user 0.009s	sys 0.023s
I20260709 13:08:47.371973 28379 raft_consensus.cc:359] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.373160 28379 raft_consensus.cc:385] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.373594 28379 raft_consensus.cc:740] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.374343 28379 consensus_queue.cc:260] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.384238 28378 tablet_bootstrap.cc:654] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.393510 28379 ts_tablet_manager.cc:1434] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:08:47.394891 28381 tablet_bootstrap.cc:492] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:47.397486 28381 ts_tablet_manager.cc:1403] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.145s	user 0.017s	sys 0.006s
I20260709 13:08:47.398075 28379 tablet_bootstrap.cc:492] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:47.399940 28381 raft_consensus.cc:359] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.400450 28381 raft_consensus.cc:385] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.400733 28381 raft_consensus.cc:740] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.401235 28381 consensus_queue.cc:260] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.402794 28381 ts_tablet_manager.cc:1434] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.000s
I20260709 13:08:47.403600 28381 tablet_bootstrap.cc:492] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:47.407233 28379 tablet_bootstrap.cc:654] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.410642 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d36af7735d4ca5bd3119a4f8411e18" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:47.411315 28105 raft_consensus.cc:3060] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.411734 28381 tablet_bootstrap.cc:654] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.409274 28432 leader_election.cc:290] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:47.423523 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d36af7735d4ca5bd3119a4f8411e18" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:47.424247 28183 raft_consensus.cc:3060] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.428998 28107 raft_consensus.cc:3060] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.434237 28414 raft_consensus.cc:2749] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:47.437443 28005 catalog_manager.cc:5697] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.438678 28376 tablet_bootstrap.cc:492] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:47.439448 28376 ts_tablet_manager.cc:1403] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.168s	user 0.019s	sys 0.022s
I20260709 13:08:47.442157 28183 raft_consensus.cc:2468] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:47.442636 28384 raft_consensus.cc:493] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.449067 28384 raft_consensus.cc:515] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.451308 28384 leader_election.cc:290] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:47.452349 28557 consensus_queue.cc:1048] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:47.452919 28328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7f29ee868b4774be667c0c3791aa0d" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:47.453778 28328 raft_consensus.cc:2393] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d2bb5df3b55462682d0f2fce57709f1 in current term 1: Already voted for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in this term.
I20260709 13:08:47.442957 28376 raft_consensus.cc:359] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.458866 28376 raft_consensus.cc:385] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.459270 28376 raft_consensus.cc:740] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.461808 28105 raft_consensus.cc:2468] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:47.465785 28295 leader_election.cc:304] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 
I20260709 13:08:47.467003 28378 tablet_bootstrap.cc:492] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:47.461506 28376 consensus_queue.cc:260] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.469238 28378 ts_tablet_manager.cc:1403] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.182s	user 0.017s	sys 0.008s
I20260709 13:08:47.474006 28594 consensus_queue.cc:1048] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:47.480649 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7f29ee868b4774be667c0c3791aa0d" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:47.482636 28074 leader_election.cc:304] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:47.477650 28002 catalog_manager.cc:5697] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 1 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.484225 28384 raft_consensus.cc:3060] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.485478 28002 catalog_manager.cc:5697] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 1 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.487524 28470 raft_consensus.cc:2804] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:47.488214 28470 raft_consensus.cc:697] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:47.489264 28470 consensus_queue.cc:237] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.489822 28378 raft_consensus.cc:359] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.490516 28378 raft_consensus.cc:385] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.490803 28376 ts_tablet_manager.cc:1434] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:08:47.494092 28609 raft_consensus.cc:493] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.494581 28609 raft_consensus.cc:515] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.490831 28378 raft_consensus.cc:740] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.496269 28378 consensus_queue.cc:260] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.496654 28385 consensus_queue.cc:1048] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:47.496886 28609 leader_election.cc:290] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:47.497882 28378 ts_tablet_manager.cc:1434] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.002s
I20260709 13:08:47.499185 28254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec0b05c6a554a24a2576d6308dd6861" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:47.500456 28601 consensus_queue.cc:1048] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:47.503177 28378 tablet_bootstrap.cc:492] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
W20260709 13:08:47.523566 28074 leader_election.cc:343] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:47.530627 28328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec0b05c6a554a24a2576d6308dd6861" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:47.531404 28328 raft_consensus.cc:2468] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 0.
I20260709 13:08:47.526155 28594 raft_consensus.cc:493] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.548210 28381 tablet_bootstrap.cc:492] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:47.549353 28381 ts_tablet_manager.cc:1403] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.146s	user 0.021s	sys 0.006s
I20260709 13:08:47.554402 28376 tablet_bootstrap.cc:492] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:47.549507 28594 raft_consensus.cc:515] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.559538 28594 leader_election.cc:290] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:47.562811 28378 tablet_bootstrap.cc:654] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.548775 28072 leader_election.cc:304] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:47.590423 28379 tablet_bootstrap.cc:492] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:47.591182 28379 ts_tablet_manager.cc:1403] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.193s	user 0.034s	sys 0.031s
I20260709 13:08:47.594813 28609 raft_consensus.cc:2804] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:47.575433 28601 consensus_queue.cc:1048] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:08:47.605247 28376 tablet_bootstrap.cc:654] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.604967 28609 raft_consensus.cc:493] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.611917 28609 raft_consensus.cc:3060] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.614686 28006 catalog_manager.cc:5697] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.623299 28384 raft_consensus.cc:2749] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:47.598636 28381 raft_consensus.cc:359] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.629503 28379 raft_consensus.cc:359] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.635587 28381 raft_consensus.cc:385] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.635641 28379 raft_consensus.cc:385] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.636341 28379 raft_consensus.cc:740] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.636219 28381 raft_consensus.cc:740] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.638967 28381 consensus_queue.cc:260] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.640183 28379 consensus_queue.cc:260] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
W20260709 13:08:47.641875 28072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:46171, user_credentials={real_user=slave}} blocked reactor thread for 98650.9us
I20260709 13:08:47.661739 28379 ts_tablet_manager.cc:1434] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.070s	user 0.010s	sys 0.000s
I20260709 13:08:47.663242 28379 tablet_bootstrap.cc:492] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:47.663919 28381 ts_tablet_manager.cc:1434] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.114s	user 0.009s	sys 0.000s
I20260709 13:08:47.668654 28381 tablet_bootstrap.cc:492] T e4e2fa350a754b899e6ce07a88e62ba5 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:47.663713 28609 raft_consensus.cc:515] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.672366 28596 raft_consensus.cc:493] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.678580 28557 consensus_queue.cc:1048] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:47.679553 28596 raft_consensus.cc:515] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.681574 28596 leader_election.cc:290] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:47.675665 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3cddbcf51c4690badc33c2cd58e0aa" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:47.685928 28328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3cddbcf51c4690badc33c2cd58e0aa" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:47.686403 28378 tablet_bootstrap.cc:492] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:47.686735 28328 raft_consensus.cc:2468] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
I20260709 13:08:47.686987 28378 ts_tablet_manager.cc:1403] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.184s	user 0.018s	sys 0.000s
I20260709 13:08:47.696739 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4a4fa897ce40ed86eb46b892297b2c" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:47.703583 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4a4fa897ce40ed86eb46b892297b2c" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:47.704334 28180 raft_consensus.cc:2468] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:47.705191 28609 leader_election.cc:290] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:47.706197 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec0b05c6a554a24a2576d6308dd6861" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
W20260709 13:08:47.707645 28074 leader_election.cc:343] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:47.712707 28327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec0b05c6a554a24a2576d6308dd6861" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:47.713348 28327 raft_consensus.cc:3060] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:47.713966 28147 leader_election.cc:343] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:47.715224 28593 consensus_queue.cc:1048] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:47.710237 28221 leader_election.cc:343] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:47.710740 28578 raft_consensus.cc:493] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.718427 28578 raft_consensus.cc:515] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.720434 28578 leader_election.cc:290] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:47.721338 28223 leader_election.cc:304] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:47.722436 28414 raft_consensus.cc:2804] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:47.722818 28414 raft_consensus.cc:493] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.723167 28414 raft_consensus.cc:3060] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.724243 28327 raft_consensus.cc:2468] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 1.
I20260709 13:08:47.726239 28596 consensus_queue.cc:1048] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:47.730409 28378 raft_consensus.cc:359] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.731477 28378 raft_consensus.cc:385] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.731527 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c25595e441a47e5bb6f0f694cb3eed9" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:47.731859 28378 raft_consensus.cc:740] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.731050 28072 leader_election.cc:304] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:47.732510 28378 consensus_queue.cc:260] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
W20260709 13:08:47.733083 28295 leader_election.cc:343] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:47.733527 28384 raft_consensus.cc:2804] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:47.734234 28384 raft_consensus.cc:697] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:08:47.734627 28378 ts_tablet_manager.cc:1434] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.047s	user 0.003s	sys 0.000s
I20260709 13:08:47.735359 28384 consensus_queue.cc:237] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.741935 28147 leader_election.cc:304] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:47.742939 28593 raft_consensus.cc:2804] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:47.743331 28593 raft_consensus.cc:493] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.743670 28593 raft_consensus.cc:3060] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.744451 28379 tablet_bootstrap.cc:654] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.751726 28414 raft_consensus.cc:515] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.753552 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c25595e441a47e5bb6f0f694cb3eed9" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:47.754206 28257 raft_consensus.cc:2468] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:47.754506 28376 tablet_bootstrap.cc:492] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:47.755012 28376 ts_tablet_manager.cc:1403] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.201s	user 0.037s	sys 0.023s
I20260709 13:08:47.754892 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4a4fa897ce40ed86eb46b892297b2c" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:47.755563 28180 raft_consensus.cc:3060] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.756183 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4a4fa897ce40ed86eb46b892297b2c" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:47.757899 28376 raft_consensus.cc:359] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.758575 28376 raft_consensus.cc:385] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.760509 28593 raft_consensus.cc:515] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.766160 28414 leader_election.cc:290] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:47.765659 28180 raft_consensus.cc:2468] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:47.769491 28593 leader_election.cc:290] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:47.769793 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3cddbcf51c4690badc33c2cd58e0aa" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:47.770377 28223 leader_election.cc:304] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
W20260709 13:08:47.771586 28147 leader_election.cc:343] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:47.773679 28414 raft_consensus.cc:2804] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:47.775540 28378 tablet_bootstrap.cc:492] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:47.776791 28414 raft_consensus.cc:697] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:47.777753 28414 consensus_queue.cc:237] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.758868 28376 raft_consensus.cc:740] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.781162 28381 tablet_bootstrap.cc:654] T e4e2fa350a754b899e6ce07a88e62ba5 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.783169 28376 consensus_queue.cc:260] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.784745 28629 raft_consensus.cc:493] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.786410 28376 ts_tablet_manager.cc:1434] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:08:47.787518 28376 tablet_bootstrap.cc:492] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:47.786455 28629 raft_consensus.cc:515] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.790676 28629 leader_election.cc:290] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:47.794881 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d2a0753f34dd08c1b1eb5e708d7ff" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:47.793073 28378 tablet_bootstrap.cc:654] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:47.795353 28221 leader_election.cc:343] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:47.800220 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d2a0753f34dd08c1b1eb5e708d7ff" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
W20260709 13:08:47.806912 28295 leader_election.cc:343] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:47.808811 28600 consensus_queue.cc:1048] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:47.812425 28381 tablet_bootstrap.cc:492] T e4e2fa350a754b899e6ce07a88e62ba5 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:47.814795 28381 ts_tablet_manager.cc:1403] T e4e2fa350a754b899e6ce07a88e62ba5 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.150s	user 0.010s	sys 0.001s
I20260709 13:08:47.819051 28600 consensus_queue.cc:1048] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:47.821746 28054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:47.801448 28376 tablet_bootstrap.cc:654] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.801625 28297 leader_election.cc:304] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
W20260709 13:08:47.833479 28297 leader_election.cc:343] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:47.833357 28414 consensus_queue.cc:1048] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:47.833987 28297 leader_election.cc:304] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:47.800931 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3cddbcf51c4690badc33c2cd58e0aa" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:47.834867 28627 raft_consensus.cc:2804] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:47.836158 28470 raft_consensus.cc:2749] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:47.836544 28627 raft_consensus.cc:493] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.836910 28627 raft_consensus.cc:3060] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.836084 28331 raft_consensus.cc:3060] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.862478 28379 tablet_bootstrap.cc:492] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:47.863077 28379 ts_tablet_manager.cc:1403] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.200s	user 0.013s	sys 0.000s
I20260709 13:08:47.864207 28331 raft_consensus.cc:2468] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:47.867748 28379 raft_consensus.cc:359] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.868508 28379 raft_consensus.cc:385] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.868872 28379 raft_consensus.cc:740] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.869642 28379 consensus_queue.cc:260] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.871578 28627 raft_consensus.cc:515] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.872888 28379 ts_tablet_manager.cc:1434] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:47.853206 28002 catalog_manager.cc:5697] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.877763 28147 leader_election.cc:304] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:47.876502 28379 tablet_bootstrap.cc:492] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:47.891516 28593 raft_consensus.cc:2804] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:47.883831 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c25595e441a47e5bb6f0f694cb3eed9" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:47.892053 28593 raft_consensus.cc:697] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:47.892238 28253 raft_consensus.cc:3060] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.892936 28593 consensus_queue.cc:237] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.898638 28384 consensus_queue.cc:1048] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:47.903070 28381 raft_consensus.cc:359] T e4e2fa350a754b899e6ce07a88e62ba5 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:47.906572 28529 raft_consensus.cc:493] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.907171 28529 raft_consensus.cc:515] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.907853 28627 leader_election.cc:290] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:47.909301 28529 leader_election.cc:290] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:47.907321 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c25595e441a47e5bb6f0f694cb3eed9" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:47.910007 28328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c8f62c26f74f9e82cb8f53544e0b2c" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
W20260709 13:08:47.910883 28295 leader_election.cc:343] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:47.912899 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c8f62c26f74f9e82cb8f53544e0b2c" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:47.915424 28147 leader_election.cc:304] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:47.916234 28529 raft_consensus.cc:2749] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:47.903856 28381 raft_consensus.cc:385] T e4e2fa350a754b899e6ce07a88e62ba5 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.917943 28381 raft_consensus.cc:740] T e4e2fa350a754b899e6ce07a88e62ba5 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.917052 28006 catalog_manager.cc:5697] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 1 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.918751 28381 consensus_queue.cc:260] T e4e2fa350a754b899e6ce07a88e62ba5 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:47.921653 28376 tablet_bootstrap.cc:492] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:47.922621 28381 ts_tablet_manager.cc:1434] T e4e2fa350a754b899e6ce07a88e62ba5 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.108s	user 0.012s	sys 0.000s
I20260709 13:08:47.923028 28376 ts_tablet_manager.cc:1403] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.135s	user 0.023s	sys 0.024s
I20260709 13:08:47.923509 28378 tablet_bootstrap.cc:492] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:47.923702 28381 tablet_bootstrap.cc:492] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:47.924067 28378 ts_tablet_manager.cc:1403] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.149s	user 0.019s	sys 0.014s
I20260709 13:08:47.925830 28376 raft_consensus.cc:359] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.929242 28376 raft_consensus.cc:385] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.929634 28376 raft_consensus.cc:740] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.930332 28376 consensus_queue.cc:260] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.927202 28253 raft_consensus.cc:2468] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:47.932838 28376 ts_tablet_manager.cc:1434] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:08:47.934222 28376 tablet_bootstrap.cc:492] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:47.934196 28297 leader_election.cc:304] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:47.935513 28627 raft_consensus.cc:2804] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:47.935938 28378 raft_consensus.cc:359] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.935986 28627 raft_consensus.cc:697] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:47.936720 28378 raft_consensus.cc:385] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.939220 28378 raft_consensus.cc:740] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:47.939972 28378 consensus_queue.cc:260] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:47.941107 28376 tablet_bootstrap.cc:654] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.942135 28378 ts_tablet_manager.cc:1434] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:47.946679 28378 tablet_bootstrap.cc:492] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:47.944800 28627 consensus_queue.cc:237] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.953485 28378 tablet_bootstrap.cc:654] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.945664 28381 tablet_bootstrap.cc:654] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.960570 28182 raft_consensus.cc:3060] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.962344 28379 tablet_bootstrap.cc:654] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:47.947656 28004 catalog_manager.cc:5697] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.976503 28414 raft_consensus.cc:493] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.977074 28414 raft_consensus.cc:515] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:47.979198 28414 leader_election.cc:290] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:47.981474 28376 tablet_bootstrap.cc:492] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:47.981997 28376 ts_tablet_manager.cc:1403] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.023s
I20260709 13:08:47.982559 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec0b05c6a554a24a2576d6308dd6861" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:47.965214 28470 consensus_queue.cc:1048] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:08:47.981774 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec0b05c6a554a24a2576d6308dd6861" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:47.989980 28331 raft_consensus.cc:2393] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd66bd010fa04c4c8d0a668a77bd4c6d in current term 1: Already voted for candidate 7d2bb5df3b55462682d0f2fce57709f1 in this term.
I20260709 13:08:47.992174 28221 leader_election.cc:304] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:47.993841 28414 raft_consensus.cc:3060] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:47.994509 28381 tablet_bootstrap.cc:492] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:47.995055 28381 ts_tablet_manager.cc:1403] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.001s
I20260709 13:08:47.997700 28381 raft_consensus.cc:359] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:47.998386 28381 raft_consensus.cc:385] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:47.998643 28381 raft_consensus.cc:740] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.001784 28381 consensus_queue.cc:260] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:48.004699 28376 raft_consensus.cc:359] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.005453 28376 raft_consensus.cc:385] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.005725 28376 raft_consensus.cc:740] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.006505 28376 consensus_queue.cc:260] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.008607 28376 ts_tablet_manager.cc:1434] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 13:08:48.009479 28376 tablet_bootstrap.cc:492] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:48.012557 28379 tablet_bootstrap.cc:492] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:48.014976 28381 ts_tablet_manager.cc:1434] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:08:48.019554 28381 tablet_bootstrap.cc:492] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:48.015523 28555 consensus_queue.cc:1048] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:08:48.013121 28379 ts_tablet_manager.cc:1403] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.137s	user 0.016s	sys 0.002s
I20260709 13:08:48.016018 28414 raft_consensus.cc:2749] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:48.024935 28379 raft_consensus.cc:359] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:48.025949 28379 raft_consensus.cc:385] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.026309 28379 raft_consensus.cc:740] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.026625 28381 tablet_bootstrap.cc:654] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.027273 28379 consensus_queue.cc:260] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:48.029745 28379 ts_tablet_manager.cc:1434] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:48.012880 28006 catalog_manager.cc:5697] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.030781 28379 tablet_bootstrap.cc:492] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:48.034826 28376 tablet_bootstrap.cc:654] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.036616 28379 tablet_bootstrap.cc:654] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.044126 28376 tablet_bootstrap.cc:492] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:48.044718 28376 ts_tablet_manager.cc:1403] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.004s
I20260709 13:08:48.047297 28381 tablet_bootstrap.cc:492] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:48.047823 28381 ts_tablet_manager.cc:1403] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 13:08:48.051750 28379 tablet_bootstrap.cc:492] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:48.052256 28379 ts_tablet_manager.cc:1403] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.004s
I20260709 13:08:48.054802 28379 raft_consensus.cc:359] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.055820 28379 raft_consensus.cc:385] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.056170 28379 raft_consensus.cc:740] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.057004 28379 consensus_queue.cc:260] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.060530 28376 raft_consensus.cc:359] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.061290 28627 raft_consensus.cc:493] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.061684 28376 raft_consensus.cc:385] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.061990 28376 raft_consensus.cc:740] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.061831 28627 raft_consensus.cc:515] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:48.062668 28376 consensus_queue.cc:260] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.063601 28381 raft_consensus.cc:359] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:48.064038 28627 leader_election.cc:290] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:48.064294 28381 raft_consensus.cc:385] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.064635 28381 raft_consensus.cc:740] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.064873 28376 ts_tablet_manager.cc:1434] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:08:48.065303 28381 consensus_queue.cc:260] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:48.085075 28381 ts_tablet_manager.cc:1434] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:08:48.065968 28376 tablet_bootstrap.cc:492] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:48.067641 28379 ts_tablet_manager.cc:1434] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:08:48.079849 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7084d0da22fc408c861229f3e9cbdb94" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:48.091310 28379 tablet_bootstrap.cc:492] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:48.070358 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7084d0da22fc408c861229f3e9cbdb94" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
W20260709 13:08:48.092628 28295 leader_election.cc:343] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:48.095680 28297 leader_election.cc:343] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:48.096192 28629 consensus_queue.cc:1048] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:48.096206 28297 leader_election.cc:304] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:48.097589 28379 tablet_bootstrap.cc:654] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.100333 28381 tablet_bootstrap.cc:492] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:48.100283 28470 raft_consensus.cc:2749] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:48.108284 28376 tablet_bootstrap.cc:654] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.109808 28379 tablet_bootstrap.cc:492] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:48.110340 28379 ts_tablet_manager.cc:1403] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:08:48.114246 28379 raft_consensus.cc:359] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:48.114912 28379 raft_consensus.cc:385] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.115185 28379 raft_consensus.cc:740] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.115837 28379 consensus_queue.cc:260] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:48.116537 28378 tablet_bootstrap.cc:492] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:48.117182 28378 ts_tablet_manager.cc:1403] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.171s	user 0.023s	sys 0.037s
I20260709 13:08:48.117975 28379 ts_tablet_manager.cc:1434] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:08:48.118988 28379 tablet_bootstrap.cc:492] T 87613dbe33ad4d7da42e38250a2d9c5e P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:48.120577 28378 raft_consensus.cc:359] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.121328 28378 raft_consensus.cc:385] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.121591 28378 raft_consensus.cc:740] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.126215 28379 tablet_bootstrap.cc:654] T 87613dbe33ad4d7da42e38250a2d9c5e P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.130995 28378 consensus_queue.cc:260] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.132658 28555 raft_consensus.cc:493] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.133442 28378 ts_tablet_manager.cc:1434] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:08:48.133162 28555 raft_consensus.cc:515] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:48.135974 28555 leader_election.cc:290] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:48.137076 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2012efcebb4e8d9dc7839fdb5927fb" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:48.137661 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2012efcebb4e8d9dc7839fdb5927fb" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:48.139232 28253 raft_consensus.cc:2468] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 0.
I20260709 13:08:48.140228 28182 raft_consensus.cc:2468] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 0.
I20260709 13:08:48.140522 28074 leader_election.cc:304] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:48.136401 28378 tablet_bootstrap.cc:492] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:48.141112 28381 tablet_bootstrap.cc:654] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.141908 28555 raft_consensus.cc:2804] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:48.142320 28555 raft_consensus.cc:493] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.142660 28555 raft_consensus.cc:3060] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.147682 28378 tablet_bootstrap.cc:654] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.148732 28376 tablet_bootstrap.cc:492] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:48.149470 28376 ts_tablet_manager.cc:1403] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.084s	user 0.007s	sys 0.007s
I20260709 13:08:48.153898 28379 tablet_bootstrap.cc:492] T 87613dbe33ad4d7da42e38250a2d9c5e P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:48.154433 28379 ts_tablet_manager.cc:1403] T 87613dbe33ad4d7da42e38250a2d9c5e P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.002s
I20260709 13:08:48.157212 28379 raft_consensus.cc:359] T 87613dbe33ad4d7da42e38250a2d9c5e P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.157939 28379 raft_consensus.cc:385] T 87613dbe33ad4d7da42e38250a2d9c5e P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.159791 28414 raft_consensus.cc:493] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.159971 28609 raft_consensus.cc:493] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.160349 28414 raft_consensus.cc:515] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.162501 28414 leader_election.cc:290] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:48.160454 28609 raft_consensus.cc:515] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.165469 28609 leader_election.cc:290] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:48.166330 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e2fa350a754b899e6ce07a88e62ba5" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:48.167042 28555 raft_consensus.cc:515] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:48.168119 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e2fa350a754b899e6ce07a88e62ba5" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:48.168793 28331 raft_consensus.cc:2468] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:48.170105 28221 leader_election.cc:304] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:48.170729 28328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c25595e441a47e5bb6f0f694cb3eed9" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:48.171020 28182 raft_consensus.cc:2468] T e4e2fa350a754b899e6ce07a88e62ba5 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:48.173815 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c25595e441a47e5bb6f0f694cb3eed9" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:48.174604 28253 raft_consensus.cc:2393] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d2bb5df3b55462682d0f2fce57709f1 in current term 1: Already voted for candidate 60d640828dc841619730621ec09d4c64 in this term.
I20260709 13:08:48.174799 28555 leader_election.cc:290] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:48.177315 28074 leader_election.cc:304] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:48.177371 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2012efcebb4e8d9dc7839fdb5927fb" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:48.180524 28182 raft_consensus.cc:3060] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.158217 28379 raft_consensus.cc:740] T 87613dbe33ad4d7da42e38250a2d9c5e P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.179170 28414 raft_consensus.cc:2804] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:48.178581 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2012efcebb4e8d9dc7839fdb5927fb" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:48.183878 28555 raft_consensus.cc:3060] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.183135 28414 raft_consensus.cc:493] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.184763 28414 raft_consensus.cc:3060] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.184124 28379 consensus_queue.cc:260] T 87613dbe33ad4d7da42e38250a2d9c5e P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.187229 28379 ts_tablet_manager.cc:1434] T 87613dbe33ad4d7da42e38250a2d9c5e P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.005s
I20260709 13:08:48.188313 28379 tablet_bootstrap.cc:492] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:48.190485 28470 raft_consensus.cc:493] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.184237 28253 raft_consensus.cc:3060] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.191093 28470 raft_consensus.cc:515] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.193207 28470 leader_election.cc:290] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:48.194559 28555 raft_consensus.cc:2749] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:48.194417 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87613dbe33ad4d7da42e38250a2d9c5e" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:48.195281 28105 raft_consensus.cc:2468] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:48.195426 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87613dbe33ad4d7da42e38250a2d9c5e" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:48.196110 28257 raft_consensus.cc:2468] T 87613dbe33ad4d7da42e38250a2d9c5e P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:48.196498 28295 leader_election.cc:304] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 
I20260709 13:08:48.197835 28470 raft_consensus.cc:2804] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:48.198537 28470 raft_consensus.cc:493] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.198832 28378 tablet_bootstrap.cc:492] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:48.198891 28470 raft_consensus.cc:3060] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.199580 28378 ts_tablet_manager.cc:1403] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.010s
I20260709 13:08:48.202399 28378 raft_consensus.cc:359] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.203048 28378 raft_consensus.cc:385] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.203310 28378 raft_consensus.cc:740] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.203950 28378 consensus_queue.cc:260] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.205979 28378 ts_tablet_manager.cc:1434] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:48.206248 28470 raft_consensus.cc:515] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.206979 28378 tablet_bootstrap.cc:492] T 2b08edfd918443739d94d5586ac7a46b P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:48.208406 28376 raft_consensus.cc:359] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:48.209051 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87613dbe33ad4d7da42e38250a2d9c5e" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:48.209635 28257 raft_consensus.cc:3060] T 87613dbe33ad4d7da42e38250a2d9c5e P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.211938 28414 raft_consensus.cc:515] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.213090 28378 tablet_bootstrap.cc:654] T 2b08edfd918443739d94d5586ac7a46b P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.214098 28414 leader_election.cc:290] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:48.207765 28381 tablet_bootstrap.cc:492] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:48.215227 28328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e2fa350a754b899e6ce07a88e62ba5" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:48.215855 28328 raft_consensus.cc:3060] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.218022 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e2fa350a754b899e6ce07a88e62ba5" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:48.218689 28183 raft_consensus.cc:3060] T e4e2fa350a754b899e6ce07a88e62ba5 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.223850 28180 raft_consensus.cc:3060] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.224135 28328 raft_consensus.cc:2468] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:48.225422 28221 leader_election.cc:304] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:48.235074 28183 raft_consensus.cc:2468] T e4e2fa350a754b899e6ce07a88e62ba5 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:48.237920 28381 ts_tablet_manager.cc:1403] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.152s	user 0.013s	sys 0.001s
I20260709 13:08:48.209105 28376 raft_consensus.cc:385] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.239408 28376 raft_consensus.cc:740] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.240087 28376 consensus_queue.cc:260] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:48.242206 28376 ts_tablet_manager.cc:1434] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.092s	user 0.004s	sys 0.000s
I20260709 13:08:48.236069 28257 raft_consensus.cc:2468] T 87613dbe33ad4d7da42e38250a2d9c5e P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:48.244451 28182 raft_consensus.cc:2468] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 1.
I20260709 13:08:48.206269 28253 raft_consensus.cc:2468] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 1.
I20260709 13:08:48.246939 28074 leader_election.cc:304] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:48.248024 28609 raft_consensus.cc:2804] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:48.248669 28609 raft_consensus.cc:697] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:08:48.249495 28609 consensus_queue.cc:237] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:48.250459 28470 leader_election.cc:290] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:48.250738 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87613dbe33ad4d7da42e38250a2d9c5e" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:48.251556 28379 tablet_bootstrap.cc:654] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.251608 28105 raft_consensus.cc:3060] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.264405 28381 raft_consensus.cc:359] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:48.265460 28381 raft_consensus.cc:385] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.269068 28555 consensus_queue.cc:1048] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:48.271431 28376 tablet_bootstrap.cc:492] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
W20260709 13:08:48.271976 28221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:46171, user_credentials={real_user=slave}} blocked reactor thread for 46636.8us
I20260709 13:08:48.285084 28297 leader_election.cc:304] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:48.285905 28470 raft_consensus.cc:2804] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:48.273167 28600 raft_consensus.cc:2804] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:48.286365 28470 raft_consensus.cc:697] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:48.286744 28600 raft_consensus.cc:697] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:48.287281 28470 consensus_queue.cc:237] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.287606 28600 consensus_queue.cc:237] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.289776 28108 raft_consensus.cc:3060] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.265817 28381 raft_consensus.cc:740] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.326172 28441 consensus_queue.cc:1048] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:48.328253 28006 catalog_manager.cc:5697] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.330734 28673 consensus_queue.cc:1048] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:48.339636 28451 consensus_queue.cc:1048] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:48.342096 28105 raft_consensus.cc:2468] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:48.351752 28381 consensus_queue.cc:260] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:48.348243 28555 raft_consensus.cc:493] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd66bd010fa04c4c8d0a668a77bd4c6d)
I20260709 13:08:48.375360 28381 ts_tablet_manager.cc:1434] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.137s	user 0.006s	sys 0.004s
I20260709 13:08:48.378190 28381 tablet_bootstrap.cc:492] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:48.394135 28557 raft_consensus.cc:493] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.373920 28555 raft_consensus.cc:515] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:48.399063 28379 tablet_bootstrap.cc:492] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:48.399616 28379 ts_tablet_manager.cc:1403] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.212s	user 0.028s	sys 0.019s
I20260709 13:08:48.401929 28378 tablet_bootstrap.cc:492] T 2b08edfd918443739d94d5586ac7a46b P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:48.404887 28379 raft_consensus.cc:359] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.394776 28557 raft_consensus.cc:515] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:48.413345 28379 raft_consensus.cc:385] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.413825 28379 raft_consensus.cc:740] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.415061 28557 leader_election.cc:290] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:48.408610 28555 leader_election.cc:290] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:48.416643 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d2a0753f34dd08c1b1eb5e708d7ff" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:48.417582 28432 raft_consensus.cc:493] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.417831 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4a4fa897ce40ed86eb46b892297b2c" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:48.418226 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d2a0753f34dd08c1b1eb5e708d7ff" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:48.442934 28331 raft_consensus.cc:2468] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
I20260709 13:08:48.413731 28005 catalog_manager.cc:5697] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 1 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.420529 28378 ts_tablet_manager.cc:1403] T 2b08edfd918443739d94d5586ac7a46b P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.214s	user 0.045s	sys 0.074s
I20260709 13:08:48.424109 28379 consensus_queue.cc:260] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.434036 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4a4fa897ce40ed86eb46b892297b2c" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:48.449884 28378 raft_consensus.cc:359] T 2b08edfd918443739d94d5586ac7a46b P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.450606 28378 raft_consensus.cc:385] T 2b08edfd918443739d94d5586ac7a46b P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.450881 28378 raft_consensus.cc:740] T 2b08edfd918443739d94d5586ac7a46b P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.450945 28414 raft_consensus.cc:493] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.451454 28147 leader_election.cc:304] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:08:48.451655 28378 consensus_queue.cc:260] T 2b08edfd918443739d94d5586ac7a46b P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.434796 28432 raft_consensus.cc:515] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.452555 28557 raft_consensus.cc:2804] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:48.452943 28557 raft_consensus.cc:493] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.453261 28557 raft_consensus.cc:3060] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.454062 28432 leader_election.cc:290] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:48.454424 28379 ts_tablet_manager.cc:1434] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.002s
I20260709 13:08:48.436489 28107 raft_consensus.cc:2468] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
I20260709 13:08:48.455446 28379 tablet_bootstrap.cc:492] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:48.451725 28074 leader_election.cc:304] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:48.457036 28555 raft_consensus.cc:2749] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:48.437189 28376 tablet_bootstrap.cc:654] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.462095 28379 tablet_bootstrap.cc:654] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.453306 28378 ts_tablet_manager.cc:1434] T 2b08edfd918443739d94d5586ac7a46b P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:48.463181 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c5064efb8c493c8abc76212d9eaf59" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
W20260709 13:08:48.467532 28297 leader_election.cc:343] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:48.467556 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c5064efb8c493c8abc76212d9eaf59" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:48.451819 28414 raft_consensus.cc:515] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:48.472908 28378 tablet_bootstrap.cc:492] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:48.474030 28414 leader_election.cc:290] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:48.481395 28006 catalog_manager.cc:5697] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.490657 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6fe3b72cb46e6bbdbea8e0f38cba7" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:48.491380 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6fe3b72cb46e6bbdbea8e0f38cba7" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
W20260709 13:08:48.492980 28297 leader_election.cc:343] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:48.493659 28297 leader_election.cc:304] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
W20260709 13:08:48.497352 28221 leader_election.cc:343] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:48.498188 28385 raft_consensus.cc:2749] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:48.515271 28379 tablet_bootstrap.cc:492] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:48.515868 28379 ts_tablet_manager.cc:1403] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.021s
I20260709 13:08:48.513612 28529 consensus_queue.cc:1048] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:08:48.519773 28379 raft_consensus.cc:359] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.520465 28379 raft_consensus.cc:385] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.520749 28379 raft_consensus.cc:740] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.520720 28432 consensus_queue.cc:1048] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:48.521862 28379 consensus_queue.cc:260] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.525476 28381 tablet_bootstrap.cc:654] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.525910 28601 raft_consensus.cc:493] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:48.526384 28223 leader_election.cc:343] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:48.526397 28601 raft_consensus.cc:515] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.527130 28223 leader_election.cc:304] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:48.527698 28378 tablet_bootstrap.cc:654] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.529261 28601 leader_election.cc:290] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:48.530966 28379 ts_tablet_manager.cc:1434] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
W20260709 13:08:48.531764 28147 consensus_peers.cc:597] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.531950 28379 tablet_bootstrap.cc:492] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:48.528162 28600 raft_consensus.cc:2749] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:48.534073 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b08edfd918443739d94d5586ac7a46b" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:48.538350 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b08edfd918443739d94d5586ac7a46b" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:48.539230 28331 raft_consensus.cc:2468] T 2b08edfd918443739d94d5586ac7a46b P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:48.543475 28221 leader_election.cc:304] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:48.545861 28600 raft_consensus.cc:2804] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:48.548847 28600 raft_consensus.cc:493] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.550218 28600 raft_consensus.cc:3060] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.566533 28557 raft_consensus.cc:515] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
W20260709 13:08:48.568022 28223 leader_election.cc:343] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:48.569559 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d2a0753f34dd08c1b1eb5e708d7ff" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:48.570251 28331 raft_consensus.cc:3060] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.573891 28385 consensus_queue.cc:1048] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:48.568339 28600 raft_consensus.cc:515] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.578351 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b08edfd918443739d94d5586ac7a46b" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:48.580353 28376 tablet_bootstrap.cc:492] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:48.580886 28376 ts_tablet_manager.cc:1403] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.338s	user 0.008s	sys 0.015s
I20260709 13:08:48.585661 28557 leader_election.cc:290] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:48.587098 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d2a0753f34dd08c1b1eb5e708d7ff" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:48.590180 28108 raft_consensus.cc:3060] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.588060 28381 tablet_bootstrap.cc:492] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
W20260709 13:08:48.587658 28223 leader_election.cc:343] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:48.591336 28381 ts_tablet_manager.cc:1403] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.214s	user 0.015s	sys 0.004s
I20260709 13:08:48.583966 28331 raft_consensus.cc:2468] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:48.592620 28379 tablet_bootstrap.cc:654] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.612720 28330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b08edfd918443739d94d5586ac7a46b" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:48.620548 28330 raft_consensus.cc:3060] T 2b08edfd918443739d94d5586ac7a46b P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.619623 28147 leader_election.cc:304] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:08:48.623186 28529 raft_consensus.cc:2804] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:48.612185 28600 leader_election.cc:290] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:48.637199 28330 raft_consensus.cc:2468] T 2b08edfd918443739d94d5586ac7a46b P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:48.642067 28385 raft_consensus.cc:493] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.644109 28378 tablet_bootstrap.cc:492] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:48.644906 28378 ts_tablet_manager.cc:1403] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.178s	user 0.015s	sys 0.005s
I20260709 13:08:48.644948 28221 leader_election.cc:304] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:48.645936 28414 raft_consensus.cc:2804] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:48.646632 28414 raft_consensus.cc:697] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:48.647740 28414 consensus_queue.cc:237] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.650343 28376 raft_consensus.cc:359] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:48.644183 28385 raft_consensus.cc:515] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.651075 28376 raft_consensus.cc:385] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.651389 28376 raft_consensus.cc:740] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.652031 28376 consensus_queue.cc:260] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:48.653964 28376 ts_tablet_manager.cc:1434] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.000s
I20260709 13:08:48.654759 28376 tablet_bootstrap.cc:492] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:48.647742 28381 raft_consensus.cc:359] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:48.656718 28381 raft_consensus.cc:385] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.657445 28381 raft_consensus.cc:740] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.657783 28385 leader_election.cc:290] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:48.656198 28378 raft_consensus.cc:359] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:48.658618 28381 consensus_queue.cc:260] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:48.660563 28378 raft_consensus.cc:385] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.660627 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dc71d60db4a3f9c0b98d246bfc818" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
W20260709 13:08:48.663889 28295 leader_election.cc:343] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:48.664341 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dc71d60db4a3f9c0b98d246bfc818" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:48.664678 28381 ts_tablet_manager.cc:1434] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:08:48.666352 28257 raft_consensus.cc:2468] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:48.666873 28381 tablet_bootstrap.cc:492] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:48.662483 28378 raft_consensus.cc:740] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.665611 28108 raft_consensus.cc:2468] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:48.668578 28297 leader_election.cc:304] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:48.668123 28378 consensus_queue.cc:260] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:48.678750 28378 ts_tablet_manager.cc:1434] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 13:08:48.661391 28529 raft_consensus.cc:697] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:48.681457 28378 tablet_bootstrap.cc:492] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:48.684746 28414 consensus_queue.cc:1048] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:48.680678 28385 raft_consensus.cc:2804] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:48.681720 28529 consensus_queue.cc:237] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:48.687302 28385 raft_consensus.cc:493] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.691370 28385 raft_consensus.cc:3060] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.695391 28376 tablet_bootstrap.cc:654] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.706089 28379 tablet_bootstrap.cc:492] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:48.707304 28379 ts_tablet_manager.cc:1403] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.176s	user 0.007s	sys 0.013s
I20260709 13:08:48.710041 28385 raft_consensus.cc:515] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:48.713850 28379 raft_consensus.cc:359] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.717319 28379 raft_consensus.cc:385] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:48.717728 28379 raft_consensus.cc:740] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:48.721151 28379 consensus_queue.cc:260] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:48.724846 28379 ts_tablet_manager.cc:1434] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260709 13:08:48.725648 28381 tablet_bootstrap.cc:654] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.725769 28379 tablet_bootstrap.cc:492] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:48.727749 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dc71d60db4a3f9c0b98d246bfc818" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:48.728480 28257 raft_consensus.cc:3060] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:48.728020 28378 tablet_bootstrap.cc:654] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.730446 28385 leader_election.cc:290] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:48.802731 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dc71d60db4a3f9c0b98d246bfc818" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:48.806289 28257 raft_consensus.cc:2468] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:48.809471 28005 catalog_manager.cc:5697] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:48.816108 28295 leader_election.cc:343] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:48.818761 28376 tablet_bootstrap.cc:492] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:48.820340 28376 ts_tablet_manager.cc:1403] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.166s	user 0.019s	sys 0.004s
I20260709 13:08:48.826853 28297 leader_election.cc:304] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:48.827816 28379 tablet_bootstrap.cc:654] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:48.833958 28529 raft_consensus.cc:493] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.866987 28529 raft_consensus.cc:515] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
W20260709 13:08:48.871042 28297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.67:41757, user_credentials={real_user=slave}} blocked reactor thread for 44665.3us
I20260709 13:08:48.872975 28432 raft_consensus.cc:2804] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:48.974025 28529 leader_election.cc:290] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
W20260709 13:08:48.986706 28147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:34859, user_credentials={real_user=slave}} blocked reactor thread for 83179.5us
I20260709 13:08:48.968282 28432 raft_consensus.cc:697] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:48.998775 28600 raft_consensus.cc:493] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.001621 28600 raft_consensus.cc:515] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:49.002703 28379 tablet_bootstrap.cc:492] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:49.003641 28379 ts_tablet_manager.cc:1403] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.278s	user 0.026s	sys 0.016s
I20260709 13:08:49.010763 28381 tablet_bootstrap.cc:492] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:49.011691 28381 ts_tablet_manager.cc:1403] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.345s	user 0.033s	sys 0.056s
I20260709 13:08:49.014863 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6fe3b72cb46e6bbdbea8e0f38cba7" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:49.017485 28379 raft_consensus.cc:359] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:49.019869 28381 raft_consensus.cc:359] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:49.020844 28381 raft_consensus.cc:385] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:49.020164 28379 raft_consensus.cc:385] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:49.021229 28381 raft_consensus.cc:740] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:49.022080 28381 consensus_queue.cc:260] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:49.024955 28378 tablet_bootstrap.cc:492] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:49.025848 28378 ts_tablet_manager.cc:1403] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.345s	user 0.011s	sys 0.001s
I20260709 13:08:49.026862 28376 raft_consensus.cc:359] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:49.029407 28376 raft_consensus.cc:385] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:49.029809 28376 raft_consensus.cc:740] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:49.031334 28376 consensus_queue.cc:260] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:49.029922 28381 ts_tablet_manager.cc:1434] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:08:49.021672 28379 raft_consensus.cc:740] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:49.036219 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6fe3b72cb46e6bbdbea8e0f38cba7" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:49.037284 28257 raft_consensus.cc:2468] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
W20260709 13:08:49.037529 28147 leader_election.cc:343] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:49.040921 28105 raft_consensus.cc:3060] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:49.035471 28381 tablet_bootstrap.cc:492] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:49.035933 28376 ts_tablet_manager.cc:1434] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.143s	user 0.004s	sys 0.007s
I20260709 13:08:49.042814 28379 consensus_queue.cc:260] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:49.053177 28376 tablet_bootstrap.cc:492] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:49.061898 28379 ts_tablet_manager.cc:1434] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.002s
I20260709 13:08:49.066263 28149 leader_election.cc:304] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:49.071835 28529 raft_consensus.cc:2804] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:49.072290 28529 raft_consensus.cc:493] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.072702 28529 raft_consensus.cc:3060] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:49.066385 28381 tablet_bootstrap.cc:654] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:49.075735 28694 raft_consensus.cc:493] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.076413 28694 raft_consensus.cc:515] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:49.083431 28694 leader_election.cc:290] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:49.087582 28376 tablet_bootstrap.cc:654] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:49.093137 28379 tablet_bootstrap.cc:492] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:49.093916 28529 raft_consensus.cc:515] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:49.095536 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddfe000e4a34d3e988447d289961873" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:49.098798 28432 consensus_queue.cc:237] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:49.102124 28600 leader_election.cc:290] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:49.109743 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c5064efb8c493c8abc76212d9eaf59" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:49.127148 28183 raft_consensus.cc:2468] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:49.154194 28631 consensus_queue.cc:1048] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:08:49.165521 28379 tablet_bootstrap.cc:654] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:49.163031 28378 raft_consensus.cc:359] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:49.175560 28378 raft_consensus.cc:385] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:08:49.180755 28221 leader_election.cc:343] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:49.184968 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddfe000e4a34d3e988447d289961873" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:49.187896 28672 consensus_queue.cc:1048] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:49.193490 28381 tablet_bootstrap.cc:492] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:49.194056 28381 ts_tablet_manager.cc:1403] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.159s	user 0.030s	sys 0.009s
I20260709 13:08:49.195783 28701 consensus_queue.cc:1048] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:49.197180 28381 raft_consensus.cc:359] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:49.199133 28381 raft_consensus.cc:385] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:49.199422 28381 raft_consensus.cc:740] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:49.200311 28529 leader_election.cc:290] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:49.202040 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6fe3b72cb46e6bbdbea8e0f38cba7" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:49.200217 28381 consensus_queue.cc:260] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
W20260709 13:08:49.203814 28147 leader_election.cc:343] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:49.203280 28002 catalog_manager.cc:5697] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 1 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:49.208320 28223 leader_election.cc:304] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:49.208817 28694 consensus_queue.cc:1048] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:49.209411 28223 leader_election.cc:343] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:49.209960 28223 leader_election.cc:304] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:49.210990 28694 raft_consensus.cc:2804] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:49.211390 28694 raft_consensus.cc:493] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.211593 28414 raft_consensus.cc:2749] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:49.211786 28694 raft_consensus.cc:3060] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:49.175877 28378 raft_consensus.cc:740] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:49.213183 28378 consensus_queue.cc:260] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:49.218971 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6fe3b72cb46e6bbdbea8e0f38cba7" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:49.219692 28253 raft_consensus.cc:3060] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:49.229791 28470 consensus_queue.cc:1048] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:49.266898 28381 ts_tablet_manager.cc:1434] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 13:08:49.281854 28378 ts_tablet_manager.cc:1434] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.256s	user 0.004s	sys 0.008s
I20260709 13:08:49.285475 28694 raft_consensus.cc:515] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
W20260709 13:08:49.303166 28297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:41757, user_credentials={real_user=slave}} blocked reactor thread for 45256us
I20260709 13:08:49.318578 28709 raft_consensus.cc:493] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.319131 28709 raft_consensus.cc:515] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:49.323225 28704 consensus_queue.cc:1048] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:49.297622 28223 consensus_peers.cc:597] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.342494 28707 raft_consensus.cc:493] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8938bce1e7864c1ab26755f60f708368)
I20260709 13:08:49.343434 28707 raft_consensus.cc:515] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:49.351243 28323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c5064efb8c493c8abc76212d9eaf59" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:49.352169 28323 raft_consensus.cc:2468] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:49.331844 28709 leader_election.cc:290] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:49.360291 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddfe000e4a34d3e988447d289961873" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:49.362339 28381 tablet_bootstrap.cc:492] T 2b08edfd918443739d94d5586ac7a46b P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:49.363333 28379 tablet_bootstrap.cc:492] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:49.363863 28379 ts_tablet_manager.cc:1403] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.271s	user 0.024s	sys 0.026s
W20260709 13:08:49.365960 28147 leader_election.cc:343] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:49.377265 28254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddfe000e4a34d3e988447d289961873" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:49.378077 28254 raft_consensus.cc:2468] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
I20260709 13:08:49.379101 28379 raft_consensus.cc:359] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:49.379819 28379 raft_consensus.cc:385] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:49.380093 28379 raft_consensus.cc:740] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:49.380729 28379 consensus_queue.cc:260] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:49.387322 28149 leader_election.cc:304] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:49.389348 28381 tablet_bootstrap.cc:654] T 2b08edfd918443739d94d5586ac7a46b P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:49.389423 28701 raft_consensus.cc:2804] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:49.390404 28701 raft_consensus.cc:493] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.390785 28701 raft_consensus.cc:3060] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:49.346804 28694 leader_election.cc:290] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
W20260709 13:08:49.349090 28223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:34231, user_credentials={real_user=slave}} blocked reactor thread for 56832.2us
I20260709 13:08:49.415516 28378 tablet_bootstrap.cc:492] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:49.428045 28379 ts_tablet_manager.cc:1434] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:08:49.429067 28376 tablet_bootstrap.cc:492] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:49.429811 28376 ts_tablet_manager.cc:1403] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.379s	user 0.024s	sys 0.016s
I20260709 13:08:49.452406 28721 raft_consensus.cc:493] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.453023 28721 raft_consensus.cc:515] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:49.455628 28327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c5064efb8c493c8abc76212d9eaf59" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:49.458120 28253 raft_consensus.cc:2468] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:49.456614 28327 raft_consensus.cc:3060] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:49.460623 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c5064efb8c493c8abc76212d9eaf59" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:49.461354 28183 raft_consensus.cc:3060] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:49.464039 28707 leader_election.cc:290] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:49.465888 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3cddbcf51c4690badc33c2cd58e0aa" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:49.473392 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3cddbcf51c4690badc33c2cd58e0aa" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:49.454568 28004 catalog_manager.cc:5697] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:49.492571 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8778ebb28d774473bbe1042cbb1c6721" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:49.494858 28631 raft_consensus.cc:493] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.495446 28631 raft_consensus.cc:515] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:49.497754 28631 leader_election.cc:290] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:49.500676 28074 leader_election.cc:304] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:49.478816 28376 raft_consensus.cc:359] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:49.503088 28376 raft_consensus.cc:385] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:49.504062 28376 raft_consensus.cc:740] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
W20260709 13:08:49.503072 28295 leader_election.cc:343] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:49.514820 28376 consensus_queue.cc:260] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:49.507825 28631 raft_consensus.cc:2749] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:49.521019 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7084d0da22fc408c861229f3e9cbdb94" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:49.528264 28379 tablet_bootstrap.cc:492] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:49.530383 28149 leader_election.cc:304] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:49.531587 28708 raft_consensus.cc:2804] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:49.530439 28376 ts_tablet_manager.cc:1434] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.100s	user 0.007s	sys 0.002s
I20260709 13:08:49.508208 28701 raft_consensus.cc:515] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:49.532151 28708 raft_consensus.cc:697] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:49.542064 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8778ebb28d774473bbe1042cbb1c6721" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:49.539297 28529 consensus_queue.cc:1048] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:08:49.550429 28708 consensus_queue.cc:237] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:49.551422 28254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddfe000e4a34d3e988447d289961873" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:49.552255 28254 raft_consensus.cc:3060] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:49.553299 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddfe000e4a34d3e988447d289961873" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:49.555063 28381 tablet_bootstrap.cc:492] T 2b08edfd918443739d94d5586ac7a46b P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:49.555598 28381 ts_tablet_manager.cc:1403] T 2b08edfd918443739d94d5586ac7a46b P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.228s	user 0.016s	sys 0.021s
W20260709 13:08:49.560058 28074 leader_election.cc:343] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:49.550338 28701 leader_election.cc:290] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:49.533535 28721 leader_election.cc:290] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:49.558496 28381 raft_consensus.cc:359] T 2b08edfd918443739d94d5586ac7a46b P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:49.566771 28381 raft_consensus.cc:385] T 2b08edfd918443739d94d5586ac7a46b P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:49.567333 28381 raft_consensus.cc:740] T 2b08edfd918443739d94d5586ac7a46b P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
W20260709 13:08:49.568218 28147 leader_election.cc:343] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:49.547827 28297 leader_election.cc:343] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:49.570144 28297 leader_election.cc:304] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:49.576180 28721 raft_consensus.cc:2749] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:49.580088 28254 raft_consensus.cc:2468] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:49.581866 28149 leader_election.cc:304] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:49.583271 28686 raft_consensus.cc:2804] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:49.585750 28381 consensus_queue.cc:260] T 2b08edfd918443739d94d5586ac7a46b P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:49.593883 28376 tablet_bootstrap.cc:492] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:49.604130 28673 raft_consensus.cc:493] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.604763 28673 raft_consensus.cc:515] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:49.607359 28451 consensus_queue.cc:1048] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:08:49.608793 28295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:34859, user_credentials={real_user=slave}} blocked reactor thread for 108643us
I20260709 13:08:49.609484 28183 raft_consensus.cc:2468] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:49.613890 28378 tablet_bootstrap.cc:654] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:49.616401 28601 raft_consensus.cc:493] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.616997 28601 raft_consensus.cc:515] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:49.618247 28379 tablet_bootstrap.cc:654] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:49.621213 28601 leader_election.cc:290] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:49.623791 28673 leader_election.cc:290] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:49.626046 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dc71d60db4a3f9c0b98d246bfc818" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:49.626911 28253 raft_consensus.cc:2393] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d2bb5df3b55462682d0f2fce57709f1 in current term 1: Already voted for candidate 60d640828dc841619730621ec09d4c64 in this term.
W20260709 13:08:49.668033 28297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:34231, user_credentials={real_user=slave}} blocked reactor thread for 67956.4us
I20260709 13:08:49.665115 28686 raft_consensus.cc:697] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:49.688905 28325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7084d0da22fc408c861229f3e9cbdb94" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:49.689679 28325 raft_consensus.cc:2468] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 0.
I20260709 13:08:49.692560 28381 ts_tablet_manager.cc:1434] T 2b08edfd918443739d94d5586ac7a46b P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.137s	user 0.012s	sys 0.006s
I20260709 13:08:49.699999 28223 leader_election.cc:304] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:49.709933 28327 raft_consensus.cc:2468] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:49.710744 28329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:49.712653 28381 tablet_bootstrap.cc:492] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
W20260709 13:08:49.714597 28221 leader_election.cc:343] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:49.722774 28601 raft_consensus.cc:2804] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:49.726971 28601 raft_consensus.cc:697] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:49.727982 28601 consensus_queue.cc:237] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:49.714624 28686 consensus_queue.cc:237] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:49.745067 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dc71d60db4a3f9c0b98d246bfc818" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:49.836819 28379 tablet_bootstrap.cc:492] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:49.837553 28379 ts_tablet_manager.cc:1403] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.319s	user 0.018s	sys 0.012s
I20260709 13:08:49.887341 28378 tablet_bootstrap.cc:492] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:49.888124 28378 ts_tablet_manager.cc:1403] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.473s	user 0.017s	sys 0.010s
I20260709 13:08:49.889115 28381 tablet_bootstrap.cc:654] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:49.914489 28376 tablet_bootstrap.cc:654] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:49.923658 28706 raft_consensus.cc:493] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.925514 28706 raft_consensus.cc:515] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:49.931185 28706 leader_election.cc:290] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:49.935359 28378 raft_consensus.cc:359] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:49.936244 28378 raft_consensus.cc:385] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:49.936607 28378 raft_consensus.cc:740] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:49.937553 28378 consensus_queue.cc:260] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:49.939419 28378 ts_tablet_manager.cc:1434] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:08:49.940712 28381 tablet_bootstrap.cc:492] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:49.942497 28381 ts_tablet_manager.cc:1403] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.230s	user 0.008s	sys 0.006s
I20260709 13:08:49.943238 28378 tablet_bootstrap.cc:492] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:49.945640 28381 raft_consensus.cc:359] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:49.947469 28381 raft_consensus.cc:385] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:49.947765 28381 raft_consensus.cc:740] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:49.948494 28381 consensus_queue.cc:260] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:49.948912 28376 tablet_bootstrap.cc:492] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:49.950052 28376 ts_tablet_manager.cc:1403] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.384s	user 0.011s	sys 0.008s
I20260709 13:08:49.950489 28378 tablet_bootstrap.cc:654] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:49.950816 28381 ts_tablet_manager.cc:1434] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 13:08:49.953359 28376 raft_consensus.cc:359] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:49.954221 28376 raft_consensus.cc:385] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:49.954551 28376 raft_consensus.cc:740] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:49.955260 28376 consensus_queue.cc:260] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:49.957409 28378 tablet_bootstrap.cc:492] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:49.957957 28378 ts_tablet_manager.cc:1403] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.002s
I20260709 13:08:49.959240 28376 ts_tablet_manager.cc:1434] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:49.960515 28376 tablet_bootstrap.cc:492] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:49.961210 28378 raft_consensus.cc:359] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:49.962040 28378 raft_consensus.cc:385] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:49.962334 28378 raft_consensus.cc:740] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:49.963181 28378 consensus_queue.cc:260] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:49.964998 28378 ts_tablet_manager.cc:1434] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:49.966172 28378 tablet_bootstrap.cc:492] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:49.966449 28376 tablet_bootstrap.cc:654] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:49.972421 28376 tablet_bootstrap.cc:492] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:49.972911 28376 ts_tablet_manager.cc:1403] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:08:49.973028 28378 tablet_bootstrap.cc:654] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:49.976591 28376 raft_consensus.cc:359] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:49.977608 28376 raft_consensus.cc:385] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:49.977936 28376 raft_consensus.cc:740] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:49.978804 28376 consensus_queue.cc:260] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:49.980124 28378 tablet_bootstrap.cc:492] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:49.980772 28378 ts_tablet_manager.cc:1403] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:08:49.980914 28376 ts_tablet_manager.cc:1434] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:08:49.982141 28376 tablet_bootstrap.cc:492] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
W20260709 13:08:49.982228 28054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:49.984539 28378 raft_consensus.cc:359] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:49.985409 28378 raft_consensus.cc:385] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:49.985651 28378 raft_consensus.cc:740] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:49.986702 28378 consensus_queue.cc:260] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:49.990212 28376 tablet_bootstrap.cc:654] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:49.991026 28378 ts_tablet_manager.cc:1434] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:08:49.992274 28378 tablet_bootstrap.cc:492] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:49.996014 28379 raft_consensus.cc:359] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:49.996727 28379 raft_consensus.cc:385] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:49.996987 28379 raft_consensus.cc:740] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:49.997728 28379 consensus_queue.cc:260] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:49.998963 28378 tablet_bootstrap.cc:654] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:50.003325 28379 ts_tablet_manager.cc:1434] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.165s	user 0.010s	sys 0.000s
I20260709 13:08:50.021535 28379 tablet_bootstrap.cc:492] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:50.030454 28378 tablet_bootstrap.cc:492] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:50.030684 28379 tablet_bootstrap.cc:654] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:50.031041 28378 ts_tablet_manager.cc:1403] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.039s	user 0.025s	sys 0.007s
I20260709 13:08:50.033599 28376 tablet_bootstrap.cc:492] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:50.034174 28376 ts_tablet_manager.cc:1403] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.005s
I20260709 13:08:50.033998 28378 raft_consensus.cc:359] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:50.035045 28378 raft_consensus.cc:385] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:50.035403 28378 raft_consensus.cc:740] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:50.039557 28378 consensus_queue.cc:260] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:50.041360 28378 ts_tablet_manager.cc:1434] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:50.042469 28378 tablet_bootstrap.cc:492] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:50.044835 28376 raft_consensus.cc:359] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:50.045593 28376 raft_consensus.cc:385] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:50.045881 28376 raft_consensus.cc:740] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:50.047258 28106 raft_consensus.cc:3060] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:50.047829 28376 consensus_queue.cc:260] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:50.054562 28376 ts_tablet_manager.cc:1434] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 13:08:50.054791 28378 tablet_bootstrap.cc:654] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:50.055872 28376 tablet_bootstrap.cc:492] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:50.056778 28072 leader_election.cc:304] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:50.062577 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:50.064707 28376 tablet_bootstrap.cc:654] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:50.067842 28673 raft_consensus.cc:2804] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:50.068301 28673 raft_consensus.cc:493] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.068598 28673 raft_consensus.cc:3060] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:50.070219 28706 consensus_queue.cc:1048] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:50.075260 28072 leader_election.cc:304] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:50.075706 28673 raft_consensus.cc:515] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:50.077114 28555 raft_consensus.cc:2749] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:50.077841 28673 leader_election.cc:290] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:50.242004 28385 raft_consensus.cc:493] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.244290 28385 raft_consensus.cc:515] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:50.279196 28758 raft_consensus.cc:493] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.279800 28758 raft_consensus.cc:515] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:50.285857 28758 leader_election.cc:290] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:50.323542 28763 raft_consensus.cc:493] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.324023 28763 raft_consensus.cc:515] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
W20260709 13:08:50.326154 28223 leader_election.cc:343] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:50.326360 28763 leader_election.cc:290] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:50.326727 28223 leader_election.cc:304] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:50.338155 28768 raft_consensus.cc:2749] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:50.378527 28181 raft_consensus.cc:3060] T 2b08edfd918443739d94d5586ac7a46b P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:50.396142 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21657d67f652457cb8eef62fd181935f" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:50.396193 28707 raft_consensus.cc:493] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.397714 28707 raft_consensus.cc:515] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:50.396379 28740 consensus_queue.cc:1048] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:08:50.406419 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddfe000e4a34d3e988447d289961873" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:50.407243 28384 raft_consensus.cc:493] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 60d640828dc841619730621ec09d4c64)
I20260709 13:08:50.408188 28707 leader_election.cc:290] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:50.408016 28384 raft_consensus.cc:515] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:50.410595 28384 leader_election.cc:290] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:50.411803 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c25595e441a47e5bb6f0f694cb3eed9" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:50.432700 28721 raft_consensus.cc:493] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.433336 28721 raft_consensus.cc:515] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:50.442580 28381 tablet_bootstrap.cc:492] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:50.443629 28721 leader_election.cc:290] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:50.446341 28378 tablet_bootstrap.cc:492] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:50.449132 28379 tablet_bootstrap.cc:492] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:50.449678 28379 ts_tablet_manager.cc:1403] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.428s	user 0.010s	sys 0.003s
I20260709 13:08:50.460157 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21657d67f652457cb8eef62fd181935f" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:50.460085 28323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21657d67f652457cb8eef62fd181935f" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:50.463995 28323 raft_consensus.cc:2468] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:50.466221 28378 ts_tablet_manager.cc:1403] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.424s	user 0.084s	sys 0.110s
I20260709 13:08:50.469161 28379 raft_consensus.cc:359] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:50.469901 28379 raft_consensus.cc:385] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:50.479349 28379 raft_consensus.cc:740] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:50.476496 28385 leader_election.cc:290] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:50.474459 28221 leader_election.cc:304] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:50.481706 28777 raft_consensus.cc:2804] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:50.482152 28777 raft_consensus.cc:493] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.482496 28777 raft_consensus.cc:3060] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:50.483052 28381 tablet_bootstrap.cc:654] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:50.477035 28378 raft_consensus.cc:359] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:50.483783 28378 raft_consensus.cc:385] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:50.483590 28379 consensus_queue.cc:260] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:50.484174 28378 raft_consensus.cc:740] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:50.485966 28379 ts_tablet_manager.cc:1434] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.002s
I20260709 13:08:50.487733 28378 consensus_queue.cc:260] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:50.490888 28378 ts_tablet_manager.cc:1434] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.005s
I20260709 13:08:50.492287 28378 tablet_bootstrap.cc:492] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:50.494128 28379 tablet_bootstrap.cc:492] T 09d32680280443ecb859c6deb72a5cc3 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:50.501020 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21657d67f652457cb8eef62fd181935f" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:50.499320 28378 tablet_bootstrap.cc:654] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:50.509473 28221 leader_election.cc:343] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:50.245577 28673 raft_consensus.cc:493] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.510705 28673 raft_consensus.cc:515] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:50.512997 28673 leader_election.cc:290] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:50.509567 28765 raft_consensus.cc:493] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.518270 28765 raft_consensus.cc:515] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:50.521147 28765 leader_election.cc:290] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:50.525563 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6fe3b72cb46e6bbdbea8e0f38cba7" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:50.526355 28379 tablet_bootstrap.cc:654] T 09d32680280443ecb859c6deb72a5cc3 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:50.526372 28253 raft_consensus.cc:2393] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d2bb5df3b55462682d0f2fce57709f1 in current term 1: Already voted for candidate 8938bce1e7864c1ab26755f60f708368 in this term.
I20260709 13:08:50.518442 28777 raft_consensus.cc:515] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:50.531188 28255 raft_consensus.cc:2393] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 60d640828dc841619730621ec09d4c64 in current term 1: Already voted for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in this term.
I20260709 13:08:50.532001 28777 leader_election.cc:290] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:50.535678 28385 consensus_queue.cc:1048] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:50.563127 28221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:34859, user_credentials={real_user=slave}} blocked reactor thread for 52228.7us
I20260709 13:08:50.568482 28323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21657d67f652457cb8eef62fd181935f" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:50.571448 28323 raft_consensus.cc:3060] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:50.571605 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21657d67f652457cb8eef62fd181935f" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:50.571938 28378 tablet_bootstrap.cc:492] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:50.571805 28256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:50.572537 28256 raft_consensus.cc:2468] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:50.573745 28378 ts_tablet_manager.cc:1403] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.082s	user 0.021s	sys 0.025s
I20260709 13:08:50.571313 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c507c906b4393aac2708e46f9bade" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:50.579638 28323 raft_consensus.cc:2468] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:50.586831 28100 raft_consensus.cc:3060] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:50.589025 28221 leader_election.cc:304] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:50.590337 28441 raft_consensus.cc:2804] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:50.590874 28441 raft_consensus.cc:697] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:50.591848 28441 consensus_queue.cc:237] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:50.592396 28297 leader_election.cc:304] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:50.593236 28385 raft_consensus.cc:2804] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:50.593554 28385 raft_consensus.cc:493] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.593845 28385 raft_consensus.cc:3060] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:50.559443 28223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:34231, user_credentials={real_user=slave}} blocked reactor thread for 44194.2us
W20260709 13:08:50.599347 28221 leader_election.cc:343] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:50.601023 28221 leader_election.cc:343] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:50.608799 28772 raft_consensus.cc:493] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.609304 28772 raft_consensus.cc:515] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:50.613194 28385 raft_consensus.cc:515] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:50.620132 28328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7084d0da22fc408c861229f3e9cbdb94" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:50.623252 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7084d0da22fc408c861229f3e9cbdb94" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:50.706348 28178 raft_consensus.cc:3060] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:50.711036 28772 leader_election.cc:290] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:50.713768 28385 leader_election.cc:290] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:50.603174 28740 consensus_queue.cc:1048] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:08:50.587226 28102 raft_consensus.cc:3060] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:50.701996 28221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:34859, user_credentials={real_user=slave}} blocked reactor thread for 87238.1us
I20260709 13:08:50.703024 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8778ebb28d774473bbe1042cbb1c6721" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:50.704681 28378 raft_consensus.cc:359] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
W20260709 13:08:50.716777 28223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:34231, user_credentials={real_user=slave}} blocked reactor thread for 100939us
I20260709 13:08:50.725420 28376 tablet_bootstrap.cc:492] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:50.764003 28378 raft_consensus.cc:385] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:50.764169 28376 ts_tablet_manager.cc:1403] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.709s	user 0.033s	sys 0.023s
I20260709 13:08:50.764348 28378 raft_consensus.cc:740] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:50.732523 28381 tablet_bootstrap.cc:492] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:50.767369 28379 tablet_bootstrap.cc:492] T 09d32680280443ecb859c6deb72a5cc3 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:50.768064 28379 ts_tablet_manager.cc:1403] T 09d32680280443ecb859c6deb72a5cc3 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.274s	user 0.017s	sys 0.000s
I20260709 13:08:50.719038 28328 raft_consensus.cc:3060] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:50.767346 28381 ts_tablet_manager.cc:1403] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.325s	user 0.024s	sys 0.007s
I20260709 13:08:50.746040 28385 raft_consensus.cc:493] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.770625 28385 raft_consensus.cc:515] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:50.773083 28378 consensus_queue.cc:260] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:50.776425 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6fe3b72cb46e6bbdbea8e0f38cba7" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:50.785856 28376 raft_consensus.cc:359] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:50.730434 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:50.792976 28376 raft_consensus.cc:385] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:50.793226 28255 raft_consensus.cc:3060] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:50.793351 28376 raft_consensus.cc:740] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:50.793509 28328 raft_consensus.cc:2468] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 1.
I20260709 13:08:50.794396 28779 consensus_queue.cc:1048] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:50.794303 28376 consensus_queue.cc:260] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:50.798900 28381 raft_consensus.cc:359] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:50.799639 28381 raft_consensus.cc:385] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:50.799827 28376 ts_tablet_manager.cc:1434] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 13:08:50.799892 28381 raft_consensus.cc:740] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:50.790095 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c507c906b4393aac2708e46f9bade" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:50.792502 28385 leader_election.cc:290] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:50.801146 28379 raft_consensus.cc:359] T 09d32680280443ecb859c6deb72a5cc3 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:50.804425 28379 raft_consensus.cc:385] T 09d32680280443ecb859c6deb72a5cc3 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:50.804739 28379 raft_consensus.cc:740] T 09d32680280443ecb859c6deb72a5cc3 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:50.760409 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddfe000e4a34d3e988447d289961873" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:50.800696 28381 consensus_queue.cc:260] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:50.807265 28379 consensus_queue.cc:260] T 09d32680280443ecb859c6deb72a5cc3 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:50.746536 28432 raft_consensus.cc:493] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.813102 28378 ts_tablet_manager.cc:1434] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.239s	user 0.009s	sys 0.000s
I20260709 13:08:50.815471 28378 tablet_bootstrap.cc:492] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:50.819003 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec1905dc240442ab4df69ac1951ce28" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:50.819967 28379 ts_tablet_manager.cc:1434] T 09d32680280443ecb859c6deb72a5cc3 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.000s
I20260709 13:08:50.820327 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d32680280443ecb859c6deb72a5cc3" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:50.820995 28253 raft_consensus.cc:2468] T 09d32680280443ecb859c6deb72a5cc3 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:50.821364 28379 tablet_bootstrap.cc:492] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:50.826560 28381 ts_tablet_manager.cc:1434] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.001s
I20260709 13:08:50.827673 28381 tablet_bootstrap.cc:492] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:50.831692 28177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:50.831859 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec1905dc240442ab4df69ac1951ce28" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:50.844489 28297 leader_election.cc:304] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:50.845433 28706 raft_consensus.cc:2804] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:50.845816 28706 raft_consensus.cc:493] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.846153 28706 raft_consensus.cc:3060] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:50.850194 28376 tablet_bootstrap.cc:492] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:50.851543 28072 leader_election.cc:304] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 
I20260709 13:08:50.852384 28673 raft_consensus.cc:2804] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:50.852665 28327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8778ebb28d774473bbe1042cbb1c6721" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:50.853061 28673 raft_consensus.cc:697] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:08:50.853384 28327 raft_consensus.cc:2468] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 0.
I20260709 13:08:50.857270 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:50.858093 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d32680280443ecb859c6deb72a5cc3" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:50.859665 28327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7084d0da22fc408c861229f3e9cbdb94" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
W20260709 13:08:50.860186 28074 leader_election.cc:343] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:50.860613 28327 raft_consensus.cc:2393] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8938bce1e7864c1ab26755f60f708368 in current term 1: Already voted for candidate 7d2bb5df3b55462682d0f2fce57709f1 in this term.
I20260709 13:08:50.861510 28074 leader_election.cc:304] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:50.862377 28327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c25595e441a47e5bb6f0f694cb3eed9" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:50.865119 28758 raft_consensus.cc:2749] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:50.849954 28005 catalog_manager.cc:5697] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 1 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.862717 28074 leader_election.cc:304] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:50.868309 28770 consensus_queue.cc:1048] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:50.869076 28223 leader_election.cc:343] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:50.869678 28759 raft_consensus.cc:2749] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:50.870775 28178 raft_consensus.cc:2468] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 1.
I20260709 13:08:50.869691 28223 leader_election.cc:304] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:50.873373 28601 raft_consensus.cc:2749] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:50.848033 28432 raft_consensus.cc:515] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:50.853989 28673 consensus_queue.cc:237] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:50.868657 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7084d0da22fc408c861229f3e9cbdb94" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:50.877570 28432 leader_election.cc:290] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:50.868305 28005 catalog_manager.cc:5697] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 1 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.880584 28788 consensus_queue.cc:1048] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:50.880878 28005 catalog_manager.cc:5697] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } }
I20260709 13:08:50.882566 28740 consensus_queue.cc:1048] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:50.883625 28379 tablet_bootstrap.cc:654] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:50.885802 28706 raft_consensus.cc:515] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:50.888242 28255 raft_consensus.cc:2468] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:50.916021 28147 leader_election.cc:304] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1
W20260709 13:08:50.921904 28295 leader_election.cc:343] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:50.925108 28295 leader_election.cc:304] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:50.926842 28378 tablet_bootstrap.cc:654] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:50.934897 28376 tablet_bootstrap.cc:654] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:50.929004 28740 raft_consensus.cc:2749] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:50.927217 28792 raft_consensus.cc:2749] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:50.943504 28295 leader_election.cc:343] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:50.954242 28381 tablet_bootstrap.cc:654] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:50.975677 28072 leader_election.cc:304] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:50.977078 28379 tablet_bootstrap.cc:492] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:50.977584 28379 ts_tablet_manager.cc:1403] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.157s	user 0.014s	sys 0.018s
I20260709 13:08:50.966368 28706 leader_election.cc:290] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:50.977341 28072 leader_election.cc:304] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
W20260709 13:08:50.991009 28297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:34231, user_credentials={real_user=slave}} blocked reactor thread for 50489.4us
I20260709 13:08:50.972123 28721 raft_consensus.cc:493] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.994654 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
W20260709 13:08:50.996790 28295 leader_election.cc:343] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:50.986423 28555 raft_consensus.cc:2804] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:51.004411 28297 leader_election.cc:343] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.008436 28297 leader_election.cc:304] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
W20260709 13:08:51.014379 28297 leader_election.cc:343] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:51.016328 28297 leader_election.cc:343] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:51.017079 28297 leader_election.cc:343] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.018970 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:51.019200 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d32680280443ecb859c6deb72a5cc3" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:51.007296 28555 raft_consensus.cc:493] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.023567 28555 raft_consensus.cc:3060] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.010856 28759 raft_consensus.cc:2749] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:51.027709 28297 leader_election.cc:304] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:51.032653 28796 raft_consensus.cc:2749] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:51.000480 28721 raft_consensus.cc:515] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
W20260709 13:08:51.037065 28297 leader_election.cc:343] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.040717 28797 raft_consensus.cc:2804] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:51.041282 28797 raft_consensus.cc:697] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
W20260709 13:08:51.021754 28072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.68:46171, user_credentials={real_user=slave}} blocked reactor thread for 44483.3us
I20260709 13:08:51.043712 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d32680280443ecb859c6deb72a5cc3" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:51.043812 28797 consensus_queue.cc:237] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:51.055433 28252 raft_consensus.cc:3060] T 09d32680280443ecb859c6deb72a5cc3 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.081657 28379 raft_consensus.cc:359] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.082450 28379 raft_consensus.cc:385] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:51.082711 28379 raft_consensus.cc:740] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:51.093082 28379 consensus_queue.cc:260] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.103889 28376 tablet_bootstrap.cc:492] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:51.104444 28376 ts_tablet_manager.cc:1403] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.300s	user 0.014s	sys 0.012s
I20260709 13:08:51.116236 28379 ts_tablet_manager.cc:1434] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.138s	user 0.007s	sys 0.002s
I20260709 13:08:51.124234 28796 raft_consensus.cc:493] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.137513 28379 tablet_bootstrap.cc:492] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:51.115640 28555 raft_consensus.cc:515] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:51.141942 28555 leader_election.cc:290] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:51.141721 28376 raft_consensus.cc:359] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.142452 28376 raft_consensus.cc:385] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:51.142726 28376 raft_consensus.cc:740] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:51.143402 28376 consensus_queue.cc:260] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
W20260709 13:08:51.146078 28805 log.cc:927] Time spent T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:08:51.149562 28328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8778ebb28d774473bbe1042cbb1c6721" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:51.150187 28328 raft_consensus.cc:3060] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.154139 28555 raft_consensus.cc:493] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.154747 28555 raft_consensus.cc:515] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:51.156591 28381 tablet_bootstrap.cc:492] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:51.157132 28381 ts_tablet_manager.cc:1403] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.330s	user 0.014s	sys 0.004s
I20260709 13:08:51.138345 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:51.158895 28721 leader_election.cc:290] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:51.160476 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:51.161197 28555 leader_election.cc:290] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:51.162744 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8778ebb28d774473bbe1042cbb1c6721" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:51.163399 28181 raft_consensus.cc:3060] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.167126 28381 raft_consensus.cc:359] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:51.167879 28381 raft_consensus.cc:385] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:51.168148 28381 raft_consensus.cc:740] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:51.139326 28796 raft_consensus.cc:515] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:51.169014 28378 tablet_bootstrap.cc:492] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:51.169528 28378 ts_tablet_manager.cc:1403] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.354s	user 0.010s	sys 0.019s
W20260709 13:08:51.169456 28297 leader_election.cc:343] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.172290 28378 raft_consensus.cc:359] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.172940 28378 raft_consensus.cc:385] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:51.173620 28381 consensus_queue.cc:260] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:51.173187 28796 leader_election.cc:290] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:51.175280 28254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c507c906b4393aac2708e46f9bade" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:51.176015 28254 raft_consensus.cc:2468] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 0.
I20260709 13:08:51.177315 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c507c906b4393aac2708e46f9bade" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:51.178774 28379 tablet_bootstrap.cc:654] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:51.178894 28328 raft_consensus.cc:2468] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 1.
I20260709 13:08:51.180809 28074 leader_election.cc:304] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:51.182085 28376 ts_tablet_manager.cc:1434] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.001s
I20260709 13:08:51.150571 28252 raft_consensus.cc:2468] T 09d32680280443ecb859c6deb72a5cc3 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
W20260709 13:08:51.183424 28221 consensus_peers.cc:597] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.184310 28707 raft_consensus.cc:2804] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:51.184319 28181 raft_consensus.cc:2468] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 1.
I20260709 13:08:51.184908 28707 raft_consensus.cc:493] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.185256 28707 raft_consensus.cc:3060] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.173206 28378 raft_consensus.cc:740] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:51.192646 28376 tablet_bootstrap.cc:492] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:51.193668 28072 leader_election.cc:304] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 
I20260709 13:08:51.193784 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5af1d945a248cabc1f6f5dbddc6098" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:51.194684 28759 raft_consensus.cc:2804] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:51.195211 28759 raft_consensus.cc:697] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:08:51.196133 28759 consensus_queue.cc:237] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:51.195122 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5af1d945a248cabc1f6f5dbddc6098" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:51.198228 28776 raft_consensus.cc:493] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.200529 28376 tablet_bootstrap.cc:654] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:51.206360 28381 ts_tablet_manager.cc:1434] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:08:51.211071 28779 consensus_queue.cc:1048] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:51.215193 28378 consensus_queue.cc:260] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
W20260709 13:08:51.217052 28297 leader_election.cc:343] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:51.229921 28297 leader_election.cc:343] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.230391 28297 leader_election.cc:304] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:51.237649 28297 leader_election.cc:304] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:51.239526 28792 raft_consensus.cc:2749] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:51.250432 28381 tablet_bootstrap.cc:492] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:51.250517 28385 raft_consensus.cc:2804] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:51.264426 28385 raft_consensus.cc:697] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:51.265604 28385 consensus_queue.cc:237] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
W20260709 13:08:51.270293 28054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:51.277290 28378 ts_tablet_manager.cc:1434] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.107s	user 0.004s	sys 0.004s
I20260709 13:08:51.231683 28776 raft_consensus.cc:515] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
W20260709 13:08:51.273994 28278 debug-util.cc:398] Leaking SignalData structure 0x7b080021a160 after lost signal to thread 21004
W20260709 13:08:51.284614 28278 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6560 after lost signal to thread 28040
I20260709 13:08:51.285189 28381 tablet_bootstrap.cc:654] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:51.286095 28278 debug-util.cc:398] Leaking SignalData structure 0x7b08001504a0 after lost signal to thread 28132
I20260709 13:08:51.288596 28776 leader_election.cc:290] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:51.291262 28707 raft_consensus.cc:515] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:51.292441 28255 raft_consensus.cc:2468] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
W20260709 13:08:51.307017 28295 leader_election.cc:343] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.307739 28295 leader_election.cc:304] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:51.321231 28721 raft_consensus.cc:2749] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:51.297245 28074 leader_election.cc:343] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:51.318522 28278 debug-util.cc:398] Leaking SignalData structure 0x7b0800060ae0 after lost signal to thread 28207
I20260709 13:08:51.327252 28297 leader_election.cc:304] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:51.329052 28323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:51.355262 28323 raft_consensus.cc:2468] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:51.356559 28379 tablet_bootstrap.cc:492] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:51.357088 28379 ts_tablet_manager.cc:1403] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.233s	user 0.050s	sys 0.079s
I20260709 13:08:51.329566 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
W20260709 13:08:51.330039 28074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:34231, user_credentials={real_user=slave}} blocked reactor thread for 51221.6us
I20260709 13:08:51.359782 28379 raft_consensus.cc:359] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:51.360659 28379 raft_consensus.cc:385] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:51.360957 28379 raft_consensus.cc:740] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:51.361729 28379 consensus_queue.cc:260] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:51.325176 28707 leader_election.cc:290] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:51.363971 28379 ts_tablet_manager.cc:1434] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:08:51.343377 28378 tablet_bootstrap.cc:492] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
W20260709 13:08:51.344661 28278 debug-util.cc:398] Leaking SignalData structure 0x7b080016f020 after lost signal to thread 28281
I20260709 13:08:51.352591 28006 catalog_manager.cc:5697] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } }
W20260709 13:08:51.367024 28221 leader_election.cc:343] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.370292 28706 raft_consensus.cc:2804] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:51.370775 28706 raft_consensus.cc:493] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.371121 28706 raft_consensus.cc:3060] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:51.372287 28278 debug-util.cc:398] Leaking SignalData structure 0x7b08000f4480 after lost signal to thread 28355
I20260709 13:08:51.368079 28006 catalog_manager.cc:5697] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:51.373188 28278 debug-util.cc:398] Leaking SignalData structure 0x7b080019c7c0 after lost signal to thread 28709
I20260709 13:08:51.370340 28182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c507c906b4393aac2708e46f9bade" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:51.382005 28221 leader_election.cc:304] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:51.383111 28770 raft_consensus.cc:2804] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:51.383504 28770 raft_consensus.cc:493] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.383867 28770 raft_consensus.cc:3060] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.385403 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c507c906b4393aac2708e46f9bade" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:51.386106 28255 raft_consensus.cc:3060] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.388406 28376 tablet_bootstrap.cc:492] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:51.388926 28376 ts_tablet_manager.cc:1403] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.197s	user 0.027s	sys 0.024s
W20260709 13:08:51.388836 28074 leader_election.cc:343] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.393241 28255 raft_consensus.cc:2468] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 1.
I20260709 13:08:51.394102 28706 raft_consensus.cc:515] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.395550 28376 raft_consensus.cc:359] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:51.396340 28376 raft_consensus.cc:385] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:51.396660 28376 raft_consensus.cc:740] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:51.396430 28074 leader_election.cc:304] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:51.397869 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:51.399027 28673 raft_consensus.cc:2804] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:08:51.399784 28295 leader_election.cc:343] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.400296 28673 raft_consensus.cc:697] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:08:51.402247 28673 consensus_queue.cc:237] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:51.396559 28706 leader_election.cc:290] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:51.403070 28376 consensus_queue.cc:260] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:51.404844 28378 tablet_bootstrap.cc:654] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:51.404970 28376 ts_tablet_manager.cc:1434] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:08:51.406322 28770 raft_consensus.cc:515] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.407392 28379 tablet_bootstrap.cc:492] T 17113c03409f4c19ae665da8835dc3b2 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:51.410250 28376 tablet_bootstrap.cc:492] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:51.409418 28381 tablet_bootstrap.cc:492] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:51.414052 28381 ts_tablet_manager.cc:1403] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.164s	user 0.024s	sys 0.020s
I20260709 13:08:51.415740 28707 consensus_queue.cc:1048] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:51.424242 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:51.416896 28381 raft_consensus.cc:359] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
W20260709 13:08:51.427564 28221 leader_election.cc:343] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.419118 28770 leader_election.cc:290] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:51.424199 28328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:51.422575 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:51.428967 28328 raft_consensus.cc:2393] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cd66bd010fa04c4c8d0a668a77bd4c6d in current term 1: Already voted for candidate 60d640828dc841619730621ec09d4c64 in this term.
I20260709 13:08:51.429486 28255 raft_consensus.cc:2393] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 60d640828dc841619730621ec09d4c64 in current term 1: Already voted for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in this term.
I20260709 13:08:51.427663 28381 raft_consensus.cc:385] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:51.428887 28376 tablet_bootstrap.cc:654] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:51.430445 28381 raft_consensus.cc:740] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:51.430826 28221 leader_election.cc:304] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:51.422127 28379 tablet_bootstrap.cc:654] T 17113c03409f4c19ae665da8835dc3b2 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:51.433414 28297 leader_election.cc:304] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:51.438138 28385 raft_consensus.cc:2749] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:51.431443 28381 consensus_queue.cc:260] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:51.439968 28005 catalog_manager.cc:5697] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.444720 28005 catalog_manager.cc:5697] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.442551 28776 raft_consensus.cc:2749] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:51.449355 28381 ts_tablet_manager.cc:1434] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:08:51.451797 28381 tablet_bootstrap.cc:492] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:51.455803 28740 raft_consensus.cc:493] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.462292 28378 tablet_bootstrap.cc:492] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:51.463572 28378 ts_tablet_manager.cc:1403] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.120s	user 0.012s	sys 0.001s
I20260709 13:08:51.466784 28740 raft_consensus.cc:515] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:51.469622 28740 leader_election.cc:290] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:51.471627 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec1905dc240442ab4df69ac1951ce28" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:51.472332 28108 raft_consensus.cc:2468] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
I20260709 13:08:51.474033 28147 leader_election.cc:304] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:08:51.475021 28686 raft_consensus.cc:2804] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:51.475507 28686 raft_consensus.cc:493] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.475904 28686 raft_consensus.cc:3060] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.477077 28378 raft_consensus.cc:359] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:51.477809 28378 raft_consensus.cc:385] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:51.478081 28378 raft_consensus.cc:740] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:51.481588 28759 raft_consensus.cc:493] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.482121 28759 raft_consensus.cc:515] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.484623 28759 leader_election.cc:290] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:51.485968 28328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec1905dc240442ab4df69ac1951ce28" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:51.486747 28328 raft_consensus.cc:2468] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 0.
I20260709 13:08:51.490110 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21657d67f652457cb8eef62fd181935f" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:51.478907 28378 consensus_queue.cc:260] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:51.498260 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21657d67f652457cb8eef62fd181935f" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:51.500772 28376 tablet_bootstrap.cc:492] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:51.501317 28376 ts_tablet_manager.cc:1403] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.091s	user 0.007s	sys 0.006s
I20260709 13:08:51.505528 28074 leader_election.cc:304] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:51.507030 28378 ts_tablet_manager.cc:1434] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:08:51.511023 28759 raft_consensus.cc:2749] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:51.519085 28686 raft_consensus.cc:515] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:51.525043 28686 leader_election.cc:290] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:51.526152 28379 tablet_bootstrap.cc:492] T 17113c03409f4c19ae665da8835dc3b2 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:51.526682 28379 ts_tablet_manager.cc:1403] T 17113c03409f4c19ae665da8835dc3b2 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.120s	user 0.014s	sys 0.003s
I20260709 13:08:51.527007 28381 tablet_bootstrap.cc:654] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:51.528766 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec1905dc240442ab4df69ac1951ce28" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:51.500268 28673 consensus_queue.cc:1048] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:08:51.529405 28108 raft_consensus.cc:3060] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.536276 28378 tablet_bootstrap.cc:492] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64: Bootstrap starting.
I20260709 13:08:51.529485 28379 raft_consensus.cc:359] T 17113c03409f4c19ae665da8835dc3b2 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.542761 28379 raft_consensus.cc:385] T 17113c03409f4c19ae665da8835dc3b2 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:51.533878 28376 raft_consensus.cc:359] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.543293 28376 raft_consensus.cc:385] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:51.543584 28376 raft_consensus.cc:740] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:51.543998 28379 raft_consensus.cc:740] T 17113c03409f4c19ae665da8835dc3b2 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:51.544203 28376 consensus_queue.cc:260] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.546165 28379 consensus_queue.cc:260] T 17113c03409f4c19ae665da8835dc3b2 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.548170 28379 ts_tablet_manager.cc:1434] T 17113c03409f4c19ae665da8835dc3b2 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:08:51.535223 28323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec1905dc240442ab4df69ac1951ce28" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:51.551064 28323 raft_consensus.cc:3060] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.558463 28379 tablet_bootstrap.cc:492] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:51.560354 28006 catalog_manager.cc:5697] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.561580 28006 catalog_manager.cc:5697] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.566543 28376 ts_tablet_manager.cc:1434] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:08:51.572158 28376 tablet_bootstrap.cc:492] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:51.579856 28379 tablet_bootstrap.cc:654] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:51.570735 28323 raft_consensus.cc:2468] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:51.581624 28147 leader_election.cc:304] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:08:51.582480 28788 raft_consensus.cc:2804] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:51.583029 28788 raft_consensus.cc:697] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:51.589112 28108 raft_consensus.cc:2468] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:51.588757 28788 consensus_queue.cc:237] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:51.592137 28379 tablet_bootstrap.cc:492] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:51.592721 28379 ts_tablet_manager.cc:1403] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.005s
I20260709 13:08:51.593434 28376 tablet_bootstrap.cc:654] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:51.587124 28378 tablet_bootstrap.cc:654] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:51.598466 28379 raft_consensus.cc:359] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:51.599360 28379 raft_consensus.cc:385] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:51.599128 28707 consensus_queue.cc:1048] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:51.599828 28379 raft_consensus.cc:740] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:51.600884 28379 consensus_queue.cc:260] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:51.601675 28797 raft_consensus.cc:493] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.602164 28797 raft_consensus.cc:515] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.603657 28379 ts_tablet_manager.cc:1434] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:08:51.604882 28379 tablet_bootstrap.cc:492] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:51.604811 28797 leader_election.cc:290] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:51.606601 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17113c03409f4c19ae665da8835dc3b2" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:51.607297 28255 raft_consensus.cc:2468] T 17113c03409f4c19ae665da8835dc3b2 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
I20260709 13:08:51.608479 28297 leader_election.cc:304] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:51.609253 28797 raft_consensus.cc:2804] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:51.609599 28797 raft_consensus.cc:493] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.610069 28797 raft_consensus.cc:3060] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.607517 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17113c03409f4c19ae665da8835dc3b2" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:51.609604 28381 tablet_bootstrap.cc:492] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:51.615864 28381 ts_tablet_manager.cc:1403] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.164s	user 0.016s	sys 0.000s
W20260709 13:08:51.616160 28295 leader_election.cc:343] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.619972 28379 tablet_bootstrap.cc:654] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:51.626362 28797 raft_consensus.cc:515] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.627198 28770 raft_consensus.cc:493] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.629617 28770 raft_consensus.cc:515] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:51.631781 28770 leader_election.cc:290] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:51.631903 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17113c03409f4c19ae665da8835dc3b2" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:51.628160 28378 tablet_bootstrap.cc:492] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64: No bootstrap required, opened a new log
I20260709 13:08:51.632539 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea6103de0047339ed0e7e5d460ee53" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:51.633056 28378 ts_tablet_manager.cc:1403] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.005s
W20260709 13:08:51.634140 28221 leader_election.cc:343] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.632563 28255 raft_consensus.cc:3060] T 17113c03409f4c19ae665da8835dc3b2 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.637249 28376 tablet_bootstrap.cc:492] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:51.637714 28376 ts_tablet_manager.cc:1403] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.066s	user 0.006s	sys 0.007s
I20260709 13:08:51.634562 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea6103de0047339ed0e7e5d460ee53" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
W20260709 13:08:51.640282 28223 leader_election.cc:343] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.640740 28223 leader_election.cc:304] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:51.642894 28770 raft_consensus.cc:2749] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:51.672909 28797 leader_election.cc:290] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:51.674225 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17113c03409f4c19ae665da8835dc3b2" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:51.674530 28759 consensus_queue.cc:1048] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:51.691226 28295 leader_election.cc:343] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.675542 28378 raft_consensus.cc:359] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.693274 28378 raft_consensus.cc:385] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:51.693606 28378 raft_consensus.cc:740] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Initialized, Role: FOLLOWER
I20260709 13:08:51.678591 28686 raft_consensus.cc:493] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.694228 28686 raft_consensus.cc:515] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:51.694416 28378 consensus_queue.cc:260] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.696353 28686 leader_election.cc:290] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:51.696640 28378 ts_tablet_manager.cc:1434] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 13:08:51.697456 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:51.698223 28252 raft_consensus.cc:2393] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8938bce1e7864c1ab26755f60f708368 in current term 1: Already voted for candidate 60d640828dc841619730621ec09d4c64 in this term.
I20260709 13:08:51.678817 28108 raft_consensus.cc:3060] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.618610 28381 raft_consensus.cc:359] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:51.699926 28381 raft_consensus.cc:385] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:51.682775 28385 raft_consensus.cc:493] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.689374 28255 raft_consensus.cc:2468] T 17113c03409f4c19ae665da8835dc3b2 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:51.676630 28376 raft_consensus.cc:359] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:51.701046 28376 raft_consensus.cc:385] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:51.701390 28376 raft_consensus.cc:740] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:51.700275 28381 raft_consensus.cc:740] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:51.700737 28385 raft_consensus.cc:515] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:51.703044 28381 consensus_queue.cc:260] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:51.708586 28297 leader_election.cc:304] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:51.700923 28178 raft_consensus.cc:3060] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.712064 28376 consensus_queue.cc:260] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:51.715847 28385 leader_election.cc:290] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:51.713820 28706 raft_consensus.cc:2804] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:51.716343 28759 raft_consensus.cc:493] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.718734 28177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fd7e0c5ab432ba3165dca1ee9f151" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:51.719426 28323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:51.716028 28707 raft_consensus.cc:493] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.736212 28376 ts_tablet_manager.cc:1434] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.002s
I20260709 13:08:51.742017 28006 catalog_manager.cc:5697] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.746780 28381 ts_tablet_manager.cc:1434] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.131s	user 0.008s	sys 0.001s
I20260709 13:08:51.751543 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fd7e0c5ab432ba3165dca1ee9f151" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:51.736929 28759 raft_consensus.cc:515] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:51.741791 28706 raft_consensus.cc:697] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
W20260709 13:08:51.759358 28295 leader_election.cc:343] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.763098 28381 tablet_bootstrap.cc:492] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:51.767069 28376 tablet_bootstrap.cc:492] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:51.772981 28759 leader_election.cc:290] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:51.774065 28706 consensus_queue.cc:237] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.774394 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea6103de0047339ed0e7e5d460ee53" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:51.775053 28177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea6103de0047339ed0e7e5d460ee53" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:51.775455 28255 raft_consensus.cc:2468] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 0.
I20260709 13:08:51.747732 28707 raft_consensus.cc:515] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.776894 28074 leader_election.cc:304] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
W20260709 13:08:51.777801 28074 leader_election.cc:343] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.778752 28707 leader_election.cc:290] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:51.779356 28707 raft_consensus.cc:2804] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:51.779675 28707 raft_consensus.cc:493] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.779712 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:51.780761 28255 raft_consensus.cc:2393] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d2bb5df3b55462682d0f2fce57709f1 in current term 1: Already voted for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in this term.
I20260709 13:08:51.780084 28707 raft_consensus.cc:3060] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.786000 28323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:51.786818 28323 raft_consensus.cc:2393] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d2bb5df3b55462682d0f2fce57709f1 in current term 1: Already voted for candidate 60d640828dc841619730621ec09d4c64 in this term.
I20260709 13:08:51.789322 28072 leader_election.cc:304] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:51.790495 28759 raft_consensus.cc:3060] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:51.763247 28379 tablet_bootstrap.cc:492] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:51.802417 28379 ts_tablet_manager.cc:1403] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.198s	user 0.009s	sys 0.034s
I20260709 13:08:51.896611 28381 tablet_bootstrap.cc:654] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:51.910382 28376 tablet_bootstrap.cc:654] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:51.806860 28297 consensus_peers.cc:597] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.914513 28297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:34231, user_credentials={real_user=slave}} blocked reactor thread for 166623us
I20260709 13:08:51.917387 28147 leader_election.cc:304] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:51.922616 28788 raft_consensus.cc:2749] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:51.939883 28297 leader_election.cc:343] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:51.946786 28297 leader_election.cc:304] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:51.929925 28706 raft_consensus.cc:493] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.960769 28797 raft_consensus.cc:2749] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:51.977248 28707 raft_consensus.cc:515] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:51.979202 28706 raft_consensus.cc:515] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:51.981976 28706 leader_election.cc:290] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:52.018869 28379 raft_consensus.cc:359] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:52.027482 28379 raft_consensus.cc:385] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:52.027912 28379 raft_consensus.cc:740] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:52.034646 28005 catalog_manager.cc:5697] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.035022 28379 consensus_queue.cc:260] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:52.043619 28379 ts_tablet_manager.cc:1434] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.241s	user 0.009s	sys 0.000s
I20260709 13:08:52.023149 28707 leader_election.cc:290] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:52.087347 28759 raft_consensus.cc:2749] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:52.103423 28379 tablet_bootstrap.cc:492] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d: Bootstrap starting.
I20260709 13:08:52.108235 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea6103de0047339ed0e7e5d460ee53" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
W20260709 13:08:52.112686 28297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:34231, user_credentials={real_user=slave}} blocked reactor thread for 172823us
I20260709 13:08:52.153846 28385 consensus_queue.cc:1048] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:52.140755 28177 raft_consensus.cc:3060] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:52.161753 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1568c5c6e6a5495fa8c5550c03721b67" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:52.119406 28796 consensus_queue.cc:1048] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:08:52.166718 28771 raft_consensus.cc:493] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.167539 28771 raft_consensus.cc:515] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:52.168602 28255 raft_consensus.cc:2468] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
W20260709 13:08:52.174675 28074 leader_election.cc:343] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:52.178402 28376 tablet_bootstrap.cc:492] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:52.184839 28379 tablet_bootstrap.cc:654] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:52.179641 28771 leader_election.cc:290] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:52.187202 28376 ts_tablet_manager.cc:1403] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.431s	user 0.016s	sys 0.009s
I20260709 13:08:52.191114 28376 raft_consensus.cc:359] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:52.191988 28376 raft_consensus.cc:385] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:52.192322 28376 raft_consensus.cc:740] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
W20260709 13:08:52.195310 28072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:46171, user_credentials={real_user=slave}} blocked reactor thread for 162204us
I20260709 13:08:52.196750 28376 consensus_queue.cc:260] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:52.204766 28845 raft_consensus.cc:493] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.212736 28845 raft_consensus.cc:515] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:52.216619 28844 consensus_queue.cc:1048] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:08:52.217913 28740 raft_consensus.cc:493] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.218508 28740 raft_consensus.cc:515] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:52.219254 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1568c5c6e6a5495fa8c5550c03721b67" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:52.223241 28376 ts_tablet_manager.cc:1434] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.002s
I20260709 13:08:52.251459 28845 leader_election.cc:290] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:52.291164 28376 tablet_bootstrap.cc:492] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
W20260709 13:08:52.342008 28295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:34859, user_credentials={real_user=slave}} blocked reactor thread for 64573.1us
W20260709 13:08:52.346633 28295 leader_election.cc:343] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:52.346580 28147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:46171, user_credentials={real_user=slave}} blocked reactor thread for 139521us
W20260709 13:08:52.335069 28223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:34231, user_credentials={real_user=slave}} blocked reactor thread for 162651us
I20260709 13:08:52.345228 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea6103de0047339ed0e7e5d460ee53" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
W20260709 13:08:52.353647 28221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:46171, user_credentials={real_user=slave}} blocked reactor thread for 141295us
I20260709 13:08:52.358222 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c507c906b4393aac2708e46f9bade" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:52.353479 28848 raft_consensus.cc:493] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.362039 28255 raft_consensus.cc:3060] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:52.423610 28381 tablet_bootstrap.cc:492] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:52.424180 28381 ts_tablet_manager.cc:1403] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.665s	user 0.022s	sys 0.013s
I20260709 13:08:52.403857 28740 leader_election.cc:290] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:52.433794 28381 raft_consensus.cc:359] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:52.434686 28381 raft_consensus.cc:385] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:52.434967 28381 raft_consensus.cc:740] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:52.442974 28376 tablet_bootstrap.cc:654] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:52.445199 28379 tablet_bootstrap.cc:492] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d: No bootstrap required, opened a new log
I20260709 13:08:52.402298 28848 raft_consensus.cc:515] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:52.445887 28379 ts_tablet_manager.cc:1403] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent bootstrapping tablet: real 0.362s	user 0.017s	sys 0.019s
I20260709 13:08:52.435607 28381 consensus_queue.cc:260] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:52.447678 28848 leader_election.cc:290] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:52.448343 28103 raft_consensus.cc:3060] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:52.370440 28851 consensus_queue.cc:1048] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.057s
I20260709 13:08:52.419745 28849 consensus_queue.cc:1048] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:08:52.463894 28381 ts_tablet_manager.cc:1434] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:08:52.465050 28381 tablet_bootstrap.cc:492] T 09d32680280443ecb859c6deb72a5cc3 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
W20260709 13:08:52.486814 28221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:46171, user_credentials={real_user=slave}} blocked reactor thread for 129776us
I20260709 13:08:52.498414 28297 leader_election.cc:304] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:52.510797 28379 raft_consensus.cc:359] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:52.517409 28379 raft_consensus.cc:385] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:52.517797 28379 raft_consensus.cc:740] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Initialized, Role: FOLLOWER
I20260709 13:08:52.518579 28379 consensus_queue.cc:260] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:52.503135 28858 raft_consensus.cc:2804] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:52.523361 28858 raft_consensus.cc:493] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.523708 28858 raft_consensus.cc:3060] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:52.528141 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bd39403164ea08b13d40dbc3c05a8" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
W20260709 13:08:52.549386 28223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:34231, user_credentials={real_user=slave}} blocked reactor thread for 185433us
I20260709 13:08:52.556018 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1568c5c6e6a5495fa8c5550c03721b67" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:52.558059 28180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bd39403164ea08b13d40dbc3c05a8" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:52.547101 28323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1568c5c6e6a5495fa8c5550c03721b67" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:52.515594 28325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17113c03409f4c19ae665da8835dc3b2" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:52.570295 28379 ts_tablet_manager.cc:1434] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d: Time spent starting tablet: real 0.124s	user 0.010s	sys 0.000s
I20260709 13:08:52.586143 28376 tablet_bootstrap.cc:492] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:52.540689 28849 consensus_queue.cc:1048] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
W20260709 13:08:52.608196 28221 leader_election.cc:343] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:52.609422 28221 leader_election.cc:343] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:52.613425 28858 raft_consensus.cc:515] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:52.615203 28323 raft_consensus.cc:2393] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd66bd010fa04c4c8d0a668a77bd4c6d in current term 1: Already voted for candidate 60d640828dc841619730621ec09d4c64 in this term.
I20260709 13:08:52.616880 28863 consensus_queue.cc:1048] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:52.619381 28376 ts_tablet_manager.cc:1403] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.303s	user 0.016s	sys 0.002s
I20260709 13:08:52.619465 28381 tablet_bootstrap.cc:654] T 09d32680280443ecb859c6deb72a5cc3 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:52.620788 28147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.68:46171, user_credentials={real_user=slave}} blocked reactor thread for 54774.8us
W20260709 13:08:52.622756 28852 log.cc:927] Time spent T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368: Append to log took a long time: real 0.251s	user 0.000s	sys 0.004s
I20260709 13:08:52.652681 28385 consensus_queue.cc:1048] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:52.685233 28255 raft_consensus.cc:2468] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 1.
I20260709 13:08:52.687865 28255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c507c906b4393aac2708e46f9bade" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:52.688728 28376 raft_consensus.cc:359] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:52.689846 28376 raft_consensus.cc:385] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:52.690172 28376 raft_consensus.cc:740] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:52.691095 28376 consensus_queue.cc:260] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:52.691919 28149 leader_election.cc:304] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:52.693771 28376 ts_tablet_manager.cc:1434] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.000s
I20260709 13:08:52.695129 28376 tablet_bootstrap.cc:492] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:52.709769 28376 tablet_bootstrap.cc:654] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:52.714402 28223 leader_election.cc:343] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:52.731027 28147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:34859, user_credentials={real_user=slave}} blocked reactor thread for 102908us
I20260709 13:08:52.753782 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1568c5c6e6a5495fa8c5550c03721b67" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:52.754429 28257 raft_consensus.cc:3060] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:52.733486 28223 leader_election.cc:304] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:52.762356 28772 raft_consensus.cc:2749] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:52.771584 28855 raft_consensus.cc:493] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.776477 28855 raft_consensus.cc:515] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:52.789076 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17113c03409f4c19ae665da8835dc3b2" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:52.798527 28257 raft_consensus.cc:2468] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:52.804095 28297 leader_election.cc:304] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:52.773537 28858 leader_election.cc:290] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:52.815119 28074 leader_election.cc:304] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:52.816444 28074 leader_election.cc:304] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:52.820227 28707 raft_consensus.cc:2749] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:52.828363 28376 tablet_bootstrap.cc:492] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:52.829028 28376 ts_tablet_manager.cc:1403] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.134s	user 0.027s	sys 0.019s
W20260709 13:08:52.833755 28054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:52.809115 28768 raft_consensus.cc:2749] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:52.821376 28223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:34231, user_credentials={real_user=slave}} blocked reactor thread for 107024us
I20260709 13:08:52.815994 28848 raft_consensus.cc:2804] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:52.835647 28858 raft_consensus.cc:2804] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:52.889355 28376 raft_consensus.cc:359] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:52.890550 28376 raft_consensus.cc:385] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:52.890969 28376 raft_consensus.cc:740] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:52.875669 28848 raft_consensus.cc:697] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:08:52.884987 28858 raft_consensus.cc:697] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:52.912901 28376 consensus_queue.cc:260] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
W20260709 13:08:52.924181 28297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:34231, user_credentials={real_user=slave}} blocked reactor thread for 53434.6us
I20260709 13:08:52.939050 28376 ts_tablet_manager.cc:1434] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.110s	user 0.011s	sys 0.000s
I20260709 13:08:52.931284 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
W20260709 13:08:52.946362 28872 log.cc:927] Time spent T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:08:52.946569 28873 raft_consensus.cc:493] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.947152 28873 raft_consensus.cc:515] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
W20260709 13:08:52.946448 28874 log.cc:927] Time spent T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:08:52.949345 28873 leader_election.cc:290] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:52.960127 28381 tablet_bootstrap.cc:492] T 09d32680280443ecb859c6deb72a5cc3 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:52.960638 28381 ts_tablet_manager.cc:1403] T 09d32680280443ecb859c6deb72a5cc3 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.496s	user 0.032s	sys 0.016s
I20260709 13:08:52.955618 28848 consensus_queue.cc:237] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:52.958526 28858 consensus_queue.cc:237] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:52.984432 28855 leader_election.cc:290] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:53.009183 28381 raft_consensus.cc:359] T 09d32680280443ecb859c6deb72a5cc3 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:53.010707 28381 raft_consensus.cc:385] T 09d32680280443ecb859c6deb72a5cc3 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.011376 28381 raft_consensus.cc:740] T 09d32680280443ecb859c6deb72a5cc3 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.012557 28381 consensus_queue.cc:260] T 09d32680280443ecb859c6deb72a5cc3 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
W20260709 13:08:53.058290 28149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:41757, user_credentials={real_user=slave}} blocked reactor thread for 163666us
I20260709 13:08:53.068440 28381 ts_tablet_manager.cc:1434] T 09d32680280443ecb859c6deb72a5cc3 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.001s
I20260709 13:08:53.071938 28376 tablet_bootstrap.cc:492] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
W20260709 13:08:53.074741 28223 leader_election.cc:343] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.088580 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1568c5c6e6a5495fa8c5550c03721b67" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:53.103052 28882 consensus_queue.cc:1048] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:53.112145 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea6103de0047339ed0e7e5d460ee53" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:53.116240 28381 tablet_bootstrap.cc:492] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:53.130802 28376 tablet_bootstrap.cc:654] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.144845 28250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea6103de0047339ed0e7e5d460ee53" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:53.146888 28221 leader_election.cc:304] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1
W20260709 13:08:53.168608 28295 leader_election.cc:343] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.156406 28250 raft_consensus.cc:2393] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8938bce1e7864c1ab26755f60f708368 in current term 1: Already voted for candidate 7d2bb5df3b55462682d0f2fce57709f1 in this term.
I20260709 13:08:53.150038 28858 raft_consensus.cc:493] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.172060 28002 catalog_manager.cc:5697] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.173292 28858 raft_consensus.cc:515] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:53.175637 28858 leader_election.cc:290] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:53.186564 28149 leader_election.cc:304] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:53.188211 28851 raft_consensus.cc:3060] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.159219 28707 raft_consensus.cc:493] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.188875 28707 raft_consensus.cc:515] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:53.183966 28768 raft_consensus.cc:2749] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:53.216427 28707 leader_election.cc:290] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:53.249855 28673 raft_consensus.cc:493] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.273921 28673 raft_consensus.cc:515] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:53.276672 28673 leader_election.cc:290] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:53.248173 28323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fd7e0c5ab432ba3165dca1ee9f151" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:53.252435 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:53.268270 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:53.258085 28176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fd7e0c5ab432ba3165dca1ee9f151" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:53.301169 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5af1d945a248cabc1f6f5dbddc6098" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:53.291596 28327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5af1d945a248cabc1f6f5dbddc6098" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:53.303406 28327 raft_consensus.cc:2468] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 0.
I20260709 13:08:53.284523 28323 raft_consensus.cc:2468] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 0.
I20260709 13:08:53.306573 28376 tablet_bootstrap.cc:492] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:53.309469 28376 ts_tablet_manager.cc:1403] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.246s	user 0.016s	sys 0.000s
I20260709 13:08:53.310457 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:53.311173 28252 raft_consensus.cc:2468] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 0.
W20260709 13:08:53.313498 28074 leader_election.cc:343] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:53.323668 28074 leader_election.cc:343] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.324424 28072 leader_election.cc:304] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:53.329628 28072 leader_election.cc:304] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:53.332868 28707 raft_consensus.cc:2804] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.333346 28707 raft_consensus.cc:493] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.333667 28707 raft_consensus.cc:3060] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.337929 28381 tablet_bootstrap.cc:654] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.345785 28376 raft_consensus.cc:359] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:53.346534 28376 raft_consensus.cc:385] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.348670 28851 raft_consensus.cc:2749] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:53.346794 28376 raft_consensus.cc:740] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.351794 28376 consensus_queue.cc:260] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:53.353350 28376 ts_tablet_manager.cc:1434] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.000s
I20260709 13:08:53.354485 28376 tablet_bootstrap.cc:492] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:53.296855 28326 raft_consensus.cc:2468] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 0.
I20260709 13:08:53.331887 28673 raft_consensus.cc:2804] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.366472 28181 raft_consensus.cc:3060] T 09d32680280443ecb859c6deb72a5cc3 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.372480 28376 tablet_bootstrap.cc:654] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.386634 28860 raft_consensus.cc:493] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.396770 28860 raft_consensus.cc:515] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:53.399758 28860 leader_election.cc:290] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:53.365654 28673 raft_consensus.cc:493] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.390391 28297 leader_election.cc:304] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:53.412683 28385 raft_consensus.cc:2804] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.413141 28385 raft_consensus.cc:493] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.413447 28385 raft_consensus.cc:3060] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:53.414865 28297 leader_election.cc:343] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.411620 28673 raft_consensus.cc:3060] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.436246 28385 raft_consensus.cc:515] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:53.448693 28221 leader_election.cc:304] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:53.453199 28673 raft_consensus.cc:515] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:53.455778 28673 leader_election.cc:290] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:53.459219 28385 leader_election.cc:290] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:53.460919 28860 raft_consensus.cc:2804] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.467723 28860 raft_consensus.cc:493] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.468091 28860 raft_consensus.cc:3060] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.469123 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:53.469859 28105 raft_consensus.cc:2468] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:53.472533 28251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:53.465078 28329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5af1d945a248cabc1f6f5dbddc6098" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:53.473281 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:53.473436 28329 raft_consensus.cc:3060] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.473934 28326 raft_consensus.cc:2468] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:53.475067 28177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
W20260709 13:08:53.483685 28297 leader_election.cc:343] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.486377 28221 leader_election.cc:304] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:53.486737 28861 consensus_queue.cc:1048] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:53.487588 28845 raft_consensus.cc:2804] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:53.487983 28845 raft_consensus.cc:493] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.488336 28845 raft_consensus.cc:3060] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.500511 28329 raft_consensus.cc:2468] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 1.
I20260709 13:08:53.502197 28707 raft_consensus.cc:515] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:53.504473 28707 leader_election.cc:290] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:53.503913 28006 catalog_manager.cc:5697] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 1 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.505339 28176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5af1d945a248cabc1f6f5dbddc6098" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:53.510713 28845 raft_consensus.cc:515] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:53.512110 28176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fd7e0c5ab432ba3165dca1ee9f151" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
W20260709 13:08:53.515022 28074 leader_election.cc:343] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:53.516827 28074 leader_election.cc:343] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.519404 28072 leader_election.cc:304] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:53.520620 28707 raft_consensus.cc:2804] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:53.521178 28707 raft_consensus.cc:697] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:08:53.522837 28329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fd7e0c5ab432ba3165dca1ee9f151" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:53.524212 28673 raft_consensus.cc:493] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.524734 28673 raft_consensus.cc:515] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:53.526837 28673 leader_election.cc:290] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:53.527922 28860 raft_consensus.cc:515] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:53.528900 28250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bd39403164ea08b13d40dbc3c05a8" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:53.529114 28251 raft_consensus.cc:2393] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 60d640828dc841619730621ec09d4c64 in current term 1: Already voted for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in this term.
I20260709 13:08:53.529186 28376 tablet_bootstrap.cc:492] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1: No bootstrap required, opened a new log
I20260709 13:08:53.529677 28250 raft_consensus.cc:2468] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 0.
I20260709 13:08:53.529901 28376 ts_tablet_manager.cc:1403] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.000s
I20260709 13:08:53.531152 28074 leader_election.cc:304] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:53.522073 28707 consensus_queue.cc:237] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:53.532840 28376 raft_consensus.cc:359] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:53.533331 28176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:53.533474 28860 leader_election.cc:290] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:53.533583 28376 raft_consensus.cc:385] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.534018 28376 raft_consensus.cc:740] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
W20260709 13:08:53.534757 28223 leader_election.cc:343] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.535116 28673 raft_consensus.cc:2804] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.535557 28673 raft_consensus.cc:493] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.535948 28673 raft_consensus.cc:3060] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.523532 28329 raft_consensus.cc:3060] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.534972 28376 consensus_queue.cc:260] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:53.540488 28324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:53.541344 28324 raft_consensus.cc:2393] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cd66bd010fa04c4c8d0a668a77bd4c6d in current term 1: Already voted for candidate 60d640828dc841619730621ec09d4c64 in this term.
I20260709 13:08:53.543155 28376 ts_tablet_manager.cc:1434] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
W20260709 13:08:53.543939 28297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.67:41757, user_credentials={real_user=slave}} blocked reactor thread for 53770.3us
W20260709 13:08:53.544395 28295 consensus_peers.cc:597] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.554091 28329 raft_consensus.cc:2468] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 1.
I20260709 13:08:53.555989 28841 consensus_queue.cc:1048] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:53.557443 28381 tablet_bootstrap.cc:492] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:53.557991 28381 ts_tablet_manager.cc:1403] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.442s	user 0.006s	sys 0.024s
I20260709 13:08:53.560899 28381 raft_consensus.cc:359] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:53.562006 28381 raft_consensus.cc:385] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.562286 28381 raft_consensus.cc:740] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.562994 28381 consensus_queue.cc:260] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:53.564205 28072 leader_election.cc:304] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:53.565841 28381 ts_tablet_manager.cc:1434] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:53.566975 28381 tablet_bootstrap.cc:492] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:53.569749 28841 raft_consensus.cc:2804] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:53.570559 28841 raft_consensus.cc:697] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:08:53.571501 28841 consensus_queue.cc:237] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:53.545379 28221 leader_election.cc:304] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:53.585718 28860 raft_consensus.cc:2749] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:53.585613 28324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:53.586364 28324 raft_consensus.cc:3060] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.587848 28176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bd39403164ea08b13d40dbc3c05a8" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:53.593700 28297 leader_election.cc:304] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:53.595083 28882 raft_consensus.cc:2749] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:53.595350 28673 raft_consensus.cc:515] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:53.598768 28673 leader_election.cc:290] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
W20260709 13:08:53.605350 28074 leader_election.cc:343] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.605970 28381 tablet_bootstrap.cc:654] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.606878 28251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bd39403164ea08b13d40dbc3c05a8" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:53.608469 28251 raft_consensus.cc:3060] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.603680 28324 raft_consensus.cc:2468] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 2.
I20260709 13:08:53.612282 28673 consensus_queue.cc:1048] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:08:53.627892 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bd39403164ea08b13d40dbc3c05a8" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:53.633486 28845 leader_election.cc:290] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:53.636113 28221 leader_election.cc:304] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:53.635052 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
W20260709 13:08:53.639544 28074 leader_election.cc:343] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.638161 28845 raft_consensus.cc:2804] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:53.654549 28845 raft_consensus.cc:697] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:53.645908 28105 raft_consensus.cc:3060] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.655495 28845 consensus_queue.cc:237] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:53.677668 28863 raft_consensus.cc:493] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.678273 28863 raft_consensus.cc:515] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:53.680466 28863 leader_election.cc:290] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:53.687462 28004 catalog_manager.cc:5697] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.706548 28002 catalog_manager.cc:5697] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 2, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 2 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.708491 28250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:53.708900 28329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:53.710899 28329 raft_consensus.cc:2393] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8938bce1e7864c1ab26755f60f708368 in current term 1: Already voted for candidate 60d640828dc841619730621ec09d4c64 in this term.
I20260709 13:08:53.709376 28250 raft_consensus.cc:2393] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8938bce1e7864c1ab26755f60f708368 in current term 1: Already voted for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in this term.
I20260709 13:08:53.715592 28105 raft_consensus.cc:2468] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 2.
I20260709 13:08:53.719303 28147 leader_election.cc:304] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:53.720157 28850 raft_consensus.cc:3060] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.729947 28251 raft_consensus.cc:2468] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 1.
I20260709 13:08:53.730909 28381 tablet_bootstrap.cc:492] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:53.731220 28074 leader_election.cc:304] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:53.731482 28381 ts_tablet_manager.cc:1403] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.165s	user 0.016s	sys 0.034s
I20260709 13:08:53.732316 28707 raft_consensus.cc:2804] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:53.732812 28707 raft_consensus.cc:697] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:08:53.745165 28381 raft_consensus.cc:359] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:53.745965 28381 raft_consensus.cc:385] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.746259 28381 raft_consensus.cc:740] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.748736 28002 catalog_manager.cc:5697] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.747005 28381 consensus_queue.cc:260] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:53.733649 28707 consensus_queue.cc:237] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:53.758487 28381 ts_tablet_manager.cc:1434] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:08:53.759575 28381 tablet_bootstrap.cc:492] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:53.765924 28381 tablet_bootstrap.cc:654] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.769025 28850 raft_consensus.cc:2749] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:53.794328 28006 catalog_manager.cc:5697] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.804744 28381 tablet_bootstrap.cc:492] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:53.805840 28381 ts_tablet_manager.cc:1403] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.014s
I20260709 13:08:53.811163 28381 raft_consensus.cc:359] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:53.811751 28381 raft_consensus.cc:385] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.812006 28381 raft_consensus.cc:740] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.812649 28381 consensus_queue.cc:260] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:53.815145 28381 ts_tablet_manager.cc:1434] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:53.819288 28381 tablet_bootstrap.cc:492] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368: Bootstrap starting.
I20260709 13:08:53.824832 28707 raft_consensus.cc:493] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.825503 28707 raft_consensus.cc:515] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:53.827567 28707 leader_election.cc:290] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:53.829442 28329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1568c5c6e6a5495fa8c5550c03721b67" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:53.830560 28251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1568c5c6e6a5495fa8c5550c03721b67" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:53.831399 28381 tablet_bootstrap.cc:654] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.858234 28074 leader_election.cc:304] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:53.860430 28707 raft_consensus.cc:2749] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:53.909778 28381 tablet_bootstrap.cc:492] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368: No bootstrap required, opened a new log
I20260709 13:08:53.910372 28381 ts_tablet_manager.cc:1403] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368: Time spent bootstrapping tablet: real 0.091s	user 0.025s	sys 0.027s
I20260709 13:08:53.913414 28381 raft_consensus.cc:359] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:53.914201 28381 raft_consensus.cc:385] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.914484 28381 raft_consensus.cc:740] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.915362 28381 consensus_queue.cc:260] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:53.918032 28381 ts_tablet_manager.cc:1434] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:08:53.925572 28181 raft_consensus.cc:3060] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:53.937212 28054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:53.939774 28707 consensus_queue.cc:1048] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:53.955144 28841 consensus_queue.cc:1048] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.054891 28102 raft_consensus.cc:3060] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.089215 28329 raft_consensus.cc:1275] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer cd66bd010fa04c4c8d0a668a77bd4c6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:54.091975 28779 consensus_queue.cc:1048] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:54.113516 28102 raft_consensus.cc:1275] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Refusing update from remote peer cd66bd010fa04c4c8d0a668a77bd4c6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:54.117805 28776 consensus_queue.cc:1048] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:54.141737 28175 raft_consensus.cc:3060] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.153096 28842 consensus_queue.cc:1048] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:54.159926 28673 consensus_queue.cc:1048] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.166975 28181 raft_consensus.cc:3060] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.180133 28850 raft_consensus.cc:493] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.180883 28850 raft_consensus.cc:515] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:54.186766 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bd39403164ea08b13d40dbc3c05a8" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1" is_pre_election: true
I20260709 13:08:54.196662 28251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bd39403164ea08b13d40dbc3c05a8" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:54.197623 28251 raft_consensus.cc:2468] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:54.198462 28673 consensus_queue.cc:1048] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:54.199613 28149 leader_election.cc:304] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:54.189563 28850 leader_election.cc:290] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:54.201712 28850 raft_consensus.cc:2804] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:54.202168 28850 raft_consensus.cc:493] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.202612 28850 raft_consensus.cc:3060] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.210798 28850 raft_consensus.cc:515] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:54.212700 28176 raft_consensus.cc:1240] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Rejecting Update request from peer 7d2bb5df3b55462682d0f2fce57709f1 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:08:54.218372 28251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bd39403164ea08b13d40dbc3c05a8" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:08:54.219112 28251 raft_consensus.cc:3060] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.227677 28251 raft_consensus.cc:2468] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 2.
I20260709 13:08:54.228399 28252 raft_consensus.cc:1240] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Rejecting Update request from peer 7d2bb5df3b55462682d0f2fce57709f1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:54.231185 28850 leader_election.cc:290] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:54.232270 28842 consensus_queue.cc:1059] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:54.232684 28149 leader_election.cc:304] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:54.233240 28707 raft_consensus.cc:3055] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.233645 28707 raft_consensus.cc:740] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:08:54.234146 28850 raft_consensus.cc:2804] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.235062 28850 raft_consensus.cc:697] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:54.234534 28707 consensus_queue.cc:260] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:54.236353 28707 raft_consensus.cc:3060] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.236539 28850 consensus_queue.cc:237] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:54.240862 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bd39403164ea08b13d40dbc3c05a8" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
I20260709 13:08:54.253288 28102 raft_consensus.cc:2410] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8938bce1e7864c1ab26755f60f708368 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:08:54.293311 28002 catalog_manager.cc:5697] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 1 to 2, leader changed from 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65) to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.698699 28102 raft_consensus.cc:1275] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Refusing update from remote peer 8938bce1e7864c1ab26755f60f708368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:08:54.699276 28102 pending_rounds.cc:85] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1: Aborting all ops after (but not including) 0
I20260709 13:08:54.699586 28102 pending_rounds.cc:107] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:08:54.700021 28102 raft_consensus.cc:2889] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:54.701815 28873 consensus_queue.cc:1048] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.710613 28251 raft_consensus.cc:1275] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Refusing update from remote peer 8938bce1e7864c1ab26755f60f708368: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:54.713287 28850 consensus_queue.cc:1048] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:54.972510 28054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:55.142412 28776 raft_consensus.cc:493] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.143016 28776 raft_consensus.cc:515] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:55.145061 28776 leader_election.cc:290] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:55.145763 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:55.146004 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:55.146569 28175 raft_consensus.cc:2468] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:55.146678 28326 raft_consensus.cc:2468] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:55.148083 28221 leader_election.cc:304] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:55.149001 28776 raft_consensus.cc:2804] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:55.149384 28776 raft_consensus.cc:493] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.149724 28776 raft_consensus.cc:3060] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.155498 28776 raft_consensus.cc:515] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:55.158300 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:55.158612 28776 leader_election.cc:290] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:55.158967 28175 raft_consensus.cc:3060] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.162158 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c732366d5f34a4b98ac0508c4b7ef10" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:55.162765 28326 raft_consensus.cc:3060] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.168071 28175 raft_consensus.cc:2468] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 2.
I20260709 13:08:55.171988 28223 leader_election.cc:304] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:55.172832 28776 raft_consensus.cc:2804] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:55.173314 28776 raft_consensus.cc:697] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:55.174119 28776 consensus_queue.cc:237] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:08:55.177588 28326 raft_consensus.cc:2468] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 2.
I20260709 13:08:55.195237 28006 catalog_manager.cc:5697] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 0 to 2, leader changed from <none> to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 2 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.556298 28181 raft_consensus.cc:1275] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer cd66bd010fa04c4c8d0a668a77bd4c6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:55.557770 28855 consensus_queue.cc:1048] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:55.573487 28329 raft_consensus.cc:1275] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer cd66bd010fa04c4c8d0a668a77bd4c6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:55.576997 28776 consensus_queue.cc:1048] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:57.093917 21001 tablet_server.cc:179] TabletServer@127.20.130.65:0 shutting down...
W20260709 13:08:57.109365 28295 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:08:57.128321 28295 consensus_peers.cc:597] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.150461 28221 consensus_peers.cc:597] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.160954 28295 consensus_peers.cc:597] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.170636 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:57.172353 21001 tablet_replica.cc:333] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
W20260709 13:08:57.172334 28147 consensus_peers.cc:597] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.173465 21001 raft_consensus.cc:2243] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.173930 21001 raft_consensus.cc:2272] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.175817 21001 tablet_replica.cc:333] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.176430 21001 raft_consensus.cc:2243] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.176841 21001 raft_consensus.cc:2272] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.179003 21001 tablet_replica.cc:333] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.179849 21001 raft_consensus.cc:2243] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:57.180974 21001 raft_consensus.cc:2272] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:57.181810 28295 consensus_peers.cc:597] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.183097 21001 tablet_replica.cc:333] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.183744 21001 raft_consensus.cc:2243] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:57.184469 21001 raft_consensus.cc:2272] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.186324 21001 tablet_replica.cc:333] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.186905 21001 raft_consensus.cc:2243] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.187361 21001 raft_consensus.cc:2272] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.189525 21001 tablet_replica.cc:333] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.190311 21001 raft_consensus.cc:2243] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.190798 21001 raft_consensus.cc:2272] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.193163 21001 tablet_replica.cc:333] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.193830 21001 raft_consensus.cc:2243] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.194267 21001 raft_consensus.cc:2272] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.196130 21001 tablet_replica.cc:333] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.196743 21001 raft_consensus.cc:2243] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.197139 21001 raft_consensus.cc:2272] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.199194 21001 tablet_replica.cc:333] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.199762 21001 raft_consensus.cc:2243] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:57.200690 21001 raft_consensus.cc:2272] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.202847 21001 tablet_replica.cc:333] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.203655 21001 raft_consensus.cc:2243] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:57.204380 21001 raft_consensus.cc:2272] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.208598 21001 tablet_replica.cc:333] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.209708 21001 raft_consensus.cc:2243] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.210224 21001 raft_consensus.cc:2272] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.212632 21001 tablet_replica.cc:333] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.213462 21001 raft_consensus.cc:2243] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.214300 21001 raft_consensus.cc:2272] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.216571 21001 tablet_replica.cc:333] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.217236 21001 raft_consensus.cc:2243] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.217659 21001 raft_consensus.cc:2272] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.219735 21001 tablet_replica.cc:333] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.220613 21001 raft_consensus.cc:2243] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:57.221549 21001 raft_consensus.cc:2272] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.224368 21001 tablet_replica.cc:333] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.225129 21001 raft_consensus.cc:2243] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.225704 21001 raft_consensus.cc:2272] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.228271 21001 tablet_replica.cc:333] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.229024 21001 raft_consensus.cc:2243] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.229532 21001 raft_consensus.cc:2272] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:57.229807 28295 consensus_peers.cc:597] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.232201 21001 tablet_replica.cc:333] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.233173 21001 raft_consensus.cc:2243] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.233734 21001 raft_consensus.cc:2272] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.236629 21001 tablet_replica.cc:333] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.237185 21001 raft_consensus.cc:2243] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.237721 21001 raft_consensus.cc:2272] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.240386 21001 tablet_replica.cc:333] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.241170 21001 raft_consensus.cc:2243] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.241715 21001 raft_consensus.cc:2272] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.244558 21001 tablet_replica.cc:333] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.247397 21001 raft_consensus.cc:2243] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.250635 21001 raft_consensus.cc:2272] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.254472 21001 tablet_replica.cc:333] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.255470 21001 raft_consensus.cc:2243] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:57.257073 21001 raft_consensus.cc:2272] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:57.258095 28295 consensus_peers.cc:597] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.259471 21001 tablet_replica.cc:333] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
W20260709 13:08:57.259997 28147 consensus_peers.cc:597] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.260291 21001 raft_consensus.cc:2243] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.260898 21001 raft_consensus.cc:2272] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.264564 21001 tablet_replica.cc:333] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.265280 21001 raft_consensus.cc:2243] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.265743 21001 raft_consensus.cc:2272] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.268071 21001 tablet_replica.cc:333] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.268855 21001 raft_consensus.cc:2243] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:08:57.269201 28295 consensus_peers.cc:597] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.269814 21001 raft_consensus.cc:2272] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:57.271204 28221 consensus_peers.cc:597] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.273248 21001 tablet_replica.cc:333] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.274106 21001 raft_consensus.cc:2243] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.274744 21001 raft_consensus.cc:2272] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.277346 21001 tablet_replica.cc:333] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.278348 21001 raft_consensus.cc:2243] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.278860 21001 raft_consensus.cc:2272] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.281338 21001 tablet_replica.cc:333] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
W20260709 13:08:57.281622 28147 consensus_peers.cc:597] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.282299 21001 raft_consensus.cc:2243] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:57.283270 21001 raft_consensus.cc:2272] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.285374 21001 tablet_replica.cc:333] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.286140 21001 raft_consensus.cc:2243] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.286640 21001 raft_consensus.cc:2272] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.289645 21001 tablet_replica.cc:333] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.290414 21001 raft_consensus.cc:2243] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.290892 21001 raft_consensus.cc:2272] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.293682 21001 tablet_replica.cc:333] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
W20260709 13:08:57.294308 28295 consensus_peers.cc:597] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.294472 21001 raft_consensus.cc:2243] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:57.295388 21001 raft_consensus.cc:2272] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:57.295420 28221 consensus_peers.cc:597] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.297555 21001 tablet_replica.cc:333] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.298156 21001 raft_consensus.cc:2243] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.298683 21001 raft_consensus.cc:2272] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.300843 21001 tablet_replica.cc:333] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.301599 21001 raft_consensus.cc:2243] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.302184 21001 raft_consensus.cc:2272] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.304960 21001 tablet_replica.cc:333] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.305729 21001 raft_consensus.cc:2243] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.306241 21001 raft_consensus.cc:2272] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.308493 21001 tablet_replica.cc:333] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
W20260709 13:08:57.308302 28147 consensus_peers.cc:597] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.309334 21001 raft_consensus.cc:2243] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.309850 21001 raft_consensus.cc:2272] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.312981 21001 tablet_replica.cc:333] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.313783 21001 raft_consensus.cc:2243] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:08:57.314028 28221 consensus_peers.cc:597] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.314836 21001 raft_consensus.cc:2272] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:57.315686 28295 consensus_peers.cc:597] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.317662 21001 tablet_replica.cc:333] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.318498 21001 raft_consensus.cc:2243] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.319053 21001 raft_consensus.cc:2272] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.321906 21001 tablet_replica.cc:333] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.322705 21001 raft_consensus.cc:2243] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:57.323333 28147 consensus_peers.cc:597] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.323246 21001 raft_consensus.cc:2272] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.326241 21001 tablet_replica.cc:333] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.327111 21001 raft_consensus.cc:2243] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.327647 21001 raft_consensus.cc:2272] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.330533 21001 tablet_replica.cc:333] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.331296 21001 raft_consensus.cc:2243] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.331888 21001 raft_consensus.cc:2272] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.334782 21001 tablet_replica.cc:333] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.335564 21001 raft_consensus.cc:2243] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.336077 21001 raft_consensus.cc:2272] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:57.336762 28147 consensus_peers.cc:597] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.339277 21001 tablet_replica.cc:333] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.340129 21001 raft_consensus.cc:2243] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.340664 21001 raft_consensus.cc:2272] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.343472 21001 tablet_replica.cc:333] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.344213 21001 raft_consensus.cc:2243] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:57.344760 28147 consensus_peers.cc:597] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.344782 21001 raft_consensus.cc:2272] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.347815 21001 tablet_replica.cc:333] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.348596 21001 raft_consensus.cc:2243] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.349040 21001 raft_consensus.cc:2272] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.351508 21001 tablet_replica.cc:333] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.352072 21001 raft_consensus.cc:2243] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:57.352802 21001 raft_consensus.cc:2272] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.355424 21001 tablet_replica.cc:333] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1: stopping tablet replica
I20260709 13:08:57.356068 21001 raft_consensus.cc:2243] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.356494 21001 raft_consensus.cc:2272] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:57.365974 28295 consensus_peers.cc:597] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.433385 21001 tablet_server.cc:196] TabletServer@127.20.130.65:0 shutdown complete.
W20260709 13:08:57.439744 28295 consensus_peers.cc:597] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.441447 28147 consensus_peers.cc:597] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.447177 28147 consensus_peers.cc:597] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.461493 28147 consensus_peers.cc:597] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.479606 28295 consensus_peers.cc:597] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.549114 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:57.559859 28147 consensus_peers.cc:597] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.560030 28295 consensus_peers.cc:597] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.562963 28955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:57.574589 28221 consensus_peers.cc:597] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.575150 28221 consensus_peers.cc:597] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.579759 28956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:57.595507 28959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:57.597551 21001 server_base.cc:1061] running on GCE node
I20260709 13:08:57.603514 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:57.603829 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:57.604081 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602537604054 us; error 0 us; skew 500 ppm
I20260709 13:08:57.604815 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:08:57.610226 28221 consensus_peers.cc:597] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.613466 21001 webserver.cc:533] Webserver started at http://127.20.130.65:45241/ using document root <none> and password file <none>
I20260709 13:08:57.615336 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:57.615578 21001 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:08:57.625011 28221 consensus_peers.cc:597] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.628624 28147 consensus_peers.cc:597] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.638298 21001 fs_manager.cc:714] Time spent opening directory manager: real 0.021s	user 0.009s	sys 0.012s
W20260709 13:08:57.640097 28295 consensus_peers.cc:597] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.652161 28295 consensus_peers.cc:597] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.656260 28963 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:57.657338 21001 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.000s	sys 0.007s
I20260709 13:08:57.657778 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-0-root
uuid: "7d2bb5df3b55462682d0f2fce57709f1"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-csvd"
I20260709 13:08:57.658388 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602291548094-21001-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:57.689522 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:57.691416 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:57.693945 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:57.710244 28970 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:08:58.111923 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:08:58.112273 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.406s	user 0.008s	sys 0.005s
I20260709 13:08:58.112613 21001 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:08:58.123328 28970 tablet_bootstrap.cc:492] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:58.166695 28970 tablet_bootstrap.cc:492] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:58.167702 28970 tablet_bootstrap.cc:492] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:08:58.168335 28970 ts_tablet_manager.cc:1403] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.004s
I20260709 13:08:58.170795 28970 raft_consensus.cc:359] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:58.175067 28970 raft_consensus.cc:740] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.193348 28970 consensus_queue.cc:260] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:58.230069 28970 ts_tablet_manager.cc:1434] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.015s
I20260709 13:08:58.230899 28970 tablet_bootstrap.cc:492] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:58.255427 28970 tablet_bootstrap.cc:492] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:58.256515 28970 tablet_bootstrap.cc:492] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:08:58.257160 28970 ts_tablet_manager.cc:1403] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.015s
I20260709 13:08:58.259904 28970 raft_consensus.cc:359] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.260715 28970 raft_consensus.cc:740] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.261659 28970 consensus_queue.cc:260] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.263878 28970 ts_tablet_manager.cc:1434] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:58.264676 28970 tablet_bootstrap.cc:492] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:58.270606 28971 raft_consensus.cc:493] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.271212 28971 raft_consensus.cc:515] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.273166 28971 leader_election.cc:290] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:58.284071 28329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c8f62c26f74f9e82cb8f53544e0b2c" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
W20260709 13:08:58.294153 28147 leader_election.cc:336] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.296059 28147 leader_election.cc:304] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:58.296878 28937 raft_consensus.cc:2749] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.318981 28970 tablet_bootstrap.cc:492] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:58.320075 28970 tablet_bootstrap.cc:492] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:08:58.320995 28970 ts_tablet_manager.cc:1403] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.057s	user 0.026s	sys 0.028s
I20260709 13:08:58.324129 28970 raft_consensus.cc:359] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:58.324885 28970 raft_consensus.cc:740] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.325615 28970 consensus_queue.cc:260] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:58.327858 28970 ts_tablet_manager.cc:1434] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:58.328676 28970 tablet_bootstrap.cc:492] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:58.350562 28970 tablet_bootstrap.cc:492] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:58.351370 28970 tablet_bootstrap.cc:492] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:08:58.351894 28970 ts_tablet_manager.cc:1403] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.007s
I20260709 13:08:58.353751 28970 raft_consensus.cc:359] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.354285 28970 raft_consensus.cc:740] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.354861 28970 consensus_queue.cc:260] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.356395 28970 ts_tablet_manager.cc:1434] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:08:58.357239 28970 tablet_bootstrap.cc:492] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:58.378122 28970 tablet_bootstrap.cc:492] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:58.379199 28970 tablet_bootstrap.cc:492] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:08:58.379967 28970 ts_tablet_manager.cc:1403] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.011s
I20260709 13:08:58.382611 28970 raft_consensus.cc:359] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.383450 28970 raft_consensus.cc:740] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.384388 28970 consensus_queue.cc:260] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.386433 28970 ts_tablet_manager.cc:1434] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:58.386842 28953 raft_consensus.cc:493] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.387737 28953 raft_consensus.cc:515] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.388947 28970 tablet_bootstrap.cc:492] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:58.390152 28953 leader_election.cc:290] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:58.390637 28953 raft_consensus.cc:493] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.416589 28953 raft_consensus.cc:515] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.418282 28953 leader_election.cc:290] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:58.419334 28176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8778ebb28d774473bbe1042cbb1c6721" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
W20260709 13:08:58.429454 28295 leader_election.cc:336] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
W20260709 13:08:58.435863 28295 leader_election.cc:336] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.436400 28295 leader_election.cc:304] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:58.437551 28953 raft_consensus.cc:2749] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.411031 28970 tablet_bootstrap.cc:492] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=1 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:58.392275 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7084d0da22fc408c861229f3e9cbdb94" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:58.441406 28297 leader_election.cc:304] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:58.442531 28953 raft_consensus.cc:2749] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.452672 28970 tablet_bootstrap.cc:492] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:08:58.454428 28970 ts_tablet_manager.cc:1403] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.012s
I20260709 13:08:58.458130 28970 raft_consensus.cc:359] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.459035 28970 raft_consensus.cc:740] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.460143 28970 consensus_queue.cc:260] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.464017 28970 ts_tablet_manager.cc:1434] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:58.464797 28970 tablet_bootstrap.cc:492] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:58.479205 28953 raft_consensus.cc:493] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.480154 28953 raft_consensus.cc:515] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.483883 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5af1d945a248cabc1f6f5dbddc6098" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:58.492599 28932 raft_consensus.cc:493] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.493172 28932 raft_consensus.cc:515] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:58.493863 28971 raft_consensus.cc:493] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.494167 21001 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:08:58.494578 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.382s	user 0.276s	sys 0.003s
I20260709 13:08:58.494419 28971 raft_consensus.cc:515] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.495283 28932 leader_election.cc:290] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:58.496404 28971 leader_election.cc:290] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:58.503510 28250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c507c906b4393aac2708e46f9bade" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:58.498445 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec0b05c6a554a24a2576d6308dd6861" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:58.512751 28952 raft_consensus.cc:493] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.513306 28952 raft_consensus.cc:515] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.533361 28952 leader_election.cc:290] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:58.535449 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2012efcebb4e8d9dc7839fdb5927fb" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:58.524923 28937 raft_consensus.cc:493] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.556898 28937 raft_consensus.cc:515] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
W20260709 13:08:58.542376 28147 leader_election.cc:336] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.560156 28147 leader_election.cc:304] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:58.568078 28971 raft_consensus.cc:493] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.572644 28971 raft_consensus.cc:515] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.573232 28991 raft_consensus.cc:2749] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.568768 28952 raft_consensus.cc:493] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.575449 28952 raft_consensus.cc:515] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.580305 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea6103de0047339ed0e7e5d460ee53" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:58.584789 28971 leader_election.cc:290] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:58.551072 28953 leader_election.cc:290] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:58.570960 28937 leader_election.cc:290] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:58.589243 28952 leader_election.cc:290] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
W20260709 13:08:58.592515 28295 leader_election.cc:336] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.594214 28295 leader_election.cc:304] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
W20260709 13:08:58.593513 28147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:34859, user_credentials={real_user=slave}} blocked reactor thread for 51169.2us
I20260709 13:08:58.600024 28329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5af1d945a248cabc1f6f5dbddc6098" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:58.600831 28329 raft_consensus.cc:2468] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:58.604418 28974 raft_consensus.cc:493] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.605118 28329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fd7e0c5ab432ba3165dca1ee9f151" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:58.605293 28974 raft_consensus.cc:515] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.606613 28945 raft_consensus.cc:493] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.607113 28952 raft_consensus.cc:493] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.607511 28945 raft_consensus.cc:515] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.607585 28952 raft_consensus.cc:515] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.609623 28945 leader_election.cc:290] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:58.611714 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2012efcebb4e8d9dc7839fdb5927fb" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:58.612315 28181 raft_consensus.cc:2468] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:58.613201 28176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea6103de0047339ed0e7e5d460ee53" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:58.613500 28223 leader_election.cc:304] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:58.613850 28176 raft_consensus.cc:2468] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
W20260709 13:08:58.615253 28221 leader_election.cc:336] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
W20260709 13:08:58.615821 28221 leader_election.cc:336] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.615283 28973 raft_consensus.cc:2804] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:58.617034 28973 raft_consensus.cc:493] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.617266 28223 leader_election.cc:304] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:58.617620 28973 raft_consensus.cc:3060] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.618368 28945 raft_consensus.cc:2804] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:58.620117 28945 raft_consensus.cc:493] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.620584 28945 raft_consensus.cc:3060] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.628798 28937 raft_consensus.cc:493] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.630487 28937 raft_consensus.cc:515] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.618587 28974 leader_election.cc:290] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:58.635324 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819e4cfb61d7498f997e955c8d2cc490" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:58.649430 28953 raft_consensus.cc:493] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.650229 28953 raft_consensus.cc:515] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.649260 28945 raft_consensus.cc:515] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.657872 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea6103de0047339ed0e7e5d460ee53" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:58.658663 28175 raft_consensus.cc:3060] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.658792 28945 leader_election.cc:290] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:58.665410 28945 raft_consensus.cc:493] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.670413 28945 raft_consensus.cc:515] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.675287 28999 raft_consensus.cc:493] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.675935 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fcb865684d406f879509172e8279ff" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:58.676098 28999 raft_consensus.cc:515] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:58.676652 28181 raft_consensus.cc:2468] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:58.677953 28223 leader_election.cc:304] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:58.679718 28945 leader_election.cc:290] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:58.680154 28974 raft_consensus.cc:2804] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:58.680753 28974 raft_consensus.cc:493] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.681280 28974 raft_consensus.cc:3060] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.692250 28974 raft_consensus.cc:515] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.693830 29001 raft_consensus.cc:493] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.695087 28932 raft_consensus.cc:2749] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.705348 28952 leader_election.cc:290] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:58.705770 29001 raft_consensus.cc:515] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.708132 29001 leader_election.cc:290] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:58.696161 28937 leader_election.cc:290] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:58.698212 28973 raft_consensus.cc:515] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.710280 28176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c507c906b4393aac2708e46f9bade" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:58.710985 28176 raft_consensus.cc:2468] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:58.711786 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c8f62c26f74f9e82cb8f53544e0b2c" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:58.712096 28223 leader_election.cc:304] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:58.712635 28181 raft_consensus.cc:2468] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:58.713549 28945 raft_consensus.cc:2804] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:58.713974 28945 raft_consensus.cc:493] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.714311 28945 raft_consensus.cc:3060] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.699574 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fcb865684d406f879509172e8279ff" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:58.717852 28252 raft_consensus.cc:2393] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8938bce1e7864c1ab26755f60f708368 in current term 2: Already voted for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in this term.
I20260709 13:08:58.709618 28974 leader_election.cc:290] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:58.719277 28176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fcb865684d406f879509172e8279ff" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:58.719971 28176 raft_consensus.cc:3060] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.720949 28953 leader_election.cc:290] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:58.721604 28937 raft_consensus.cc:493] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.723006 28329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec0b05c6a554a24a2576d6308dd6861" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:58.722183 28937 raft_consensus.cc:515] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.723836 28329 raft_consensus.cc:2468] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:58.726189 28177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2012efcebb4e8d9dc7839fdb5927fb" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:58.726781 28177 raft_consensus.cc:3060] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:58.730728 28221 leader_election.cc:336] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.732896 28176 raft_consensus.cc:2468] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 2.
I20260709 13:08:58.734086 28223 leader_election.cc:304] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
W20260709 13:08:58.695284 28295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:34859, user_credentials={real_user=slave}} blocked reactor thread for 102802us
W20260709 13:08:58.734755 28295 leader_election.cc:336] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.735181 28295 leader_election.cc:304] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d
W20260709 13:08:58.735211 28147 leader_election.cc:336] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.735908 28147 leader_election.cc:304] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:58.736719 28177 raft_consensus.cc:2468] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 2.
I20260709 13:08:58.737196 28175 raft_consensus.cc:2468] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 2.
I20260709 13:08:58.738936 28223 leader_election.cc:304] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:58.739521 28932 raft_consensus.cc:2749] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.739905 28223 leader_election.cc:304] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:58.740233 29001 raft_consensus.cc:2804] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:58.741792 29007 raft_consensus.cc:2804] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:58.745216 29008 raft_consensus.cc:2804] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:58.746125 28973 leader_election.cc:290] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:58.680946 28999 leader_election.cc:290] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:58.747252 28974 raft_consensus.cc:493] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.748970 28974 raft_consensus.cc:515] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.748183 29007 raft_consensus.cc:697] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:58.749215 28971 raft_consensus.cc:2749] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.751116 29007 consensus_queue.cc:237] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.747962 28937 leader_election.cc:290] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:58.752646 28177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819e4cfb61d7498f997e955c8d2cc490" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:58.753361 28177 raft_consensus.cc:2468] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 1.
I20260709 13:08:58.746398 29001 raft_consensus.cc:697] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:58.755141 29001 consensus_queue.cc:237] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.755987 28974 leader_election.cc:290] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:58.760015 28223 leader_election.cc:304] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:58.767645 28999 raft_consensus.cc:2804] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:58.768033 28999 raft_consensus.cc:493] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.768613 28999 raft_consensus.cc:3060] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.768181 28945 raft_consensus.cc:515] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.758344 28221 leader_election.cc:304] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:58.774361 28177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c507c906b4393aac2708e46f9bade" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:58.774987 28177 raft_consensus.cc:3060] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.775388 28974 raft_consensus.cc:2804] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:58.775862 28974 raft_consensus.cc:493] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.776299 28974 raft_consensus.cc:3060] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.777511 28999 raft_consensus.cc:515] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.780484 28946 raft_consensus.cc:493] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.782410 28946 raft_consensus.cc:515] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
W20260709 13:08:58.780252 28221 leader_election.cc:336] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.786540 28971 raft_consensus.cc:493] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.791487 28971 raft_consensus.cc:515] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.793898 28971 leader_election.cc:290] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:58.790637 28946 leader_election.cc:290] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:58.804191 28999 leader_election.cc:290] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:58.774942 29008 raft_consensus.cc:697] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:58.814392 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819e4cfb61d7498f997e955c8d2cc490" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:58.815182 28175 raft_consensus.cc:3060] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.814708 29008 consensus_queue.cc:237] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.811206 28970 tablet_bootstrap.cc:492] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:58.784749 28945 leader_election.cc:290] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
W20260709 13:08:58.786181 28221 leader_election.cc:336] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
W20260709 13:08:58.826050 28297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:34231, user_credentials={real_user=slave}} blocked reactor thread for 46480.5us
W20260709 13:08:58.819619 28295 leader_election.cc:336] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.802366 28177 raft_consensus.cc:2468] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 2.
I20260709 13:08:58.827674 28970 tablet_bootstrap.cc:492] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:08:58.829468 28297 leader_election.cc:304] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:58.828361 28147 leader_election.cc:304] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:08:58.832734 28970 ts_tablet_manager.cc:1403] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.368s	user 0.068s	sys 0.067s
W20260709 13:08:58.839722 28147 leader_election.cc:336] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
W20260709 13:08:58.841216 28147 leader_election.cc:336] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.841379 28223 leader_election.cc:304] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:08:58.841707 28147 leader_election.cc:304] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:58.848021 29010 raft_consensus.cc:2804] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:58.848148 28953 raft_consensus.cc:2804] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:58.848616 28953 raft_consensus.cc:493] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.848981 28953 raft_consensus.cc:3060] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.849880 29010 raft_consensus.cc:697] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:58.850834 29010 consensus_queue.cc:237] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.864027 29016 raft_consensus.cc:2804] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:58.864477 29016 raft_consensus.cc:493] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:58.864813 29016 raft_consensus.cc:3060] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.865164 28970 raft_consensus.cc:359] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:58.865882 28970 raft_consensus.cc:740] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.866678 28970 consensus_queue.cc:260] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
W20260709 13:08:58.868213 28221 leader_election.cc:336] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
W20260709 13:08:58.869205 28221 leader_election.cc:336] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.869561 28970 ts_tablet_manager.cc:1434] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.003s
I20260709 13:08:58.870759 28970 tablet_bootstrap.cc:492] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
W20260709 13:08:58.871737 28221 leader_election.cc:336] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
W20260709 13:08:58.873389 28221 leader_election.cc:336] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.871479 28971 raft_consensus.cc:2749] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.855113 28974 raft_consensus.cc:515] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:58.875586 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7084d0da22fc408c861229f3e9cbdb94" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:58.889874 28326 raft_consensus.cc:2468] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
W20260709 13:08:58.917027 28147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:34859, user_credentials={real_user=slave}} blocked reactor thread for 75833.5us
W20260709 13:08:58.917886 28147 leader_election.cc:336] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.918407 28147 leader_election.cc:304] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:58.927179 28971 raft_consensus.cc:2749] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.932060 28974 leader_election.cc:290] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
W20260709 13:08:58.940687 28221 leader_election.cc:336] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
W20260709 13:08:58.941532 28221 leader_election.cc:336] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
W20260709 13:08:58.942723 28295 leader_election.cc:336] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.953995 28953 raft_consensus.cc:515] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.970762 28953 leader_election.cc:290] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:58.957713 28175 raft_consensus.cc:2468] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 2.
I20260709 13:08:58.965806 29016 raft_consensus.cc:515] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:58.966696 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec0b05c6a554a24a2576d6308dd6861" candidate_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:58.972198 28326 raft_consensus.cc:3060] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.973312 29016 leader_election.cc:290] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
W20260709 13:08:58.973536 28221 leader_election.cc:336] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.982165 28970 tablet_bootstrap.cc:492] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:58.983502 28970 tablet_bootstrap.cc:492] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:08:58.984360 28970 ts_tablet_manager.cc:1403] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.114s	user 0.010s	sys 0.021s
W20260709 13:08:58.984973 28295 leader_election.cc:336] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:58.986372 28326 raft_consensus.cc:2468] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd66bd010fa04c4c8d0a668a77bd4c6d in term 2.
I20260709 13:08:58.987125 28970 raft_consensus.cc:359] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:58.987771 28970 raft_consensus.cc:740] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.988507 28970 consensus_queue.cc:260] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:58.990193 28970 ts_tablet_manager.cc:1434] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:08:59.033305 28970 tablet_bootstrap.cc:492] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:59.028338 28223 leader_election.cc:304] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
W20260709 13:08:59.072510 28223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:34231, user_credentials={real_user=slave}} blocked reactor thread for 44932.5us
I20260709 13:08:59.075356 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8778ebb28d774473bbe1042cbb1c6721" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:59.077178 28326 raft_consensus.cc:2468] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 1.
I20260709 13:08:59.078029 28974 raft_consensus.cc:2804] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:59.078908 28974 raft_consensus.cc:697] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:59.082183 28221 leader_election.cc:304] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:59.083844 29008 raft_consensus.cc:2804] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:59.084628 29008 raft_consensus.cc:697] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Becoming Leader. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:08:59.086530 29008 consensus_queue.cc:237] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:59.093726 28974 consensus_queue.cc:237] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:59.091599 28006 catalog_manager.cc:5697] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 1 to 2, leader changed from 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65) to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 2 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.097868 28006 catalog_manager.cc:5697] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 1 to 2, leader changed from 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65) to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 2 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.100961 28006 catalog_manager.cc:5697] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 1 to 2, leader changed from 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65) to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 2 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:59.129637 28147 leader_election.cc:336] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:59.130365 28147 leader_election.cc:304] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:59.131070 28324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5af1d945a248cabc1f6f5dbddc6098" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:59.134222 28324 raft_consensus.cc:3060] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.134351 29018 raft_consensus.cc:2749] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:59.142328 28147 leader_election.cc:336] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:59.143131 28147 leader_election.cc:304] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:59.157068 28952 raft_consensus.cc:2749] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:59.158691 28147 leader_election.cc:336] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:59.202860 28324 raft_consensus.cc:2468] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 2.
W20260709 13:08:59.215891 28221 consensus_peers.cc:597] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.229347 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fd7e0c5ab432ba3165dca1ee9f151" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:59.230340 28175 raft_consensus.cc:2468] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 1.
I20260709 13:08:59.234118 28970 tablet_bootstrap.cc:492] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:59.235364 28970 tablet_bootstrap.cc:492] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:08:59.236233 28970 ts_tablet_manager.cc:1403] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.204s	user 0.019s	sys 0.014s
I20260709 13:08:59.244235 28970 raft_consensus.cc:359] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:59.245529 28176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c8f62c26f74f9e82cb8f53544e0b2c" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:59.262630 28970 raft_consensus.cc:740] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.262296 28176 raft_consensus.cc:3060] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.274544 28147 leader_election.cc:304] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:59.276250 28147 leader_election.cc:304] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:08:59.276564 29018 raft_consensus.cc:2804] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:59.277017 29018 raft_consensus.cc:493] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:59.277184 28952 raft_consensus.cc:2804] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:59.277479 29018 raft_consensus.cc:3060] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.277616 28952 raft_consensus.cc:493] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:59.278054 28952 raft_consensus.cc:3060] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.288007 28176 raft_consensus.cc:2468] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 2.
I20260709 13:08:59.295781 28970 consensus_queue.cc:260] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:59.287998 28952 raft_consensus.cc:515] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:59.319682 28175 raft_consensus.cc:1275] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer cd66bd010fa04c4c8d0a668a77bd4c6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:59.312624 28147 leader_election.cc:304] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:08:59.321153 29016 raft_consensus.cc:2804] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:59.321894 29016 raft_consensus.cc:697] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:59.323335 29016 consensus_queue.cc:237] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:59.323450 28974 consensus_queue.cc:1048] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:08:59.329438 28221 consensus_peers.cc:597] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:59.331365 28221 consensus_peers.cc:597] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.341595 28297 leader_election.cc:304] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:59.343106 28176 raft_consensus.cc:1275] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer cd66bd010fa04c4c8d0a668a77bd4c6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:59.344121 28952 leader_election.cc:290] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:59.344292 28976 raft_consensus.cc:493] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.350152 28976 raft_consensus.cc:515] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:08:59.351897 28953 raft_consensus.cc:2804] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:59.352387 28953 raft_consensus.cc:493] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:08:59.352797 28953 raft_consensus.cc:3060] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.348381 28970 ts_tablet_manager.cc:1434] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.002s
W20260709 13:08:59.359462 28147 leader_election.cc:336] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:59.346573 29008 consensus_queue.cc:1048] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:08:59.363531 28970 tablet_bootstrap.cc:492] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:59.369784 29018 raft_consensus.cc:515] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:59.392580 28297 leader_election.cc:304] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:59.394049 29022 raft_consensus.cc:2804] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:59.394145 28976 leader_election.cc:290] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:59.394711 29022 raft_consensus.cc:697] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 2 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
W20260709 13:08:59.409050 28147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:34859, user_credentials={real_user=slave}} blocked reactor thread for 49622.5us
I20260709 13:08:59.409646 28181 raft_consensus.cc:1275] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer cd66bd010fa04c4c8d0a668a77bd4c6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:59.409216 29018 leader_election.cc:290] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:08:59.411585 29008 consensus_queue.cc:1048] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:59.413312 28147 leader_election.cc:336] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:59.418306 28181 raft_consensus.cc:1275] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer cd66bd010fa04c4c8d0a668a77bd4c6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:59.395974 29022 consensus_queue.cc:237] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:59.444185 28324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8778ebb28d774473bbe1042cbb1c6721" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:59.444923 28324 raft_consensus.cc:3060] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.444273 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7084d0da22fc408c861229f3e9cbdb94" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:08:59.427891 29008 consensus_queue.cc:1048] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 13:08:59.468652 28147 leader_election.cc:336] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
W20260709 13:08:59.469180 28147 leader_election.cc:336] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:59.458119 28326 raft_consensus.cc:3060] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.485616 28324 raft_consensus.cc:2468] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 2.
I20260709 13:08:59.489986 28953 raft_consensus.cc:515] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
W20260709 13:08:59.495501 28221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.65:34859, user_credentials={real_user=slave}} blocked reactor thread for 134429us
I20260709 13:08:59.520033 28326 raft_consensus.cc:2468] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 2.
W20260709 13:08:59.533087 28295 consensus_peers.cc:597] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.492395 28953 leader_election.cc:290] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 election: Requested vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:59.550414 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0c3ca5b68a47259dd1c2672f3e4b70" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
W20260709 13:08:59.583850 28295 leader_election.cc:336] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:08:59.600733 28322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0c3ca5b68a47259dd1c2672f3e4b70" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:08:59.613047 28181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fd7e0c5ab432ba3165dca1ee9f151" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:08:59.613998 28181 raft_consensus.cc:3060] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.627861 28965 leader_election.cc:304] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:59.629696 28976 raft_consensus.cc:2749] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.631704 28006 catalog_manager.cc:5697] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 1 to 2, leader changed from 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65) to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 2 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:59.641786 28970 tablet_bootstrap.cc:492] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:08:59.641814 28221 consensus_peers.cc:597] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.646811 28221 consensus_peers.cc:597] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.678853 28181 raft_consensus.cc:2468] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 2.
W20260709 13:08:59.674471 28295 consensus_peers.cc:597] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.680322 28295 consensus_peers.cc:597] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.687773 28147 leader_election.cc:304] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:59.686444 28976 raft_consensus.cc:493] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.692217 28976 raft_consensus.cc:515] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:59.700886 28147 leader_election.cc:304] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:59.691284 28970 tablet_bootstrap.cc:492] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:08:59.703009 28970 ts_tablet_manager.cc:1403] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.340s	user 0.029s	sys 0.005s
I20260709 13:08:59.704880 29057 raft_consensus.cc:2804] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:59.723358 29057 raft_consensus.cc:697] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:59.694824 28976 leader_election.cc:290] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:08:59.715689 28322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec1905dc240442ab4df69ac1951ce28" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
W20260709 13:08:59.717796 28221 consensus_peers.cc:597] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.722013 28952 raft_consensus.cc:2804] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:59.732806 28952 raft_consensus.cc:697] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:08:59.733846 28952 consensus_queue.cc:237] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:59.735574 28976 raft_consensus.cc:493] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.724699 29057 consensus_queue.cc:237] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:08:59.736169 28976 raft_consensus.cc:515] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:59.740005 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bd39403164ea08b13d40dbc3c05a8" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:59.740650 28326 raft_consensus.cc:1275] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer cd66bd010fa04c4c8d0a668a77bd4c6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:59.725735 28006 catalog_manager.cc:5697] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 1 to 2, leader changed from 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65) to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.741791 28970 raft_consensus.cc:359] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:59.742805 28970 raft_consensus.cc:740] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.738798 28976 leader_election.cc:290] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:08:59.743865 28970 consensus_queue.cc:260] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:59.745849 28297 leader_election.cc:304] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:08:59.753818 29027 raft_consensus.cc:2804] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:59.754386 29027 raft_consensus.cc:697] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 2 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:08:59.755438 29027 consensus_queue.cc:237] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
W20260709 13:08:59.770097 28295 consensus_peers.cc:597] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.774163 28002 catalog_manager.cc:5697] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 1 to 2, leader changed from 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65) to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 2 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.776808 28002 catalog_manager.cc:5697] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 1 to 2, leader changed from 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65) to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 2 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.779605 28002 catalog_manager.cc:5697] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d reported cstate change: term changed from 1 to 2, leader changed from 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65) to cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67). New cstate: current_term: 2 leader_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:59.799654 28970 ts_tablet_manager.cc:1434] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.000s
I20260709 13:08:59.800724 28970 tablet_bootstrap.cc:492] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:59.808842 28179 raft_consensus.cc:1275] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer cd66bd010fa04c4c8d0a668a77bd4c6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:59.810858 29068 raft_consensus.cc:493] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.811596 29068 raft_consensus.cc:515] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
W20260709 13:08:59.811988 28147 consensus_peers.cc:597] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.817092 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:08:59.818259 29068 leader_election.cc:290] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:08:59.834605 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
W20260709 13:08:59.844023 28295 consensus_peers.cc:597] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.851414 28965 leader_election.cc:304] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:59.853018 29068 raft_consensus.cc:2749] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:59.858062 28295 consensus_peers.cc:597] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.859843 29010 consensus_queue.cc:1048] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:59.861531 28221 consensus_peers.cc:597] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:59.880692 28221 consensus_peers.cc:597] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.914415 28973 consensus_queue.cc:1048] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:08:59.942390 28970 tablet_bootstrap.cc:492] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:59.943382 28970 tablet_bootstrap.cc:492] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:08:59.944011 28970 ts_tablet_manager.cc:1403] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.144s	user 0.024s	sys 0.016s
I20260709 13:08:59.945411 28324 raft_consensus.cc:1275] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 8938bce1e7864c1ab26755f60f708368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:59.946578 28970 raft_consensus.cc:359] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:08:59.947311 28970 raft_consensus.cc:740] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.948722 28970 consensus_queue.cc:260] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
W20260709 13:08:59.949590 28295 consensus_peers.cc:597] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.954854 28221 consensus_peers.cc:597] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.955631 28221 consensus_peers.cc:597] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.955725 28970 ts_tablet_manager.cc:1434] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:08:59.958410 28970 tablet_bootstrap.cc:492] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:08:59.954798 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bd39403164ea08b13d40dbc3c05a8" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:08:59.962297 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec1905dc240442ab4df69ac1951ce28" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
W20260709 13:08:59.953986 28295 consensus_peers.cc:597] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.976552 29057 consensus_queue.cc:1048] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:59.976845 28967 leader_election.cc:304] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:08:59.978399 28967 leader_election.cc:304] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368
I20260709 13:08:59.980885 29068 raft_consensus.cc:2749] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:59.985764 28002 catalog_manager.cc:5697] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 1 to 2, leader changed from 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65) to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.997095 28002 catalog_manager.cc:5697] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 1 to 2, leader changed from 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65) to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.991961 28976 raft_consensus.cc:2749] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:00.001112 28147 consensus_peers.cc:597] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.017127 28147 consensus_peers.cc:597] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.006937 28295 consensus_peers.cc:597] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.021657 28295 consensus_peers.cc:597] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.033136 28006 catalog_manager.cc:5697] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 1 to 2, leader changed from 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65) to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 2 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:00.042778 28295 consensus_peers.cc:597] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.053740 28295 consensus_peers.cc:597] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:00.062804 28177 raft_consensus.cc:1275] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer 60d640828dc841619730621ec09d4c64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.074566 28953 consensus_queue.cc:1048] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:00.077917 28147 consensus_peers.cc:597] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.082803 28147 consensus_peers.cc:597] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.083416 28147 consensus_peers.cc:597] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:00.105547 29068 raft_consensus.cc:493] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.106261 29068 raft_consensus.cc:515] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:00.108901 29068 leader_election.cc:290] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:09:00.112077 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6fe3b72cb46e6bbdbea8e0f38cba7" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:09:00.112614 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff6fe3b72cb46e6bbdbea8e0f38cba7" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:09:00.114473 28967 leader_election.cc:304] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:09:00.115670 29068 raft_consensus.cc:2749] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:00.114897 28970 tablet_bootstrap.cc:492] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.117789 28970 tablet_bootstrap.cc:492] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
W20260709 13:09:00.119567 28147 consensus_peers.cc:597] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:00.123564 28970 ts_tablet_manager.cc:1403] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.167s	user 0.014s	sys 0.005s
W20260709 13:09:00.125844 28221 consensus_peers.cc:597] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:00.126190 28970 raft_consensus.cc:359] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:00.126888 28970 raft_consensus.cc:740] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.127722 28970 consensus_queue.cc:260] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:00.129741 28970 ts_tablet_manager.cc:1434] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:09:00.130736 28970 tablet_bootstrap.cc:492] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
W20260709 13:09:00.138659 28295 consensus_peers.cc:597] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.142577 28221 consensus_peers.cc:597] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:00.156833 29068 raft_consensus.cc:493] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.157589 29068 raft_consensus.cc:515] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:00.164148 28970 tablet_bootstrap.cc:492] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.164184 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5af1d945a248cabc1f6f5dbddc6098" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:09:00.163237 29068 leader_election.cc:290] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:09:00.167426 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5af1d945a248cabc1f6f5dbddc6098" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:09:00.168040 28970 tablet_bootstrap.cc:492] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:00.168807 28970 ts_tablet_manager.cc:1403] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.003s
I20260709 13:09:00.171499 28970 raft_consensus.cc:359] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:00.172252 28970 raft_consensus.cc:740] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.173110 28970 consensus_queue.cc:260] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:00.174734 28965 leader_election.cc:304] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368
I20260709 13:09:00.176034 29068 raft_consensus.cc:2749] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:00.181962 28970 ts_tablet_manager.cc:1434] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:09:00.183104 29068 raft_consensus.cc:493] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.186559 29068 raft_consensus.cc:515] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:00.190477 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311b4ef735894403b3e8fccbe834bd77" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:09:00.190944 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311b4ef735894403b3e8fccbe834bd77" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8938bce1e7864c1ab26755f60f708368" is_pre_election: true
I20260709 13:09:00.192616 29068 leader_election.cc:290] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:09:00.192945 28965 leader_election.cc:304] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368
I20260709 13:09:00.193282 28970 tablet_bootstrap.cc:492] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:00.195254 28326 raft_consensus.cc:1275] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 8938bce1e7864c1ab26755f60f708368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.193830 29068 raft_consensus.cc:2749] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:00.196969 29020 consensus_queue.cc:1048] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:00.208021 28221 consensus_peers.cc:597] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.209334 28221 consensus_peers.cc:597] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.232945 28147 consensus_peers.cc:597] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.255818 28147 consensus_peers.cc:597] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:00.264698 28326 raft_consensus.cc:1275] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 8938bce1e7864c1ab26755f60f708368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.272661 29068 raft_consensus.cc:493] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.273567 29068 raft_consensus.cc:515] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:00.275532 29072 consensus_queue.cc:1048] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:00.277200 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a4e5a2e05b4a11b13b756a9fcd11a5" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:09:00.278844 29068 leader_election.cc:290] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:09:00.279163 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a4e5a2e05b4a11b13b756a9fcd11a5" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:09:00.281126 28970 tablet_bootstrap.cc:492] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.280742 28965 leader_election.cc:304] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:09:00.285521 29068 raft_consensus.cc:2749] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:00.288740 28147 consensus_peers.cc:597] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:00.290139 28970 tablet_bootstrap.cc:492] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
W20260709 13:09:00.292646 28295 consensus_peers.cc:597] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.293476 28970 ts_tablet_manager.cc:1403] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.111s	user 0.038s	sys 0.009s
I20260709 13:09:00.296527 28970 raft_consensus.cc:359] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:00.297317 28970 raft_consensus.cc:740] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.298053 28970 consensus_queue.cc:260] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
W20260709 13:09:00.299321 28147 consensus_peers.cc:597] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:00.302057 28178 raft_consensus.cc:1275] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer 60d640828dc841619730621ec09d4c64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.304845 29021 consensus_queue.cc:1048] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:00.308863 28970 ts_tablet_manager.cc:1434] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:09:00.309983 28970 tablet_bootstrap.cc:492] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
W20260709 13:09:00.334607 28295 consensus_peers.cc:597] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.349330 28147 consensus_peers.cc:597] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.413443 28147 consensus_peers.cc:597] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:00.428018 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.65:34859
I20260709 13:09:00.428094 29105 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.65:34859 every 8 connection(s)
I20260709 13:09:00.429630 28970 tablet_bootstrap.cc:492] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.440634 28970 tablet_bootstrap.cc:492] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:00.441691 28970 ts_tablet_manager.cc:1403] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.132s	user 0.035s	sys 0.007s
I20260709 13:09:00.469084 28970 raft_consensus.cc:359] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:00.469924 28970 raft_consensus.cc:740] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.470804 28970 consensus_queue.cc:260] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:00.475296 28970 ts_tablet_manager.cc:1434] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:09:00.478524 28970 tablet_bootstrap.cc:492] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:00.549948 29045 raft_consensus.cc:3060] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.560370 28970 tablet_bootstrap.cc:492] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.561476 28970 tablet_bootstrap.cc:492] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:00.562108 28970 ts_tablet_manager.cc:1403] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.002s
I20260709 13:09:00.575973 28970 raft_consensus.cc:359] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:00.576540 28970 raft_consensus.cc:740] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.577134 28970 consensus_queue.cc:260] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:00.579074 28970 ts_tablet_manager.cc:1434] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.005s
I20260709 13:09:00.580128 28970 tablet_bootstrap.cc:492] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
W20260709 13:09:00.589044 28295 consensus_peers.cc:597] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:00.592077 29107 heartbeater.cc:344] Connected to a master server at 127.20.130.126:34867
I20260709 13:09:00.592574 29107 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:00.593510 29107 heartbeater.cc:507] Master 127.20.130.126:34867 requested a full tablet report, sending...
I20260709 13:09:00.609963 28970 tablet_bootstrap.cc:492] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.611076 28970 tablet_bootstrap.cc:492] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:00.611805 28970 ts_tablet_manager.cc:1403] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.001s
I20260709 13:09:00.614288 28970 raft_consensus.cc:359] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:00.614899 28970 raft_consensus.cc:740] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.615586 28970 consensus_queue.cc:260] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:00.617164 28970 ts_tablet_manager.cc:1434] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:00.617806 28970 tablet_bootstrap.cc:492] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:00.620033 28006 ts_manager.cc:194] Re-registered known tserver with Master: 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
I20260709 13:09:00.643846 28970 tablet_bootstrap.cc:492] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.644752 28970 tablet_bootstrap.cc:492] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:00.645313 28970 ts_tablet_manager.cc:1403] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.011s
I20260709 13:09:00.647495 28970 raft_consensus.cc:359] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:00.648168 28970 raft_consensus.cc:740] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.648901 28970 consensus_queue.cc:260] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:00.651067 28970 ts_tablet_manager.cc:1434] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 13:09:00.651747 28970 tablet_bootstrap.cc:492] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:00.668586 29045 raft_consensus.cc:3060] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.685091 28970 tablet_bootstrap.cc:492] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.686317 28970 tablet_bootstrap.cc:492] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:00.687059 28970 ts_tablet_manager.cc:1403] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.013s
I20260709 13:09:00.688401 28006 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49688
I20260709 13:09:00.690038 28970 raft_consensus.cc:359] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:00.690789 28970 raft_consensus.cc:740] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.691720 28970 consensus_queue.cc:260] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:00.693632 29107 heartbeater.cc:499] Master 127.20.130.126:34867 was elected leader, sending a full tablet report...
I20260709 13:09:00.693747 28970 ts_tablet_manager.cc:1434] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:00.694813 28970 tablet_bootstrap.cc:492] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:00.709249 28970 tablet_bootstrap.cc:492] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.710053 28970 tablet_bootstrap.cc:492] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:00.710654 28970 ts_tablet_manager.cc:1403] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:09:00.713591 28970 raft_consensus.cc:359] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:00.714262 28970 raft_consensus.cc:740] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.715036 28970 consensus_queue.cc:260] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:00.718111 28970 ts_tablet_manager.cc:1434] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:09:00.718863 28970 tablet_bootstrap.cc:492] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:00.729269 29068 raft_consensus.cc:493] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.729900 29068 raft_consensus.cc:515] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:00.733803 28257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17113c03409f4c19ae665da8835dc3b2" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" is_pre_election: true
I20260709 13:09:00.735822 29068 leader_election.cc:290] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:09:00.743322 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17113c03409f4c19ae665da8835dc3b2" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60d640828dc841619730621ec09d4c64" is_pre_election: true
I20260709 13:09:00.753687 28965 leader_election.cc:304] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1; no voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:09:00.756524 29068 raft_consensus.cc:2749] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:00.741568 28970 tablet_bootstrap.cc:492] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.767956 28970 tablet_bootstrap.cc:492] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:00.768702 28970 ts_tablet_manager.cc:1403] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.004s
I20260709 13:09:00.770792 28970 raft_consensus.cc:359] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:00.774140 28970 raft_consensus.cc:740] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.775230 28970 consensus_queue.cc:260] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:00.777372 28970 ts_tablet_manager.cc:1434] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:09:00.778666 28970 tablet_bootstrap.cc:492] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:00.821653 28970 tablet_bootstrap.cc:492] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.822671 28970 tablet_bootstrap.cc:492] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:00.823408 28970 ts_tablet_manager.cc:1403] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.004s
I20260709 13:09:00.826013 28970 raft_consensus.cc:359] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:00.826719 28970 raft_consensus.cc:740] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.827484 28970 consensus_queue.cc:260] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:00.829778 28970 ts_tablet_manager.cc:1434] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:00.831602 28970 tablet_bootstrap.cc:492] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:00.851715 28970 tablet_bootstrap.cc:492] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.852686 28970 tablet_bootstrap.cc:492] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:00.853401 28970 ts_tablet_manager.cc:1403] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 13:09:00.856593 28970 raft_consensus.cc:359] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:00.858752 28970 raft_consensus.cc:740] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.859501 28970 consensus_queue.cc:260] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:00.862056 28970 ts_tablet_manager.cc:1434] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:00.863101 28970 tablet_bootstrap.cc:492] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:00.881238 28970 tablet_bootstrap.cc:492] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.882268 28970 tablet_bootstrap.cc:492] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:00.882987 28970 ts_tablet_manager.cc:1403] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:09:00.885510 28970 raft_consensus.cc:359] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:00.886205 28970 raft_consensus.cc:740] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.886940 28970 consensus_queue.cc:260] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:00.889176 28970 ts_tablet_manager.cc:1434] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:00.890363 28970 tablet_bootstrap.cc:492] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:00.914242 28970 tablet_bootstrap.cc:492] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.915310 28970 tablet_bootstrap.cc:492] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:00.916090 28970 ts_tablet_manager.cc:1403] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.007s
I20260709 13:09:00.918699 28970 raft_consensus.cc:359] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:00.919466 28970 raft_consensus.cc:740] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.920133 28970 consensus_queue.cc:260] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:00.922333 28970 ts_tablet_manager.cc:1434] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:00.923200 28970 tablet_bootstrap.cc:492] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:00.932255 29045 raft_consensus.cc:3060] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.946066 28970 tablet_bootstrap.cc:492] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.947299 28970 tablet_bootstrap.cc:492] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:00.947983 28970 ts_tablet_manager.cc:1403] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.011s
I20260709 13:09:00.952497 28970 raft_consensus.cc:359] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:00.953244 28970 raft_consensus.cc:740] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.954085 28970 consensus_queue.cc:260] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:00.956429 28970 ts_tablet_manager.cc:1434] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:09:00.957346 28970 tablet_bootstrap.cc:492] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:00.975530 28970 tablet_bootstrap.cc:492] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.976845 28970 tablet_bootstrap.cc:492] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:00.977456 28970 ts_tablet_manager.cc:1403] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:09:00.979756 28970 raft_consensus.cc:359] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:00.980532 28970 raft_consensus.cc:740] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.981202 28970 consensus_queue.cc:260] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:00.984367 28970 ts_tablet_manager.cc:1434] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:00.986730 28970 tablet_bootstrap.cc:492] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.009980 28970 tablet_bootstrap.cc:492] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.010893 28970 tablet_bootstrap.cc:492] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.011710 28970 ts_tablet_manager.cc:1403] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.025s	user 0.023s	sys 0.000s
I20260709 13:09:01.014199 28970 raft_consensus.cc:359] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:01.015164 28970 raft_consensus.cc:740] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.015853 28970 consensus_queue.cc:260] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:01.017329 28970 ts_tablet_manager.cc:1434] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:09:01.020143 28970 tablet_bootstrap.cc:492] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.131234 29041 raft_consensus.cc:3060] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.141604 28970 tablet_bootstrap.cc:492] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.143932 28970 tablet_bootstrap.cc:492] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.144667 28970 ts_tablet_manager.cc:1403] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.126s	user 0.022s	sys 0.031s
I20260709 13:09:01.152169 28970 raft_consensus.cc:359] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:01.152964 28970 raft_consensus.cc:740] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.153736 28970 consensus_queue.cc:260] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:01.156129 28970 ts_tablet_manager.cc:1434] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:01.157795 28970 tablet_bootstrap.cc:492] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.208863 28970 tablet_bootstrap.cc:492] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.212117 28970 tablet_bootstrap.cc:492] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.219661 28970 ts_tablet_manager.cc:1403] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.000s
I20260709 13:09:01.222698 28970 raft_consensus.cc:359] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:01.224344 28970 raft_consensus.cc:740] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.225200 28970 consensus_queue.cc:260] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:01.228801 28970 ts_tablet_manager.cc:1434] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:01.235839 28970 tablet_bootstrap.cc:492] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.253849 29045 raft_consensus.cc:3060] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.311287 29041 raft_consensus.cc:3060] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.326193 28970 tablet_bootstrap.cc:492] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.327822 28970 tablet_bootstrap.cc:492] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.328644 28970 ts_tablet_manager.cc:1403] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.093s	user 0.032s	sys 0.032s
I20260709 13:09:01.351562 28970 raft_consensus.cc:359] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:01.352425 28970 raft_consensus.cc:740] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.353296 28970 consensus_queue.cc:260] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:01.356034 28970 ts_tablet_manager.cc:1434] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.003s
I20260709 13:09:01.357736 28970 tablet_bootstrap.cc:492] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.465793 28970 tablet_bootstrap.cc:492] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.466828 28970 tablet_bootstrap.cc:492] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.467657 28970 ts_tablet_manager.cc:1403] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.110s	user 0.042s	sys 0.028s
I20260709 13:09:01.470883 28970 raft_consensus.cc:359] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:01.471746 28970 raft_consensus.cc:740] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.472712 28970 consensus_queue.cc:260] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:01.483832 28970 ts_tablet_manager.cc:1434] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.004s
I20260709 13:09:01.484761 28970 tablet_bootstrap.cc:492] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.502455 28970 tablet_bootstrap.cc:492] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.503607 28970 tablet_bootstrap.cc:492] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.504407 28970 ts_tablet_manager.cc:1403] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:09:01.513027 28970 raft_consensus.cc:359] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:01.513752 28970 raft_consensus.cc:740] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.514492 28970 consensus_queue.cc:260] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:01.516763 28970 ts_tablet_manager.cc:1434] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:09:01.517673 28970 tablet_bootstrap.cc:492] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.536226 28970 tablet_bootstrap.cc:492] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.537227 28970 tablet_bootstrap.cc:492] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.537920 28970 ts_tablet_manager.cc:1403] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:09:01.542675 28970 raft_consensus.cc:359] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:01.543498 28970 raft_consensus.cc:740] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.544312 28970 consensus_queue.cc:260] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:01.546612 28970 ts_tablet_manager.cc:1434] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:01.548030 28970 tablet_bootstrap.cc:492] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.572395 28970 tablet_bootstrap.cc:492] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.573145 28970 tablet_bootstrap.cc:492] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.573915 28970 ts_tablet_manager.cc:1403] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.011s
I20260709 13:09:01.576359 28970 raft_consensus.cc:359] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:01.577196 28970 raft_consensus.cc:740] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.577982 28970 consensus_queue.cc:260] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:01.580188 28970 ts_tablet_manager.cc:1434] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:01.581755 28970 tablet_bootstrap.cc:492] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.603374 28970 tablet_bootstrap.cc:492] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.604382 28970 tablet_bootstrap.cc:492] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.605083 28970 ts_tablet_manager.cc:1403] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:09:01.607719 28970 raft_consensus.cc:359] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:01.611109 28970 raft_consensus.cc:740] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.611984 28970 consensus_queue.cc:260] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:01.614661 28970 ts_tablet_manager.cc:1434] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:09:01.615711 28970 tablet_bootstrap.cc:492] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.641026 28970 tablet_bootstrap.cc:492] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.642120 28970 tablet_bootstrap.cc:492] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.642841 28970 ts_tablet_manager.cc:1403] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.005s
I20260709 13:09:01.645573 28970 raft_consensus.cc:359] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:01.646314 28970 raft_consensus.cc:740] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.647109 28970 consensus_queue.cc:260] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:01.649380 28970 ts_tablet_manager.cc:1434] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:01.651137 28970 tablet_bootstrap.cc:492] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.705497 28970 tablet_bootstrap.cc:492] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.706519 28970 tablet_bootstrap.cc:492] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.707306 28970 ts_tablet_manager.cc:1403] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.056s	user 0.023s	sys 0.009s
I20260709 13:09:01.710152 28970 raft_consensus.cc:359] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:01.710819 28970 raft_consensus.cc:740] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.711514 28970 consensus_queue.cc:260] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:01.713100 28970 ts_tablet_manager.cc:1434] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:09:01.713799 28970 tablet_bootstrap.cc:492] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.725713 29045 raft_consensus.cc:3060] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.734506 29039 raft_consensus.cc:3060] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.736073 28970 tablet_bootstrap.cc:492] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.737073 28970 tablet_bootstrap.cc:492] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.737713 28970 ts_tablet_manager.cc:1403] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.010s
I20260709 13:09:01.748760 28970 raft_consensus.cc:359] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:01.749457 28970 raft_consensus.cc:740] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.750140 28970 consensus_queue.cc:260] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:01.753371 28970 ts_tablet_manager.cc:1434] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 13:09:01.756095 28970 tablet_bootstrap.cc:492] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.826601 28970 tablet_bootstrap.cc:492] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.828845 28970 tablet_bootstrap.cc:492] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.829737 28970 ts_tablet_manager.cc:1403] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.033s
I20260709 13:09:01.832093 28970 raft_consensus.cc:359] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:01.832856 28970 raft_consensus.cc:740] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.833776 28970 consensus_queue.cc:260] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:01.836246 28970 ts_tablet_manager.cc:1434] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:01.837100 28970 tablet_bootstrap.cc:492] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.860148 28970 tablet_bootstrap.cc:492] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.861268 28970 tablet_bootstrap.cc:492] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.862103 28970 ts_tablet_manager.cc:1403] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.011s
I20260709 13:09:01.864596 28970 raft_consensus.cc:359] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:01.865350 28970 raft_consensus.cc:740] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.866129 28970 consensus_queue.cc:260] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:01.868317 28970 ts_tablet_manager.cc:1434] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:01.871057 28970 tablet_bootstrap.cc:492] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.904120 28970 tablet_bootstrap.cc:492] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.905099 28970 tablet_bootstrap.cc:492] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.906309 28970 ts_tablet_manager.cc:1403] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.011s
I20260709 13:09:01.908972 28970 raft_consensus.cc:359] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:01.909781 28970 raft_consensus.cc:740] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.911592 28970 consensus_queue.cc:260] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:01.913874 28970 ts_tablet_manager.cc:1434] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:09:01.914637 28970 tablet_bootstrap.cc:492] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
W20260709 13:09:01.927774 28221 consensus_peers.cc:597] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:01.934538 28970 tablet_bootstrap.cc:492] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.935662 28970 tablet_bootstrap.cc:492] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.936352 28970 ts_tablet_manager.cc:1403] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:09:01.939456 28970 raft_consensus.cc:359] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:01.940136 28970 raft_consensus.cc:740] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.940830 28970 consensus_queue.cc:260] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:01.943199 28970 ts_tablet_manager.cc:1434] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:01.944057 28970 tablet_bootstrap.cc:492] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:01.990549 28970 tablet_bootstrap.cc:492] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:01.991590 28970 tablet_bootstrap.cc:492] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:01.992532 28970 ts_tablet_manager.cc:1403] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.000s
I20260709 13:09:01.995823 28970 raft_consensus.cc:359] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:01.996609 28970 raft_consensus.cc:740] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.997378 28970 consensus_queue.cc:260] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:01.999698 28970 ts_tablet_manager.cc:1434] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:02.001433 28970 tablet_bootstrap.cc:492] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap starting.
I20260709 13:09:02.036996 28970 tablet_bootstrap.cc:492] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:02.038043 28970 tablet_bootstrap.cc:492] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1: Bootstrap complete.
I20260709 13:09:02.038769 28970 ts_tablet_manager.cc:1403] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.011s
I20260709 13:09:02.041410 28970 raft_consensus.cc:359] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:02.042148 28970 raft_consensus.cc:740] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.043167 28970 consensus_queue.cc:260] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:02.046499 28970 ts_tablet_manager.cc:1434] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:02.094969 29041 raft_consensus.cc:3060] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.365592 29045 raft_consensus.cc:3060] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.413427 29045 raft_consensus.cc:3060] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.460807 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:10.516320 28331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f"
dest_uuid: "60d640828dc841619730621ec09d4c64"
mode: GRACEFUL
new_leader_uuid: "8938bce1e7864c1ab26755f60f708368"
 from {username='slave'} at 127.0.0.1:48580
I20260709 13:09:10.517035 28331 raft_consensus.cc:606] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Received request to transfer leadership to TS 8938bce1e7864c1ab26755f60f708368
I20260709 13:09:10.519577 28331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "311b4ef735894403b3e8fccbe834bd77"
dest_uuid: "60d640828dc841619730621ec09d4c64"
mode: GRACEFUL
new_leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:48580
I20260709 13:09:10.520045 28331 raft_consensus.cc:606] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Received request to transfer leadership to TS 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:09:10.522763 28322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "483dc2ac5ecf492087dcef4c6fa1770c"
dest_uuid: "60d640828dc841619730621ec09d4c64"
mode: GRACEFUL
new_leader_uuid: "8938bce1e7864c1ab26755f60f708368"
 from {username='slave'} at 127.0.0.1:48580
I20260709 13:09:10.523413 28322 raft_consensus.cc:606] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Received request to transfer leadership to TS 8938bce1e7864c1ab26755f60f708368
I20260709 13:09:10.526327 28322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b0c3ca5b68a47259dd1c2672f3e4b70"
dest_uuid: "60d640828dc841619730621ec09d4c64"
mode: GRACEFUL
new_leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:48580
I20260709 13:09:10.526896 28322 raft_consensus.cc:606] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Received request to transfer leadership to TS 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:09:10.541106 28251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ec0b05c6a554a24a2576d6308dd6861"
dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
mode: GRACEFUL
new_leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:60990
I20260709 13:09:10.541720 28251 raft_consensus.cc:606] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Received request to transfer leadership to TS 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:09:10.544327 28322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca0b8ae0f3f4484081fbdb57587fbac2"
dest_uuid: "60d640828dc841619730621ec09d4c64"
mode: GRACEFUL
new_leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:48580
I20260709 13:09:10.544916 28322 raft_consensus.cc:606] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Received request to transfer leadership to TS 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:09:10.557662 28177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d920220c89994ca1bd5a7d4fcc7c7e10"
dest_uuid: "8938bce1e7864c1ab26755f60f708368"
mode: GRACEFUL
new_leader_uuid: "60d640828dc841619730621ec09d4c64"
 from {username='slave'} at 127.0.0.1:48822
I20260709 13:09:10.558109 28177 raft_consensus.cc:606] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Received request to transfer leadership to TS 60d640828dc841619730621ec09d4c64
I20260709 13:09:10.559352 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:09:10.560768 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:10.709233 29181 raft_consensus.cc:993] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368: : Instructing follower 60d640828dc841619730621ec09d4c64 to start an election
I20260709 13:09:10.709896 29187 raft_consensus.cc:1081] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Signalling peer 60d640828dc841619730621ec09d4c64 to start an election
I20260709 13:09:10.711503 28331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d920220c89994ca1bd5a7d4fcc7c7e10"
dest_uuid: "60d640828dc841619730621ec09d4c64"
 from {username='slave'} at 127.0.0.1:43254
I20260709 13:09:10.712177 28331 raft_consensus.cc:493] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.712464 28331 raft_consensus.cc:3060] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.719285 29185 raft_consensus.cc:993] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64: : Instructing follower 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:10.719856 29184 raft_consensus.cc:1081] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Signalling peer 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:10.720218 28331 raft_consensus.cc:515] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:10.721508 29042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca0b8ae0f3f4484081fbdb57587fbac2"
dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:34962
I20260709 13:09:10.722101 29042 raft_consensus.cc:493] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.722455 29042 raft_consensus.cc:3060] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.724148 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d920220c89994ca1bd5a7d4fcc7c7e10" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:09:10.723953 28177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d920220c89994ca1bd5a7d4fcc7c7e10" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:09:10.724778 28252 raft_consensus.cc:3060] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.724817 28177 raft_consensus.cc:3055] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.725332 28177 raft_consensus.cc:740] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:09:10.726238 28177 consensus_queue.cc:260] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:10.727560 28177 raft_consensus.cc:3060] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.733968 28252 raft_consensus.cc:2468] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 2.
I20260709 13:09:10.723412 28331 leader_election.cc:290] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:09:10.736672 29042 raft_consensus.cc:515] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:10.737217 28177 raft_consensus.cc:2468] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 2.
I20260709 13:09:10.737854 28297 leader_election.cc:304] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:09:10.738715 29184 raft_consensus.cc:2804] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.739261 29042 leader_election.cc:290] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:09:10.740232 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0b8ae0f3f4484081fbdb57587fbac2" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:09:10.740832 28331 raft_consensus.cc:3055] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.741110 28331 raft_consensus.cc:740] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:09:10.741930 28331 consensus_queue.cc:260] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:10.743299 28331 raft_consensus.cc:3060] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.749807 28331 raft_consensus.cc:2468] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:10.743448 29184 raft_consensus.cc:697] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [term 2 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:09:10.743964 28177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0b8ae0f3f4484081fbdb57587fbac2" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:09:10.751170 28177 raft_consensus.cc:3060] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.751340 29184 consensus_queue.cc:237] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:10.751187 28965 leader_election.cc:304] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 
I20260709 13:09:10.757495 29173 raft_consensus.cc:993] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d: : Instructing follower 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:10.758163 29173 raft_consensus.cc:1081] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Signalling peer 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:10.759835 28177 raft_consensus.cc:2468] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:10.760390 29042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ec0b05c6a554a24a2576d6308dd6861"
dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:34984
I20260709 13:09:10.761310 29195 raft_consensus.cc:2804] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.762092 29042 raft_consensus.cc:493] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.762560 29042 raft_consensus.cc:3060] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.767177 29195 raft_consensus.cc:697] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:09:10.768390 29195 consensus_queue.cc:237] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:10.769893 29042 raft_consensus.cc:515] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:10.772918 29042 leader_election.cc:290] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 3 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:09:10.773914 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec0b05c6a554a24a2576d6308dd6861" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:09:10.774103 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec0b05c6a554a24a2576d6308dd6861" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:09:10.774557 28331 raft_consensus.cc:3060] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.774963 28252 raft_consensus.cc:3055] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:10.775396 28252 raft_consensus.cc:740] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:09:10.776369 28252 consensus_queue.cc:260] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:10.779515 28252 raft_consensus.cc:3060] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.781795 28331 raft_consensus.cc:2468] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 3.
I20260709 13:09:10.783192 28965 leader_election.cc:304] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 
I20260709 13:09:10.786619 28002 catalog_manager.cc:5697] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 1 to 2, leader changed from 8938bce1e7864c1ab26755f60f708368 (127.20.130.66) to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 2 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:10.788787 29196 raft_consensus.cc:2804] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:10.791338 28252 raft_consensus.cc:2468] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 3.
I20260709 13:09:10.794301 29196 raft_consensus.cc:697] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 3 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:09:10.795746 29196 consensus_queue.cc:237] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:10.806382 28006 catalog_manager.cc:5697] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 1 to 2, leader changed from 60d640828dc841619730621ec09d4c64 (127.20.130.68) to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.836575 28006 catalog_manager.cc:5697] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 2 to 3, leader changed from cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67) to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 3 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:10.884882 29193 raft_consensus.cc:993] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64: : Instructing follower 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:10.885407 29193 raft_consensus.cc:1081] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Signalling peer 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:10.887310 29042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "311b4ef735894403b3e8fccbe834bd77"
dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:34962
I20260709 13:09:10.887857 29042 raft_consensus.cc:493] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.888216 29042 raft_consensus.cc:3060] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.895915 29042 raft_consensus.cc:515] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:10.897622 29042 leader_election.cc:290] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:09:10.898283 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311b4ef735894403b3e8fccbe834bd77" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:09:10.898938 28331 raft_consensus.cc:3055] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.898725 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311b4ef735894403b3e8fccbe834bd77" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:09:10.899230 28331 raft_consensus.cc:740] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:09:10.899467 28178 raft_consensus.cc:3060] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.900285 28331 consensus_queue.cc:260] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:10.901484 28331 raft_consensus.cc:3060] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.907969 28178 raft_consensus.cc:2468] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:10.909303 28967 leader_election.cc:304] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:09:10.910147 29196 raft_consensus.cc:2804] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.910645 29196 raft_consensus.cc:697] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:09:10.911494 28331 raft_consensus.cc:2468] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:10.911631 29196 consensus_queue.cc:237] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:10.913515 29193 raft_consensus.cc:993] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64: : Instructing follower 8938bce1e7864c1ab26755f60f708368 to start an election
I20260709 13:09:10.913996 29193 raft_consensus.cc:1081] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Signalling peer 8938bce1e7864c1ab26755f60f708368 to start an election
I20260709 13:09:10.916746 28178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f"
dest_uuid: "8938bce1e7864c1ab26755f60f708368"
 from {username='slave'} at 127.0.0.1:51950
I20260709 13:09:10.917230 28178 raft_consensus.cc:493] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.917564 28178 raft_consensus.cc:3060] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.924757 28178 raft_consensus.cc:515] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:10.925997 29184 raft_consensus.cc:993] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64: : Instructing follower 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:10.926548 29193 raft_consensus.cc:1081] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Signalling peer 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:10.925812 28006 catalog_manager.cc:5697] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 1 to 2, leader changed from 60d640828dc841619730621ec09d4c64 (127.20.130.68) to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.927500 28178 leader_election.cc:290] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:09:10.928470 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:09:10.928610 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:09:10.929096 28252 raft_consensus.cc:3060] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.929118 28331 raft_consensus.cc:3055] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.929628 28331 raft_consensus.cc:740] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:09:10.930495 28331 consensus_queue.cc:260] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
W20260709 13:09:10.931401 28296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.931620 28331 raft_consensus.cc:3060] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.933589 29042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b0c3ca5b68a47259dd1c2672f3e4b70"
dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:34962
I20260709 13:09:10.934187 29042 raft_consensus.cc:493] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.934556 29042 raft_consensus.cc:3060] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.948834 28331 raft_consensus.cc:2468] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 2.
I20260709 13:09:10.950225 28147 leader_election.cc:304] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:09:10.950060 29042 raft_consensus.cc:515] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:10.951095 29181 raft_consensus.cc:2804] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.951589 28252 raft_consensus.cc:2468] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 2.
I20260709 13:09:10.951587 29181 raft_consensus.cc:697] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:09:10.953044 29042 leader_election.cc:290] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:09:10.953249 29181 consensus_queue.cc:237] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:10.954636 28331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0c3ca5b68a47259dd1c2672f3e4b70" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:09:10.953706 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0c3ca5b68a47259dd1c2672f3e4b70" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:09:10.955238 28331 raft_consensus.cc:3055] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.955371 28252 raft_consensus.cc:3060] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.955546 28331 raft_consensus.cc:740] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:09:10.956349 28331 consensus_queue.cc:260] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:10.957422 28331 raft_consensus.cc:3060] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.006186 28252 raft_consensus.cc:2468] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:11.008460 28331 raft_consensus.cc:2468] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:11.009296 28967 leader_election.cc:304] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:09:11.010511 29196 raft_consensus.cc:2804] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:11.011103 29196 raft_consensus.cc:697] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:09:11.012220 29196 consensus_queue.cc:237] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:11.038659 28006 catalog_manager.cc:5697] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 1 to 2, leader changed from 60d640828dc841619730621ec09d4c64 (127.20.130.68) to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.045025 29184 raft_consensus.cc:993] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64: : Instructing follower 8938bce1e7864c1ab26755f60f708368 to start an election
I20260709 13:09:11.045612 29184 raft_consensus.cc:1081] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Signalling peer 8938bce1e7864c1ab26755f60f708368 to start an election
I20260709 13:09:11.043641 28002 catalog_manager.cc:5697] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 1 to 2, leader changed from 60d640828dc841619730621ec09d4c64 (127.20.130.68) to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.048375 28178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "483dc2ac5ecf492087dcef4c6fa1770c"
dest_uuid: "8938bce1e7864c1ab26755f60f708368"
 from {username='slave'} at 127.0.0.1:51950
I20260709 13:09:11.048976 28178 raft_consensus.cc:493] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:11.049307 28178 raft_consensus.cc:3060] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.057590 28178 raft_consensus.cc:515] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:11.059767 28178 leader_election.cc:290] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:09:11.060292 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483dc2ac5ecf492087dcef4c6fa1770c" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:09:11.060966 28252 raft_consensus.cc:3060] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.063424 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483dc2ac5ecf492087dcef4c6fa1770c" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:09:11.064028 28326 raft_consensus.cc:3055] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:11.064304 28326 raft_consensus.cc:740] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:09:11.065045 28326 consensus_queue.cc:260] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:11.066277 28326 raft_consensus.cc:3060] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.067997 28252 raft_consensus.cc:2468] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 2.
I20260709 13:09:11.069823 28149 leader_election.cc:304] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:09:11.070578 29187 raft_consensus.cc:2804] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:11.071082 29187 raft_consensus.cc:697] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:09:11.071918 29187 consensus_queue.cc:237] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:11.073292 28326 raft_consensus.cc:2468] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 2.
I20260709 13:09:11.080869 28002 catalog_manager.cc:5697] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 1 to 2, leader changed from 60d640828dc841619730621ec09d4c64 (127.20.130.68) to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.172427 28326 raft_consensus.cc:1275] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.173506 29196 consensus_queue.cc:1048] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:11.187105 28178 raft_consensus.cc:1275] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.188627 29195 consensus_queue.cc:1048] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:11.242422 28326 raft_consensus.cc:1275] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 3 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:11.243542 29195 consensus_queue.cc:1048] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:11.252421 28252 raft_consensus.cc:1275] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:11.255796 29199 consensus_queue.cc:1048] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:11.256610 28178 raft_consensus.cc:1275] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer 60d640828dc841619730621ec09d4c64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.259161 28251 raft_consensus.cc:1275] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Refusing update from remote peer 60d640828dc841619730621ec09d4c64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.261338 29193 consensus_queue.cc:1048] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:11.263038 29193 consensus_queue.cc:1048] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:11.393198 28251 raft_consensus.cc:1275] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.394388 29199 consensus_queue.cc:1048] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:11.404289 28326 raft_consensus.cc:1275] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.405740 29196 consensus_queue.cc:1048] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:11.468875 28322 raft_consensus.cc:1275] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 8938bce1e7864c1ab26755f60f708368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.470155 29187 consensus_queue.cc:1048] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:11.484323 28251 raft_consensus.cc:1275] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Refusing update from remote peer 8938bce1e7864c1ab26755f60f708368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.485756 29187 consensus_queue.cc:1048] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:11.496125 28252 raft_consensus.cc:1275] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Refusing update from remote peer 8938bce1e7864c1ab26755f60f708368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.497411 28322 raft_consensus.cc:1275] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.497511 29187 consensus_queue.cc:1048] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:11.499369 29199 consensus_queue.cc:1048] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:11.502573 28178 raft_consensus.cc:1275] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.504344 29199 consensus_queue.cc:1048] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:11.513851 28331 raft_consensus.cc:1275] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 8938bce1e7864c1ab26755f60f708368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.518420 29187 consensus_queue.cc:1048] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:11.561794 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:11.603020 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:11.642510 28178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1112009449724fb880c6bfbb99c54b3a"
dest_uuid: "8938bce1e7864c1ab26755f60f708368"
mode: GRACEFUL
new_leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:48822
I20260709 13:09:11.643177 28178 raft_consensus.cc:606] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Received request to transfer leadership to TS 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:09:11.646230 28177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "337d2a0753f34dd08c1b1eb5e708d7ff"
dest_uuid: "8938bce1e7864c1ab26755f60f708368"
mode: GRACEFUL
new_leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:48822
I20260709 13:09:11.654817 28177 raft_consensus.cc:606] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Received request to transfer leadership to TS 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:09:11.658032 28177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "483dc2ac5ecf492087dcef4c6fa1770c"
dest_uuid: "8938bce1e7864c1ab26755f60f708368"
mode: GRACEFUL
new_leader_uuid: "60d640828dc841619730621ec09d4c64"
 from {username='slave'} at 127.0.0.1:48822
I20260709 13:09:11.658715 28177 raft_consensus.cc:606] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Received request to transfer leadership to TS 60d640828dc841619730621ec09d4c64
I20260709 13:09:11.661702 28322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4bbaf9dd8a447f6bc1e1feeceb3008d"
dest_uuid: "60d640828dc841619730621ec09d4c64"
mode: GRACEFUL
new_leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:48580
I20260709 13:09:11.662199 28322 raft_consensus.cc:606] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Received request to transfer leadership to TS 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:09:11.664074 29231 raft_consensus.cc:993] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368: : Instructing follower 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:11.664671 29231 raft_consensus.cc:1081] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Signalling peer 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:11.665235 28251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f776edf45fe042b994923a680048889b"
dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
mode: GRACEFUL
new_leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:60990
I20260709 13:09:11.665818 28251 raft_consensus.cc:606] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Received request to transfer leadership to TS 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:09:11.666594 29041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1112009449724fb880c6bfbb99c54b3a"
dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:09:11.667203 29041 raft_consensus.cc:493] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:11.667380 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:11.667577 29041 raft_consensus.cc:3060] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.669134 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:11.675693 29041 raft_consensus.cc:515] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:11.677836 29041 leader_election.cc:290] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:09:11.678483 28322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1112009449724fb880c6bfbb99c54b3a" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:09:11.679966 28322 raft_consensus.cc:3060] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.680213 28177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1112009449724fb880c6bfbb99c54b3a" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:09:11.680835 28177 raft_consensus.cc:3055] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:11.681143 28177 raft_consensus.cc:740] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:09:11.683045 28177 consensus_queue.cc:260] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:11.684490 28177 raft_consensus.cc:3060] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.689394 28322 raft_consensus.cc:2468] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:11.690732 28965 leader_election.cc:304] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 
I20260709 13:09:11.691267 28177 raft_consensus.cc:2468] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:11.691589 29199 raft_consensus.cc:2804] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:11.692162 29199 raft_consensus.cc:697] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:09:11.692940 29199 consensus_queue.cc:237] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:11.702600 28002 catalog_manager.cc:5697] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 1 to 2, leader changed from 8938bce1e7864c1ab26755f60f708368 (127.20.130.66) to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.872805 29187 raft_consensus.cc:993] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368: : Instructing follower 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:11.873332 29231 raft_consensus.cc:1081] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Signalling peer 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:11.874962 29042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "337d2a0753f34dd08c1b1eb5e708d7ff"
dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:09:11.875550 29042 raft_consensus.cc:493] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:11.875891 29042 raft_consensus.cc:3060] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.882161 29042 raft_consensus.cc:515] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:11.884496 29042 leader_election.cc:290] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:09:11.884744 28322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d2a0753f34dd08c1b1eb5e708d7ff" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:09:11.885456 28322 raft_consensus.cc:3060] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.890512 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d2a0753f34dd08c1b1eb5e708d7ff" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:09:11.891189 28178 raft_consensus.cc:3055] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:11.891517 28178 raft_consensus.cc:740] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:09:11.891778 28322 raft_consensus.cc:2468] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:11.892342 28178 consensus_queue.cc:260] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:11.893563 28965 leader_election.cc:304] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 7d2bb5df3b55462682d0f2fce57709f1; no voters: 
I20260709 13:09:11.893710 28178 raft_consensus.cc:3060] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.894371 29199 raft_consensus.cc:2804] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:11.895181 29199 raft_consensus.cc:697] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:09:11.896126 29199 consensus_queue.cc:237] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:11.904634 28178 raft_consensus.cc:2468] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:11.906536 28002 catalog_manager.cc:5697] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 1 to 2, leader changed from 8938bce1e7864c1ab26755f60f708368 (127.20.130.66) to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.014814 29225 raft_consensus.cc:993] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368: : Instructing follower 60d640828dc841619730621ec09d4c64 to start an election
I20260709 13:09:12.015427 29231 raft_consensus.cc:1081] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Signalling peer 60d640828dc841619730621ec09d4c64 to start an election
I20260709 13:09:12.017225 28322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "483dc2ac5ecf492087dcef4c6fa1770c"
dest_uuid: "60d640828dc841619730621ec09d4c64"
 from {username='slave'} at 127.0.0.1:43254
I20260709 13:09:12.017791 28322 raft_consensus.cc:493] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:12.018162 28322 raft_consensus.cc:3060] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.025990 28322 raft_consensus.cc:515] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:12.027913 28322 leader_election.cc:290] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:09:12.029315 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483dc2ac5ecf492087dcef4c6fa1770c" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:09:12.029409 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483dc2ac5ecf492087dcef4c6fa1770c" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:09:12.030186 28252 raft_consensus.cc:3060] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.030287 28178 raft_consensus.cc:3055] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.030743 28178 raft_consensus.cc:740] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:09:12.031529 28178 consensus_queue.cc:260] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:12.033640 28178 raft_consensus.cc:3060] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.039943 28178 raft_consensus.cc:2468] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 3.
I20260709 13:09:12.042186 28297 leader_election.cc:304] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:09:12.043025 28252 raft_consensus.cc:2468] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 3.
I20260709 13:09:12.044165 29208 raft_consensus.cc:993] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d: : Instructing follower 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:12.045770 29208 raft_consensus.cc:1081] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Signalling peer 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:12.045971 29185 raft_consensus.cc:2804] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:12.046494 29185 raft_consensus.cc:697] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 3 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:09:12.047640 29042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f776edf45fe042b994923a680048889b"
dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:34984
I20260709 13:09:12.047394 29185 consensus_queue.cc:237] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:12.048434 29042 raft_consensus.cc:493] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:12.048794 29042 raft_consensus.cc:3060] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.058774 29042 raft_consensus.cc:515] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:12.060802 29042 leader_election.cc:290] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 3 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:09:12.059700 28002 catalog_manager.cc:5697] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 2 to 3, leader changed from 8938bce1e7864c1ab26755f60f708368 (127.20.130.66) to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 3 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.061371 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:09:12.062068 28252 raft_consensus.cc:3055] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.062366 28252 raft_consensus.cc:740] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:09:12.063282 28252 consensus_queue.cc:260] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:12.064529 28252 raft_consensus.cc:3060] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.066359 28322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f776edf45fe042b994923a680048889b" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:09:12.067013 28322 raft_consensus.cc:3060] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.071265 28252 raft_consensus.cc:2468] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 3.
I20260709 13:09:12.072542 28967 leader_election.cc:304] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:09:12.073421 29199 raft_consensus.cc:2804] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:12.073885 29199 raft_consensus.cc:697] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 3 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:09:12.074723 29199 consensus_queue.cc:237] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:12.075227 28322 raft_consensus.cc:2468] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 3.
I20260709 13:09:12.089011 28002 catalog_manager.cc:5697] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 2 to 3, leader changed from cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67) to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 3 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.099705 28322 raft_consensus.cc:1275] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.101302 29199 consensus_queue.cc:1048] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.117238 28178 raft_consensus.cc:1275] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.118665 29199 consensus_queue.cc:1048] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.161026 29193 raft_consensus.cc:993] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64: : Instructing follower 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:12.161504 29193 raft_consensus.cc:1081] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Signalling peer 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:12.163455 29041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4bbaf9dd8a447f6bc1e1feeceb3008d"
dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:34962
I20260709 13:09:12.163985 29041 raft_consensus.cc:493] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:12.164330 29041 raft_consensus.cc:3060] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.171195 29041 raft_consensus.cc:515] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:12.172874 29041 leader_election.cc:290] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:09:12.173590 28322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bbaf9dd8a447f6bc1e1feeceb3008d" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:09:12.173866 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bbaf9dd8a447f6bc1e1feeceb3008d" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:09:12.174226 28322 raft_consensus.cc:3055] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:12.174453 28178 raft_consensus.cc:3060] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.174583 28322 raft_consensus.cc:740] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:09:12.175786 28322 consensus_queue.cc:260] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:12.176982 28322 raft_consensus.cc:3060] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.181381 28178 raft_consensus.cc:2468] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:12.182667 28967 leader_election.cc:304] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:09:12.183791 29199 raft_consensus.cc:2804] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:12.184295 29199 raft_consensus.cc:697] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:09:12.185900 29199 consensus_queue.cc:237] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:12.206708 28004 catalog_manager.cc:5697] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 1 to 2, leader changed from 60d640828dc841619730621ec09d4c64 (127.20.130.68) to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.210330 28322 raft_consensus.cc:2468] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:12.334259 28322 raft_consensus.cc:1275] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.335367 29199 consensus_queue.cc:1048] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.344383 28178 raft_consensus.cc:1275] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.346695 29195 consensus_queue.cc:1048] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.464627 28252 raft_consensus.cc:1275] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Refusing update from remote peer 60d640828dc841619730621ec09d4c64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:12.466602 29185 consensus_queue.cc:1048] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:12.478309 28178 raft_consensus.cc:1275] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 3 FOLLOWER]: Refusing update from remote peer 60d640828dc841619730621ec09d4c64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:12.483116 29193 consensus_queue.cc:1048] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:12.541206 28252 raft_consensus.cc:1275] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:12.542860 29195 consensus_queue.cc:1048] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.551988 28322 raft_consensus.cc:1275] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 3 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:12.553355 29199 consensus_queue.cc:1048] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.570657 28178 raft_consensus.cc:1275] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.572036 29199 consensus_queue.cc:1048] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.584656 28322 raft_consensus.cc:1275] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.586608 29195 consensus_queue.cc:1048] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.670050 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:12.712340 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:12.749186 28252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18c5064efb8c493c8abc76212d9eaf59"
dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
mode: GRACEFUL
new_leader_uuid: "8938bce1e7864c1ab26755f60f708368"
 from {username='slave'} at 127.0.0.1:60990
I20260709 13:09:12.749861 28252 raft_consensus.cc:606] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Received request to transfer leadership to TS 8938bce1e7864c1ab26755f60f708368
I20260709 13:09:12.753082 28252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ac04c15a2dc474b8def84d7d597afe1"
dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
mode: GRACEFUL
new_leader_uuid: "60d640828dc841619730621ec09d4c64"
 from {username='slave'} at 127.0.0.1:60990
I20260709 13:09:12.753710 28252 raft_consensus.cc:606] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Received request to transfer leadership to TS 60d640828dc841619730621ec09d4c64
I20260709 13:09:12.756150 28252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d4a4fa897ce40ed86eb46b892297b2c"
dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
mode: GRACEFUL
new_leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:60990
I20260709 13:09:12.756575 28252 raft_consensus.cc:606] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Received request to transfer leadership to TS 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:09:12.758701 28322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c25595e441a47e5bb6f0f694cb3eed9"
dest_uuid: "60d640828dc841619730621ec09d4c64"
mode: GRACEFUL
new_leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:48580
I20260709 13:09:12.759157 28322 raft_consensus.cc:606] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Received request to transfer leadership to TS 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:09:12.761548 28252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef7f29ee868b4774be667c0c3791aa0d"
dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
mode: GRACEFUL
new_leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:60990
I20260709 13:09:12.762006 28252 raft_consensus.cc:606] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Received request to transfer leadership to TS 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:09:12.763082 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:12.764257 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:12.812602 29193 raft_consensus.cc:993] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64: : Instructing follower 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:12.813263 29185 raft_consensus.cc:1081] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Signalling peer 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:12.814713 29041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c25595e441a47e5bb6f0f694cb3eed9"
dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:34962
I20260709 13:09:12.815238 29041 raft_consensus.cc:493] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:12.815518 29041 raft_consensus.cc:3060] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.817806 29246 raft_consensus.cc:993] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d: : Instructing follower 60d640828dc841619730621ec09d4c64 to start an election
I20260709 13:09:12.818528 29138 raft_consensus.cc:1081] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Signalling peer 60d640828dc841619730621ec09d4c64 to start an election
I20260709 13:09:12.820822 28322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ac04c15a2dc474b8def84d7d597afe1"
dest_uuid: "60d640828dc841619730621ec09d4c64"
 from {username='slave'} at 127.0.0.1:43260
I20260709 13:09:12.821308 28322 raft_consensus.cc:493] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:12.821619 28322 raft_consensus.cc:3060] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.823364 29041 raft_consensus.cc:515] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:12.825063 29041 leader_election.cc:290] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:09:12.825974 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c25595e441a47e5bb6f0f694cb3eed9" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:09:12.825977 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c25595e441a47e5bb6f0f694cb3eed9" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:09:12.826819 28326 raft_consensus.cc:3055] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:12.827147 28252 raft_consensus.cc:3060] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.827318 28326 raft_consensus.cc:740] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:09:12.827026 28322 raft_consensus.cc:515] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:12.828260 28326 consensus_queue.cc:260] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:12.829545 28326 raft_consensus.cc:3060] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.830988 28322 leader_election.cc:290] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:09:12.832715 28251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04c15a2dc474b8def84d7d597afe1" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:09:12.833307 28251 raft_consensus.cc:3055] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:12.833606 28251 raft_consensus.cc:740] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:09:12.834399 28251 consensus_queue.cc:260] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:12.834717 28252 raft_consensus.cc:2468] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:12.837750 28251 raft_consensus.cc:3060] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.838201 28967 leader_election.cc:304] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:09:12.839691 29195 raft_consensus.cc:2804] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:12.836580 28326 raft_consensus.cc:2468] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:12.840240 29195 raft_consensus.cc:697] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:09:12.835639 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac04c15a2dc474b8def84d7d597afe1" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:09:12.844631 28178 raft_consensus.cc:3060] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.845011 29195 consensus_queue.cc:237] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:12.845691 28251 raft_consensus.cc:2468] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 2.
I20260709 13:09:12.848969 28297 leader_election.cc:304] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:09:12.850325 28178 raft_consensus.cc:2468] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 2.
I20260709 13:09:12.850500 29193 raft_consensus.cc:2804] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:12.851061 29193 raft_consensus.cc:697] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [term 2 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:09:12.851948 29193 consensus_queue.cc:237] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:12.863003 28004 catalog_manager.cc:5697] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 1 to 2, leader changed from cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67) to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 2 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.863297 28002 catalog_manager.cc:5697] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 1 to 2, leader changed from 60d640828dc841619730621ec09d4c64 (127.20.130.68) to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.961114 29208 raft_consensus.cc:993] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d: : Instructing follower 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:12.961736 29246 raft_consensus.cc:1081] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Signalling peer 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:12.963677 29041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d4a4fa897ce40ed86eb46b892297b2c"
dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:34984
I20260709 13:09:12.964210 29041 raft_consensus.cc:493] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:12.964593 29041 raft_consensus.cc:3060] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.971288 29041 raft_consensus.cc:515] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:12.973366 29041 leader_election.cc:290] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:09:12.974054 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4a4fa897ce40ed86eb46b892297b2c" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:09:12.974381 28251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4a4fa897ce40ed86eb46b892297b2c" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:09:12.974723 28178 raft_consensus.cc:3060] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.974957 28251 raft_consensus.cc:3055] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:12.975255 28251 raft_consensus.cc:740] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:09:12.975999 28251 consensus_queue.cc:260] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:12.976999 28251 raft_consensus.cc:3060] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.982653 28178 raft_consensus.cc:2468] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:12.984018 28967 leader_election.cc:304] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:09:12.984994 29195 raft_consensus.cc:2804] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:12.987315 29195 raft_consensus.cc:697] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:09:12.988289 29195 consensus_queue.cc:237] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:12.993417 28251 raft_consensus.cc:2468] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:13.013749 28002 catalog_manager.cc:5697] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 1 to 2, leader changed from cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67) to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.025022 29208 raft_consensus.cc:993] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d: : Instructing follower 8938bce1e7864c1ab26755f60f708368 to start an election
I20260709 13:09:13.025619 29208 raft_consensus.cc:1081] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Signalling peer 8938bce1e7864c1ab26755f60f708368 to start an election
I20260709 13:09:13.027443 28177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18c5064efb8c493c8abc76212d9eaf59"
dest_uuid: "8938bce1e7864c1ab26755f60f708368"
 from {username='slave'} at 127.0.0.1:51918
I20260709 13:09:13.028074 28177 raft_consensus.cc:493] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:13.028502 28177 raft_consensus.cc:3060] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.041549 28177 raft_consensus.cc:515] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:13.044780 28177 leader_election.cc:290] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:09:13.045454 28251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c5064efb8c493c8abc76212d9eaf59" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:09:13.046114 28251 raft_consensus.cc:3055] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:13.046439 28251 raft_consensus.cc:740] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:09:13.047297 28251 consensus_queue.cc:260] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:13.047703 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c5064efb8c493c8abc76212d9eaf59" candidate_uuid: "8938bce1e7864c1ab26755f60f708368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:09:13.048354 28326 raft_consensus.cc:3060] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.048622 28251 raft_consensus.cc:3060] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.057034 28251 raft_consensus.cc:2468] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 2.
I20260709 13:09:13.059871 28149 leader_election.cc:304] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8938bce1e7864c1ab26755f60f708368, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:09:13.061352 29231 raft_consensus.cc:2804] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:13.062028 29231 raft_consensus.cc:697] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Becoming Leader. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:09:13.063071 29231 consensus_queue.cc:237] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:13.066390 28326 raft_consensus.cc:2468] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8938bce1e7864c1ab26755f60f708368 in term 2.
I20260709 13:09:13.083698 28004 catalog_manager.cc:5697] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 reported cstate change: term changed from 1 to 2, leader changed from cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67) to 8938bce1e7864c1ab26755f60f708368 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "8938bce1e7864c1ab26755f60f708368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.189046 29246 raft_consensus.cc:993] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d: : Instructing follower 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:13.189603 29138 raft_consensus.cc:1081] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Signalling peer 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:13.191066 29041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef7f29ee868b4774be667c0c3791aa0d"
dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:34984
I20260709 13:09:13.191558 29041 raft_consensus.cc:493] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:13.191912 29041 raft_consensus.cc:3060] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.198341 29041 raft_consensus.cc:515] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:13.200086 29041 leader_election.cc:290] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:09:13.200584 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7f29ee868b4774be667c0c3791aa0d" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:09:13.201151 28252 raft_consensus.cc:3055] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:13.201447 28252 raft_consensus.cc:740] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:09:13.201457 28322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7f29ee868b4774be667c0c3791aa0d" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:09:13.202080 28322 raft_consensus.cc:3060] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.202299 28252 consensus_queue.cc:260] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:13.203620 28252 raft_consensus.cc:3060] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.210333 28252 raft_consensus.cc:2468] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:13.211671 28967 leader_election.cc:304] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:09:13.212589 29199 raft_consensus.cc:2804] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:13.210747 28322 raft_consensus.cc:2468] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:13.213058 29199 raft_consensus.cc:697] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:09:13.214001 29199 consensus_queue.cc:237] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:13.230315 28004 catalog_manager.cc:5697] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 1 to 2, leader changed from cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67) to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.266125 28252 raft_consensus.cc:1275] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:13.267531 29199 consensus_queue.cc:1048] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.281342 28177 raft_consensus.cc:1275] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer 60d640828dc841619730621ec09d4c64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:13.282601 29247 consensus_queue.cc:1048] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.288993 28322 raft_consensus.cc:1275] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:13.290380 29195 consensus_queue.cc:1048] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.319669 28251 raft_consensus.cc:1275] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Refusing update from remote peer 60d640828dc841619730621ec09d4c64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:13.320947 29247 consensus_queue.cc:1048] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:13.453821 28177 raft_consensus.cc:1275] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:13.455340 29199 consensus_queue.cc:1048] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.470129 28253 raft_consensus.cc:1275] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:13.473392 29196 consensus_queue.cc:1048] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.529613 28251 raft_consensus.cc:1275] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Refusing update from remote peer 8938bce1e7864c1ab26755f60f708368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:13.530789 29225 consensus_queue.cc:1048] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.540526 28326 raft_consensus.cc:1275] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 8938bce1e7864c1ab26755f60f708368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:13.542724 29277 consensus_queue.cc:1048] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.731870 28322 raft_consensus.cc:1275] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:13.733142 29274 consensus_queue.cc:1048] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.757567 28251 raft_consensus.cc:1275] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:13.759244 29273 consensus_queue.cc:1048] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:13.765056 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:13.817510 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:13.863075 28183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f"
dest_uuid: "8938bce1e7864c1ab26755f60f708368"
mode: GRACEFUL
new_leader_uuid: "60d640828dc841619730621ec09d4c64"
 from {username='slave'} at 127.0.0.1:48822
I20260709 13:09:13.863696 28183 raft_consensus.cc:606] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Received request to transfer leadership to TS 60d640828dc841619730621ec09d4c64
I20260709 13:09:13.866228 28322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1568c5c6e6a5495fa8c5550c03721b67"
dest_uuid: "60d640828dc841619730621ec09d4c64"
mode: GRACEFUL
new_leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:48580
I20260709 13:09:13.866707 28322 raft_consensus.cc:606] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Received request to transfer leadership to TS 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:09:13.869239 28251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d2012efcebb4e8d9dc7839fdb5927fb"
dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
mode: GRACEFUL
new_leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:60990
I20260709 13:09:13.869727 28251 raft_consensus.cc:606] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Received request to transfer leadership to TS 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:09:13.871037 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:13.872278 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:13.892210 29231 raft_consensus.cc:993] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368: : Instructing follower 60d640828dc841619730621ec09d4c64 to start an election
I20260709 13:09:13.892851 29277 raft_consensus.cc:1081] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Signalling peer 60d640828dc841619730621ec09d4c64 to start an election
I20260709 13:09:13.894340 28322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f"
dest_uuid: "60d640828dc841619730621ec09d4c64"
 from {username='slave'} at 127.0.0.1:43254
I20260709 13:09:13.894863 28322 raft_consensus.cc:493] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:13.895216 28322 raft_consensus.cc:3060] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.900554 28322 raft_consensus.cc:515] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:13.902390 28322 leader_election.cc:290] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:09:13.903491 28251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:09:13.903273 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebe992abe014550bcd49e684e26c59f" candidate_uuid: "60d640828dc841619730621ec09d4c64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:09:13.904103 28251 raft_consensus.cc:3060] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.904212 28183 raft_consensus.cc:3055] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:13.904604 28183 raft_consensus.cc:740] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8938bce1e7864c1ab26755f60f708368, State: Running, Role: LEADER
I20260709 13:09:13.905342 28183 consensus_queue.cc:260] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:13.906713 28183 raft_consensus.cc:3060] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.910552 28251 raft_consensus.cc:2468] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 3.
I20260709 13:09:13.912039 28297 leader_election.cc:304] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d640828dc841619730621ec09d4c64, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:09:13.912698 28183 raft_consensus.cc:2468] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d640828dc841619730621ec09d4c64 in term 3.
I20260709 13:09:13.912739 29270 raft_consensus.cc:2804] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:13.913506 29270 raft_consensus.cc:697] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 3 LEADER]: Becoming Leader. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:09:13.914351 29270 consensus_queue.cc:237] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } }
I20260709 13:09:13.924543 28006 catalog_manager.cc:5697] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 reported cstate change: term changed from 2 to 3, leader changed from 8938bce1e7864c1ab26755f60f708368 (127.20.130.66) to 60d640828dc841619730621ec09d4c64 (127.20.130.68). New cstate: current_term: 3 leader_uuid: "60d640828dc841619730621ec09d4c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.971058 29270 raft_consensus.cc:993] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64: : Instructing follower 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:13.971604 29247 raft_consensus.cc:1081] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Signalling peer 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:13.973234 29039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1568c5c6e6a5495fa8c5550c03721b67"
dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:34962
I20260709 13:09:13.973716 29039 raft_consensus.cc:493] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:13.974009 29039 raft_consensus.cc:3060] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.979194 29039 raft_consensus.cc:515] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:13.981240 29039 leader_election.cc:290] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Requested vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171)
I20260709 13:09:13.982172 28322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1568c5c6e6a5495fa8c5550c03721b67" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:09:13.982054 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1568c5c6e6a5495fa8c5550c03721b67" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:09:13.982884 28322 raft_consensus.cc:3055] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:13.983067 28253 raft_consensus.cc:3060] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.983299 28322 raft_consensus.cc:740] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:09:13.984143 28322 consensus_queue.cc:260] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:13.985440 28322 raft_consensus.cc:3060] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.990156 28253 raft_consensus.cc:2468] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:13.991492 28967 leader_election.cc:304] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:09:13.992013 28322 raft_consensus.cc:2468] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:13.992380 29199 raft_consensus.cc:2804] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:13.992944 29199 raft_consensus.cc:697] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:09:13.993811 29199 consensus_queue.cc:237] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:14.002826 28006 catalog_manager.cc:5697] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 1 to 2, leader changed from 60d640828dc841619730621ec09d4c64 (127.20.130.68) to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.043967 29138 raft_consensus.cc:993] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d: : Instructing follower 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:14.044480 29246 raft_consensus.cc:1081] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Signalling peer 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:14.046151 29041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d2012efcebb4e8d9dc7839fdb5927fb"
dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:34984
I20260709 13:09:14.046675 29041 raft_consensus.cc:493] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:14.047132 29041 raft_consensus.cc:3060] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.052352 29041 raft_consensus.cc:515] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:14.054972 29041 leader_election.cc:290] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231), cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757)
I20260709 13:09:14.056129 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2012efcebb4e8d9dc7839fdb5927fb" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d"
I20260709 13:09:14.056710 28253 raft_consensus.cc:3055] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:14.057034 28253 raft_consensus.cc:740] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd66bd010fa04c4c8d0a668a77bd4c6d, State: Running, Role: LEADER
I20260709 13:09:14.057823 28253 consensus_queue.cc:260] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:14.059037 28253 raft_consensus.cc:3060] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.064065 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2012efcebb4e8d9dc7839fdb5927fb" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:09:14.064749 28178 raft_consensus.cc:3060] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.065179 28253 raft_consensus.cc:2468] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 3.
I20260709 13:09:14.066337 28967 leader_election.cc:304] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d; no voters: 
I20260709 13:09:14.067274 29199 raft_consensus.cc:2804] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:14.068593 29199 raft_consensus.cc:697] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 3 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:09:14.069497 29199 consensus_queue.cc:237] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } }
I20260709 13:09:14.074105 28178 raft_consensus.cc:2468] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 3.
I20260709 13:09:14.081938 28006 catalog_manager.cc:5697] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 2 to 3, leader changed from cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67) to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 3 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.307734 28178 raft_consensus.cc:1275] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 3 FOLLOWER]: Refusing update from remote peer 60d640828dc841619730621ec09d4c64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:14.309005 29247 consensus_queue.cc:1048] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:14.332871 28251 raft_consensus.cc:1275] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Refusing update from remote peer 60d640828dc841619730621ec09d4c64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:14.335469 29193 consensus_queue.cc:1048] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:14.458127 28253 raft_consensus.cc:1275] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:14.459538 29199 consensus_queue.cc:1048] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:14.473717 28322 raft_consensus.cc:1275] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:14.475255 29199 consensus_queue.cc:1048] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:14.503569 28183 raft_consensus.cc:1275] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 3 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:14.504599 29195 consensus_queue.cc:1048] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:14.514159 28251 raft_consensus.cc:1275] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:14.515762 29199 consensus_queue.cc:1048] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:14.873302 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:14.932497 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:14.968710 28326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "846616843e7743a6a799541dd5ea10fd"
dest_uuid: "60d640828dc841619730621ec09d4c64"
mode: GRACEFUL
new_leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:48580
I20260709 13:09:14.969336 28326 raft_consensus.cc:606] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Received request to transfer leadership to TS 7d2bb5df3b55462682d0f2fce57709f1
I20260709 13:09:14.970638 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:14.972319 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:15.370393 29270 raft_consensus.cc:993] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64: : Instructing follower 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:15.370851 29270 raft_consensus.cc:1081] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Signalling peer 7d2bb5df3b55462682d0f2fce57709f1 to start an election
I20260709 13:09:15.372398 29039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "846616843e7743a6a799541dd5ea10fd"
dest_uuid: "7d2bb5df3b55462682d0f2fce57709f1"
 from {username='slave'} at 127.0.0.1:34962
I20260709 13:09:15.372915 29039 raft_consensus.cc:493] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:15.373240 29039 raft_consensus.cc:3060] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.379277 29039 raft_consensus.cc:515] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:15.381785 29039 leader_election.cc:290] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Requested vote from peers 60d640828dc841619730621ec09d4c64 (127.20.130.68:46171), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:09:15.382357 28326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846616843e7743a6a799541dd5ea10fd" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60d640828dc841619730621ec09d4c64"
I20260709 13:09:15.382711 28183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846616843e7743a6a799541dd5ea10fd" candidate_uuid: "7d2bb5df3b55462682d0f2fce57709f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8938bce1e7864c1ab26755f60f708368"
I20260709 13:09:15.383261 28183 raft_consensus.cc:3060] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.383069 28326 raft_consensus.cc:3055] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:15.386258 28326 raft_consensus.cc:740] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60d640828dc841619730621ec09d4c64, State: Running, Role: LEADER
I20260709 13:09:15.386878 28326 consensus_queue.cc:260] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:15.388060 28326 raft_consensus.cc:3060] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.389748 28183 raft_consensus.cc:2468] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:15.391249 28967 leader_election.cc:304] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368; no voters: 
I20260709 13:09:15.392064 29273 raft_consensus.cc:2804] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:15.392783 29273 raft_consensus.cc:697] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Becoming Leader. State: Replica: 7d2bb5df3b55462682d0f2fce57709f1, State: Running, Role: LEADER
I20260709 13:09:15.393559 28326 raft_consensus.cc:2468] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bb5df3b55462682d0f2fce57709f1 in term 2.
I20260709 13:09:15.393831 29273 consensus_queue.cc:237] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:15.403972 28004 catalog_manager.cc:5697] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 reported cstate change: term changed from 1 to 2, leader changed from 60d640828dc841619730621ec09d4c64 (127.20.130.68) to 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "7d2bb5df3b55462682d0f2fce57709f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.899209 28322 raft_consensus.cc:1275] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.900390 29273 consensus_queue.cc:1048] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.914047 28183 raft_consensus.cc:1275] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Refusing update from remote peer 7d2bb5df3b55462682d0f2fce57709f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.915815 29273 consensus_queue.cc:1048] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.973272 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:16.011713 21001 tablet_server.cc:179] TabletServer@127.20.130.65:34859 shutting down...
W20260709 13:09:16.029896 28147 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 267 similar messages]
W20260709 13:09:16.038905 28147 consensus_peers.cc:597] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.047608 28295 consensus_peers.cc:597] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.052956 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:16.054112 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.055183 21001 raft_consensus.cc:2243] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.056217 21001 raft_consensus.cc:2272] T 1568c5c6e6a5495fa8c5550c03721b67 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.059327 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.060349 21001 raft_consensus.cc:2243] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.061059 21001 raft_consensus.cc:2272] T ef17503e5d4343a8a3bd382a33be8508 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.063328 28295 consensus_peers.cc:597] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.064703 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.065547 21001 raft_consensus.cc:2243] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.066054 21001 raft_consensus.cc:2272] T 819e4cfb61d7498f997e955c8d2cc490 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.066555 28147 consensus_peers.cc:597] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.068377 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.069136 21001 raft_consensus.cc:2243] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.069847 21001 raft_consensus.cc:2272] T ca0b8ae0f3f4484081fbdb57587fbac2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.071847 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.072440 21001 raft_consensus.cc:2243] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.072860 21001 raft_consensus.cc:2272] T 21657d67f652457cb8eef62fd181935f P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.075266 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.076042 21001 raft_consensus.cc:2243] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.076727 21001 raft_consensus.cc:2272] T 5e6b2213d1624e8ab60743daffa01749 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.079121 28221 consensus_peers.cc:597] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.078266 28147 consensus_peers.cc:597] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.079761 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.080394 21001 raft_consensus.cc:2243] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.080840 21001 raft_consensus.cc:2272] T 8ddfe000e4a34d3e988447d289961873 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.082291 28147 consensus_peers.cc:597] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.083392 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.084571 21001 raft_consensus.cc:2243] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.085134 21001 raft_consensus.cc:2272] T 87613dbe33ad4d7da42e38250a2d9c5e P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.088034 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.088657 21001 raft_consensus.cc:2243] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.089066 21001 raft_consensus.cc:2272] T 9d3cddbcf51c4690badc33c2cd58e0aa P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.092053 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.092947 21001 raft_consensus.cc:2243] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.093566 21001 raft_consensus.cc:2272] T e60c507c906b4393aac2708e46f9bade P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.096760 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.097703 21001 raft_consensus.cc:2243] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.098520 21001 raft_consensus.cc:2272] T 8d4a4fa897ce40ed86eb46b892297b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.101030 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.101682 21001 raft_consensus.cc:2243] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.102439 21001 raft_consensus.cc:2272] T ef7f29ee868b4774be667c0c3791aa0d P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.104656 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.105401 21001 raft_consensus.cc:2243] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.105822 21001 raft_consensus.cc:2272] T 213cfac76ce044dea3c787992d09120a P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.108322 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.109124 21001 raft_consensus.cc:2243] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.110101 21001 raft_consensus.cc:2272] T 7d2012efcebb4e8d9dc7839fdb5927fb P 7d2bb5df3b55462682d0f2fce57709f1 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.112255 28221 consensus_peers.cc:597] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.112987 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.113708 21001 raft_consensus.cc:2243] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.114444 21001 raft_consensus.cc:2272] T 8ec0b05c6a554a24a2576d6308dd6861 P 7d2bb5df3b55462682d0f2fce57709f1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.117290 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.117965 21001 raft_consensus.cc:2243] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.118461 21001 raft_consensus.cc:2272] T ddbdcf3655d24af7b91441e5b9029d33 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.119772 28221 consensus_peers.cc:597] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.121241 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.122108 21001 raft_consensus.cc:2243] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.123001 21001 raft_consensus.cc:2272] T 1112009449724fb880c6bfbb99c54b3a P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.125082 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.125648 21001 raft_consensus.cc:2243] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.126053 21001 raft_consensus.cc:2272] T 54d36af7735d4ca5bd3119a4f8411e18 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.128085 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.128657 21001 raft_consensus.cc:2243] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.129048 21001 raft_consensus.cc:2272] T 452dc71d60db4a3f9c0b98d246bfc818 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.130990 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.131560 21001 raft_consensus.cc:2243] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.132272 21001 raft_consensus.cc:2272] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.134368 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.135043 21001 raft_consensus.cc:2243] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.135623 21001 raft_consensus.cc:2272] T f6fcb865684d406f879509172e8279ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.138427 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.139245 21001 raft_consensus.cc:2243] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:09:16.139411 28147 consensus_peers.cc:597] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.140199 28295 consensus_peers.cc:597] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.140228 21001 raft_consensus.cc:2272] T 311b4ef735894403b3e8fccbe834bd77 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.141559 28295 consensus_peers.cc:597] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.143011 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.143769 21001 raft_consensus.cc:2243] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:09:16.144637 28147 consensus_peers.cc:597] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.144704 21001 raft_consensus.cc:2272] T 9c25595e441a47e5bb6f0f694cb3eed9 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.148068 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.148963 21001 raft_consensus.cc:2243] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.149531 21001 raft_consensus.cc:2272] T 6ccac4bb40d14b6ead1be9a53f6189cd P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.152240 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.152794 21001 raft_consensus.cc:2243] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.153225 21001 raft_consensus.cc:2272] T 5f13ee4d444e404288a43a09599419be P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.155262 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.155788 21001 raft_consensus.cc:2243] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.156212 21001 raft_consensus.cc:2272] T 3ed08161191348c6ba309a4b9338bb75 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.158829 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.159591 21001 raft_consensus.cc:2243] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.160094 21001 raft_consensus.cc:2272] T 7084d0da22fc408c861229f3e9cbdb94 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.162735 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.163435 21001 raft_consensus.cc:2243] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.163899 21001 raft_consensus.cc:2272] T 17113c03409f4c19ae665da8835dc3b2 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.166455 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.167191 21001 raft_consensus.cc:2243] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.167685 21001 raft_consensus.cc:2272] T c9ea6103de0047339ed0e7e5d460ee53 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.170327 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.171099 21001 raft_consensus.cc:2243] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.171638 21001 raft_consensus.cc:2272] T 64545454d8c2457bb4b0837f80555b00 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.173918 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.174459 21001 raft_consensus.cc:2243] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.174908 21001 raft_consensus.cc:2272] T a7aff2f54c384028a34db3b71d560967 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.176858 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.177326 21001 raft_consensus.cc:2243] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.177646 21001 raft_consensus.cc:2272] T b594683784854e99994376f255918d99 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.179347 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.179793 21001 raft_consensus.cc:2243] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.180109 21001 raft_consensus.cc:2272] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.182138 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.182664 21001 raft_consensus.cc:2243] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.183525 21001 raft_consensus.cc:2272] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.186203 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.186910 21001 raft_consensus.cc:2243] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.187434 21001 raft_consensus.cc:2272] T f0d5182347b142749bd1d50ce09224a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.189324 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.189873 21001 raft_consensus.cc:2243] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.190299 21001 raft_consensus.cc:2272] T 77c8f62c26f74f9e82cb8f53544e0b2c P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.192198 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.192715 21001 raft_consensus.cc:2243] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.193475 21001 raft_consensus.cc:2272] T 337d2a0753f34dd08c1b1eb5e708d7ff P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.197228 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.197983 21001 raft_consensus.cc:2243] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.198905 21001 raft_consensus.cc:2272] T 846616843e7743a6a799541dd5ea10fd P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.200366 28295 consensus_peers.cc:597] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.202025 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.202608 21001 raft_consensus.cc:2243] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.203039 21001 raft_consensus.cc:2272] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.205054 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.205605 21001 raft_consensus.cc:2243] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.205987 21001 raft_consensus.cc:2272] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.208624 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.209316 21001 raft_consensus.cc:2243] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.209800 21001 raft_consensus.cc:2272] T 2d5af1d945a248cabc1f6f5dbddc6098 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.212718 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.213418 21001 raft_consensus.cc:2243] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.213842 21001 raft_consensus.cc:2272] T 611bd39403164ea08b13d40dbc3c05a8 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.216445 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.217173 21001 raft_consensus.cc:2243] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.217703 21001 raft_consensus.cc:2272] T 8778ebb28d774473bbe1042cbb1c6721 P 7d2bb5df3b55462682d0f2fce57709f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.220494 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.221096 21001 raft_consensus.cc:2243] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.222007 21001 raft_consensus.cc:2272] T f776edf45fe042b994923a680048889b P 7d2bb5df3b55462682d0f2fce57709f1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.224879 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:16.225481 21001 raft_consensus.cc:2243] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.225916 21001 raft_consensus.cc:2272] T 8ec1905dc240442ab4df69ac1951ce28 P 7d2bb5df3b55462682d0f2fce57709f1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.235168 28221 consensus_peers.cc:597] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.298506 21001 tablet_server.cc:196] TabletServer@127.20.130.65:34859 shutdown complete.
W20260709 13:09:16.312073 28295 consensus_peers.cc:597] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.321110 28147 consensus_peers.cc:597] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.345129 28295 consensus_peers.cc:597] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.361929 28147 consensus_peers.cc:597] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.372367 28147 consensus_peers.cc:597] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.372812 28147 consensus_peers.cc:597] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.381049 21001 tablet_server.cc:179] TabletServer@127.20.130.66:0 shutting down...
W20260709 13:09:16.406416 28295 consensus_peers.cc:597] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.429759 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:09:16.429982 28223 consensus_peers.cc:597] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.437865 28295 consensus_peers.cc:597] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.439158 21001 tablet_replica.cc:333] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.440167 21001 raft_consensus.cc:2243] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.440768 21001 raft_consensus.cc:2272] T 8c732366d5f34a4b98ac0508c4b7ef10 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.443296 21001 tablet_replica.cc:333] T 09d32680280443ecb859c6deb72a5cc3 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.444065 21001 raft_consensus.cc:2243] T 09d32680280443ecb859c6deb72a5cc3 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.444494 21001 raft_consensus.cc:2272] T 09d32680280443ecb859c6deb72a5cc3 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.445763 28221 consensus_peers.cc:597] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.446583 21001 tablet_replica.cc:333] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.447414 21001 raft_consensus.cc:2243] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.447774 21001 raft_consensus.cc:2272] T c9ea6103de0047339ed0e7e5d460ee53 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.450340 21001 tablet_replica.cc:333] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.451110 21001 raft_consensus.cc:2243] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.452173 21001 raft_consensus.cc:2272] T 8ec1905dc240442ab4df69ac1951ce28 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.455017 21001 tablet_replica.cc:333] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.455721 21001 raft_consensus.cc:2243] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.456674 21001 raft_consensus.cc:2272] T 8778ebb28d774473bbe1042cbb1c6721 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.459291 21001 tablet_replica.cc:333] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.459986 21001 raft_consensus.cc:2243] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.460997 21001 raft_consensus.cc:2272] T 8ddfe000e4a34d3e988447d289961873 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.463059 21001 tablet_replica.cc:333] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.463546 21001 raft_consensus.cc:2243] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.463956 21001 raft_consensus.cc:2272] T 7d2012efcebb4e8d9dc7839fdb5927fb P 8938bce1e7864c1ab26755f60f708368 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.465925 21001 tablet_replica.cc:333] T e4e2fa350a754b899e6ce07a88e62ba5 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.466668 21001 raft_consensus.cc:2243] T e4e2fa350a754b899e6ce07a88e62ba5 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.467254 21001 raft_consensus.cc:2272] T e4e2fa350a754b899e6ce07a88e62ba5 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.469833 21001 tablet_replica.cc:333] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.470482 21001 raft_consensus.cc:2243] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.470901 21001 raft_consensus.cc:2272] T e60c507c906b4393aac2708e46f9bade P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.472155 28297 consensus_peers.cc:597] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.473464 21001 tablet_replica.cc:333] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.474291 21001 raft_consensus.cc:2243] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.474807 21001 raft_consensus.cc:2272] T 8d4a4fa897ce40ed86eb46b892297b2c P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.477016 21001 tablet_replica.cc:333] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.477667 21001 raft_consensus.cc:2243] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.478138 21001 raft_consensus.cc:2272] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.480608 21001 tablet_replica.cc:333] T b594683784854e99994376f255918d99 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
W20260709 13:09:16.481302 28297 consensus_peers.cc:597] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.481345 21001 raft_consensus.cc:2243] T b594683784854e99994376f255918d99 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.482081 21001 raft_consensus.cc:2272] T b594683784854e99994376f255918d99 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.484074 21001 tablet_replica.cc:333] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.484619 21001 raft_consensus.cc:2243] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.485011 21001 raft_consensus.cc:2272] T 0ebe992abe014550bcd49e684e26c59f P 8938bce1e7864c1ab26755f60f708368 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.487077 21001 tablet_replica.cc:333] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.487735 21001 raft_consensus.cc:2243] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.488562 21001 raft_consensus.cc:2272] T 18c5064efb8c493c8abc76212d9eaf59 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.489586 28297 consensus_peers.cc:597] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.490716 21001 tablet_replica.cc:333] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.491338 21001 raft_consensus.cc:2243] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.492035 21001 raft_consensus.cc:2272] T 44fffb1e4048464bbca5a6415161d48c P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.493872 21001 tablet_replica.cc:333] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.494385 21001 raft_consensus.cc:2243] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.495111 21001 raft_consensus.cc:2272] T 9d3cddbcf51c4690badc33c2cd58e0aa P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.497135 21001 tablet_replica.cc:333] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.497613 21001 raft_consensus.cc:2243] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.497980 21001 raft_consensus.cc:2272] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.499789 21001 tablet_replica.cc:333] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.500278 21001 raft_consensus.cc:2243] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.501034 21001 raft_consensus.cc:2272] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.503546 21001 tablet_replica.cc:333] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.504290 21001 raft_consensus.cc:2243] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.504767 21001 raft_consensus.cc:2272] T 483dc2ac5ecf492087dcef4c6fa1770c P 8938bce1e7864c1ab26755f60f708368 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.506124 28221 consensus_peers.cc:597] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.506635 28221 consensus_peers.cc:597] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.507089 21001 tablet_replica.cc:333] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.507671 21001 raft_consensus.cc:2243] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.508390 21001 raft_consensus.cc:2272] T 6ccac4bb40d14b6ead1be9a53f6189cd P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.510978 21001 tablet_replica.cc:333] T 70fb7c326e6d4798b42697699d03ba70 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.511808 21001 raft_consensus.cc:2243] T 70fb7c326e6d4798b42697699d03ba70 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.512296 21001 raft_consensus.cc:2272] T 70fb7c326e6d4798b42697699d03ba70 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.514250 28297 consensus_peers.cc:597] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.514282 21001 tablet_replica.cc:333] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.515102 21001 raft_consensus.cc:2243] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.515549 21001 raft_consensus.cc:2272] T 311b4ef735894403b3e8fccbe834bd77 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.517323 21001 tablet_replica.cc:333] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.517987 21001 raft_consensus.cc:2243] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.518509 21001 raft_consensus.cc:2272] T a7aff2f54c384028a34db3b71d560967 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.521011 21001 tablet_replica.cc:333] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.521662 21001 raft_consensus.cc:2243] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.522176 21001 raft_consensus.cc:2272] T 35580b937e5c492e9ad0e2bcaa176e96 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.522661 28147 consensus_peers.cc:597] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.524457 21001 tablet_replica.cc:333] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.525389 21001 raft_consensus.cc:2243] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.526443 21001 raft_consensus.cc:2272] T f0d5182347b142749bd1d50ce09224a8 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.528371 28223 consensus_peers.cc:597] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.529433 21001 tablet_replica.cc:333] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
W20260709 13:09:16.529932 28223 consensus_peers.cc:597] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.530304 21001 raft_consensus.cc:2243] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.530846 21001 raft_consensus.cc:2272] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.533337 21001 tablet_replica.cc:333] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.534113 21001 raft_consensus.cc:2243] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.534548 21001 raft_consensus.cc:2272] T 337d2a0753f34dd08c1b1eb5e708d7ff P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.537041 21001 tablet_replica.cc:333] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.537786 21001 raft_consensus.cc:2243] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:16.537880 28223 consensus_peers.cc:597] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.538403 21001 raft_consensus.cc:2272] T 77c8f62c26f74f9e82cb8f53544e0b2c P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.540956 21001 tablet_replica.cc:333] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.541675 21001 raft_consensus.cc:2243] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.542176 21001 raft_consensus.cc:2272] T 846616843e7743a6a799541dd5ea10fd P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.542429 28147 consensus_peers.cc:597] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.544230 28221 consensus_peers.cc:597] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.545003 21001 tablet_replica.cc:333] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.545595 21001 raft_consensus.cc:2243] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.546006 21001 raft_consensus.cc:2272] T 1112009449724fb880c6bfbb99c54b3a P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.548323 21001 tablet_replica.cc:333] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.549240 21001 raft_consensus.cc:2243] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.549755 21001 raft_consensus.cc:2272] T 54d36af7735d4ca5bd3119a4f8411e18 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.552150 21001 tablet_replica.cc:333] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.552716 21001 raft_consensus.cc:2243] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.553157 21001 raft_consensus.cc:2272] T f6fcb865684d406f879509172e8279ff P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.555047 21001 tablet_replica.cc:333] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.555557 21001 raft_consensus.cc:2243] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.556349 21001 raft_consensus.cc:2272] T 5e6b2213d1624e8ab60743daffa01749 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.558266 21001 tablet_replica.cc:333] T 2b08edfd918443739d94d5586ac7a46b P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.558784 21001 raft_consensus.cc:2243] T 2b08edfd918443739d94d5586ac7a46b P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.559235 21001 raft_consensus.cc:2272] T 2b08edfd918443739d94d5586ac7a46b P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.561264 21001 tablet_replica.cc:333] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.561791 21001 raft_consensus.cc:2243] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.562197 21001 raft_consensus.cc:2272] T 5ac04c15a2dc474b8def84d7d597afe1 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.564273 21001 tablet_replica.cc:333] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.564787 21001 raft_consensus.cc:2243] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.565178 21001 raft_consensus.cc:2272] T d920220c89994ca1bd5a7d4fcc7c7e10 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.567863 21001 tablet_replica.cc:333] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.568528 21001 raft_consensus.cc:2243] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.569418 21001 raft_consensus.cc:2272] T ef17503e5d4343a8a3bd382a33be8508 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.571401 21001 tablet_replica.cc:333] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.571862 21001 raft_consensus.cc:2243] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.572546 21001 raft_consensus.cc:2272] T 7084d0da22fc408c861229f3e9cbdb94 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.574618 21001 tablet_replica.cc:333] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.575174 21001 raft_consensus.cc:2243] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.576103 21001 raft_consensus.cc:2272] T 5f13ee4d444e404288a43a09599419be P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.577857 28221 consensus_peers.cc:597] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Couldn't send request to peer 7d2bb5df3b55462682d0f2fce57709f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.578395 21001 tablet_replica.cc:333] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.579010 21001 raft_consensus.cc:2243] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.579805 21001 raft_consensus.cc:2272] T 2d5af1d945a248cabc1f6f5dbddc6098 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.581991 21001 tablet_replica.cc:333] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.582489 21001 raft_consensus.cc:2243] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.583256 21001 raft_consensus.cc:2272] T 611bd39403164ea08b13d40dbc3c05a8 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.585522 21001 tablet_replica.cc:333] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.586050 21001 raft_consensus.cc:2243] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.586532 21001 raft_consensus.cc:2272] T 3958573ac72b4113b6cb6ee2303db8f9 P 8938bce1e7864c1ab26755f60f708368 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.587702 28223 consensus_peers.cc:597] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.589480 21001 tablet_replica.cc:333] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.590242 21001 raft_consensus.cc:2243] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.590783 21001 raft_consensus.cc:2272] T 819e4cfb61d7498f997e955c8d2cc490 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.592341 28223 consensus_peers.cc:597] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.593437 21001 tablet_replica.cc:333] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368: stopping tablet replica
I20260709 13:09:16.594054 21001 raft_consensus.cc:2243] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.594535 21001 raft_consensus.cc:2272] T ca0b8ae0f3f4484081fbdb57587fbac2 P 8938bce1e7864c1ab26755f60f708368 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.604506 28297 consensus_peers.cc:597] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.619668 28223 consensus_peers.cc:597] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.620617 28223 consensus_peers.cc:597] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.646626 28297 consensus_peers.cc:597] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.648182 28297 consensus_peers.cc:597] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.675985 28297 consensus_peers.cc:597] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:34231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.676877 28223 consensus_peers.cc:597] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:34231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.685839 21001 tablet_server.cc:196] TabletServer@127.20.130.66:0 shutdown complete.
W20260709 13:09:16.686584 28223 consensus_peers.cc:597] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:34231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.707942 28297 consensus_peers.cc:597] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:34231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.759040 21001 tablet_server.cc:179] TabletServer@127.20.130.67:0 shutting down...
W20260709 13:09:16.764896 28297 consensus_peers.cc:597] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 -> Peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Couldn't send request to peer cd66bd010fa04c4c8d0a668a77bd4c6d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.798976 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:16.800129 21001 tablet_replica.cc:333] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.801155 21001 raft_consensus.cc:2243] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.802531 21001 raft_consensus.cc:2272] T 8c732366d5f34a4b98ac0508c4b7ef10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.805528 21001 tablet_replica.cc:333] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.806318 21001 raft_consensus.cc:2243] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.806845 21001 raft_consensus.cc:2272] T 1568c5c6e6a5495fa8c5550c03721b67 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.809638 21001 tablet_replica.cc:333] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.810353 21001 raft_consensus.cc:2243] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.811419 21001 raft_consensus.cc:2272] T c9ea6103de0047339ed0e7e5d460ee53 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.813963 21001 tablet_replica.cc:333] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.814579 21001 raft_consensus.cc:2243] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.814967 21001 raft_consensus.cc:2272] T f776edf45fe042b994923a680048889b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.817104 21001 tablet_replica.cc:333] T 09d32680280443ecb859c6deb72a5cc3 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.817845 21001 raft_consensus.cc:2243] T 09d32680280443ecb859c6deb72a5cc3 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.818317 21001 raft_consensus.cc:2272] T 09d32680280443ecb859c6deb72a5cc3 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.820827 21001 tablet_replica.cc:333] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.821885 21001 raft_consensus.cc:2243] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.822382 21001 raft_consensus.cc:2272] T 8ddfe000e4a34d3e988447d289961873 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.824791 21001 tablet_replica.cc:333] T 87613dbe33ad4d7da42e38250a2d9c5e P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.825358 21001 raft_consensus.cc:2243] T 87613dbe33ad4d7da42e38250a2d9c5e P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.825770 21001 raft_consensus.cc:2272] T 87613dbe33ad4d7da42e38250a2d9c5e P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.827790 21001 tablet_replica.cc:333] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.828326 21001 raft_consensus.cc:2243] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.829070 21001 raft_consensus.cc:2272] T e4e2fa350a754b899e6ce07a88e62ba5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.830957 21001 tablet_replica.cc:333] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.831501 21001 raft_consensus.cc:2243] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.831907 21001 raft_consensus.cc:2272] T 9c25595e441a47e5bb6f0f694cb3eed9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.833580 21001 tablet_replica.cc:333] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.834105 21001 raft_consensus.cc:2243] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.834841 21001 raft_consensus.cc:2272] T e60c507c906b4393aac2708e46f9bade P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.836805 21001 tablet_replica.cc:333] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.837319 21001 raft_consensus.cc:2243] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.837714 21001 raft_consensus.cc:2272] T 8d4a4fa897ce40ed86eb46b892297b2c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.839468 21001 tablet_replica.cc:333] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.840023 21001 raft_consensus.cc:2243] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.840770 21001 raft_consensus.cc:2272] T 21657d67f652457cb8eef62fd181935f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.842504 21001 tablet_replica.cc:333] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.843094 21001 raft_consensus.cc:2243] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.843473 21001 raft_consensus.cc:2272] T 0ebe992abe014550bcd49e684e26c59f P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.845168 21001 tablet_replica.cc:333] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.845993 21001 raft_consensus.cc:2243] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.846554 21001 raft_consensus.cc:2272] T 18c5064efb8c493c8abc76212d9eaf59 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.848649 21001 tablet_replica.cc:333] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.849380 21001 raft_consensus.cc:2243] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.849778 21001 raft_consensus.cc:2272] T 44fffb1e4048464bbca5a6415161d48c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.850685 28297 consensus_peers.cc:597] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 -> Peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Couldn't send request to peer cd66bd010fa04c4c8d0a668a77bd4c6d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.851950 21001 tablet_replica.cc:333] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.852653 21001 raft_consensus.cc:2243] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.853543 21001 raft_consensus.cc:2272] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.855688 21001 tablet_replica.cc:333] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.856271 21001 raft_consensus.cc:2243] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.857059 21001 raft_consensus.cc:2272] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.859221 21001 tablet_replica.cc:333] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.859804 21001 raft_consensus.cc:2243] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.860690 21001 raft_consensus.cc:2272] T b594683784854e99994376f255918d99 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.862669 21001 tablet_replica.cc:333] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.863269 21001 raft_consensus.cc:2243] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.863690 21001 raft_consensus.cc:2272] T ef7f29ee868b4774be667c0c3791aa0d P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.865592 21001 tablet_replica.cc:333] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.866181 21001 raft_consensus.cc:2243] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.866624 21001 raft_consensus.cc:2272] T 611bd39403164ea08b13d40dbc3c05a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.868580 21001 tablet_replica.cc:333] T 3958573ac72b4113b6cb6ee2303db8f9 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.869159 21001 raft_consensus.cc:2243] T 3958573ac72b4113b6cb6ee2303db8f9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.869594 21001 raft_consensus.cc:2272] T 3958573ac72b4113b6cb6ee2303db8f9 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.871675 21001 tablet_replica.cc:333] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.872272 21001 raft_consensus.cc:2243] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.873128 21001 raft_consensus.cc:2272] T 64545454d8c2457bb4b0837f80555b00 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.875265 21001 tablet_replica.cc:333] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.875872 21001 raft_consensus.cc:2243] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.876641 21001 raft_consensus.cc:2272] T 35580b937e5c492e9ad0e2bcaa176e96 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.878778 21001 tablet_replica.cc:333] T f0d5182347b142749bd1d50ce09224a8 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.879441 21001 raft_consensus.cc:2243] T f0d5182347b142749bd1d50ce09224a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.879889 21001 raft_consensus.cc:2272] T f0d5182347b142749bd1d50ce09224a8 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.881880 21001 tablet_replica.cc:333] T 6ccac4bb40d14b6ead1be9a53f6189cd P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.882459 21001 raft_consensus.cc:2243] T 6ccac4bb40d14b6ead1be9a53f6189cd P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.882956 21001 raft_consensus.cc:2272] T 6ccac4bb40d14b6ead1be9a53f6189cd P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.884925 21001 tablet_replica.cc:333] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.885478 21001 raft_consensus.cc:2243] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.885905 21001 raft_consensus.cc:2272] T 5ff6fe3b72cb46e6bbdbea8e0f38cba7 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.888725 21001 tablet_replica.cc:333] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.889588 21001 raft_consensus.cc:2243] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.890137 21001 raft_consensus.cc:2272] T 483dc2ac5ecf492087dcef4c6fa1770c P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.892778 21001 tablet_replica.cc:333] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.893612 21001 raft_consensus.cc:2243] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.894164 21001 raft_consensus.cc:2272] T 452dc71d60db4a3f9c0b98d246bfc818 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.896910 28297 consensus_peers.cc:597] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 -> Peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Couldn't send request to peer cd66bd010fa04c4c8d0a668a77bd4c6d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.897131 21001 tablet_replica.cc:333] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.897840 21001 raft_consensus.cc:2243] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.898811 21001 raft_consensus.cc:2272] T f6fcb865684d406f879509172e8279ff P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.901705 21001 tablet_replica.cc:333] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.902478 21001 raft_consensus.cc:2243] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.903045 21001 raft_consensus.cc:2272] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.905138 21001 tablet_replica.cc:333] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.905750 21001 raft_consensus.cc:2243] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.906309 21001 raft_consensus.cc:2272] T d920220c89994ca1bd5a7d4fcc7c7e10 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.908841 21001 tablet_replica.cc:333] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.909456 21001 raft_consensus.cc:2243] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:09:16.910104 28297 consensus_peers.cc:597] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 -> Peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Couldn't send request to peer cd66bd010fa04c4c8d0a668a77bd4c6d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.910250 21001 raft_consensus.cc:2272] T 2b08edfd918443739d94d5586ac7a46b P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.912717 21001 tablet_replica.cc:333] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.913411 21001 raft_consensus.cc:2243] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.913930 21001 raft_consensus.cc:2272] T 5ac04c15a2dc474b8def84d7d597afe1 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.916620 21001 tablet_replica.cc:333] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.917240 21001 raft_consensus.cc:2243] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:16.917501 28297 consensus_peers.cc:597] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 -> Peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Couldn't send request to peer 8938bce1e7864c1ab26755f60f708368. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:34231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.917917 21001 raft_consensus.cc:2272] T ef17503e5d4343a8a3bd382a33be8508 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.920444 21001 tablet_replica.cc:333] T 17113c03409f4c19ae665da8835dc3b2 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.921006 21001 raft_consensus.cc:2243] T 17113c03409f4c19ae665da8835dc3b2 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.921496 21001 raft_consensus.cc:2272] T 17113c03409f4c19ae665da8835dc3b2 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.923488 21001 tablet_replica.cc:333] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.924033 21001 raft_consensus.cc:2243] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.924428 21001 raft_consensus.cc:2272] T 3ed08161191348c6ba309a4b9338bb75 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.926383 21001 tablet_replica.cc:333] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.926913 21001 raft_consensus.cc:2243] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.927425 21001 raft_consensus.cc:2272] T 5f13ee4d444e404288a43a09599419be P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.929538 21001 tablet_replica.cc:333] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.929988 21001 raft_consensus.cc:2243] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.930333 21001 raft_consensus.cc:2272] T 7d2012efcebb4e8d9dc7839fdb5927fb P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.932142 21001 tablet_replica.cc:333] T 213cfac76ce044dea3c787992d09120a P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.932592 21001 raft_consensus.cc:2243] T 213cfac76ce044dea3c787992d09120a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.932933 21001 raft_consensus.cc:2272] T 213cfac76ce044dea3c787992d09120a P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.934589 21001 tablet_replica.cc:333] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.935138 21001 raft_consensus.cc:2243] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.935590 21001 raft_consensus.cc:2272] T 8ec0b05c6a554a24a2576d6308dd6861 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.937824 21001 tablet_replica.cc:333] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.938462 21001 raft_consensus.cc:2243] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.939376 21001 raft_consensus.cc:2272] T ddbdcf3655d24af7b91441e5b9029d33 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.941303 21001 tablet_replica.cc:333] T 5e6b2213d1624e8ab60743daffa01749 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.941764 21001 raft_consensus.cc:2243] T 5e6b2213d1624e8ab60743daffa01749 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.942160 21001 raft_consensus.cc:2272] T 5e6b2213d1624e8ab60743daffa01749 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.944131 21001 tablet_replica.cc:333] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.944576 21001 raft_consensus.cc:2243] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.945278 21001 raft_consensus.cc:2272] T 819e4cfb61d7498f997e955c8d2cc490 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.946995 21001 tablet_replica.cc:333] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d: stopping tablet replica
I20260709 13:09:16.947441 21001 raft_consensus.cc:2243] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.948163 21001 raft_consensus.cc:2272] T 70fb7c326e6d4798b42697699d03ba70 P cd66bd010fa04c4c8d0a668a77bd4c6d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.031534 28297 consensus_peers.cc:597] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 -> Peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Couldn't send request to peer cd66bd010fa04c4c8d0a668a77bd4c6d. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.67:41757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.070586 21001 tablet_server.cc:196] TabletServer@127.20.130.67:0 shutdown complete.
W20260709 13:09:17.073484 28297 consensus_peers.cc:597] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 -> Peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Couldn't send request to peer cd66bd010fa04c4c8d0a668a77bd4c6d. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.67:41757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.086406 29315 raft_consensus.cc:493] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:09:17.087105 29315 raft_consensus.cc:515] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:17.089810 29315 leader_election.cc:290] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
W20260709 13:09:17.094543 28297 leader_election.cc:336] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Network error: Client connection negotiation failed: client connection to 127.20.130.67:41757: connect: Connection refused (error 111)
W20260709 13:09:17.095280 28295 leader_election.cc:336] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:09:17.095712 28295 leader_election.cc:304] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:09:17.096477 29315 raft_consensus.cc:2749] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:17.114396 29315 raft_consensus.cc:493] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:09:17.115044 29315 raft_consensus.cc:515] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:17.117444 29315 leader_election.cc:290] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
W20260709 13:09:17.123775 28297 consensus_peers.cc:597] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 -> Peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Couldn't send request to peer cd66bd010fa04c4c8d0a668a77bd4c6d. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.67:41757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.124172 28295 leader_election.cc:336] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
W20260709 13:09:17.124923 28297 leader_election.cc:336] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Network error: Client connection negotiation failed: client connection to 127.20.130.66:34231: connect: Connection refused (error 111)
I20260709 13:09:17.125353 28297 leader_election.cc:304] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:09:17.126075 29315 raft_consensus.cc:2749] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:17.150262 21001 tablet_server.cc:179] TabletServer@127.20.130.68:0 shutting down...
W20260709 13:09:17.187484 28297 consensus_peers.cc:597] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 -> Peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Couldn't send request to peer cd66bd010fa04c4c8d0a668a77bd4c6d. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.67:41757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.188051 29270 raft_consensus.cc:493] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:09:17.188490 29270 raft_consensus.cc:515] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd66bd010fa04c4c8d0a668a77bd4c6d" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 41757 } } peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } }
I20260709 13:09:17.190356 29270 leader_election.cc:290] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757), 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859)
W20260709 13:09:17.194145 28297 leader_election.cc:336] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Network error: Client connection negotiation failed: client connection to 127.20.130.67:41757: connect: Connection refused (error 111)
W20260709 13:09:17.195672 28295 leader_election.cc:336] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:09:17.196174 28295 leader_election.cc:304] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, cd66bd010fa04c4c8d0a668a77bd4c6d
I20260709 13:09:17.196800 29270 raft_consensus.cc:2749] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:17.198135 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:17.198910 21001 tablet_replica.cc:333] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.199662 21001 raft_consensus.cc:2243] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.200117 21001 raft_consensus.cc:2272] T 1568c5c6e6a5495fa8c5550c03721b67 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.202401 21001 tablet_replica.cc:333] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.203081 21001 raft_consensus.cc:2243] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.203593 21001 raft_consensus.cc:2272] T 8c732366d5f34a4b98ac0508c4b7ef10 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.205745 28297 consensus_peers.cc:597] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 -> Peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Couldn't send request to peer cd66bd010fa04c4c8d0a668a77bd4c6d. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.67:41757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.205762 21001 tablet_replica.cc:333] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.206660 21001 raft_consensus.cc:2243] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.207500 21001 raft_consensus.cc:2272] T 09d32680280443ecb859c6deb72a5cc3 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.209488 21001 tablet_replica.cc:333] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.210112 21001 raft_consensus.cc:2243] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.210562 21001 raft_consensus.cc:2272] T 8ec1905dc240442ab4df69ac1951ce28 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.212775 21001 tablet_replica.cc:333] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.213394 21001 raft_consensus.cc:2243] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.213764 29270 raft_consensus.cc:493] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d2bb5df3b55462682d0f2fce57709f1)
I20260709 13:09:17.213948 21001 raft_consensus.cc:2272] T f776edf45fe042b994923a680048889b P 60d640828dc841619730621ec09d4c64 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.214412 29270 raft_consensus.cc:515] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d640828dc841619730621ec09d4c64" member_type: VOTER last_known_addr { host: "127.20.130.68" port: 46171 } } peers { permanent_uuid: "7d2bb5df3b55462682d0f2fce57709f1" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34859 } } peers { permanent_uuid: "8938bce1e7864c1ab26755f60f708368" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34231 } }
I20260709 13:09:17.216686 29270 leader_election.cc:290] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859), 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231)
I20260709 13:09:17.218052 21001 tablet_replica.cc:333] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.218962 21001 raft_consensus.cc:2243] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.219519 21001 raft_consensus.cc:2272] T 8778ebb28d774473bbe1042cbb1c6721 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.220029 28297 leader_election.cc:336] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8938bce1e7864c1ab26755f60f708368 (127.20.130.66:34231): Network error: Client connection negotiation failed: client connection to 127.20.130.66:34231: connect: Connection refused (error 111)
W20260709 13:09:17.220588 28295 leader_election.cc:336] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7d2bb5df3b55462682d0f2fce57709f1 (127.20.130.65:34859): Network error: Client connection negotiation failed: client connection to 127.20.130.65:34859: connect: Connection refused (error 111)
I20260709 13:09:17.220906 28295 leader_election.cc:304] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60d640828dc841619730621ec09d4c64; no voters: 7d2bb5df3b55462682d0f2fce57709f1, 8938bce1e7864c1ab26755f60f708368
I20260709 13:09:17.221472 29270 raft_consensus.cc:2749] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:17.221982 21001 tablet_replica.cc:333] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.222681 21001 raft_consensus.cc:2243] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.223206 21001 raft_consensus.cc:2272] T e4e2fa350a754b899e6ce07a88e62ba5 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.225862 21001 tablet_replica.cc:333] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.226692 21001 raft_consensus.cc:2243] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.227617 21001 raft_consensus.cc:2272] T 0ebe992abe014550bcd49e684e26c59f P 60d640828dc841619730621ec09d4c64 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.227617 28297 consensus_peers.cc:597] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 -> Peer cd66bd010fa04c4c8d0a668a77bd4c6d (127.20.130.67:41757): Couldn't send request to peer cd66bd010fa04c4c8d0a668a77bd4c6d. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.67:41757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.229702 21001 tablet_replica.cc:333] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.230245 21001 raft_consensus.cc:2243] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.230628 21001 raft_consensus.cc:2272] T 21657d67f652457cb8eef62fd181935f P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.232517 21001 tablet_replica.cc:333] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.233017 21001 raft_consensus.cc:2243] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.233371 21001 raft_consensus.cc:2272] T 18c5064efb8c493c8abc76212d9eaf59 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.235349 21001 tablet_replica.cc:333] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.235879 21001 raft_consensus.cc:2243] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.236277 21001 raft_consensus.cc:2272] T 44fffb1e4048464bbca5a6415161d48c P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.237991 21001 tablet_replica.cc:333] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.238579 21001 raft_consensus.cc:2243] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.239423 21001 raft_consensus.cc:2272] T 87613dbe33ad4d7da42e38250a2d9c5e P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.241135 21001 tablet_replica.cc:333] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.241674 21001 raft_consensus.cc:2243] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.242066 21001 raft_consensus.cc:2272] T 9d3cddbcf51c4690badc33c2cd58e0aa P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.243815 21001 tablet_replica.cc:333] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.244321 21001 raft_consensus.cc:2243] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.245013 21001 raft_consensus.cc:2272] T 8a8fd7e0c5ab432ba3165dca1ee9f151 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.246739 21001 tablet_replica.cc:333] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.247285 21001 raft_consensus.cc:2243] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.247970 21001 raft_consensus.cc:2272] T 483dc2ac5ecf492087dcef4c6fa1770c P 60d640828dc841619730621ec09d4c64 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.249940 21001 tablet_replica.cc:333] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.250560 21001 raft_consensus.cc:2243] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.251112 21001 raft_consensus.cc:2272] T 2d5af1d945a248cabc1f6f5dbddc6098 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.253293 21001 tablet_replica.cc:333] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.253849 21001 raft_consensus.cc:2243] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.254642 21001 raft_consensus.cc:2272] T 3958573ac72b4113b6cb6ee2303db8f9 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.256610 21001 tablet_replica.cc:333] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.257189 21001 raft_consensus.cc:2243] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.257705 21001 raft_consensus.cc:2272] T 337d2a0753f34dd08c1b1eb5e708d7ff P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.260170 21001 tablet_replica.cc:333] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.260778 21001 raft_consensus.cc:2243] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.261329 21001 raft_consensus.cc:2272] T 846616843e7743a6a799541dd5ea10fd P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.263345 21001 tablet_replica.cc:333] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.263845 21001 raft_consensus.cc:2243] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.264555 21001 raft_consensus.cc:2272] T 77c8f62c26f74f9e82cb8f53544e0b2c P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.266506 21001 tablet_replica.cc:333] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.267096 21001 raft_consensus.cc:2243] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.267513 21001 raft_consensus.cc:2272] T ef7f29ee868b4774be667c0c3791aa0d P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.269663 21001 tablet_replica.cc:333] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.270195 21001 raft_consensus.cc:2243] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.270995 21001 raft_consensus.cc:2272] T 452dc71d60db4a3f9c0b98d246bfc818 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.272769 21001 tablet_replica.cc:333] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.273283 21001 raft_consensus.cc:2243] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.274015 21001 raft_consensus.cc:2272] T 54d36af7735d4ca5bd3119a4f8411e18 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.275822 21001 tablet_replica.cc:333] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.276335 21001 raft_consensus.cc:2243] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.276719 21001 raft_consensus.cc:2272] T 1112009449724fb880c6bfbb99c54b3a P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.278399 21001 tablet_replica.cc:333] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.278982 21001 raft_consensus.cc:2243] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.279373 21001 raft_consensus.cc:2272] T 7b0c3ca5b68a47259dd1c2672f3e4b70 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.281086 21001 tablet_replica.cc:333] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.281632 21001 raft_consensus.cc:2243] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.282032 21001 raft_consensus.cc:2272] T 9c25595e441a47e5bb6f0f694cb3eed9 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.283910 21001 tablet_replica.cc:333] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.284422 21001 raft_consensus.cc:2243] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.284806 21001 raft_consensus.cc:2272] T 311b4ef735894403b3e8fccbe834bd77 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.286650 21001 tablet_replica.cc:333] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.287211 21001 raft_consensus.cc:2243] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.287945 21001 raft_consensus.cc:2272] T 213cfac76ce044dea3c787992d09120a P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.289871 21001 tablet_replica.cc:333] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.290380 21001 raft_consensus.cc:2243] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.290759 21001 raft_consensus.cc:2272] T 35580b937e5c492e9ad0e2bcaa176e96 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.292517 21001 tablet_replica.cc:333] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.293036 21001 raft_consensus.cc:2243] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.293773 21001 raft_consensus.cc:2272] T a7aff2f54c384028a34db3b71d560967 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.295755 21001 tablet_replica.cc:333] T 64545454d8c2457bb4b0837f80555b00 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.296299 21001 raft_consensus.cc:2243] T 64545454d8c2457bb4b0837f80555b00 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.296711 21001 raft_consensus.cc:2272] T 64545454d8c2457bb4b0837f80555b00 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.298666 21001 tablet_replica.cc:333] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.299207 21001 raft_consensus.cc:2243] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.299600 21001 raft_consensus.cc:2272] T ca0b8ae0f3f4484081fbdb57587fbac2 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.301397 21001 tablet_replica.cc:333] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.301905 21001 raft_consensus.cc:2243] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.302712 21001 raft_consensus.cc:2272] T 17113c03409f4c19ae665da8835dc3b2 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.304567 21001 tablet_replica.cc:333] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.305068 21001 raft_consensus.cc:2243] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.305455 21001 raft_consensus.cc:2272] T 7084d0da22fc408c861229f3e9cbdb94 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.307313 21001 tablet_replica.cc:333] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.307808 21001 raft_consensus.cc:2243] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.308550 21001 raft_consensus.cc:2272] T 3ed08161191348c6ba309a4b9338bb75 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.310496 21001 tablet_replica.cc:333] T 70fb7c326e6d4798b42697699d03ba70 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.311120 21001 raft_consensus.cc:2243] T 70fb7c326e6d4798b42697699d03ba70 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.311544 21001 raft_consensus.cc:2272] T 70fb7c326e6d4798b42697699d03ba70 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.313401 21001 tablet_replica.cc:333] T 2b08edfd918443739d94d5586ac7a46b P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.313898 21001 raft_consensus.cc:2243] T 2b08edfd918443739d94d5586ac7a46b P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.314296 21001 raft_consensus.cc:2272] T 2b08edfd918443739d94d5586ac7a46b P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.316169 21001 tablet_replica.cc:333] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.316628 21001 raft_consensus.cc:2243] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.317314 21001 raft_consensus.cc:2272] T 5ac04c15a2dc474b8def84d7d597afe1 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.319072 21001 tablet_replica.cc:333] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.319630 21001 raft_consensus.cc:2243] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.320055 21001 raft_consensus.cc:2272] T 0bf28c2ae4fd4bcdbcc0ebcf6090342a P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.321771 21001 tablet_replica.cc:333] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.322254 21001 raft_consensus.cc:2243] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.322647 21001 raft_consensus.cc:2272] T f8a4e5a2e05b4a11b13b756a9fcd11a5 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.324592 21001 tablet_replica.cc:333] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.325085 21001 raft_consensus.cc:2243] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.325780 21001 raft_consensus.cc:2272] T d920220c89994ca1bd5a7d4fcc7c7e10 P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.327585 21001 tablet_replica.cc:333] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.328053 21001 raft_consensus.cc:2243] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.328471 21001 raft_consensus.cc:2272] T 8ec0b05c6a554a24a2576d6308dd6861 P 60d640828dc841619730621ec09d4c64 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.330157 21001 tablet_replica.cc:333] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.330631 21001 raft_consensus.cc:2243] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.331032 21001 raft_consensus.cc:2272] T ddbdcf3655d24af7b91441e5b9029d33 P 60d640828dc841619730621ec09d4c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.332882 21001 tablet_replica.cc:333] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64: stopping tablet replica
I20260709 13:09:17.333317 21001 raft_consensus.cc:2243] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.333654 21001 raft_consensus.cc:2272] T b4bbaf9dd8a447f6bc1e1feeceb3008d P 60d640828dc841619730621ec09d4c64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.396911 21001 tablet_server.cc:196] TabletServer@127.20.130.68:0 shutdown complete.
I20260709 13:09:17.456535 21001 master.cc:562] Master@127.20.130.126:34867 shutting down...
I20260709 13:09:17.482475 21001 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.483130 21001 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.483479 21001 tablet_replica.cc:333] T 00000000000000000000000000000000 P f8d75479743548ee9e2bc9d589e05c73: stopping tablet replica
I20260709 13:09:17.505024 21001 master.cc:584] Master@127.20.130.126:34867 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (36364 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:09:17.599685 21001 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.130.126:46151
I20260709 13:09:17.601109 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:17.607640 29327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:17.607636 29326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:17.608629 29329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:17.609097 21001 server_base.cc:1061] running on GCE node
I20260709 13:09:17.610352 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:17.610556 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:17.610666 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602557610654 us; error 0 us; skew 500 ppm
I20260709 13:09:17.611292 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:17.615120 21001 webserver.cc:533] Webserver started at http://127.20.130.126:36831/ using document root <none> and password file <none>
I20260709 13:09:17.615938 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:17.616225 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:17.616609 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:17.618407 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/master-0-root/instance:
uuid: "8a0959435cd242008b58947fc65a39d7"
format_stamp: "Formatted at 2026-07-09 13:09:17 on dist-test-slave-csvd"
I20260709 13:09:17.627895 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:09:17.633543 29334 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:17.634646 21001 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:09:17.635145 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/master-0-root
uuid: "8a0959435cd242008b58947fc65a39d7"
format_stamp: "Formatted at 2026-07-09 13:09:17 on dist-test-slave-csvd"
I20260709 13:09:17.635679 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:17.655048 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:17.656385 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:17.699201 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.126:46151
I20260709 13:09:17.699327 29385 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.126:46151 every 8 connection(s)
I20260709 13:09:17.703720 29386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:17.720942 29386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7: Bootstrap starting.
I20260709 13:09:17.726511 29386 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.731316 29386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7: No bootstrap required, opened a new log
I20260709 13:09:17.733445 29386 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a0959435cd242008b58947fc65a39d7" member_type: VOTER }
I20260709 13:09:17.733831 29386 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.734014 29386 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a0959435cd242008b58947fc65a39d7, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.734601 29386 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a0959435cd242008b58947fc65a39d7" member_type: VOTER }
I20260709 13:09:17.735085 29386 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:17.735302 29386 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:17.735523 29386 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.740384 29386 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a0959435cd242008b58947fc65a39d7" member_type: VOTER }
I20260709 13:09:17.740880 29386 leader_election.cc:304] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a0959435cd242008b58947fc65a39d7; no voters: 
I20260709 13:09:17.741927 29386 leader_election.cc:290] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:17.742334 29389 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.743850 29389 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [term 1 LEADER]: Becoming Leader. State: Replica: 8a0959435cd242008b58947fc65a39d7, State: Running, Role: LEADER
I20260709 13:09:17.744576 29389 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a0959435cd242008b58947fc65a39d7" member_type: VOTER }
I20260709 13:09:17.745023 29386 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:17.749385 29391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a0959435cd242008b58947fc65a39d7. Latest consensus state: current_term: 1 leader_uuid: "8a0959435cd242008b58947fc65a39d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a0959435cd242008b58947fc65a39d7" member_type: VOTER } }
I20260709 13:09:17.750180 29391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:17.751250 29390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a0959435cd242008b58947fc65a39d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a0959435cd242008b58947fc65a39d7" member_type: VOTER } }
I20260709 13:09:17.751950 29390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:17.753302 29398 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:17.759725 29398 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:17.760869 21001 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:17.768594 29398 catalog_manager.cc:1383] Generated new cluster ID: 565b5e2fab234309aca08aeaf80c33a5
I20260709 13:09:17.768909 29398 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:17.786048 29398 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:17.787369 29398 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:17.800088 29398 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7: Generated new TSK 0
I20260709 13:09:17.800671 29398 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:17.827988 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:17.833995 29407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:17.834959 29408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:17.836594 29410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:17.836915 21001 server_base.cc:1061] running on GCE node
I20260709 13:09:17.837872 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:17.838044 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:17.838176 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602557838165 us; error 0 us; skew 500 ppm
I20260709 13:09:17.838780 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:17.841058 21001 webserver.cc:533] Webserver started at http://127.20.130.65:38673/ using document root <none> and password file <none>
I20260709 13:09:17.841549 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:17.841712 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:17.842032 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:17.843165 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-0-root/instance:
uuid: "7bc86c49419c4d8ea732431b6e796ad0"
format_stamp: "Formatted at 2026-07-09 13:09:17 on dist-test-slave-csvd"
I20260709 13:09:17.847777 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:17.851437 29415 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:17.852511 21001 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:09:17.852804 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-0-root
uuid: "7bc86c49419c4d8ea732431b6e796ad0"
format_stamp: "Formatted at 2026-07-09 13:09:17 on dist-test-slave-csvd"
I20260709 13:09:17.853070 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:17.872493 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:17.873806 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:17.875427 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:17.877780 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:17.878038 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:17.878283 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:17.878502 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:17.919548 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.65:40679
I20260709 13:09:17.919646 29477 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.65:40679 every 8 connection(s)
I20260709 13:09:17.924677 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:17.932324 29483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:17.933429 29482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:17.934940 29485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:17.935770 21001 server_base.cc:1061] running on GCE node
I20260709 13:09:17.937033 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:17.937363 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:17.937590 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602557937554 us; error 0 us; skew 500 ppm
I20260709 13:09:17.938246 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:17.941118 29478 heartbeater.cc:344] Connected to a master server at 127.20.130.126:46151
I20260709 13:09:17.941393 21001 webserver.cc:533] Webserver started at http://127.20.130.66:35897/ using document root <none> and password file <none>
I20260709 13:09:17.941488 29478 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:17.942080 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:17.942339 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:17.942454 29478 heartbeater.cc:507] Master 127.20.130.126:46151 requested a full tablet report, sending...
I20260709 13:09:17.942615 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:17.944195 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-1-root/instance:
uuid: "a0820165e71f4b2fb2d0803fad9fb420"
format_stamp: "Formatted at 2026-07-09 13:09:17 on dist-test-slave-csvd"
I20260709 13:09:17.944983 29351 ts_manager.cc:194] Registered new tserver with Master: 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679)
I20260709 13:09:17.946864 29351 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52982
I20260709 13:09:17.949164 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:17.952692 29490 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:17.953495 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:17.953912 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-1-root
uuid: "a0820165e71f4b2fb2d0803fad9fb420"
format_stamp: "Formatted at 2026-07-09 13:09:17 on dist-test-slave-csvd"
I20260709 13:09:17.954172 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:17.997295 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:17.998489 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:18.000029 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:18.002295 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:18.002489 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:18.002811 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:18.003005 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:09:18.045791 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.66:44953
I20260709 13:09:18.045955 29552 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.66:44953 every 8 connection(s)
I20260709 13:09:18.050860 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:18.059072 29557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:18.062350 29556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:18.063038 29553 heartbeater.cc:344] Connected to a master server at 127.20.130.126:46151
W20260709 13:09:18.063263 29559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:18.063568 29553 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:18.064096 21001 server_base.cc:1061] running on GCE node
I20260709 13:09:18.064548 29553 heartbeater.cc:507] Master 127.20.130.126:46151 requested a full tablet report, sending...
I20260709 13:09:18.065119 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:18.065426 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:18.065641 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602558065623 us; error 0 us; skew 500 ppm
I20260709 13:09:18.066288 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:18.066847 29351 ts_manager.cc:194] Registered new tserver with Master: a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:18.068467 29351 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52988
I20260709 13:09:18.069447 21001 webserver.cc:533] Webserver started at http://127.20.130.67:33217/ using document root <none> and password file <none>
I20260709 13:09:18.070057 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:18.070261 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:18.070559 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:18.071750 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-2-root/instance:
uuid: "3af434568070447aa4dd06f17b8ea841"
format_stamp: "Formatted at 2026-07-09 13:09:18 on dist-test-slave-csvd"
I20260709 13:09:18.076210 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:09:18.079357 29564 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:18.080117 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:09:18.080433 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-2-root
uuid: "3af434568070447aa4dd06f17b8ea841"
format_stamp: "Formatted at 2026-07-09 13:09:18 on dist-test-slave-csvd"
I20260709 13:09:18.080698 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:18.092500 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:18.093688 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:18.095183 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:18.097409 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:18.097584 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:18.097898 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:18.098057 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:18.138317 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.67:42797
I20260709 13:09:18.138401 29626 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.67:42797 every 8 connection(s)
I20260709 13:09:18.152225 29627 heartbeater.cc:344] Connected to a master server at 127.20.130.126:46151
I20260709 13:09:18.152633 29627 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:18.153362 29627 heartbeater.cc:507] Master 127.20.130.126:46151 requested a full tablet report, sending...
I20260709 13:09:18.155441 29351 ts_manager.cc:194] Registered new tserver with Master: 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:18.156343 21001 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014834959s
I20260709 13:09:18.157083 29351 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52996
I20260709 13:09:18.181548 29351 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53008:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:18.184657 29351 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:18.256124 29517 tablet_service.cc:1511] Processing CreateTablet for tablet 878d85a39a9640bebc225db5d1cfb600 (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:18.256584 29516 tablet_service.cc:1511] Processing CreateTablet for tablet 80b782e2a60c44d497a721f35b3f45a8 (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:18.257017 29515 tablet_service.cc:1511] Processing CreateTablet for tablet 20ada9e7ba6d45a39ffccd55f1bd310b (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:18.257733 29517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878d85a39a9640bebc225db5d1cfb600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.258441 29515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20ada9e7ba6d45a39ffccd55f1bd310b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.259032 29518 tablet_service.cc:1511] Processing CreateTablet for tablet edd50e3d325646bf966915acae27c417 (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:18.260332 29518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd50e3d325646bf966915acae27c417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.263926 29514 tablet_service.cc:1511] Processing CreateTablet for tablet c6ab67a572b540b7be34d85f34bae33b (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:18.265424 29514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ab67a572b540b7be34d85f34bae33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.267346 29516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b782e2a60c44d497a721f35b3f45a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.270872 29513 tablet_service.cc:1511] Processing CreateTablet for tablet 8d13ed1f707a49508d2dd7a042f780f8 (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:18.272338 29513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d13ed1f707a49508d2dd7a042f780f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.278965 29512 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8d8b8082f942cf8f4846210f267c6e (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:18.280946 29512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8d8b8082f942cf8f4846210f267c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.289146 29511 tablet_service.cc:1511] Processing CreateTablet for tablet 592d34c7b1ad4f07b5e1644ada89240e (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:18.293660 29510 tablet_service.cc:1511] Processing CreateTablet for tablet 4e83193f628a4bf19349124d2ab51a8d (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:18.295796 29511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 592d34c7b1ad4f07b5e1644ada89240e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.297474 29510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e83193f628a4bf19349124d2ab51a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.300778 29509 tablet_service.cc:1511] Processing CreateTablet for tablet c204a2926c364e87b8ef95e38eec369b (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:18.302227 29509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c204a2926c364e87b8ef95e38eec369b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.305939 29641 tablet_bootstrap.cc:492] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420: Bootstrap starting.
I20260709 13:09:18.340092 29442 tablet_service.cc:1511] Processing CreateTablet for tablet 878d85a39a9640bebc225db5d1cfb600 (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:18.341440 29442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878d85a39a9640bebc225db5d1cfb600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.344300 29436 tablet_service.cc:1511] Processing CreateTablet for tablet 592d34c7b1ad4f07b5e1644ada89240e (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:18.345235 29440 tablet_service.cc:1511] Processing CreateTablet for tablet 20ada9e7ba6d45a39ffccd55f1bd310b (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:18.345748 29436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 592d34c7b1ad4f07b5e1644ada89240e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.346342 29437 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8d8b8082f942cf8f4846210f267c6e (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:18.344322 29441 tablet_service.cc:1511] Processing CreateTablet for tablet 80b782e2a60c44d497a721f35b3f45a8 (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:18.346760 29440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20ada9e7ba6d45a39ffccd55f1bd310b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.348409 29439 tablet_service.cc:1511] Processing CreateTablet for tablet c6ab67a572b540b7be34d85f34bae33b (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:18.348803 29438 tablet_service.cc:1511] Processing CreateTablet for tablet 8d13ed1f707a49508d2dd7a042f780f8 (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:18.349825 29439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ab67a572b540b7be34d85f34bae33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.351511 29443 tablet_service.cc:1511] Processing CreateTablet for tablet edd50e3d325646bf966915acae27c417 (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:18.352257 29435 tablet_service.cc:1511] Processing CreateTablet for tablet 4e83193f628a4bf19349124d2ab51a8d (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:18.353744 29441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b782e2a60c44d497a721f35b3f45a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.354543 29443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd50e3d325646bf966915acae27c417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.355434 29435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e83193f628a4bf19349124d2ab51a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.354277 29434 tablet_service.cc:1511] Processing CreateTablet for tablet c204a2926c364e87b8ef95e38eec369b (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:18.356561 29434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c204a2926c364e87b8ef95e38eec369b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.357174 29438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d13ed1f707a49508d2dd7a042f780f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.359301 29437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8d8b8082f942cf8f4846210f267c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.364401 29592 tablet_service.cc:1511] Processing CreateTablet for tablet edd50e3d325646bf966915acae27c417 (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:18.366477 29592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd50e3d325646bf966915acae27c417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.368682 29591 tablet_service.cc:1511] Processing CreateTablet for tablet 878d85a39a9640bebc225db5d1cfb600 (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:18.370647 29591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878d85a39a9640bebc225db5d1cfb600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.388787 29590 tablet_service.cc:1511] Processing CreateTablet for tablet 80b782e2a60c44d497a721f35b3f45a8 (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:18.390476 29590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b782e2a60c44d497a721f35b3f45a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.401285 29589 tablet_service.cc:1511] Processing CreateTablet for tablet 20ada9e7ba6d45a39ffccd55f1bd310b (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:18.403556 29589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20ada9e7ba6d45a39ffccd55f1bd310b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.412873 29641 tablet_bootstrap.cc:654] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.413990 29588 tablet_service.cc:1511] Processing CreateTablet for tablet c6ab67a572b540b7be34d85f34bae33b (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:18.415616 29588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ab67a572b540b7be34d85f34bae33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.420156 29587 tablet_service.cc:1511] Processing CreateTablet for tablet 8d13ed1f707a49508d2dd7a042f780f8 (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:18.421669 29587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d13ed1f707a49508d2dd7a042f780f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.423141 29585 tablet_service.cc:1511] Processing CreateTablet for tablet 592d34c7b1ad4f07b5e1644ada89240e (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:18.425966 29586 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8d8b8082f942cf8f4846210f267c6e (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:18.427811 29583 tablet_service.cc:1511] Processing CreateTablet for tablet c204a2926c364e87b8ef95e38eec369b (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:18.428856 29584 tablet_service.cc:1511] Processing CreateTablet for tablet 4e83193f628a4bf19349124d2ab51a8d (DEFAULT_TABLE table=test-workload [id=199eb13731b14bc4a5efff5a8d8b3f20]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:18.439750 29586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8d8b8082f942cf8f4846210f267c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.455976 29585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 592d34c7b1ad4f07b5e1644ada89240e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.456844 29584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e83193f628a4bf19349124d2ab51a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.460130 29642 tablet_bootstrap.cc:492] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:18.460040 29644 tablet_bootstrap.cc:492] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841: Bootstrap starting.
I20260709 13:09:18.463824 29583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c204a2926c364e87b8ef95e38eec369b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.468338 29642 tablet_bootstrap.cc:654] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.480067 29644 tablet_bootstrap.cc:654] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.488444 29641 tablet_bootstrap.cc:492] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420: No bootstrap required, opened a new log
I20260709 13:09:18.489069 29641 ts_tablet_manager.cc:1403] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420: Time spent bootstrapping tablet: real 0.183s	user 0.008s	sys 0.008s
I20260709 13:09:18.495923 29641 raft_consensus.cc:359] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.496912 29641 raft_consensus.cc:385] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.497280 29641 raft_consensus.cc:740] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.511247 29641 consensus_queue.cc:260] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.521944 29647 raft_consensus.cc:493] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.522571 29647 raft_consensus.cc:515] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.523029 29644 tablet_bootstrap.cc:492] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841: No bootstrap required, opened a new log
I20260709 13:09:18.523034 29641 ts_tablet_manager.cc:1434] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.002s
I20260709 13:09:18.523680 29553 heartbeater.cc:499] Master 127.20.130.126:46151 was elected leader, sending a full tablet report...
I20260709 13:09:18.524292 29641 tablet_bootstrap.cc:492] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420: Bootstrap starting.
I20260709 13:09:18.523680 29644 ts_tablet_manager.cc:1403] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.009s
I20260709 13:09:18.529330 29647 leader_election.cc:290] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:18.531839 29641 tablet_bootstrap.cc:654] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.534391 29644 raft_consensus.cc:359] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.535255 29644 raft_consensus.cc:385] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.535586 29644 raft_consensus.cc:740] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.536098 29642 tablet_bootstrap.cc:492] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0: No bootstrap required, opened a new log
I20260709 13:09:18.542174 29642 ts_tablet_manager.cc:1403] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.026s
I20260709 13:09:18.547637 29641 tablet_bootstrap.cc:492] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420: No bootstrap required, opened a new log
I20260709 13:09:18.541600 29644 consensus_queue.cc:260] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.548425 29641 ts_tablet_manager.cc:1403] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.002s
W20260709 13:09:18.549940 29554 tablet.cc:2406] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:18.551283 29627 heartbeater.cc:499] Master 127.20.130.126:46151 was elected leader, sending a full tablet report...
I20260709 13:09:18.552641 29641 raft_consensus.cc:359] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.553469 29641 raft_consensus.cc:385] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.553762 29641 raft_consensus.cc:740] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.554497 29641 consensus_queue.cc:260] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.556507 29644 ts_tablet_manager.cc:1434] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.003s
I20260709 13:09:18.556869 29641 ts_tablet_manager.cc:1434] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:18.557682 29644 tablet_bootstrap.cc:492] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841: Bootstrap starting.
I20260709 13:09:18.558069 29641 tablet_bootstrap.cc:492] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420: Bootstrap starting.
I20260709 13:09:18.545374 29642 raft_consensus.cc:359] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.561580 29642 raft_consensus.cc:385] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.561966 29642 raft_consensus.cc:740] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.561702 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878d85a39a9640bebc225db5d1cfb600" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3af434568070447aa4dd06f17b8ea841" is_pre_election: true
I20260709 13:09:18.564639 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878d85a39a9640bebc225db5d1cfb600" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0" is_pre_election: true
I20260709 13:09:18.565510 29641 tablet_bootstrap.cc:654] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:18.566675 29494 leader_election.cc:343] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:18.567523 29494 leader_election.cc:343] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.567920 29494 leader_election.cc:304] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0820165e71f4b2fb2d0803fad9fb420; no voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0
I20260709 13:09:18.568639 29644 tablet_bootstrap.cc:654] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.568816 29647 raft_consensus.cc:2749] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:18.563136 29642 consensus_queue.cc:260] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.573868 29641 tablet_bootstrap.cc:492] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420: No bootstrap required, opened a new log
I20260709 13:09:18.574415 29644 tablet_bootstrap.cc:492] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841: No bootstrap required, opened a new log
I20260709 13:09:18.574414 29641 ts_tablet_manager.cc:1403] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:09:18.575033 29644 ts_tablet_manager.cc:1403] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:09:18.578380 29644 raft_consensus.cc:359] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.579221 29644 raft_consensus.cc:385] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.579528 29644 raft_consensus.cc:740] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.580096 29642 ts_tablet_manager.cc:1434] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:09:18.580307 29644 consensus_queue.cc:260] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.580935 29478 heartbeater.cc:499] Master 127.20.130.126:46151 was elected leader, sending a full tablet report...
I20260709 13:09:18.582551 29644 ts_tablet_manager.cc:1434] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:09:18.585049 29642 tablet_bootstrap.cc:492] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:18.585877 29644 tablet_bootstrap.cc:492] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841: Bootstrap starting.
I20260709 13:09:18.578225 29641 raft_consensus.cc:359] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.590032 29641 raft_consensus.cc:385] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.590427 29641 raft_consensus.cc:740] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.591295 29641 consensus_queue.cc:260] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.593007 29644 tablet_bootstrap.cc:654] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.593771 29641 ts_tablet_manager.cc:1434] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:09:18.594974 29641 tablet_bootstrap.cc:492] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420: Bootstrap starting.
I20260709 13:09:18.598618 29642 tablet_bootstrap.cc:654] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.600855 29644 tablet_bootstrap.cc:492] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841: No bootstrap required, opened a new log
I20260709 13:09:18.601418 29644 ts_tablet_manager.cc:1403] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:09:18.604971 29641 tablet_bootstrap.cc:654] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.605289 29644 raft_consensus.cc:359] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.606340 29644 raft_consensus.cc:385] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.606727 29644 raft_consensus.cc:740] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.607985 29644 consensus_queue.cc:260] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.611471 29644 ts_tablet_manager.cc:1434] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.004s
I20260709 13:09:18.612937 29644 tablet_bootstrap.cc:492] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841: Bootstrap starting.
I20260709 13:09:18.622236 29644 tablet_bootstrap.cc:654] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.622776 29642 tablet_bootstrap.cc:492] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0: No bootstrap required, opened a new log
I20260709 13:09:18.623158 29641 tablet_bootstrap.cc:492] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420: No bootstrap required, opened a new log
I20260709 13:09:18.623410 29642 ts_tablet_manager.cc:1403] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.010s
I20260709 13:09:18.623689 29641 ts_tablet_manager.cc:1403] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.012s
I20260709 13:09:18.626818 29641 raft_consensus.cc:359] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.627602 29641 raft_consensus.cc:385] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.627894 29641 raft_consensus.cc:740] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.628643 29641 consensus_queue.cc:260] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.630901 29641 ts_tablet_manager.cc:1434] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:18.630448 29642 raft_consensus.cc:359] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.631680 29642 raft_consensus.cc:385] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.631994 29641 tablet_bootstrap.cc:492] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420: Bootstrap starting.
I20260709 13:09:18.632186 29642 raft_consensus.cc:740] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.633560 29642 consensus_queue.cc:260] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.639408 29651 raft_consensus.cc:493] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.640026 29651 raft_consensus.cc:515] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.642647 29642 ts_tablet_manager.cc:1434] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 13:09:18.647213 29642 tablet_bootstrap.cc:492] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:18.651072 29651 leader_election.cc:290] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:18.652207 29641 tablet_bootstrap.cc:654] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.654064 29642 tablet_bootstrap.cc:654] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.661062 29647 raft_consensus.cc:493] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.661646 29647 raft_consensus.cc:515] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.666095 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e83193f628a4bf19349124d2ab51a8d" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0" is_pre_election: true
I20260709 13:09:18.666854 29452 raft_consensus.cc:2468] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 0.
I20260709 13:09:18.667912 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e83193f628a4bf19349124d2ab51a8d" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3af434568070447aa4dd06f17b8ea841" is_pre_election: true
I20260709 13:09:18.669139 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878d85a39a9640bebc225db5d1cfb600" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0" is_pre_election: true
I20260709 13:09:18.670403 29644 tablet_bootstrap.cc:492] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841: No bootstrap required, opened a new log
I20260709 13:09:18.670974 29644 ts_tablet_manager.cc:1403] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.020s
I20260709 13:09:18.671125 29494 leader_election.cc:304] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
W20260709 13:09:18.672079 29494 leader_election.cc:343] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.672171 29648 raft_consensus.cc:2804] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.672818 29648 raft_consensus.cc:493] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.673271 29648 raft_consensus.cc:3060] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:18.673432 29568 leader_election.cc:343] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.674268 29644 raft_consensus.cc:359] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.675079 29644 raft_consensus.cc:385] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.675361 29644 raft_consensus.cc:740] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.663771 29647 leader_election.cc:290] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:18.678653 29642 tablet_bootstrap.cc:492] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0: No bootstrap required, opened a new log
I20260709 13:09:18.679297 29642 ts_tablet_manager.cc:1403] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.004s
I20260709 13:09:18.680639 29644 consensus_queue.cc:260] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.681740 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878d85a39a9640bebc225db5d1cfb600" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420" is_pre_election: true
I20260709 13:09:18.682484 29528 raft_consensus.cc:2468] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 0.
I20260709 13:09:18.683192 29644 ts_tablet_manager.cc:1434] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:18.684307 29644 tablet_bootstrap.cc:492] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841: Bootstrap starting.
I20260709 13:09:18.685448 29648 raft_consensus.cc:515] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.684288 29565 leader_election.cc:304] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, a0820165e71f4b2fb2d0803fad9fb420; no voters: 7bc86c49419c4d8ea732431b6e796ad0
I20260709 13:09:18.687378 29651 raft_consensus.cc:2804] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.685917 29642 raft_consensus.cc:359] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.687753 29651 raft_consensus.cc:493] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.687978 29642 raft_consensus.cc:385] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.688138 29651 raft_consensus.cc:3060] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.688426 29642 raft_consensus.cc:740] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.688540 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e83193f628a4bf19349124d2ab51a8d" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:18.689206 29453 raft_consensus.cc:3060] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.689428 29642 consensus_queue.cc:260] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.692209 29642 ts_tablet_manager.cc:1434] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:09:18.693306 29642 tablet_bootstrap.cc:492] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:18.700199 29644 tablet_bootstrap.cc:654] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.700433 29642 tablet_bootstrap.cc:654] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.705291 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e83193f628a4bf19349124d2ab51a8d" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3af434568070447aa4dd06f17b8ea841"
I20260709 13:09:18.705814 29641 tablet_bootstrap.cc:492] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420: No bootstrap required, opened a new log
I20260709 13:09:18.706359 29641 ts_tablet_manager.cc:1403] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420: Time spent bootstrapping tablet: real 0.075s	user 0.017s	sys 0.009s
I20260709 13:09:18.703214 29453 raft_consensus.cc:2468] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 1.
W20260709 13:09:18.708768 29494 leader_election.cc:343] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.705243 29662 raft_consensus.cc:493] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.710000 29494 leader_election.cc:304] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420; no voters: 3af434568070447aa4dd06f17b8ea841
I20260709 13:09:18.710840 29662 raft_consensus.cc:515] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.711449 29647 raft_consensus.cc:2804] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.704061 29648 leader_election.cc:290] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 1 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:18.713423 29651 raft_consensus.cc:515] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.709443 29641 raft_consensus.cc:359] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.716361 29651 leader_election.cc:290] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:18.715658 29641 raft_consensus.cc:385] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.717029 29641 raft_consensus.cc:740] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.717556 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878d85a39a9640bebc225db5d1cfb600" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:18.717936 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878d85a39a9640bebc225db5d1cfb600" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:18.717821 29641 consensus_queue.cc:260] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.718334 29452 raft_consensus.cc:3060] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.718570 29528 raft_consensus.cc:3060] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.719575 29662 leader_election.cc:290] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:18.718541 29642 tablet_bootstrap.cc:492] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0: No bootstrap required, opened a new log
I20260709 13:09:18.720317 29641 ts_tablet_manager.cc:1434] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:09:18.720558 29642 ts_tablet_manager.cc:1403] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 13:09:18.721403 29641 tablet_bootstrap.cc:492] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420: Bootstrap starting.
I20260709 13:09:18.724140 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b782e2a60c44d497a721f35b3f45a8" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420" is_pre_election: true
I20260709 13:09:18.725076 29527 raft_consensus.cc:2468] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 0.
I20260709 13:09:18.726481 29565 leader_election.cc:304] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:18.727392 29662 raft_consensus.cc:2804] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.727803 29662 raft_consensus.cc:493] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.727665 29642 raft_consensus.cc:359] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.728343 29662 raft_consensus.cc:3060] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.726738 29644 tablet_bootstrap.cc:492] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841: No bootstrap required, opened a new log
I20260709 13:09:18.728370 29452 raft_consensus.cc:2468] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 1.
I20260709 13:09:18.728488 29642 raft_consensus.cc:385] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.727491 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b782e2a60c44d497a721f35b3f45a8" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0" is_pre_election: true
I20260709 13:09:18.730060 29651 raft_consensus.cc:493] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.729555 29644 ts_tablet_manager.cc:1403] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.006s
I20260709 13:09:18.731576 29651 raft_consensus.cc:515] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.729009 29647 raft_consensus.cc:697] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [term 1 LEADER]: Becoming Leader. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:18.734018 29647 consensus_queue.cc:237] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.735528 29651 leader_election.cc:290] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:18.736162 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ab67a572b540b7be34d85f34bae33b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420" is_pre_election: true
I20260709 13:09:18.736958 29641 tablet_bootstrap.cc:654] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:18.737739 29565 leader_election.cc:343] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.731177 29642 raft_consensus.cc:740] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
W20260709 13:09:18.732571 29568 leader_election.cc:343] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.738806 29662 raft_consensus.cc:515] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.739667 29568 leader_election.cc:304] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0; no voters: 
I20260709 13:09:18.740571 29651 raft_consensus.cc:2804] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.738129 29528 raft_consensus.cc:2468] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 1.
I20260709 13:09:18.741343 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ab67a572b540b7be34d85f34bae33b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0" is_pre_election: true
I20260709 13:09:18.741987 29452 raft_consensus.cc:2468] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 0.
I20260709 13:09:18.742185 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b782e2a60c44d497a721f35b3f45a8" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:18.743340 29642 consensus_queue.cc:260] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.744376 29568 leader_election.cc:304] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0; no voters: a0820165e71f4b2fb2d0803fad9fb420
I20260709 13:09:18.746837 29651 raft_consensus.cc:697] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Becoming Leader. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:18.747138 29662 leader_election.cc:290] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:18.749034 29662 raft_consensus.cc:2804] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.749576 29662 raft_consensus.cc:493] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:18.749768 29568 leader_election.cc:343] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.750094 29662 raft_consensus.cc:3060] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.748049 29651 consensus_queue.cc:237] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
W20260709 13:09:18.754851 29399 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:18.747875 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b782e2a60c44d497a721f35b3f45a8" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:18.756206 29528 raft_consensus.cc:3060] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.757355 29642 ts_tablet_manager.cc:1434] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.002s
I20260709 13:09:18.758484 29642 tablet_bootstrap.cc:492] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:18.758833 29641 tablet_bootstrap.cc:492] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420: No bootstrap required, opened a new log
I20260709 13:09:18.759411 29641 ts_tablet_manager.cc:1403] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420: Time spent bootstrapping tablet: real 0.038s	user 0.004s	sys 0.024s
I20260709 13:09:18.740319 29644 raft_consensus.cc:359] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.759837 29644 raft_consensus.cc:385] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.760208 29644 raft_consensus.cc:740] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.761052 29644 consensus_queue.cc:260] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.767246 29662 raft_consensus.cc:515] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.768137 29641 raft_consensus.cc:359] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.768934 29641 raft_consensus.cc:385] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.769232 29641 raft_consensus.cc:740] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.770485 29644 ts_tablet_manager.cc:1434] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:09:18.772672 29350 catalog_manager.cc:5697] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3af434568070447aa4dd06f17b8ea841 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "3af434568070447aa4dd06f17b8ea841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.773819 29528 raft_consensus.cc:2468] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 1.
I20260709 13:09:18.774317 29644 tablet_bootstrap.cc:492] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841: Bootstrap starting.
I20260709 13:09:18.775164 29565 leader_election.cc:304] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, a0820165e71f4b2fb2d0803fad9fb420; no voters: 7bc86c49419c4d8ea732431b6e796ad0
I20260709 13:09:18.770323 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ab67a572b540b7be34d85f34bae33b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:18.776398 29651 raft_consensus.cc:2804] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.776749 29453 raft_consensus.cc:3060] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.776919 29651 raft_consensus.cc:697] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Becoming Leader. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:18.777906 29651 consensus_queue.cc:237] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.778532 29351 catalog_manager.cc:5697] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.781987 29644 tablet_bootstrap.cc:654] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.784655 29453 raft_consensus.cc:2468] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 1.
I20260709 13:09:18.782797 29642 tablet_bootstrap.cc:654] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.785794 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ab67a572b540b7be34d85f34bae33b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:18.786887 29662 leader_election.cc:290] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:18.770104 29641 consensus_queue.cc:260] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.788879 29528 raft_consensus.cc:3060] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.790256 29641 ts_tablet_manager.cc:1434] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 13:09:18.790760 29568 leader_election.cc:304] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0; no voters: 
I20260709 13:09:18.791299 29641 tablet_bootstrap.cc:492] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420: Bootstrap starting.
I20260709 13:09:18.792558 29662 raft_consensus.cc:2804] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.793044 29662 raft_consensus.cc:697] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Becoming Leader. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:18.793618 29642 tablet_bootstrap.cc:492] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0: No bootstrap required, opened a new log
I20260709 13:09:18.794139 29642 ts_tablet_manager.cc:1403] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.004s
I20260709 13:09:18.793859 29662 consensus_queue.cc:237] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.796701 29528 raft_consensus.cc:2468] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 1.
I20260709 13:09:18.797130 29642 raft_consensus.cc:359] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.798099 29642 raft_consensus.cc:385] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.798249 29641 tablet_bootstrap.cc:654] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.798519 29642 raft_consensus.cc:740] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.799809 29642 consensus_queue.cc:260] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.802639 29642 ts_tablet_manager.cc:1434] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:18.803869 29642 tablet_bootstrap.cc:492] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:18.810484 29644 tablet_bootstrap.cc:492] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841: No bootstrap required, opened a new log
I20260709 13:09:18.812516 29642 tablet_bootstrap.cc:654] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.812719 29644 ts_tablet_manager.cc:1403] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.009s
I20260709 13:09:18.818653 29644 raft_consensus.cc:359] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.820578 29654 raft_consensus.cc:493] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.821311 29654 raft_consensus.cc:515] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.836992 29642 tablet_bootstrap.cc:492] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0: No bootstrap required, opened a new log
I20260709 13:09:18.837666 29642 ts_tablet_manager.cc:1403] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.014s
I20260709 13:09:18.839443 29654 leader_election.cc:290] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:18.840780 29642 raft_consensus.cc:359] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.841615 29642 raft_consensus.cc:385] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.841921 29642 raft_consensus.cc:740] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.842649 29642 consensus_queue.cc:260] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.844919 29642 ts_tablet_manager.cc:1434] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:18.847260 29350 catalog_manager.cc:5697] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3af434568070447aa4dd06f17b8ea841 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "3af434568070447aa4dd06f17b8ea841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.848840 29642 tablet_bootstrap.cc:492] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:18.849346 29350 catalog_manager.cc:5697] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3af434568070447aa4dd06f17b8ea841 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "3af434568070447aa4dd06f17b8ea841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.856261 29642 tablet_bootstrap.cc:654] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.819775 29644 raft_consensus.cc:385] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.877063 29644 raft_consensus.cc:740] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.878273 29644 consensus_queue.cc:260] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.892637 29644 ts_tablet_manager.cc:1434] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260709 13:09:18.895859 29644 tablet_bootstrap.cc:492] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841: Bootstrap starting.
I20260709 13:09:18.899435 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "592d34c7b1ad4f07b5e1644ada89240e" candidate_uuid: "7bc86c49419c4d8ea732431b6e796ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3af434568070447aa4dd06f17b8ea841" is_pre_election: true
I20260709 13:09:18.899785 29641 tablet_bootstrap.cc:492] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420: No bootstrap required, opened a new log
I20260709 13:09:18.900285 29641 ts_tablet_manager.cc:1403] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420: Time spent bootstrapping tablet: real 0.109s	user 0.040s	sys 0.056s
I20260709 13:09:18.901055 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "592d34c7b1ad4f07b5e1644ada89240e" candidate_uuid: "7bc86c49419c4d8ea732431b6e796ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420" is_pre_election: true
I20260709 13:09:18.900220 29602 raft_consensus.cc:2468] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bc86c49419c4d8ea732431b6e796ad0 in term 0.
I20260709 13:09:18.902846 29642 tablet_bootstrap.cc:492] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0: No bootstrap required, opened a new log
I20260709 13:09:18.903425 29642 ts_tablet_manager.cc:1403] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.055s	user 0.024s	sys 0.022s
I20260709 13:09:18.903611 29641 raft_consensus.cc:359] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.904428 29641 raft_consensus.cc:385] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.904768 29641 raft_consensus.cc:740] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.902865 29419 leader_election.cc:304] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0; no voters: 
I20260709 13:09:18.905819 29654 raft_consensus.cc:2804] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.906272 29654 raft_consensus.cc:493] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.905869 29641 consensus_queue.cc:260] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.906415 29642 raft_consensus.cc:359] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.907331 29642 raft_consensus.cc:385] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.907646 29642 raft_consensus.cc:740] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.908324 29641 ts_tablet_manager.cc:1434] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:09:18.909482 29641 tablet_bootstrap.cc:492] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420: Bootstrap starting.
I20260709 13:09:18.906631 29654 raft_consensus.cc:3060] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.915485 29644 tablet_bootstrap.cc:654] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.916018 29641 tablet_bootstrap.cc:654] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.915311 29528 raft_consensus.cc:2468] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bc86c49419c4d8ea732431b6e796ad0 in term 0.
I20260709 13:09:18.908394 29642 consensus_queue.cc:260] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.922412 29654 raft_consensus.cc:515] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.924279 29642 ts_tablet_manager.cc:1434] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.005s
I20260709 13:09:18.926433 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "592d34c7b1ad4f07b5e1644ada89240e" candidate_uuid: "7bc86c49419c4d8ea732431b6e796ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3af434568070447aa4dd06f17b8ea841"
I20260709 13:09:18.927409 29602 raft_consensus.cc:3060] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.929458 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "592d34c7b1ad4f07b5e1644ada89240e" candidate_uuid: "7bc86c49419c4d8ea732431b6e796ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:18.930122 29528 raft_consensus.cc:3060] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.937721 29528 raft_consensus.cc:2468] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bc86c49419c4d8ea732431b6e796ad0 in term 1.
I20260709 13:09:18.938673 29602 raft_consensus.cc:2468] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bc86c49419c4d8ea732431b6e796ad0 in term 1.
I20260709 13:09:18.938907 29416 leader_election.cc:304] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:18.940140 29684 raft_consensus.cc:2804] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.940806 29654 leader_election.cc:290] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [CANDIDATE]: Term 1 election: Requested vote from peers a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:18.941639 29642 tablet_bootstrap.cc:492] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:18.943327 29641 tablet_bootstrap.cc:492] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420: No bootstrap required, opened a new log
I20260709 13:09:18.943737 29641 ts_tablet_manager.cc:1403] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.008s
I20260709 13:09:18.944586 29662 raft_consensus.cc:493] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.945129 29662 raft_consensus.cc:515] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.946233 29641 raft_consensus.cc:359] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.947296 29641 raft_consensus.cc:385] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.947446 29662 leader_election.cc:290] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953), 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679)
I20260709 13:09:18.947610 29641 raft_consensus.cc:740] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.948441 29641 consensus_queue.cc:260] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.948769 29684 raft_consensus.cc:697] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 LEADER]: Becoming Leader. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Running, Role: LEADER
I20260709 13:09:18.950325 29642 tablet_bootstrap.cc:654] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.949868 29684 consensus_queue.cc:237] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.950606 29641 ts_tablet_manager.cc:1434] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:18.950663 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd50e3d325646bf966915acae27c417" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0" is_pre_election: true
I20260709 13:09:18.951766 29641 tablet_bootstrap.cc:492] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420: Bootstrap starting.
I20260709 13:09:18.951730 29453 raft_consensus.cc:2468] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 0.
I20260709 13:09:18.953135 29644 tablet_bootstrap.cc:492] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841: No bootstrap required, opened a new log
I20260709 13:09:18.953677 29644 ts_tablet_manager.cc:1403] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.015s
I20260709 13:09:18.956173 29568 leader_election.cc:304] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0; no voters: 
I20260709 13:09:18.957377 29662 raft_consensus.cc:2804] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.957755 29662 raft_consensus.cc:493] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.958122 29662 raft_consensus.cc:3060] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.961301 29641 tablet_bootstrap.cc:654] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.957772 29644 raft_consensus.cc:359] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.961753 29644 raft_consensus.cc:385] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.962080 29644 raft_consensus.cc:740] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.963030 29644 consensus_queue.cc:260] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.965377 29644 ts_tablet_manager.cc:1434] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:18.968374 29644 tablet_bootstrap.cc:492] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841: Bootstrap starting.
I20260709 13:09:18.975298 29349 catalog_manager.cc:5697] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "7bc86c49419c4d8ea732431b6e796ad0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.984208 29644 tablet_bootstrap.cc:654] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.986289 29642 tablet_bootstrap.cc:492] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0: No bootstrap required, opened a new log
I20260709 13:09:18.986949 29642 ts_tablet_manager.cc:1403] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.005s
I20260709 13:09:18.987377 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd50e3d325646bf966915acae27c417" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420" is_pre_election: true
I20260709 13:09:18.988116 29528 raft_consensus.cc:2468] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 0.
I20260709 13:09:18.989915 29642 raft_consensus.cc:359] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.991022 29642 raft_consensus.cc:385] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.991386 29642 raft_consensus.cc:740] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.991783 29641 tablet_bootstrap.cc:492] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420: No bootstrap required, opened a new log
I20260709 13:09:18.992295 29641 ts_tablet_manager.cc:1403] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.011s
I20260709 13:09:18.992460 29642 consensus_queue.cc:260] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.994047 29662 raft_consensus.cc:515] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.995043 29641 raft_consensus.cc:359] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:18.995730 29641 raft_consensus.cc:385] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.995995 29641 raft_consensus.cc:740] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.997185 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd50e3d325646bf966915acae27c417" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:18.997810 29528 raft_consensus.cc:3060] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.998277 29642 ts_tablet_manager.cc:1434] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:18.999706 29642 tablet_bootstrap.cc:492] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:19.000629 29684 raft_consensus.cc:493] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.001319 29684 raft_consensus.cc:515] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.001605 29641 consensus_queue.cc:260] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.003774 29641 ts_tablet_manager.cc:1434] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:09:19.004740 29641 tablet_bootstrap.cc:492] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420: Bootstrap starting.
I20260709 13:09:19.009084 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204a2926c364e87b8ef95e38eec369b" candidate_uuid: "7bc86c49419c4d8ea732431b6e796ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420" is_pre_election: true
I20260709 13:09:19.010553 29641 tablet_bootstrap.cc:654] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.010819 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd50e3d325646bf966915acae27c417" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:19.011474 29453 raft_consensus.cc:3060] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:19.012441 29416 leader_election.cc:343] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.014504 29684 leader_election.cc:290] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:19.015426 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204a2926c364e87b8ef95e38eec369b" candidate_uuid: "7bc86c49419c4d8ea732431b6e796ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3af434568070447aa4dd06f17b8ea841" is_pre_election: true
W20260709 13:09:19.017613 29419 leader_election.cc:343] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.018263 29419 leader_election.cc:304] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0; no voters: 3af434568070447aa4dd06f17b8ea841, a0820165e71f4b2fb2d0803fad9fb420
I20260709 13:09:19.023664 29684 raft_consensus.cc:2749] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:19.030828 29453 raft_consensus.cc:2468] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 1.
I20260709 13:09:19.032943 29568 leader_election.cc:304] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0; no voters: 
I20260709 13:09:19.034205 29651 raft_consensus.cc:2804] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.034845 29651 raft_consensus.cc:697] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Becoming Leader. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:19.036029 29651 consensus_queue.cc:237] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.037196 29528 raft_consensus.cc:2468] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 1.
I20260709 13:09:19.031054 29662 leader_election.cc:290] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 election: Requested vote from peers a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953), 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679)
I20260709 13:09:19.045578 29642 tablet_bootstrap.cc:654] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.046536 29644 tablet_bootstrap.cc:492] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841: No bootstrap required, opened a new log
I20260709 13:09:19.047278 29644 ts_tablet_manager.cc:1403] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841: Time spent bootstrapping tablet: real 0.079s	user 0.039s	sys 0.025s
I20260709 13:09:19.051283 29641 tablet_bootstrap.cc:492] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420: No bootstrap required, opened a new log
I20260709 13:09:19.050817 29644 raft_consensus.cc:359] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.051833 29641 ts_tablet_manager.cc:1403] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.028s
I20260709 13:09:19.052093 29644 raft_consensus.cc:385] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.052518 29644 raft_consensus.cc:740] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.053794 29644 consensus_queue.cc:260] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.054417 29641 raft_consensus.cc:359] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.055169 29641 raft_consensus.cc:385] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.055449 29641 raft_consensus.cc:740] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.056314 29641 consensus_queue.cc:260] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.057240 29644 ts_tablet_manager.cc:1434] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:09:19.057888 29641 ts_tablet_manager.cc:1434] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:19.058743 29644 tablet_bootstrap.cc:492] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841: Bootstrap starting.
I20260709 13:09:19.061813 29349 catalog_manager.cc:5697] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3af434568070447aa4dd06f17b8ea841 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "3af434568070447aa4dd06f17b8ea841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.067734 29644 tablet_bootstrap.cc:654] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.072432 29642 tablet_bootstrap.cc:492] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0: No bootstrap required, opened a new log
I20260709 13:09:19.073103 29642 ts_tablet_manager.cc:1403] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.011s
I20260709 13:09:19.078997 29644 tablet_bootstrap.cc:492] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841: No bootstrap required, opened a new log
I20260709 13:09:19.079113 29642 raft_consensus.cc:359] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.079632 29644 ts_tablet_manager.cc:1403] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 13:09:19.079954 29642 raft_consensus.cc:385] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.080253 29642 raft_consensus.cc:740] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.080924 29642 consensus_queue.cc:260] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.082329 29644 raft_consensus.cc:359] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.082842 29642 ts_tablet_manager.cc:1434] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:19.083068 29644 raft_consensus.cc:385] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.083343 29644 raft_consensus.cc:740] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.083874 29642 tablet_bootstrap.cc:492] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:19.084002 29644 consensus_queue.cc:260] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.086273 29644 ts_tablet_manager.cc:1434] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:19.087275 29644 tablet_bootstrap.cc:492] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841: Bootstrap starting.
I20260709 13:09:19.089825 29642 tablet_bootstrap.cc:654] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.092609 29644 tablet_bootstrap.cc:654] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.101269 29644 tablet_bootstrap.cc:492] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841: No bootstrap required, opened a new log
I20260709 13:09:19.101440 29642 tablet_bootstrap.cc:492] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0: No bootstrap required, opened a new log
I20260709 13:09:19.101402 29684 raft_consensus.cc:493] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.101761 29644 ts_tablet_manager.cc:1403] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:09:19.102129 29642 ts_tablet_manager.cc:1403] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.007s
I20260709 13:09:19.102090 29684 raft_consensus.cc:515] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.104584 29642 raft_consensus.cc:359] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.104730 29644 raft_consensus.cc:359] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.105173 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b782e2a60c44d497a721f35b3f45a8" candidate_uuid: "7bc86c49419c4d8ea732431b6e796ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420" is_pre_election: true
I20260709 13:09:19.105334 29642 raft_consensus.cc:385] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.105527 29644 raft_consensus.cc:385] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.105890 29642 raft_consensus.cc:740] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.105728 29684 leader_election.cc:290] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:19.106099 29528 raft_consensus.cc:2393] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7bc86c49419c4d8ea732431b6e796ad0 in current term 1: Already voted for candidate 3af434568070447aa4dd06f17b8ea841 in this term.
I20260709 13:09:19.106158 29644 raft_consensus.cc:740] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.105437 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b782e2a60c44d497a721f35b3f45a8" candidate_uuid: "7bc86c49419c4d8ea732431b6e796ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3af434568070447aa4dd06f17b8ea841" is_pre_election: true
I20260709 13:09:19.106891 29642 consensus_queue.cc:260] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.107542 29644 consensus_queue.cc:260] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.108134 29419 leader_election.cc:304] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0; no voters: 3af434568070447aa4dd06f17b8ea841, a0820165e71f4b2fb2d0803fad9fb420
I20260709 13:09:19.108951 29642 ts_tablet_manager.cc:1434] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:09:19.109552 29644 ts_tablet_manager.cc:1434] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:19.109699 29686 raft_consensus.cc:3060] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.117302 29686 raft_consensus.cc:2749] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:19.178272 29651 raft_consensus.cc:493] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.180378 29651 raft_consensus.cc:515] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.186180 29686 raft_consensus.cc:493] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.187450 29686 raft_consensus.cc:515] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.187727 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ada9e7ba6d45a39ffccd55f1bd310b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0" is_pre_election: true
I20260709 13:09:19.189198 29453 raft_consensus.cc:2468] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 0.
I20260709 13:09:19.190287 29662 raft_consensus.cc:493] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.191411 29662 raft_consensus.cc:515] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.192449 29568 leader_election.cc:304] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0; no voters: 
I20260709 13:09:19.192759 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d13ed1f707a49508d2dd7a042f780f8" candidate_uuid: "7bc86c49419c4d8ea732431b6e796ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420" is_pre_election: true
I20260709 13:09:19.193789 29528 raft_consensus.cc:2468] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bc86c49419c4d8ea732431b6e796ad0 in term 0.
I20260709 13:09:19.193959 29667 raft_consensus.cc:2804] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:19.194491 29667 raft_consensus.cc:493] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.194882 29667 raft_consensus.cc:3060] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.195598 29651 leader_election.cc:290] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:19.195823 29416 leader_election.cc:304] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:19.196991 29684 raft_consensus.cc:2804] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:19.197548 29662 leader_election.cc:290] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:19.197402 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ada9e7ba6d45a39ffccd55f1bd310b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420" is_pre_election: true
I20260709 13:09:19.198225 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e83193f628a4bf19349124d2ab51a8d" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0" is_pre_election: true
I20260709 13:09:19.198575 29527 raft_consensus.cc:2468] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 0.
I20260709 13:09:19.198751 29686 leader_election.cc:290] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:19.199471 29453 raft_consensus.cc:2393] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3af434568070447aa4dd06f17b8ea841 in current term 1: Already voted for candidate a0820165e71f4b2fb2d0803fad9fb420 in this term.
I20260709 13:09:19.199559 29662 consensus_queue.cc:1048] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:19.203049 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d13ed1f707a49508d2dd7a042f780f8" candidate_uuid: "7bc86c49419c4d8ea732431b6e796ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3af434568070447aa4dd06f17b8ea841" is_pre_election: true
I20260709 13:09:19.204072 29602 raft_consensus.cc:2468] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bc86c49419c4d8ea732431b6e796ad0 in term 0.
I20260709 13:09:19.197419 29684 raft_consensus.cc:493] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.205471 29684 raft_consensus.cc:3060] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.197405 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e83193f628a4bf19349124d2ab51a8d" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420" is_pre_election: true
I20260709 13:09:19.209673 29565 leader_election.cc:304] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841; no voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420
I20260709 13:09:19.211129 29662 raft_consensus.cc:3060] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.214511 29667 raft_consensus.cc:515] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.217715 29667 leader_election.cc:290] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:19.218016 29647 raft_consensus.cc:493] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.218828 29647 raft_consensus.cc:515] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.218937 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ada9e7ba6d45a39ffccd55f1bd310b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:19.219861 29528 raft_consensus.cc:3060] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.218950 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ada9e7ba6d45a39ffccd55f1bd310b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:19.220443 29452 raft_consensus.cc:3060] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.222960 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8d8b8082f942cf8f4846210f267c6e" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0" is_pre_election: true
I20260709 13:09:19.223850 29451 raft_consensus.cc:2468] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 0.
I20260709 13:09:19.225214 29647 leader_election.cc:290] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:19.225314 29494 leader_election.cc:304] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:19.226258 29647 raft_consensus.cc:2804] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:19.226702 29647 raft_consensus.cc:493] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.227648 29647 raft_consensus.cc:3060] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.227710 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8d8b8082f942cf8f4846210f267c6e" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3af434568070447aa4dd06f17b8ea841" is_pre_election: true
I20260709 13:09:19.228637 29602 raft_consensus.cc:2468] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 0.
I20260709 13:09:19.231217 29669 consensus_queue.cc:1048] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:19.239826 29647 raft_consensus.cc:515] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.242193 29684 raft_consensus.cc:515] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.247928 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d13ed1f707a49508d2dd7a042f780f8" candidate_uuid: "7bc86c49419c4d8ea732431b6e796ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:19.248785 29526 raft_consensus.cc:3060] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.249547 29452 raft_consensus.cc:2468] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 1.
I20260709 13:09:19.251343 29662 raft_consensus.cc:2749] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:19.251928 29669 consensus_queue.cc:1048] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:19.256204 29568 leader_election.cc:304] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0; no voters: 
I20260709 13:09:19.257421 29669 raft_consensus.cc:2804] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.258008 29669 raft_consensus.cc:697] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Becoming Leader. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:19.259307 29669 consensus_queue.cc:237] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.260972 29684 leader_election.cc:290] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [CANDIDATE]: Term 1 election: Requested vote from peers a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:19.264182 29528 raft_consensus.cc:2468] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 1.
I20260709 13:09:19.265753 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d13ed1f707a49508d2dd7a042f780f8" candidate_uuid: "7bc86c49419c4d8ea732431b6e796ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3af434568070447aa4dd06f17b8ea841"
I20260709 13:09:19.266389 29602 raft_consensus.cc:3060] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.274520 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8d8b8082f942cf8f4846210f267c6e" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:19.275219 29450 raft_consensus.cc:3060] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.276042 29651 consensus_queue.cc:1048] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:19.277654 29651 consensus_queue.cc:1048] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:19.277957 29601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8d8b8082f942cf8f4846210f267c6e" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3af434568070447aa4dd06f17b8ea841"
I20260709 13:09:19.278856 29601 raft_consensus.cc:3060] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.290012 29647 leader_election.cc:290] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 1 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:19.293555 29526 raft_consensus.cc:2468] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bc86c49419c4d8ea732431b6e796ad0 in term 1.
I20260709 13:09:19.296628 29416 leader_election.cc:304] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:19.297806 29450 raft_consensus.cc:2468] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 1.
I20260709 13:09:19.298470 29684 raft_consensus.cc:2804] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.299598 29494 leader_election.cc:304] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:19.301937 29665 raft_consensus.cc:2804] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.302542 29665 raft_consensus.cc:697] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 1 LEADER]: Becoming Leader. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:19.299571 29684 raft_consensus.cc:697] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 LEADER]: Becoming Leader. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Running, Role: LEADER
I20260709 13:09:19.304025 29665 consensus_queue.cc:237] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.304584 29684 consensus_queue.cc:237] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.291663 29601 raft_consensus.cc:2468] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 1.
I20260709 13:09:19.315701 29667 consensus_queue.cc:1048] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:19.317405 29647 consensus_queue.cc:1048] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:19.294485 29602 raft_consensus.cc:2468] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bc86c49419c4d8ea732431b6e796ad0 in term 1.
I20260709 13:09:19.346735 29351 catalog_manager.cc:5697] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3af434568070447aa4dd06f17b8ea841 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "3af434568070447aa4dd06f17b8ea841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.352830 29669 raft_consensus.cc:493] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.353713 29669 raft_consensus.cc:515] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.358266 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204a2926c364e87b8ef95e38eec369b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420" is_pre_election: true
I20260709 13:09:19.359258 29527 raft_consensus.cc:2468] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 0.
I20260709 13:09:19.361260 29669 leader_election.cc:290] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:19.366300 29647 consensus_queue.cc:1048] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:19.365772 29347 catalog_manager.cc:5697] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "7bc86c49419c4d8ea732431b6e796ad0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:19.368287 29565 leader_election.cc:304] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:19.369971 29703 raft_consensus.cc:2804] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:19.370584 29703 raft_consensus.cc:493] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.358266 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204a2926c364e87b8ef95e38eec369b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0" is_pre_election: true
I20260709 13:09:19.371421 29452 raft_consensus.cc:2468] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 0.
I20260709 13:09:19.372644 29703 raft_consensus.cc:3060] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.383836 29703 raft_consensus.cc:515] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.387636 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204a2926c364e87b8ef95e38eec369b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:19.388276 29451 raft_consensus.cc:3060] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.388844 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204a2926c364e87b8ef95e38eec369b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:19.389536 29525 raft_consensus.cc:3060] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.398490 29451 raft_consensus.cc:2468] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 1.
I20260709 13:09:19.399210 29703 leader_election.cc:290] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:19.400071 29568 leader_election.cc:304] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0; no voters: 
I20260709 13:09:19.403625 29669 raft_consensus.cc:2804] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.404141 29669 raft_consensus.cc:697] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Becoming Leader. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:19.405023 29525 raft_consensus.cc:2468] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 1.
I20260709 13:09:19.405150 29669 consensus_queue.cc:237] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:19.405967 29349 catalog_manager.cc:5697] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:19.426005 29347 catalog_manager.cc:5697] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3af434568070447aa4dd06f17b8ea841 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "3af434568070447aa4dd06f17b8ea841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.430965 29684 consensus_queue.cc:1048] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:19.444309 29684 consensus_queue.cc:1048] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:19.523955 29669 consensus_queue.cc:1048] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:19.537634 29669 consensus_queue.cc:1048] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:19.679388 21001 ts_manager.cc:295] Set tserver state for 7bc86c49419c4d8ea732431b6e796ad0 to MAINTENANCE_MODE
I20260709 13:09:19.680320 21001 tablet_server.cc:179] TabletServer@127.20.130.65:0 shutting down...
I20260709 13:09:19.708503 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:19.709372 21001 tablet_replica.cc:333] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0: stopping tablet replica
I20260709 13:09:19.710181 21001 raft_consensus.cc:2243] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.710675 21001 raft_consensus.cc:2272] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.713403 21001 tablet_replica.cc:333] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0: stopping tablet replica
I20260709 13:09:19.714021 21001 raft_consensus.cc:2243] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.714854 21001 raft_consensus.cc:2272] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.718772 21001 tablet_replica.cc:333] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0: stopping tablet replica
I20260709 13:09:19.719918 21001 raft_consensus.cc:2243] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.720731 21001 pending_rounds.cc:70] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0: Trying to abort 1 pending ops.
I20260709 13:09:19.720971 21001 pending_rounds.cc:77] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636082923692032 op_type: NO_OP noop_request { }
W20260709 13:09:19.721314 29568 consensus_peers.cc:597] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.721335 21001 raft_consensus.cc:2889] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:19.721436 29712 consensus_queue.cc:1048] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:19.722077 21001 raft_consensus.cc:2272] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.723182 29568 consensus_peers.cc:597] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.725639 21001 tablet_replica.cc:333] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0: stopping tablet replica
I20260709 13:09:19.726855 21001 raft_consensus.cc:2243] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.727571 21001 raft_consensus.cc:2272] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.730327 21001 tablet_replica.cc:333] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0: stopping tablet replica
I20260709 13:09:19.731134 21001 raft_consensus.cc:2243] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.731621 21001 raft_consensus.cc:2272] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.734935 21001 tablet_replica.cc:333] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0: stopping tablet replica
I20260709 13:09:19.735700 21001 raft_consensus.cc:2243] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:19.735890 29568 consensus_peers.cc:597] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.736202 21001 raft_consensus.cc:2272] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.740916 29494 consensus_peers.cc:597] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.741700 21001 tablet_replica.cc:333] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0: stopping tablet replica
I20260709 13:09:19.742630 21001 raft_consensus.cc:2243] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.743204 21001 raft_consensus.cc:2272] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.746320 21001 tablet_replica.cc:333] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0: stopping tablet replica
I20260709 13:09:19.746980 21001 raft_consensus.cc:2243] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.747414 21001 raft_consensus.cc:2272] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.749778 21001 tablet_replica.cc:333] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0: stopping tablet replica
I20260709 13:09:19.750273 21001 raft_consensus.cc:2243] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.750660 21001 raft_consensus.cc:2272] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.752573 21001 tablet_replica.cc:333] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0: stopping tablet replica
I20260709 13:09:19.753057 21001 raft_consensus.cc:2243] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.753448 21001 raft_consensus.cc:2272] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.756150 29399 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:19.779270 21001 tablet_server.cc:196] TabletServer@127.20.130.65:0 shutdown complete.
W20260709 13:09:19.803220 29568 consensus_peers.cc:597] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.815689 29494 consensus_peers.cc:597] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.816349 29669 consensus_queue.cc:1048] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:19.849208 29568 consensus_peers.cc:597] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.019328 29669 consensus_queue.cc:1048] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:20.057687 29568 consensus_peers.cc:597] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:20.757190 29399 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:20.942692 29709 raft_consensus.cc:493] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7bc86c49419c4d8ea732431b6e796ad0)
I20260709 13:09:20.943397 29709 raft_consensus.cc:515] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:20.945364 29709 leader_election.cc:290] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:20.947257 29601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "592d34c7b1ad4f07b5e1644ada89240e" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3af434568070447aa4dd06f17b8ea841" is_pre_election: true
W20260709 13:09:20.949280 29494 leader_election.cc:336] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111)
I20260709 13:09:20.949716 29494 leader_election.cc:304] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0820165e71f4b2fb2d0803fad9fb420; no voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0
I20260709 13:09:20.949750 29669 raft_consensus.cc:493] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7bc86c49419c4d8ea732431b6e796ad0)
I20260709 13:09:20.950404 29709 raft_consensus.cc:2749] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:20.950404 29669 raft_consensus.cc:515] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:20.952337 29669 leader_election.cc:290] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:20.953359 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "592d34c7b1ad4f07b5e1644ada89240e" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420" is_pre_election: true
I20260709 13:09:20.953934 29525 raft_consensus.cc:2468] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 1.
I20260709 13:09:20.955291 29565 leader_election.cc:304] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
W20260709 13:09:20.956018 29568 leader_election.cc:336] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111)
I20260709 13:09:20.956091 29669 raft_consensus.cc:2804] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.956619 29669 raft_consensus.cc:493] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7bc86c49419c4d8ea732431b6e796ad0)
I20260709 13:09:20.956969 29669 raft_consensus.cc:3060] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.962883 29669 raft_consensus.cc:515] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:20.965019 29669 leader_election.cc:290] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 2 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:20.966100 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "592d34c7b1ad4f07b5e1644ada89240e" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:20.966768 29525 raft_consensus.cc:3060] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:20.968576 29568 leader_election.cc:336] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111)
I20260709 13:09:20.972709 29525 raft_consensus.cc:2468] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 2.
I20260709 13:09:20.973801 29565 leader_election.cc:304] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, a0820165e71f4b2fb2d0803fad9fb420; no voters: 7bc86c49419c4d8ea732431b6e796ad0
I20260709 13:09:20.974489 29669 raft_consensus.cc:2804] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:20.975040 29669 raft_consensus.cc:697] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 2 LEADER]: Becoming Leader. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:20.975915 29669 consensus_queue.cc:237] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:20.983392 29347 catalog_manager.cc:5697] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 reported cstate change: term changed from 1 to 2, leader changed from 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65) to 3af434568070447aa4dd06f17b8ea841 (127.20.130.67). New cstate: current_term: 2 leader_uuid: "3af434568070447aa4dd06f17b8ea841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:21.114718 29568 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111) [suppressed 126 similar messages]
I20260709 13:09:21.348248 29651 raft_consensus.cc:493] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.348747 29651 raft_consensus.cc:515] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:21.350482 29651 leader_election.cc:290] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:21.351649 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d13ed1f707a49508d2dd7a042f780f8" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420" is_pre_election: true
I20260709 13:09:21.352478 29525 raft_consensus.cc:2468] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 1.
I20260709 13:09:21.353763 29565 leader_election.cc:304] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:21.354772 29651 raft_consensus.cc:2804] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:21.355262 29651 raft_consensus.cc:493] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:21.355146 29568 leader_election.cc:336] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111)
I20260709 13:09:21.355783 29651 raft_consensus.cc:3060] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.361923 29651 raft_consensus.cc:515] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:21.363891 29651 leader_election.cc:290] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 2 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:21.365079 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d13ed1f707a49508d2dd7a042f780f8" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:21.365767 29525 raft_consensus.cc:3060] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:21.367630 29568 leader_election.cc:336] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111)
I20260709 13:09:21.371469 29525 raft_consensus.cc:2468] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 2.
I20260709 13:09:21.372502 29565 leader_election.cc:304] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, a0820165e71f4b2fb2d0803fad9fb420; no voters: 7bc86c49419c4d8ea732431b6e796ad0
I20260709 13:09:21.373153 29651 raft_consensus.cc:2804] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.373613 29651 raft_consensus.cc:697] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 2 LEADER]: Becoming Leader. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:21.374418 29651 consensus_queue.cc:237] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:21.382725 29347 catalog_manager.cc:5697] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 reported cstate change: term changed from 1 to 2, leader changed from 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65) to 3af434568070447aa4dd06f17b8ea841 (127.20.130.67). New cstate: current_term: 2 leader_uuid: "3af434568070447aa4dd06f17b8ea841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:21.427735 29568 consensus_peers.cc:597] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.517880 29525 raft_consensus.cc:1275] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Refusing update from remote peer 3af434568070447aa4dd06f17b8ea841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.519146 29651 consensus_queue.cc:1048] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:21.758069 29399 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:21.785758 29568 consensus_peers.cc:597] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.964808 29494 consensus_peers.cc:597] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:21.996136 29525 raft_consensus.cc:1275] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Refusing update from remote peer 3af434568070447aa4dd06f17b8ea841: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:21.997552 29737 consensus_queue.cc:1048] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:22.017323 29494 consensus_peers.cc:597] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:22.035760 29568 consensus_peers.cc:597] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:22.085950 29568 consensus_peers.cc:597] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:22.183638 29568 consensus_peers.cc:597] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:22.230634 29568 consensus_peers.cc:597] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:22.481299 29568 consensus_peers.cc:597] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:22.605244 29568 consensus_peers.cc:597] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:22.759052 29399 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:23.759989 29399 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:24.059125 29568 consensus_peers.cc:597] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.143975 29568 consensus_peers.cc:597] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.250712 29494 consensus_peers.cc:597] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:24.278700 29568 consensus_peers.cc:597] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:24.523147 29494 consensus_peers.cc:597] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:24.550346 29568 consensus_peers.cc:597] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:24.593467 29568 consensus_peers.cc:597] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:24.760988 29399 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:24.805794 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:24.813104 29742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:24.815471 29743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:24.816987 29745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:24.817994 21001 server_base.cc:1061] running on GCE node
I20260709 13:09:24.819726 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:24.819929 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:24.820155 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602564820132 us; error 0 us; skew 500 ppm
I20260709 13:09:24.820719 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:24.823539 21001 webserver.cc:533] Webserver started at http://127.20.130.65:38673/ using document root <none> and password file <none>
I20260709 13:09:24.824057 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:24.824254 21001 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:09:24.828161 21001 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:09:24.832435 29750 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:24.833243 21001 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:09:24.833588 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-0-root
uuid: "7bc86c49419c4d8ea732431b6e796ad0"
format_stamp: "Formatted at 2026-07-09 13:09:17 on dist-test-slave-csvd"
I20260709 13:09:24.833947 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602291548094-21001-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:24.851225 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:24.852777 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:24.854486 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:24.859599 29757 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:09:24.884533 29568 consensus_peers.cc:597] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:24.914709 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:09:24.915109 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.057s	user 0.001s	sys 0.003s
I20260709 13:09:24.915359 21001 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:09:24.920046 29757 tablet_bootstrap.cc:492] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:24.933622 29757 tablet_bootstrap.cc:492] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.934468 29757 tablet_bootstrap.cc:492] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap complete.
I20260709 13:09:24.935060 29757 ts_tablet_manager.cc:1403] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:09:24.937482 29757 raft_consensus.cc:359] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:24.938131 29757 raft_consensus.cc:740] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.938791 29757 consensus_queue.cc:260] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:24.941390 29757 ts_tablet_manager.cc:1434] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:09:24.942085 29757 tablet_bootstrap.cc:492] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:24.953207 29757 tablet_bootstrap.cc:492] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.954015 29757 tablet_bootstrap.cc:492] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap complete.
I20260709 13:09:24.954348 21001 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:09:24.954663 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.039s	user 0.036s	sys 0.000s
I20260709 13:09:24.954743 29757 ts_tablet_manager.cc:1403] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:09:24.958483 29757 raft_consensus.cc:359] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:24.959306 29757 raft_consensus.cc:740] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.960132 29757 consensus_queue.cc:260] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:24.961906 29757 ts_tablet_manager.cc:1434] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:24.962653 29757 tablet_bootstrap.cc:492] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:24.977953 29757 tablet_bootstrap.cc:492] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.978845 29757 tablet_bootstrap.cc:492] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap complete.
I20260709 13:09:24.979768 29757 ts_tablet_manager.cc:1403] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 13:09:24.982307 29757 raft_consensus.cc:359] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:24.982978 29757 raft_consensus.cc:740] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.983745 29757 consensus_queue.cc:260] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:24.986054 29757 ts_tablet_manager.cc:1434] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:24.986822 29757 tablet_bootstrap.cc:492] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:25.000042 29757 tablet_bootstrap.cc:492] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.000846 29757 tablet_bootstrap.cc:492] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap complete.
I20260709 13:09:25.001415 29757 ts_tablet_manager.cc:1403] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 13:09:25.003400 29757 raft_consensus.cc:359] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.003925 29757 raft_consensus.cc:740] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.004555 29757 consensus_queue.cc:260] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.006186 29757 ts_tablet_manager.cc:1434] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:25.006840 29757 tablet_bootstrap.cc:492] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:25.017132 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.65:40679
I20260709 13:09:25.017257 29819 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.65:40679 every 8 connection(s)
I20260709 13:09:25.018826 29757 tablet_bootstrap.cc:492] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.019709 29757 tablet_bootstrap.cc:492] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap complete.
I20260709 13:09:25.020239 29757 ts_tablet_manager.cc:1403] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:09:25.022264 29757 raft_consensus.cc:359] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.024694 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:25.022904 29757 raft_consensus.cc:740] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.028483 29757 consensus_queue.cc:260] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.030722 29757 ts_tablet_manager.cc:1434] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:25.031616 29757 tablet_bootstrap.cc:492] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:25.059165 29820 heartbeater.cc:344] Connected to a master server at 127.20.130.126:46151
I20260709 13:09:25.060192 29820 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:25.061244 29820 heartbeater.cc:507] Master 127.20.130.126:46151 requested a full tablet report, sending...
I20260709 13:09:25.063151 29601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20ada9e7ba6d45a39ffccd55f1bd310b"
dest_uuid: "3af434568070447aa4dd06f17b8ea841"
mode: GRACEFUL
new_leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:54992
I20260709 13:09:25.063949 29601 raft_consensus.cc:606] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Received request to transfer leadership to TS a0820165e71f4b2fb2d0803fad9fb420
I20260709 13:09:25.066155 29757 tablet_bootstrap.cc:492] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.067324 29757 tablet_bootstrap.cc:492] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap complete.
I20260709 13:09:25.068009 29757 ts_tablet_manager.cc:1403] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.016s
I20260709 13:09:25.068938 29601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "878d85a39a9640bebc225db5d1cfb600"
dest_uuid: "3af434568070447aa4dd06f17b8ea841"
mode: GRACEFUL
new_leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:54992
I20260709 13:09:25.069795 29601 raft_consensus.cc:606] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Received request to transfer leadership to TS a0820165e71f4b2fb2d0803fad9fb420
I20260709 13:09:25.073419 29351 ts_manager.cc:194] Re-registered known tserver with Master: 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679)
I20260709 13:09:25.074724 29757 raft_consensus.cc:359] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.075649 29757 raft_consensus.cc:740] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.077005 29601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d13ed1f707a49508d2dd7a042f780f8"
dest_uuid: "3af434568070447aa4dd06f17b8ea841"
mode: GRACEFUL
new_leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:54992
I20260709 13:09:25.077831 29601 raft_consensus.cc:606] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 2 LEADER]: Received request to transfer leadership to TS a0820165e71f4b2fb2d0803fad9fb420
I20260709 13:09:25.079448 29651 raft_consensus.cc:993] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841: : Instructing follower a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:25.076390 29757 consensus_queue.cc:260] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.080009 29651 raft_consensus.cc:1081] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Signalling peer a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:25.081306 29601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edd50e3d325646bf966915acae27c417"
dest_uuid: "3af434568070447aa4dd06f17b8ea841"
mode: GRACEFUL
new_leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:54992
I20260709 13:09:25.082145 29601 raft_consensus.cc:606] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Received request to transfer leadership to TS a0820165e71f4b2fb2d0803fad9fb420
I20260709 13:09:25.082259 29525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20ada9e7ba6d45a39ffccd55f1bd310b"
dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:48226
I20260709 13:09:25.083197 29525 raft_consensus.cc:493] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:25.083638 29525 raft_consensus.cc:3060] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.084491 29757 ts_tablet_manager.cc:1434] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:09:25.085752 29757 tablet_bootstrap.cc:492] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:25.091732 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:25.092502 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:25.093300 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:25.093532 29525 raft_consensus.cc:515] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.096184 29525 leader_election.cc:290] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 2 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:25.096632 29792 raft_consensus.cc:3060] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.102056 29601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ada9e7ba6d45a39ffccd55f1bd310b" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3af434568070447aa4dd06f17b8ea841"
W20260709 13:09:25.102388 29568 consensus_peers.cc:597] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:25.102778 29601 raft_consensus.cc:3055] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:25.103243 29601 raft_consensus.cc:740] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:25.104208 29601 consensus_queue.cc:260] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.105723 29601 raft_consensus.cc:3060] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.109066 29757 tablet_bootstrap.cc:492] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:09:25.110502 29757 tablet_bootstrap.cc:492] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap complete.
I20260709 13:09:25.111413 29757 ts_tablet_manager.cc:1403] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.000s
I20260709 13:09:25.115484 29601 raft_consensus.cc:2468] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 2.
I20260709 13:09:25.117177 29494 leader_election.cc:304] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:25.117604 29757 raft_consensus.cc:359] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.118276 29733 raft_consensus.cc:2804] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:25.118636 29757 raft_consensus.cc:740] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.119590 29757 consensus_queue.cc:260] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.120163 29351 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53020
I20260709 13:09:25.122009 29757 ts_tablet_manager.cc:1434] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:09:25.122893 29757 tablet_bootstrap.cc:492] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:25.125679 29820 heartbeater.cc:499] Master 127.20.130.126:46151 was elected leader, sending a full tablet report...
I20260709 13:09:25.129530 29733 raft_consensus.cc:697] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Becoming Leader. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:25.131431 29791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ada9e7ba6d45a39ffccd55f1bd310b" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:25.132162 29791 raft_consensus.cc:3060] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.138641 29733 consensus_queue.cc:237] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.139953 29791 raft_consensus.cc:2468] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 2.
I20260709 13:09:25.146489 29757 tablet_bootstrap.cc:492] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.147572 29757 tablet_bootstrap.cc:492] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap complete.
I20260709 13:09:25.148197 29757 ts_tablet_manager.cc:1403] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.003s
I20260709 13:09:25.151028 29757 raft_consensus.cc:359] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.151796 29757 raft_consensus.cc:740] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.152611 29757 consensus_queue.cc:260] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.154726 29757 ts_tablet_manager.cc:1434] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:25.155601 29757 tablet_bootstrap.cc:492] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:25.157423 29347 catalog_manager.cc:5697] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 reported cstate change: term changed from 1 to 2, leader changed from 3af434568070447aa4dd06f17b8ea841 (127.20.130.67) to a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.169507 29757 tablet_bootstrap.cc:492] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.170337 29757 tablet_bootstrap.cc:492] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap complete.
I20260709 13:09:25.170979 29757 ts_tablet_manager.cc:1403] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:09:25.173557 29757 raft_consensus.cc:359] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.174115 29757 raft_consensus.cc:740] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.174748 29757 consensus_queue.cc:260] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.176586 29757 ts_tablet_manager.cc:1434] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:25.177356 29757 tablet_bootstrap.cc:492] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap starting.
I20260709 13:09:25.190167 29757 tablet_bootstrap.cc:492] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.191185 29757 tablet_bootstrap.cc:492] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0: Bootstrap complete.
I20260709 13:09:25.191715 29757 ts_tablet_manager.cc:1403] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:09:25.193596 29757 raft_consensus.cc:359] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.194105 29757 raft_consensus.cc:740] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc86c49419c4d8ea732431b6e796ad0, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.194644 29757 consensus_queue.cc:260] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.196170 29757 ts_tablet_manager.cc:1434] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:25.276129 29741 raft_consensus.cc:993] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841: : Instructing follower a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:25.276605 29651 raft_consensus.cc:1081] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Signalling peer a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:25.278187 29525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "878d85a39a9640bebc225db5d1cfb600"
dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:48226
I20260709 13:09:25.278779 29525 raft_consensus.cc:493] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:25.279175 29525 raft_consensus.cc:3060] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.284747 29525 raft_consensus.cc:515] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.286168 29525 leader_election.cc:290] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 2 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:25.286988 29792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878d85a39a9640bebc225db5d1cfb600" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:25.287364 29601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878d85a39a9640bebc225db5d1cfb600" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3af434568070447aa4dd06f17b8ea841"
I20260709 13:09:25.287678 29792 raft_consensus.cc:3060] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.287964 29601 raft_consensus.cc:3055] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:25.288295 29601 raft_consensus.cc:740] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:25.289122 29601 consensus_queue.cc:260] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.290350 29601 raft_consensus.cc:3060] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.294832 29792 raft_consensus.cc:2468] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 2.
I20260709 13:09:25.296156 29494 leader_election.cc:304] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:25.296927 29733 raft_consensus.cc:2804] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:25.297400 29733 raft_consensus.cc:697] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Becoming Leader. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:25.297541 29601 raft_consensus.cc:2468] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 2.
I20260709 13:09:25.298347 29733 consensus_queue.cc:237] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.306190 29351 catalog_manager.cc:5697] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 reported cstate change: term changed from 1 to 2, leader changed from 3af434568070447aa4dd06f17b8ea841 (127.20.130.67) to a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.404431 29741 raft_consensus.cc:993] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841: : Instructing follower a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:25.404935 29651 raft_consensus.cc:1081] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Signalling peer a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:25.406409 29525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edd50e3d325646bf966915acae27c417"
dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:48226
I20260709 13:09:25.406909 29525 raft_consensus.cc:493] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:25.407284 29525 raft_consensus.cc:3060] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.413401 29525 raft_consensus.cc:515] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.415649 29792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd50e3d325646bf966915acae27c417" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:25.415980 29525 leader_election.cc:290] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 2 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:25.416327 29792 raft_consensus.cc:3060] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.419863 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd50e3d325646bf966915acae27c417" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3af434568070447aa4dd06f17b8ea841"
I20260709 13:09:25.420374 29602 raft_consensus.cc:3055] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:25.420682 29602 raft_consensus.cc:740] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:25.421592 29602 consensus_queue.cc:260] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.422948 29602 raft_consensus.cc:3060] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.423313 29792 raft_consensus.cc:2468] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 2.
I20260709 13:09:25.424345 29494 leader_election.cc:304] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:25.425110 29733 raft_consensus.cc:2804] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:25.425530 29733 raft_consensus.cc:697] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Becoming Leader. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:25.426363 29733 consensus_queue.cc:237] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.428650 29602 raft_consensus.cc:2468] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 2.
I20260709 13:09:25.434005 29351 catalog_manager.cc:5697] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 reported cstate change: term changed from 1 to 2, leader changed from 3af434568070447aa4dd06f17b8ea841 (127.20.130.67) to a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.494716 29792 raft_consensus.cc:3060] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.500178 29792 pending_rounds.cc:85] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0: Aborting all ops after (but not including) 0
I20260709 13:09:25.500460 29792 pending_rounds.cc:107] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:09:25.500715 29792 raft_consensus.cc:2889] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:25.536096 29741 raft_consensus.cc:993] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841: : Instructing follower a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:25.536547 29845 raft_consensus.cc:1081] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 2 LEADER]: Signalling peer a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:25.537940 29525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d13ed1f707a49508d2dd7a042f780f8"
dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:48226
I20260709 13:09:25.538452 29525 raft_consensus.cc:493] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:25.538739 29525 raft_consensus.cc:3060] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.543257 29525 raft_consensus.cc:515] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.544960 29525 leader_election.cc:290] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 3 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:25.545804 29792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d13ed1f707a49508d2dd7a042f780f8" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:25.546145 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d13ed1f707a49508d2dd7a042f780f8" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3af434568070447aa4dd06f17b8ea841"
I20260709 13:09:25.546450 29792 raft_consensus.cc:3060] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.546751 29602 raft_consensus.cc:3055] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:25.547159 29602 raft_consensus.cc:740] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:25.547890 29602 consensus_queue.cc:260] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.548849 29602 raft_consensus.cc:3060] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.551748 29792 raft_consensus.cc:2468] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 3.
I20260709 13:09:25.552829 29494 leader_election.cc:304] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:25.553529 29733 raft_consensus.cc:2804] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:25.554028 29733 raft_consensus.cc:697] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 LEADER]: Becoming Leader. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:25.554358 29602 raft_consensus.cc:2468] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 3.
I20260709 13:09:25.555042 29733 consensus_queue.cc:237] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:25.569135 29351 catalog_manager.cc:5697] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 reported cstate change: term changed from 2 to 3, leader changed from 3af434568070447aa4dd06f17b8ea841 (127.20.130.67) to a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66). New cstate: current_term: 3 leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.571964 29602 raft_consensus.cc:1275] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.573927 29733 consensus_queue.cc:1048] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:25.590870 29792 raft_consensus.cc:1275] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.592347 29733 consensus_queue.cc:1048] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:25.721987 29602 raft_consensus.cc:1275] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.723297 29852 consensus_queue.cc:1048] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.732859 29792 raft_consensus.cc:1275] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.734298 29831 consensus_queue.cc:1048] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:25.762002 29399 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:25.810385 29792 raft_consensus.cc:1275] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.811949 29831 consensus_queue.cc:1048] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:25.821740 29602 raft_consensus.cc:1275] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.823823 29852 consensus_queue.cc:1048] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:26.022490 29792 raft_consensus.cc:1275] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:26.023870 29852 consensus_queue.cc:1048] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:26.033710 29602 raft_consensus.cc:1275] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:26.035657 29831 consensus_queue.cc:1048] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:26.105290 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:26.122529 29525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a8d8b8082f942cf8f4846210f267c6e"
dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
mode: GRACEFUL
new_leader_uuid: "3af434568070447aa4dd06f17b8ea841"
 from {username='slave'} at 127.0.0.1:37752
I20260709 13:09:26.123080 29525 raft_consensus.cc:606] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 1 LEADER]: Received request to transfer leadership to TS 3af434568070447aa4dd06f17b8ea841
I20260709 13:09:26.125391 29525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edd50e3d325646bf966915acae27c417"
dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
mode: GRACEFUL
new_leader_uuid: "3af434568070447aa4dd06f17b8ea841"
 from {username='slave'} at 127.0.0.1:37752
I20260709 13:09:26.125826 29525 raft_consensus.cc:606] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Received request to transfer leadership to TS 3af434568070447aa4dd06f17b8ea841
I20260709 13:09:26.126820 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:26.127374 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:26.127957 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:26.192744 29852 raft_consensus.cc:993] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420: : Instructing follower 3af434568070447aa4dd06f17b8ea841 to start an election
I20260709 13:09:26.193202 29733 raft_consensus.cc:1081] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 1 LEADER]: Signalling peer 3af434568070447aa4dd06f17b8ea841 to start an election
I20260709 13:09:26.194813 29602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a8d8b8082f942cf8f4846210f267c6e"
dest_uuid: "3af434568070447aa4dd06f17b8ea841"
 from {username='slave'} at 127.0.0.1:54974
I20260709 13:09:26.195277 29602 raft_consensus.cc:493] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:26.195524 29602 raft_consensus.cc:3060] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:26.201376 29602 raft_consensus.cc:515] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:26.203078 29602 leader_election.cc:290] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 2 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:26.203789 29792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8d8b8082f942cf8f4846210f267c6e" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:26.203961 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8d8b8082f942cf8f4846210f267c6e" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:26.204528 29792 raft_consensus.cc:3060] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:26.204654 29525 raft_consensus.cc:3055] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:26.205056 29525 raft_consensus.cc:740] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:26.205683 29525 consensus_queue.cc:260] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:26.206509 29525 raft_consensus.cc:3060] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:26.209447 29792 raft_consensus.cc:2468] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 2.
I20260709 13:09:26.210493 29568 leader_election.cc:304] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0; no voters: 
I20260709 13:09:26.211239 29741 raft_consensus.cc:2804] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:26.211385 29525 raft_consensus.cc:2468] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 2.
I20260709 13:09:26.211692 29741 raft_consensus.cc:697] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [term 2 LEADER]: Becoming Leader. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:26.212641 29741 consensus_queue.cc:237] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:26.219398 29351 catalog_manager.cc:5697] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 reported cstate change: term changed from 1 to 2, leader changed from a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66) to 3af434568070447aa4dd06f17b8ea841 (127.20.130.67). New cstate: current_term: 2 leader_uuid: "3af434568070447aa4dd06f17b8ea841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.434909 29852 raft_consensus.cc:993] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420: : Instructing follower 3af434568070447aa4dd06f17b8ea841 to start an election
I20260709 13:09:26.435420 29733 raft_consensus.cc:1081] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Signalling peer 3af434568070447aa4dd06f17b8ea841 to start an election
I20260709 13:09:26.437024 29602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edd50e3d325646bf966915acae27c417"
dest_uuid: "3af434568070447aa4dd06f17b8ea841"
 from {username='slave'} at 127.0.0.1:54974
I20260709 13:09:26.437551 29602 raft_consensus.cc:493] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:26.437952 29602 raft_consensus.cc:3060] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.443097 29602 raft_consensus.cc:515] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:26.444995 29602 leader_election.cc:290] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 3 election: Requested vote from peers a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953), 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679)
I20260709 13:09:26.445745 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd50e3d325646bf966915acae27c417" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:26.446015 29792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd50e3d325646bf966915acae27c417" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:26.446393 29525 raft_consensus.cc:3055] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:26.446619 29792 raft_consensus.cc:3060] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.446815 29525 raft_consensus.cc:740] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:26.447633 29525 consensus_queue.cc:260] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:26.448506 29525 raft_consensus.cc:3060] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.452682 29792 raft_consensus.cc:2468] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 3.
I20260709 13:09:26.454028 29568 leader_election.cc:304] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0; no voters: 
I20260709 13:09:26.454813 29741 raft_consensus.cc:2804] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:26.455161 29525 raft_consensus.cc:2468] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 3.
I20260709 13:09:26.455332 29741 raft_consensus.cc:697] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 3 LEADER]: Becoming Leader. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:26.456403 29741 consensus_queue.cc:237] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:26.462224 29351 catalog_manager.cc:5697] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 reported cstate change: term changed from 2 to 3, leader changed from a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66) to 3af434568070447aa4dd06f17b8ea841 (127.20.130.67). New cstate: current_term: 3 leader_uuid: "3af434568070447aa4dd06f17b8ea841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.595077 29791 raft_consensus.cc:1275] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Refusing update from remote peer 3af434568070447aa4dd06f17b8ea841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:26.596408 29845 consensus_queue.cc:1048] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:26.607163 29525 raft_consensus.cc:1275] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Refusing update from remote peer 3af434568070447aa4dd06f17b8ea841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:26.609369 29867 consensus_queue.cc:1048] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:26.763025 29399 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:26.913246 29525 raft_consensus.cc:1275] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Refusing update from remote peer 3af434568070447aa4dd06f17b8ea841: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:26.914537 29867 consensus_queue.cc:1048] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:26.922533 29792 raft_consensus.cc:1275] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Refusing update from remote peer 3af434568070447aa4dd06f17b8ea841: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:26.925877 29867 consensus_queue.cc:1048] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:27.134126 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:27.141844 29525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "878d85a39a9640bebc225db5d1cfb600"
dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
mode: GRACEFUL
new_leader_uuid: "3af434568070447aa4dd06f17b8ea841"
 from {username='slave'} at 127.0.0.1:37752
I20260709 13:09:27.142366 29525 raft_consensus.cc:606] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Received request to transfer leadership to TS 3af434568070447aa4dd06f17b8ea841
I20260709 13:09:27.145216 29602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c204a2926c364e87b8ef95e38eec369b"
dest_uuid: "3af434568070447aa4dd06f17b8ea841"
mode: GRACEFUL
new_leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:54992
I20260709 13:09:27.145787 29602 raft_consensus.cc:606] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Received request to transfer leadership to TS a0820165e71f4b2fb2d0803fad9fb420
I20260709 13:09:27.148183 29602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edd50e3d325646bf966915acae27c417"
dest_uuid: "3af434568070447aa4dd06f17b8ea841"
mode: GRACEFUL
new_leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:54992
I20260709 13:09:27.148659 29602 raft_consensus.cc:606] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 3 LEADER]: Received request to transfer leadership to TS a0820165e71f4b2fb2d0803fad9fb420
I20260709 13:09:27.149739 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:27.150254 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:27.150815 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:27.208580 29733 raft_consensus.cc:993] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420: : Instructing follower 3af434568070447aa4dd06f17b8ea841 to start an election
I20260709 13:09:27.209144 29873 raft_consensus.cc:1081] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Signalling peer 3af434568070447aa4dd06f17b8ea841 to start an election
I20260709 13:09:27.210693 29602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "878d85a39a9640bebc225db5d1cfb600"
dest_uuid: "3af434568070447aa4dd06f17b8ea841"
 from {username='slave'} at 127.0.0.1:54974
I20260709 13:09:27.211220 29602 raft_consensus.cc:493] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:27.211526 29602 raft_consensus.cc:3060] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.216449 29602 raft_consensus.cc:515] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:27.218266 29602 leader_election.cc:290] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 3 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:27.219121 29791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878d85a39a9640bebc225db5d1cfb600" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:27.219430 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878d85a39a9640bebc225db5d1cfb600" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:27.219738 29791 raft_consensus.cc:3060] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.220080 29525 raft_consensus.cc:3055] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:27.220368 29525 raft_consensus.cc:740] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:27.220986 29525 consensus_queue.cc:260] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:27.221839 29525 raft_consensus.cc:3060] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.224867 29791 raft_consensus.cc:2468] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 3.
I20260709 13:09:27.225955 29568 leader_election.cc:304] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0; no voters: 
I20260709 13:09:27.226182 29525 raft_consensus.cc:2468] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 3.
I20260709 13:09:27.226642 29741 raft_consensus.cc:2804] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:27.227181 29741 raft_consensus.cc:697] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 3 LEADER]: Becoming Leader. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:27.227986 29741 consensus_queue.cc:237] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:27.234237 29351 catalog_manager.cc:5697] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 reported cstate change: term changed from 2 to 3, leader changed from a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66) to 3af434568070447aa4dd06f17b8ea841 (127.20.130.67). New cstate: current_term: 3 leader_uuid: "3af434568070447aa4dd06f17b8ea841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.306173 29741 raft_consensus.cc:993] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841: : Instructing follower a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:27.306607 29867 raft_consensus.cc:1081] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Signalling peer a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:27.307969 29525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c204a2926c364e87b8ef95e38eec369b"
dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:48226
I20260709 13:09:27.308470 29525 raft_consensus.cc:493] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:27.308761 29525 raft_consensus.cc:3060] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.313162 29525 raft_consensus.cc:515] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:27.314518 29525 leader_election.cc:290] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 2 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:27.315514 29791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204a2926c364e87b8ef95e38eec369b" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:27.315762 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204a2926c364e87b8ef95e38eec369b" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3af434568070447aa4dd06f17b8ea841"
I20260709 13:09:27.316112 29791 raft_consensus.cc:3060] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.316387 29602 raft_consensus.cc:3055] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:27.316702 29602 raft_consensus.cc:740] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:27.317436 29602 consensus_queue.cc:260] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:27.318528 29602 raft_consensus.cc:3060] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.321331 29791 raft_consensus.cc:2468] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 2.
I20260709 13:09:27.322372 29494 leader_election.cc:304] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:27.323094 29873 raft_consensus.cc:2804] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:27.323479 29873 raft_consensus.cc:697] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Becoming Leader. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:27.323956 29602 raft_consensus.cc:2468] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 2.
I20260709 13:09:27.324251 29873 consensus_queue.cc:237] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:27.330849 29351 catalog_manager.cc:5697] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 reported cstate change: term changed from 1 to 2, leader changed from 3af434568070447aa4dd06f17b8ea841 (127.20.130.67) to a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.516983 29741 raft_consensus.cc:993] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841: : Instructing follower a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:27.517424 29741 raft_consensus.cc:1081] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 3 LEADER]: Signalling peer a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:27.518862 29525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edd50e3d325646bf966915acae27c417"
dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:48226
I20260709 13:09:27.519351 29525 raft_consensus.cc:493] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:27.519585 29525 raft_consensus.cc:3060] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.524137 29525 raft_consensus.cc:515] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:27.525543 29525 leader_election.cc:290] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 4 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:27.526554 29791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd50e3d325646bf966915acae27c417" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:27.526832 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd50e3d325646bf966915acae27c417" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3af434568070447aa4dd06f17b8ea841"
I20260709 13:09:27.527288 29791 raft_consensus.cc:3060] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.527434 29602 raft_consensus.cc:3055] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:27.527845 29602 raft_consensus.cc:740] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:27.528705 29602 consensus_queue.cc:260] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:27.530032 29602 raft_consensus.cc:3060] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.534816 29791 raft_consensus.cc:2468] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 4.
I20260709 13:09:27.536306 29494 leader_election.cc:304] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:27.537058 29873 raft_consensus.cc:2804] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:27.537292 29602 raft_consensus.cc:2468] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 4.
I20260709 13:09:27.537537 29873 raft_consensus.cc:697] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 4 LEADER]: Becoming Leader. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:27.538552 29873 consensus_queue.cc:237] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:27.546154 29351 catalog_manager.cc:5697] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 reported cstate change: term changed from 3 to 4, leader changed from 3af434568070447aa4dd06f17b8ea841 (127.20.130.67) to a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66). New cstate: current_term: 4 leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.726127 29791 raft_consensus.cc:1275] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:27.727494 29873 consensus_queue.cc:1048] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:27.738008 29601 raft_consensus.cc:1275] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:27.739979 29882 consensus_queue.cc:1048] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:27.764040 29399 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:27.779774 29791 raft_consensus.cc:1275] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Refusing update from remote peer 3af434568070447aa4dd06f17b8ea841: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:27.780966 29741 consensus_queue.cc:1048] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:27.789811 29525 raft_consensus.cc:1275] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Refusing update from remote peer 3af434568070447aa4dd06f17b8ea841: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:27.792203 29741 consensus_queue.cc:1048] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:27.997555 29791 raft_consensus.cc:1275] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 4 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:27.998652 29882 consensus_queue.cc:1048] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:28.006975 29601 raft_consensus.cc:1275] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 4 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:28.009166 29733 consensus_queue.cc:1048] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:28.157721 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:28.166039 29525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20ada9e7ba6d45a39ffccd55f1bd310b"
dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
mode: GRACEFUL
new_leader_uuid: "3af434568070447aa4dd06f17b8ea841"
 from {username='slave'} at 127.0.0.1:37752
I20260709 13:09:28.166579 29525 raft_consensus.cc:606] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Received request to transfer leadership to TS 3af434568070447aa4dd06f17b8ea841
I20260709 13:09:28.168973 29525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c204a2926c364e87b8ef95e38eec369b"
dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
mode: GRACEFUL
new_leader_uuid: "3af434568070447aa4dd06f17b8ea841"
 from {username='slave'} at 127.0.0.1:37752
I20260709 13:09:28.169533 29525 raft_consensus.cc:606] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Received request to transfer leadership to TS 3af434568070447aa4dd06f17b8ea841
I20260709 13:09:28.171959 29602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6ab67a572b540b7be34d85f34bae33b"
dest_uuid: "3af434568070447aa4dd06f17b8ea841"
mode: GRACEFUL
new_leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:54992
I20260709 13:09:28.172489 29602 raft_consensus.cc:606] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Received request to transfer leadership to TS a0820165e71f4b2fb2d0803fad9fb420
I20260709 13:09:28.173823 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:28.174328 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:28.174947 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:28.285507 29882 raft_consensus.cc:993] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420: : Instructing follower 3af434568070447aa4dd06f17b8ea841 to start an election
I20260709 13:09:28.286069 29733 raft_consensus.cc:1081] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Signalling peer 3af434568070447aa4dd06f17b8ea841 to start an election
I20260709 13:09:28.287510 29602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c204a2926c364e87b8ef95e38eec369b"
dest_uuid: "3af434568070447aa4dd06f17b8ea841"
 from {username='slave'} at 127.0.0.1:54974
I20260709 13:09:28.288087 29602 raft_consensus.cc:493] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:28.288434 29602 raft_consensus.cc:3060] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:28.294055 29602 raft_consensus.cc:515] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:28.295671 29602 leader_election.cc:290] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 3 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:28.296562 29791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204a2926c364e87b8ef95e38eec369b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:28.296783 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204a2926c364e87b8ef95e38eec369b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:28.297266 29791 raft_consensus.cc:3060] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:28.297315 29525 raft_consensus.cc:3055] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:28.297760 29525 raft_consensus.cc:740] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:28.298524 29525 consensus_queue.cc:260] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:28.299716 29525 raft_consensus.cc:3060] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:28.304603 29791 raft_consensus.cc:2468] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 3.
I20260709 13:09:28.305824 29568 leader_election.cc:304] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0; no voters: 
I20260709 13:09:28.306416 29525 raft_consensus.cc:2468] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 3.
I20260709 13:09:28.306653 29741 raft_consensus.cc:2804] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:28.307361 29741 raft_consensus.cc:697] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 3 LEADER]: Becoming Leader. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:28.308163 29741 consensus_queue.cc:237] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:28.313885 29347 catalog_manager.cc:5697] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 reported cstate change: term changed from 2 to 3, leader changed from a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66) to 3af434568070447aa4dd06f17b8ea841 (127.20.130.67). New cstate: current_term: 3 leader_uuid: "3af434568070447aa4dd06f17b8ea841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.328192 29887 raft_consensus.cc:993] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841: : Instructing follower a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:28.328650 29741 raft_consensus.cc:1081] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Signalling peer a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:28.329945 29525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6ab67a572b540b7be34d85f34bae33b"
dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:48226
I20260709 13:09:28.330408 29525 raft_consensus.cc:493] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:28.330695 29525 raft_consensus.cc:3060] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.335172 29525 raft_consensus.cc:515] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:28.336766 29525 leader_election.cc:290] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 2 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:28.337509 29791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ab67a572b540b7be34d85f34bae33b" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:28.337783 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ab67a572b540b7be34d85f34bae33b" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3af434568070447aa4dd06f17b8ea841"
I20260709 13:09:28.338249 29791 raft_consensus.cc:3060] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.338315 29602 raft_consensus.cc:3055] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:28.338757 29602 raft_consensus.cc:740] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:28.339565 29602 consensus_queue.cc:260] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:28.340739 29602 raft_consensus.cc:3060] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.345404 29791 raft_consensus.cc:2468] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 2.
I20260709 13:09:28.346599 29494 leader_election.cc:304] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:28.347370 29733 raft_consensus.cc:2804] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:28.347515 29602 raft_consensus.cc:2468] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 2.
I20260709 13:09:28.347908 29733 raft_consensus.cc:697] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Becoming Leader. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:28.348946 29733 consensus_queue.cc:237] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:28.355967 29347 catalog_manager.cc:5697] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 reported cstate change: term changed from 1 to 2, leader changed from 3af434568070447aa4dd06f17b8ea841 (127.20.130.67) to a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.414474 29882 raft_consensus.cc:993] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420: : Instructing follower 3af434568070447aa4dd06f17b8ea841 to start an election
I20260709 13:09:28.415006 29733 raft_consensus.cc:1081] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Signalling peer 3af434568070447aa4dd06f17b8ea841 to start an election
I20260709 13:09:28.416342 29602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20ada9e7ba6d45a39ffccd55f1bd310b"
dest_uuid: "3af434568070447aa4dd06f17b8ea841"
 from {username='slave'} at 127.0.0.1:54974
I20260709 13:09:28.416778 29602 raft_consensus.cc:493] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:28.417007 29602 raft_consensus.cc:3060] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:28.421360 29602 raft_consensus.cc:515] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:28.422792 29602 leader_election.cc:290] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 3 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:28.423696 29791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ada9e7ba6d45a39ffccd55f1bd310b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:28.423837 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ada9e7ba6d45a39ffccd55f1bd310b" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:28.424453 29791 raft_consensus.cc:3060] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:28.424472 29525 raft_consensus.cc:3055] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:28.425010 29525 raft_consensus.cc:740] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:28.425786 29525 consensus_queue.cc:260] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:28.426980 29525 raft_consensus.cc:3060] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:28.431913 29791 raft_consensus.cc:2468] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 3.
I20260709 13:09:28.433188 29568 leader_election.cc:304] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0; no voters: 
I20260709 13:09:28.433460 29525 raft_consensus.cc:2468] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 3.
I20260709 13:09:28.433890 29741 raft_consensus.cc:2804] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:28.434513 29741 raft_consensus.cc:697] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 3 LEADER]: Becoming Leader. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:28.435278 29741 consensus_queue.cc:237] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:28.441941 29347 catalog_manager.cc:5697] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 reported cstate change: term changed from 2 to 3, leader changed from a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66) to 3af434568070447aa4dd06f17b8ea841 (127.20.130.67). New cstate: current_term: 3 leader_uuid: "3af434568070447aa4dd06f17b8ea841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.738760 29525 raft_consensus.cc:1275] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Refusing update from remote peer 3af434568070447aa4dd06f17b8ea841: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:28.740134 29741 consensus_queue.cc:1048] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:28.749249 29791 raft_consensus.cc:1275] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Refusing update from remote peer 3af434568070447aa4dd06f17b8ea841: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:28.750777 29887 consensus_queue.cc:1048] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:09:28.765008 29399 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:28.883353 29602 raft_consensus.cc:1275] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:28.884698 29873 consensus_queue.cc:1048] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.893455 29791 raft_consensus.cc:1275] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:28.895342 29882 consensus_queue.cc:1048] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.898017 29791 raft_consensus.cc:1275] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Refusing update from remote peer 3af434568070447aa4dd06f17b8ea841: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:28.900261 29887 consensus_queue.cc:1048] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:28.909668 29525 raft_consensus.cc:1275] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Refusing update from remote peer 3af434568070447aa4dd06f17b8ea841: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:28.911898 29887 consensus_queue.cc:1048] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:29.181231 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:29.188510 29602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "592d34c7b1ad4f07b5e1644ada89240e"
dest_uuid: "3af434568070447aa4dd06f17b8ea841"
mode: GRACEFUL
new_leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:54992
I20260709 13:09:29.189026 29602 raft_consensus.cc:606] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 2 LEADER]: Received request to transfer leadership to TS a0820165e71f4b2fb2d0803fad9fb420
I20260709 13:09:29.191937 29602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80b782e2a60c44d497a721f35b3f45a8"
dest_uuid: "3af434568070447aa4dd06f17b8ea841"
mode: GRACEFUL
new_leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:54992
I20260709 13:09:29.192534 29602 raft_consensus.cc:606] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Received request to transfer leadership to TS a0820165e71f4b2fb2d0803fad9fb420
I20260709 13:09:29.223505 29525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d13ed1f707a49508d2dd7a042f780f8"
dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
mode: GRACEFUL
new_leader_uuid: "3af434568070447aa4dd06f17b8ea841"
 from {username='slave'} at 127.0.0.1:37752
I20260709 13:09:29.225800 29525 raft_consensus.cc:606] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 LEADER]: Received request to transfer leadership to TS 3af434568070447aa4dd06f17b8ea841
I20260709 13:09:29.228618 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:29.231931 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:29.233011 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:29.416638 29741 raft_consensus.cc:993] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841: : Instructing follower a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:29.417280 29887 raft_consensus.cc:1081] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 2 LEADER]: Signalling peer a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:29.418880 29525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "592d34c7b1ad4f07b5e1644ada89240e"
dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:48226
I20260709 13:09:29.419492 29525 raft_consensus.cc:493] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.419902 29525 raft_consensus.cc:3060] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.427333 29525 raft_consensus.cc:515] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:29.428922 29525 leader_election.cc:290] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 3 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:29.430315 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "592d34c7b1ad4f07b5e1644ada89240e" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3af434568070447aa4dd06f17b8ea841"
I20260709 13:09:29.430209 29792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "592d34c7b1ad4f07b5e1644ada89240e" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:29.431149 29602 raft_consensus.cc:3055] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:29.431308 29792 raft_consensus.cc:3060] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.431437 29602 raft_consensus.cc:740] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:29.432600 29602 consensus_queue.cc:260] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:29.434118 29602 raft_consensus.cc:3060] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.438455 29792 raft_consensus.cc:2468] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 3.
I20260709 13:09:29.439849 29494 leader_election.cc:304] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:29.440699 29903 raft_consensus.cc:2804] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:29.441175 29903 raft_consensus.cc:697] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 3 LEADER]: Becoming Leader. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:29.441738 29602 raft_consensus.cc:2468] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 3.
I20260709 13:09:29.442499 29903 consensus_queue.cc:237] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:29.452831 29347 catalog_manager.cc:5697] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 reported cstate change: term changed from 2 to 3, leader changed from 3af434568070447aa4dd06f17b8ea841 (127.20.130.67) to a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66). New cstate: current_term: 3 leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.547291 29741 raft_consensus.cc:993] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841: : Instructing follower a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:29.547813 29741 raft_consensus.cc:1081] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Signalling peer a0820165e71f4b2fb2d0803fad9fb420 to start an election
I20260709 13:09:29.549304 29525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80b782e2a60c44d497a721f35b3f45a8"
dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
 from {username='slave'} at 127.0.0.1:48226
I20260709 13:09:29.549765 29525 raft_consensus.cc:493] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.550055 29525 raft_consensus.cc:3060] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.555107 29525 raft_consensus.cc:515] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:29.556535 29525 leader_election.cc:290] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 2 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), 3af434568070447aa4dd06f17b8ea841 (127.20.130.67:42797)
I20260709 13:09:29.557456 29792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b782e2a60c44d497a721f35b3f45a8" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:29.557745 29602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b782e2a60c44d497a721f35b3f45a8" candidate_uuid: "a0820165e71f4b2fb2d0803fad9fb420" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3af434568070447aa4dd06f17b8ea841"
I20260709 13:09:29.558161 29792 raft_consensus.cc:3060] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.558272 29602 raft_consensus.cc:3055] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:29.558663 29602 raft_consensus.cc:740] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:29.559656 29602 consensus_queue.cc:260] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:29.561147 29602 raft_consensus.cc:3060] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.566300 29792 raft_consensus.cc:2468] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 2.
I20260709 13:09:29.567790 29494 leader_election.cc:304] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bc86c49419c4d8ea732431b6e796ad0, a0820165e71f4b2fb2d0803fad9fb420; no voters: 
I20260709 13:09:29.568639 29903 raft_consensus.cc:2804] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:29.568718 29602 raft_consensus.cc:2468] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0820165e71f4b2fb2d0803fad9fb420 in term 2.
I20260709 13:09:29.569131 29903 raft_consensus.cc:697] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Becoming Leader. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:29.570363 29903 consensus_queue.cc:237] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:29.578506 29347 catalog_manager.cc:5697] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 reported cstate change: term changed from 1 to 2, leader changed from 3af434568070447aa4dd06f17b8ea841 (127.20.130.67) to a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "a0820165e71f4b2fb2d0803fad9fb420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.606035 29882 raft_consensus.cc:993] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420: : Instructing follower 3af434568070447aa4dd06f17b8ea841 to start an election
I20260709 13:09:29.606606 29882 raft_consensus.cc:1081] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 LEADER]: Signalling peer 3af434568070447aa4dd06f17b8ea841 to start an election
I20260709 13:09:29.608194 29602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d13ed1f707a49508d2dd7a042f780f8"
dest_uuid: "3af434568070447aa4dd06f17b8ea841"
 from {username='slave'} at 127.0.0.1:54974
I20260709 13:09:29.608752 29602 raft_consensus.cc:493] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.609058 29602 raft_consensus.cc:3060] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:29.615029 29602 raft_consensus.cc:515] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:29.616657 29602 leader_election.cc:290] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 4 election: Requested vote from peers 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679), a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953)
I20260709 13:09:29.617440 29792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d13ed1f707a49508d2dd7a042f780f8" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "7bc86c49419c4d8ea732431b6e796ad0"
I20260709 13:09:29.617868 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d13ed1f707a49508d2dd7a042f780f8" candidate_uuid: "3af434568070447aa4dd06f17b8ea841" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a0820165e71f4b2fb2d0803fad9fb420"
I20260709 13:09:29.618211 29792 raft_consensus.cc:3060] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:29.618453 29525 raft_consensus.cc:3055] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:29.618851 29525 raft_consensus.cc:740] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0820165e71f4b2fb2d0803fad9fb420, State: Running, Role: LEADER
I20260709 13:09:29.619679 29525 consensus_queue.cc:260] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:29.620883 29525 raft_consensus.cc:3060] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:29.623505 29792 raft_consensus.cc:2468] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 4.
I20260709 13:09:29.624580 29568 leader_election.cc:304] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3af434568070447aa4dd06f17b8ea841, 7bc86c49419c4d8ea732431b6e796ad0; no voters: 
I20260709 13:09:29.625285 29741 raft_consensus.cc:2804] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:29.625698 29741 raft_consensus.cc:697] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 4 LEADER]: Becoming Leader. State: Replica: 3af434568070447aa4dd06f17b8ea841, State: Running, Role: LEADER
I20260709 13:09:29.626035 29525 raft_consensus.cc:2468] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af434568070447aa4dd06f17b8ea841 in term 4.
I20260709 13:09:29.626708 29741 consensus_queue.cc:237] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } }
I20260709 13:09:29.634611 29347 catalog_manager.cc:5697] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 reported cstate change: term changed from 3 to 4, leader changed from a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66) to 3af434568070447aa4dd06f17b8ea841 (127.20.130.67). New cstate: current_term: 4 leader_uuid: "3af434568070447aa4dd06f17b8ea841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:29.766289 29399 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:29.827711 29792 raft_consensus.cc:1275] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:29.829082 29882 consensus_queue.cc:1048] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:29.844288 29602 raft_consensus.cc:1275] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:29.845602 29882 consensus_queue.cc:1048] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:29.950804 29792 raft_consensus.cc:1275] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.952040 29882 consensus_queue.cc:1048] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.961620 29602 raft_consensus.cc:1275] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Refusing update from remote peer a0820165e71f4b2fb2d0803fad9fb420: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.963703 29903 consensus_queue.cc:1048] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3af434568070447aa4dd06f17b8ea841" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:30.109202 29791 raft_consensus.cc:1275] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 4 FOLLOWER]: Refusing update from remote peer 3af434568070447aa4dd06f17b8ea841: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:30.110500 29741 consensus_queue.cc:1048] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bc86c49419c4d8ea732431b6e796ad0" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.119876 29525 raft_consensus.cc:1275] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 4 FOLLOWER]: Refusing update from remote peer 3af434568070447aa4dd06f17b8ea841: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:30.121639 29924 consensus_queue.cc:1048] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0820165e71f4b2fb2d0803fad9fb420" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.243043 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:30.276160 21001 tablet_server.cc:179] TabletServer@127.20.130.65:40679 shutting down...
W20260709 13:09:30.297572 29494 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 79 similar messages]
I20260709 13:09:30.299592 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:30.300582 21001 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:30.301492 29494 consensus_peers.cc:597] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:30.301852 21001 raft_consensus.cc:2243] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.302392 21001 raft_consensus.cc:2272] T 4e83193f628a4bf19349124d2ab51a8d P 7bc86c49419c4d8ea732431b6e796ad0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.304817 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:30.305414 21001 raft_consensus.cc:2243] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.305902 21001 raft_consensus.cc:2272] T 878d85a39a9640bebc225db5d1cfb600 P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.308355 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:30.308969 21001 raft_consensus.cc:2243] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.309405 21001 raft_consensus.cc:2272] T c6ab67a572b540b7be34d85f34bae33b P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.311645 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:30.312239 21001 raft_consensus.cc:2243] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.312896 21001 raft_consensus.cc:2272] T c204a2926c364e87b8ef95e38eec369b P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.315922 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:30.316411 21001 raft_consensus.cc:2243] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.316887 21001 raft_consensus.cc:2272] T 80b782e2a60c44d497a721f35b3f45a8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.320420 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:30.321122 21001 raft_consensus.cc:2243] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.321944 21001 raft_consensus.cc:2272] T edd50e3d325646bf966915acae27c417 P 7bc86c49419c4d8ea732431b6e796ad0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.324514 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:30.325023 21001 raft_consensus.cc:2243] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.325421 21001 raft_consensus.cc:2272] T 592d34c7b1ad4f07b5e1644ada89240e P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.328274 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:30.328812 21001 raft_consensus.cc:2243] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.329295 21001 raft_consensus.cc:2272] T 4a8d8b8082f942cf8f4846210f267c6e P 7bc86c49419c4d8ea732431b6e796ad0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.331672 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:30.332134 21001 raft_consensus.cc:2243] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.332540 21001 raft_consensus.cc:2272] T 8d13ed1f707a49508d2dd7a042f780f8 P 7bc86c49419c4d8ea732431b6e796ad0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.335383 21001 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:30.335956 21001 raft_consensus.cc:2243] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.336629 21001 raft_consensus.cc:2272] T 20ada9e7ba6d45a39ffccd55f1bd310b P 7bc86c49419c4d8ea732431b6e796ad0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:30.354161 29568 consensus_peers.cc:597] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:30.367358 29568 consensus_peers.cc:597] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:30.375546 21001 tablet_server.cc:196] TabletServer@127.20.130.65:40679 shutdown complete.
W20260709 13:09:30.391681 29568 consensus_peers.cc:597] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:30.407596 21001 tablet_server.cc:179] TabletServer@127.20.130.66:0 shutting down...
I20260709 13:09:30.439787 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:30.440729 21001 tablet_replica.cc:333] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420: stopping tablet replica
I20260709 13:09:30.442126 21001 raft_consensus.cc:2243] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.442822 21001 raft_consensus.cc:2272] T 20ada9e7ba6d45a39ffccd55f1bd310b P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:30.443876 29494 consensus_peers.cc:597] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:30.445429 21001 tablet_replica.cc:333] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420: stopping tablet replica
I20260709 13:09:30.446190 21001 raft_consensus.cc:2243] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.446707 21001 raft_consensus.cc:2272] T 8d13ed1f707a49508d2dd7a042f780f8 P a0820165e71f4b2fb2d0803fad9fb420 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.449206 21001 tablet_replica.cc:333] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420: stopping tablet replica
I20260709 13:09:30.449967 21001 raft_consensus.cc:2243] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.450469 21001 raft_consensus.cc:2272] T 4a8d8b8082f942cf8f4846210f267c6e P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.452828 21001 tablet_replica.cc:333] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420: stopping tablet replica
I20260709 13:09:30.453369 21001 raft_consensus.cc:2243] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.454150 21001 raft_consensus.cc:2272] T 592d34c7b1ad4f07b5e1644ada89240e P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.457393 21001 tablet_replica.cc:333] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420: stopping tablet replica
I20260709 13:09:30.457965 21001 raft_consensus.cc:2243] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.458782 21001 raft_consensus.cc:2272] T edd50e3d325646bf966915acae27c417 P a0820165e71f4b2fb2d0803fad9fb420 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.461215 21001 tablet_replica.cc:333] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420: stopping tablet replica
I20260709 13:09:30.461697 21001 raft_consensus.cc:2243] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.462153 21001 raft_consensus.cc:2272] T c204a2926c364e87b8ef95e38eec369b P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.464300 21001 tablet_replica.cc:333] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420: stopping tablet replica
I20260709 13:09:30.464761 21001 raft_consensus.cc:2243] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.465760 21001 raft_consensus.cc:2272] T c6ab67a572b540b7be34d85f34bae33b P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.467852 21001 tablet_replica.cc:333] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420: stopping tablet replica
I20260709 13:09:30.468359 21001 raft_consensus.cc:2243] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.469122 21001 raft_consensus.cc:2272] T 80b782e2a60c44d497a721f35b3f45a8 P a0820165e71f4b2fb2d0803fad9fb420 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.471571 21001 tablet_replica.cc:333] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420: stopping tablet replica
I20260709 13:09:30.472051 21001 raft_consensus.cc:2243] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.472931 21001 raft_consensus.cc:2272] T 4e83193f628a4bf19349124d2ab51a8d P a0820165e71f4b2fb2d0803fad9fb420 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.475143 21001 tablet_replica.cc:333] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420: stopping tablet replica
I20260709 13:09:30.475641 21001 raft_consensus.cc:2243] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.476135 21001 raft_consensus.cc:2272] T 878d85a39a9640bebc225db5d1cfb600 P a0820165e71f4b2fb2d0803fad9fb420 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.508400 21001 tablet_server.cc:196] TabletServer@127.20.130.66:0 shutdown complete.
W20260709 13:09:30.513442 29565 consensus_peers.cc:597] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 -> Peer a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953): Couldn't send request to peer a0820165e71f4b2fb2d0803fad9fb420. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:44953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:30.535534 21001 tablet_server.cc:179] TabletServer@127.20.130.67:0 shutting down...
W20260709 13:09:30.543354 29565 consensus_peers.cc:597] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 -> Peer a0820165e71f4b2fb2d0803fad9fb420 (127.20.130.66:44953): Couldn't send request to peer a0820165e71f4b2fb2d0803fad9fb420. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:44953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:30.563930 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:30.564894 21001 tablet_replica.cc:333] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841: stopping tablet replica
I20260709 13:09:30.565683 21001 raft_consensus.cc:2243] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.566183 21001 raft_consensus.cc:2272] T 4e83193f628a4bf19349124d2ab51a8d P 3af434568070447aa4dd06f17b8ea841 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.568607 21001 tablet_replica.cc:333] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841: stopping tablet replica
I20260709 13:09:30.569180 21001 raft_consensus.cc:2243] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.570036 21001 raft_consensus.cc:2272] T 4a8d8b8082f942cf8f4846210f267c6e P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.572988 21001 tablet_replica.cc:333] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841: stopping tablet replica
I20260709 13:09:30.573635 21001 raft_consensus.cc:2243] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.574508 21001 raft_consensus.cc:2272] T 20ada9e7ba6d45a39ffccd55f1bd310b P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:30.575717 29568 consensus_peers.cc:597] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 -> Peer 7bc86c49419c4d8ea732431b6e796ad0 (127.20.130.65:40679): Couldn't send request to peer 7bc86c49419c4d8ea732431b6e796ad0. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:40679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:30.577639 21001 tablet_replica.cc:333] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841: stopping tablet replica
I20260709 13:09:30.578466 21001 raft_consensus.cc:2243] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.579555 21001 raft_consensus.cc:2272] T 8d13ed1f707a49508d2dd7a042f780f8 P 3af434568070447aa4dd06f17b8ea841 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.581976 21001 tablet_replica.cc:333] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841: stopping tablet replica
I20260709 13:09:30.582463 21001 raft_consensus.cc:2243] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.583402 21001 raft_consensus.cc:2272] T c204a2926c364e87b8ef95e38eec369b P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.585500 21001 tablet_replica.cc:333] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841: stopping tablet replica
I20260709 13:09:30.585999 21001 raft_consensus.cc:2243] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.586398 21001 raft_consensus.cc:2272] T 80b782e2a60c44d497a721f35b3f45a8 P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.588989 21001 tablet_replica.cc:333] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841: stopping tablet replica
I20260709 13:09:30.589548 21001 raft_consensus.cc:2243] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.589995 21001 raft_consensus.cc:2272] T c6ab67a572b540b7be34d85f34bae33b P 3af434568070447aa4dd06f17b8ea841 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.592058 21001 tablet_replica.cc:333] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841: stopping tablet replica
I20260709 13:09:30.592546 21001 raft_consensus.cc:2243] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.593422 21001 raft_consensus.cc:2272] T 878d85a39a9640bebc225db5d1cfb600 P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.595474 21001 tablet_replica.cc:333] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841: stopping tablet replica
I20260709 13:09:30.595930 21001 raft_consensus.cc:2243] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.596316 21001 raft_consensus.cc:2272] T 592d34c7b1ad4f07b5e1644ada89240e P 3af434568070447aa4dd06f17b8ea841 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.598631 21001 tablet_replica.cc:333] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841: stopping tablet replica
I20260709 13:09:30.599174 21001 raft_consensus.cc:2243] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.599649 21001 raft_consensus.cc:2272] T edd50e3d325646bf966915acae27c417 P 3af434568070447aa4dd06f17b8ea841 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.632520 21001 tablet_server.cc:196] TabletServer@127.20.130.67:0 shutdown complete.
I20260709 13:09:30.658804 21001 master.cc:562] Master@127.20.130.126:46151 shutting down...
I20260709 13:09:30.684008 21001 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.684609 21001 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.684950 21001 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8a0959435cd242008b58947fc65a39d7: stopping tablet replica
I20260709 13:09:30.704703 21001 master.cc:584] Master@127.20.130.126:46151 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13151 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:09:30.751513 21001 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.130.126:44271
I20260709 13:09:30.752795 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:30.759253 29933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:30.759380 29934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:30.759948 29936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:30.760624 21001 server_base.cc:1061] running on GCE node
I20260709 13:09:30.761623 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:30.761860 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:30.762025 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602570762003 us; error 0 us; skew 500 ppm
I20260709 13:09:30.762537 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:30.764889 21001 webserver.cc:533] Webserver started at http://127.20.130.126:45847/ using document root <none> and password file <none>
I20260709 13:09:30.765427 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:30.765633 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:30.765906 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:30.767169 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/master-0-root/instance:
uuid: "cf76566c64b947b0b08d2e3fd9dfe35c"
format_stamp: "Formatted at 2026-07-09 13:09:30 on dist-test-slave-csvd"
I20260709 13:09:30.771587 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:09:30.774981 29941 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:30.775725 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:30.776041 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/master-0-root
uuid: "cf76566c64b947b0b08d2e3fd9dfe35c"
format_stamp: "Formatted at 2026-07-09 13:09:30 on dist-test-slave-csvd"
I20260709 13:09:30.776320 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:30.804069 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:30.805521 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:30.846521 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.126:44271
I20260709 13:09:30.846633 29992 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.126:44271 every 8 connection(s)
I20260709 13:09:30.850667 29993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:30.863041 29993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c: Bootstrap starting.
I20260709 13:09:30.868343 29993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.872946 29993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c: No bootstrap required, opened a new log
I20260709 13:09:30.875119 29993 raft_consensus.cc:359] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf76566c64b947b0b08d2e3fd9dfe35c" member_type: VOTER }
I20260709 13:09:30.875499 29993 raft_consensus.cc:385] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.875674 29993 raft_consensus.cc:740] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf76566c64b947b0b08d2e3fd9dfe35c, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.876296 29993 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf76566c64b947b0b08d2e3fd9dfe35c" member_type: VOTER }
I20260709 13:09:30.876725 29993 raft_consensus.cc:399] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:30.876911 29993 raft_consensus.cc:493] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:30.877123 29993 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.882031 29993 raft_consensus.cc:515] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf76566c64b947b0b08d2e3fd9dfe35c" member_type: VOTER }
I20260709 13:09:30.882506 29993 leader_election.cc:304] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf76566c64b947b0b08d2e3fd9dfe35c; no voters: 
I20260709 13:09:30.883656 29993 leader_election.cc:290] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:30.884029 29996 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.885382 29996 raft_consensus.cc:697] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [term 1 LEADER]: Becoming Leader. State: Replica: cf76566c64b947b0b08d2e3fd9dfe35c, State: Running, Role: LEADER
I20260709 13:09:30.886066 29996 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf76566c64b947b0b08d2e3fd9dfe35c" member_type: VOTER }
I20260709 13:09:30.886606 29993 sys_catalog.cc:565] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:30.893028 29998 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf76566c64b947b0b08d2e3fd9dfe35c. Latest consensus state: current_term: 1 leader_uuid: "cf76566c64b947b0b08d2e3fd9dfe35c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf76566c64b947b0b08d2e3fd9dfe35c" member_type: VOTER } }
I20260709 13:09:30.893049 29997 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf76566c64b947b0b08d2e3fd9dfe35c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf76566c64b947b0b08d2e3fd9dfe35c" member_type: VOTER } }
I20260709 13:09:30.894062 29998 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:30.894098 29997 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:30.896121 30006 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:30.900892 30006 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:30.902714 21001 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:30.909824 30006 catalog_manager.cc:1383] Generated new cluster ID: b68c05cb0e0446edb019d96a85ecc176
I20260709 13:09:30.910135 30006 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:30.923885 30006 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:30.925210 30006 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:30.938616 30006 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c: Generated new TSK 0
I20260709 13:09:30.939304 30006 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:30.969619 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:30.975847 30014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:30.976647 30015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:30.978667 21001 server_base.cc:1061] running on GCE node
W20260709 13:09:30.978663 30017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:30.979974 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:30.980181 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:30.980304 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602570980293 us; error 0 us; skew 500 ppm
I20260709 13:09:30.980779 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:30.983227 21001 webserver.cc:533] Webserver started at http://127.20.130.65:45247/ using document root <none> and password file <none>
I20260709 13:09:30.983685 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:30.983840 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:30.984052 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:30.985172 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/ts-0-root/instance:
uuid: "a1211f4238dd4e498de8e4cf239e6d3d"
format_stamp: "Formatted at 2026-07-09 13:09:30 on dist-test-slave-csvd"
I20260709 13:09:30.989884 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:09:30.993388 30022 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:30.994355 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:09:30.994639 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/ts-0-root
uuid: "a1211f4238dd4e498de8e4cf239e6d3d"
format_stamp: "Formatted at 2026-07-09 13:09:30 on dist-test-slave-csvd"
I20260709 13:09:30.994877 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:31.013628 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:31.014833 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:31.016321 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:31.018710 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:31.018992 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:09:31.019261 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:31.019438 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.060891 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.65:41625
I20260709 13:09:31.060978 30084 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.65:41625 every 8 connection(s)
I20260709 13:09:31.065960 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:31.074976 30089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.076092 30090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:31.078542 21001 server_base.cc:1061] running on GCE node
I20260709 13:09:31.081856 30085 heartbeater.cc:344] Connected to a master server at 127.20.130.126:44271
W20260709 13:09:31.080730 30092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:31.082574 30085 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:31.083424 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:31.083590 30085 heartbeater.cc:507] Master 127.20.130.126:44271 requested a full tablet report, sending...
W20260709 13:09:31.083772 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:31.084018 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602571083998 us; error 0 us; skew 500 ppm
I20260709 13:09:31.084782 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:31.085928 29958 ts_manager.cc:194] Registered new tserver with Master: a1211f4238dd4e498de8e4cf239e6d3d (127.20.130.65:41625)
I20260709 13:09:31.087422 21001 webserver.cc:533] Webserver started at http://127.20.130.66:42447/ using document root <none> and password file <none>
I20260709 13:09:31.087997 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:31.088245 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:31.088306 29958 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50548
I20260709 13:09:31.088513 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:31.089926 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/ts-1-root/instance:
uuid: "51a38ba837db4c40a9a14cef116f5fa1"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-csvd"
I20260709 13:09:31.094687 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:31.098238 30097 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.099125 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:31.099377 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/ts-1-root
uuid: "51a38ba837db4c40a9a14cef116f5fa1"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-csvd"
I20260709 13:09:31.099619 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:31.112313 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:31.113409 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:31.114821 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:31.117024 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:31.117197 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.117503 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:31.117663 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.158243 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.66:34487
I20260709 13:09:31.158370 30159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.66:34487 every 8 connection(s)
I20260709 13:09:31.163277 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:31.170025 30163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.173281 30164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.178031 30166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:31.178786 21001 server_base.cc:1061] running on GCE node
I20260709 13:09:31.179785 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:31.180049 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:31.180178 30160 heartbeater.cc:344] Connected to a master server at 127.20.130.126:44271
I20260709 13:09:31.180285 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602571180264 us; error 0 us; skew 500 ppm
I20260709 13:09:31.180670 30160 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:31.181175 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:31.181584 30160 heartbeater.cc:507] Master 127.20.130.126:44271 requested a full tablet report, sending...
I20260709 13:09:31.183949 21001 webserver.cc:533] Webserver started at http://127.20.130.67:41537/ using document root <none> and password file <none>
I20260709 13:09:31.183952 29958 ts_manager.cc:194] Registered new tserver with Master: 51a38ba837db4c40a9a14cef116f5fa1 (127.20.130.66:34487)
I20260709 13:09:31.184649 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:31.184898 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:31.185168 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:31.185695 29958 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50558
I20260709 13:09:31.186337 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/ts-2-root/instance:
uuid: "60ab7a41742140b693e0e9c72b4da4a0"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-csvd"
I20260709 13:09:31.190999 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:09:31.194466 30171 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.195469 21001 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:31.195806 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/ts-2-root
uuid: "60ab7a41742140b693e0e9c72b4da4a0"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-csvd"
I20260709 13:09:31.196127 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602291548094-21001-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:31.213184 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:31.214412 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:31.215941 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:31.218152 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:31.218392 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.218636 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:31.218813 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.259459 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.67:43363
I20260709 13:09:31.259574 30233 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.67:43363 every 8 connection(s)
I20260709 13:09:31.272802 30234 heartbeater.cc:344] Connected to a master server at 127.20.130.126:44271
I20260709 13:09:31.273272 30234 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:31.274039 30234 heartbeater.cc:507] Master 127.20.130.126:44271 requested a full tablet report, sending...
I20260709 13:09:31.276108 29958 ts_manager.cc:194] Registered new tserver with Master: 60ab7a41742140b693e0e9c72b4da4a0 (127.20.130.67:43363)
I20260709 13:09:31.277029 21001 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014394712s
I20260709 13:09:31.277527 29958 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50566
I20260709 13:09:31.303719 29958 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50570:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:31.305996 29958 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:31.357589 30199 tablet_service.cc:1511] Processing CreateTablet for tablet 9a1c617da60c4fa089f127628ea54724 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f80db2b6dcdd4461b49ad14c06367182]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:31.359148 30199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a1c617da60c4fa089f127628ea54724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.363749 30198 tablet_service.cc:1511] Processing CreateTablet for tablet dcb746fe7a894e52bfc7f399058d8df6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f80db2b6dcdd4461b49ad14c06367182]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:31.365260 30198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb746fe7a894e52bfc7f399058d8df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.371371 30125 tablet_service.cc:1511] Processing CreateTablet for tablet 9a1c617da60c4fa089f127628ea54724 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f80db2b6dcdd4461b49ad14c06367182]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:31.373063 30125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a1c617da60c4fa089f127628ea54724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.374151 30050 tablet_service.cc:1511] Processing CreateTablet for tablet 9a1c617da60c4fa089f127628ea54724 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f80db2b6dcdd4461b49ad14c06367182]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:31.375732 30050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a1c617da60c4fa089f127628ea54724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.380555 30124 tablet_service.cc:1511] Processing CreateTablet for tablet dcb746fe7a894e52bfc7f399058d8df6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f80db2b6dcdd4461b49ad14c06367182]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:31.382031 30124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb746fe7a894e52bfc7f399058d8df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.377313 30049 tablet_service.cc:1511] Processing CreateTablet for tablet dcb746fe7a894e52bfc7f399058d8df6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f80db2b6dcdd4461b49ad14c06367182]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:31.383862 30049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb746fe7a894e52bfc7f399058d8df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.417588 30251 tablet_bootstrap.cc:492] T dcb746fe7a894e52bfc7f399058d8df6 P a1211f4238dd4e498de8e4cf239e6d3d: Bootstrap starting.
I20260709 13:09:31.420008 30249 tablet_bootstrap.cc:492] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0: Bootstrap starting.
I20260709 13:09:31.420511 30250 tablet_bootstrap.cc:492] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1: Bootstrap starting.
I20260709 13:09:31.426584 30249 tablet_bootstrap.cc:654] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.427564 30251 tablet_bootstrap.cc:654] T dcb746fe7a894e52bfc7f399058d8df6 P a1211f4238dd4e498de8e4cf239e6d3d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.427903 30250 tablet_bootstrap.cc:654] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.432099 30249 tablet_bootstrap.cc:492] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0: No bootstrap required, opened a new log
I20260709 13:09:31.432767 30249 ts_tablet_manager.cc:1403] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.003s
I20260709 13:09:31.433451 30251 tablet_bootstrap.cc:492] T dcb746fe7a894e52bfc7f399058d8df6 P a1211f4238dd4e498de8e4cf239e6d3d: No bootstrap required, opened a new log
I20260709 13:09:31.434048 30251 ts_tablet_manager.cc:1403] T dcb746fe7a894e52bfc7f399058d8df6 P a1211f4238dd4e498de8e4cf239e6d3d: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 13:09:31.434653 30250 tablet_bootstrap.cc:492] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1: No bootstrap required, opened a new log
I20260709 13:09:31.435213 30250 ts_tablet_manager.cc:1403] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.009s
I20260709 13:09:31.437315 30249 raft_consensus.cc:359] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } } peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } }
I20260709 13:09:31.437202 30251 raft_consensus.cc:359] T dcb746fe7a894e52bfc7f399058d8df6 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.438087 30249 raft_consensus.cc:385] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.438191 30251 raft_consensus.cc:385] T dcb746fe7a894e52bfc7f399058d8df6 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.438459 30249 raft_consensus.cc:740] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60ab7a41742140b693e0e9c72b4da4a0, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.438175 30250 raft_consensus.cc:359] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } } peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } }
I20260709 13:09:31.438853 30251 raft_consensus.cc:740] T dcb746fe7a894e52bfc7f399058d8df6 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1211f4238dd4e498de8e4cf239e6d3d, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.439225 30250 raft_consensus.cc:385] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.439631 30250 raft_consensus.cc:740] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a38ba837db4c40a9a14cef116f5fa1, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.439667 30249 consensus_queue.cc:260] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } } peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } }
I20260709 13:09:31.439834 30251 consensus_queue.cc:260] T dcb746fe7a894e52bfc7f399058d8df6 P a1211f4238dd4e498de8e4cf239e6d3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.440498 30250 consensus_queue.cc:260] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } } peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } }
I20260709 13:09:31.442548 30234 heartbeater.cc:499] Master 127.20.130.126:44271 was elected leader, sending a full tablet report...
I20260709 13:09:31.443240 30249 ts_tablet_manager.cc:1434] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:09:31.450358 30249 tablet_bootstrap.cc:492] T dcb746fe7a894e52bfc7f399058d8df6 P 60ab7a41742140b693e0e9c72b4da4a0: Bootstrap starting.
I20260709 13:09:31.451362 30250 ts_tablet_manager.cc:1434] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.010s
I20260709 13:09:31.452675 30160 heartbeater.cc:499] Master 127.20.130.126:44271 was elected leader, sending a full tablet report...
I20260709 13:09:31.451464 30251 ts_tablet_manager.cc:1434] T dcb746fe7a894e52bfc7f399058d8df6 P a1211f4238dd4e498de8e4cf239e6d3d: Time spent starting tablet: real 0.017s	user 0.014s	sys 0.001s
I20260709 13:09:31.455084 30085 heartbeater.cc:499] Master 127.20.130.126:44271 was elected leader, sending a full tablet report...
I20260709 13:09:31.455771 30251 tablet_bootstrap.cc:492] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d: Bootstrap starting.
I20260709 13:09:31.456132 30250 tablet_bootstrap.cc:492] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1: Bootstrap starting.
I20260709 13:09:31.462816 30251 tablet_bootstrap.cc:654] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.463155 30250 tablet_bootstrap.cc:654] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.469341 30250 tablet_bootstrap.cc:492] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1: No bootstrap required, opened a new log
I20260709 13:09:31.470197 30250 ts_tablet_manager.cc:1403] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.007s
I20260709 13:09:31.473856 30250 raft_consensus.cc:359] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.474692 30250 raft_consensus.cc:385] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.475085 30250 raft_consensus.cc:740] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a38ba837db4c40a9a14cef116f5fa1, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.475266 30251 tablet_bootstrap.cc:492] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d: No bootstrap required, opened a new log
I20260709 13:09:31.475896 30251 ts_tablet_manager.cc:1403] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.001s
I20260709 13:09:31.476099 30250 consensus_queue.cc:260] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.478504 30250 ts_tablet_manager.cc:1434] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:09:31.479336 30251 raft_consensus.cc:359] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } } peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } }
I20260709 13:09:31.479990 30251 raft_consensus.cc:385] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.480255 30251 raft_consensus.cc:740] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1211f4238dd4e498de8e4cf239e6d3d, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.480779 30249 tablet_bootstrap.cc:654] T dcb746fe7a894e52bfc7f399058d8df6 P 60ab7a41742140b693e0e9c72b4da4a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.481097 30251 consensus_queue.cc:260] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } } peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } }
I20260709 13:09:31.483230 30251 ts_tablet_manager.cc:1434] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:31.487048 30249 tablet_bootstrap.cc:492] T dcb746fe7a894e52bfc7f399058d8df6 P 60ab7a41742140b693e0e9c72b4da4a0: No bootstrap required, opened a new log
I20260709 13:09:31.487917 30249 ts_tablet_manager.cc:1403] T dcb746fe7a894e52bfc7f399058d8df6 P 60ab7a41742140b693e0e9c72b4da4a0: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.004s
I20260709 13:09:31.491434 30249 raft_consensus.cc:359] T dcb746fe7a894e52bfc7f399058d8df6 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.492329 30249 raft_consensus.cc:385] T dcb746fe7a894e52bfc7f399058d8df6 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.492698 30249 raft_consensus.cc:740] T dcb746fe7a894e52bfc7f399058d8df6 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60ab7a41742140b693e0e9c72b4da4a0, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.493567 30249 consensus_queue.cc:260] T dcb746fe7a894e52bfc7f399058d8df6 P 60ab7a41742140b693e0e9c72b4da4a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.495819 30249 ts_tablet_manager.cc:1434] T dcb746fe7a894e52bfc7f399058d8df6 P 60ab7a41742140b693e0e9c72b4da4a0: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:09:31.508479 30257 raft_consensus.cc:493] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.509277 30257 raft_consensus.cc:515] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.511632 30257 leader_election.cc:290] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1211f4238dd4e498de8e4cf239e6d3d (127.20.130.65:41625), 60ab7a41742140b693e0e9c72b4da4a0 (127.20.130.67:43363)
I20260709 13:09:31.521399 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb746fe7a894e52bfc7f399058d8df6" candidate_uuid: "51a38ba837db4c40a9a14cef116f5fa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" is_pre_election: true
I20260709 13:09:31.522218 30060 raft_consensus.cc:2468] T dcb746fe7a894e52bfc7f399058d8df6 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a38ba837db4c40a9a14cef116f5fa1 in term 0.
I20260709 13:09:31.523453 30099 leader_election.cc:304] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a38ba837db4c40a9a14cef116f5fa1, a1211f4238dd4e498de8e4cf239e6d3d; no voters: 
I20260709 13:09:31.524315 30257 raft_consensus.cc:2804] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.524273 30209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb746fe7a894e52bfc7f399058d8df6" candidate_uuid: "51a38ba837db4c40a9a14cef116f5fa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ab7a41742140b693e0e9c72b4da4a0" is_pre_election: true
I20260709 13:09:31.524830 30257 raft_consensus.cc:493] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.525156 30209 raft_consensus.cc:2468] T dcb746fe7a894e52bfc7f399058d8df6 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a38ba837db4c40a9a14cef116f5fa1 in term 0.
I20260709 13:09:31.525220 30257 raft_consensus.cc:3060] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.531229 30257 raft_consensus.cc:515] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.532970 30257 leader_election.cc:290] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [CANDIDATE]: Term 1 election: Requested vote from peers a1211f4238dd4e498de8e4cf239e6d3d (127.20.130.65:41625), 60ab7a41742140b693e0e9c72b4da4a0 (127.20.130.67:43363)
I20260709 13:09:31.533775 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb746fe7a894e52bfc7f399058d8df6" candidate_uuid: "51a38ba837db4c40a9a14cef116f5fa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1211f4238dd4e498de8e4cf239e6d3d"
I20260709 13:09:31.534017 30209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb746fe7a894e52bfc7f399058d8df6" candidate_uuid: "51a38ba837db4c40a9a14cef116f5fa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ab7a41742140b693e0e9c72b4da4a0"
I20260709 13:09:31.534327 30060 raft_consensus.cc:3060] T dcb746fe7a894e52bfc7f399058d8df6 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.534622 30209 raft_consensus.cc:3060] T dcb746fe7a894e52bfc7f399058d8df6 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.539813 30060 raft_consensus.cc:2468] T dcb746fe7a894e52bfc7f399058d8df6 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a38ba837db4c40a9a14cef116f5fa1 in term 1.
I20260709 13:09:31.539938 30209 raft_consensus.cc:2468] T dcb746fe7a894e52bfc7f399058d8df6 P 60ab7a41742140b693e0e9c72b4da4a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a38ba837db4c40a9a14cef116f5fa1 in term 1.
I20260709 13:09:31.541036 30099 leader_election.cc:304] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a38ba837db4c40a9a14cef116f5fa1, a1211f4238dd4e498de8e4cf239e6d3d; no voters: 
I20260709 13:09:31.541824 30257 raft_consensus.cc:2804] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.542877 30257 raft_consensus.cc:697] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 LEADER]: Becoming Leader. State: Replica: 51a38ba837db4c40a9a14cef116f5fa1, State: Running, Role: LEADER
I20260709 13:09:31.543607 30257 consensus_queue.cc:237] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.552678 29956 catalog_manager.cc:5697] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51a38ba837db4c40a9a14cef116f5fa1 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "51a38ba837db4c40a9a14cef116f5fa1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:31.562685 30257 raft_consensus.cc:493] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.563258 30257 raft_consensus.cc:515] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } } peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } }
I20260709 13:09:31.565050 30257 leader_election.cc:290] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60ab7a41742140b693e0e9c72b4da4a0 (127.20.130.67:43363), a1211f4238dd4e498de8e4cf239e6d3d (127.20.130.65:41625)
I20260709 13:09:31.565840 30209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1c617da60c4fa089f127628ea54724" candidate_uuid: "51a38ba837db4c40a9a14cef116f5fa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ab7a41742140b693e0e9c72b4da4a0" is_pre_election: true
I20260709 13:09:31.566032 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1c617da60c4fa089f127628ea54724" candidate_uuid: "51a38ba837db4c40a9a14cef116f5fa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" is_pre_election: true
I20260709 13:09:31.566515 30209 raft_consensus.cc:2468] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a38ba837db4c40a9a14cef116f5fa1 in term 0.
I20260709 13:09:31.566671 30060 raft_consensus.cc:2468] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a38ba837db4c40a9a14cef116f5fa1 in term 0.
I20260709 13:09:31.567660 30100 leader_election.cc:304] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a38ba837db4c40a9a14cef116f5fa1, 60ab7a41742140b693e0e9c72b4da4a0; no voters: 
I20260709 13:09:31.568332 30257 raft_consensus.cc:2804] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.568673 30257 raft_consensus.cc:493] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.568897 30257 raft_consensus.cc:3060] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.573717 30257 raft_consensus.cc:515] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } } peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } }
I20260709 13:09:31.575464 30257 leader_election.cc:290] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [CANDIDATE]: Term 1 election: Requested vote from peers 60ab7a41742140b693e0e9c72b4da4a0 (127.20.130.67:43363), a1211f4238dd4e498de8e4cf239e6d3d (127.20.130.65:41625)
I20260709 13:09:31.576412 30209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1c617da60c4fa089f127628ea54724" candidate_uuid: "51a38ba837db4c40a9a14cef116f5fa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ab7a41742140b693e0e9c72b4da4a0"
I20260709 13:09:31.576683 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1c617da60c4fa089f127628ea54724" candidate_uuid: "51a38ba837db4c40a9a14cef116f5fa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1211f4238dd4e498de8e4cf239e6d3d"
I20260709 13:09:31.576959 30209 raft_consensus.cc:3060] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.577420 30060 raft_consensus.cc:3060] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.583810 30209 raft_consensus.cc:2468] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a38ba837db4c40a9a14cef116f5fa1 in term 1.
I20260709 13:09:31.584681 30060 raft_consensus.cc:2468] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a38ba837db4c40a9a14cef116f5fa1 in term 1.
I20260709 13:09:31.584975 30100 leader_election.cc:304] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a38ba837db4c40a9a14cef116f5fa1, 60ab7a41742140b693e0e9c72b4da4a0; no voters: 
I20260709 13:09:31.585830 30257 raft_consensus.cc:2804] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.586239 30257 raft_consensus.cc:697] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 LEADER]: Becoming Leader. State: Replica: 51a38ba837db4c40a9a14cef116f5fa1, State: Running, Role: LEADER
I20260709 13:09:31.586870 30257 consensus_queue.cc:237] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } } peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } }
I20260709 13:09:31.593689 29956 catalog_manager.cc:5697] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51a38ba837db4c40a9a14cef116f5fa1 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "51a38ba837db4c40a9a14cef116f5fa1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:31.632831 29956 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50574:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:31.634688 29956 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:31.657811 30050 tablet_service.cc:1511] Processing CreateTablet for tablet cc2986cf23ef4245840a0cc3eb516f45 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3c699df9d5084315a317d0747d83ca66]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:31.659144 30050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc2986cf23ef4245840a0cc3eb516f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.658864 30125 tablet_service.cc:1511] Processing CreateTablet for tablet cc2986cf23ef4245840a0cc3eb516f45 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3c699df9d5084315a317d0747d83ca66]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:31.660140 30125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc2986cf23ef4245840a0cc3eb516f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.662606 30199 tablet_service.cc:1511] Processing CreateTablet for tablet cc2986cf23ef4245840a0cc3eb516f45 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3c699df9d5084315a317d0747d83ca66]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:31.663875 30199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc2986cf23ef4245840a0cc3eb516f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.664239 30124 tablet_service.cc:1511] Processing CreateTablet for tablet 740d1e5467ce4250960dbb48ce5a9ca3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3c699df9d5084315a317d0747d83ca66]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:31.664762 30049 tablet_service.cc:1511] Processing CreateTablet for tablet 740d1e5467ce4250960dbb48ce5a9ca3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3c699df9d5084315a317d0747d83ca66]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:31.665477 30124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 740d1e5467ce4250960dbb48ce5a9ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.665974 30049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 740d1e5467ce4250960dbb48ce5a9ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.666553 30198 tablet_service.cc:1511] Processing CreateTablet for tablet 740d1e5467ce4250960dbb48ce5a9ca3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3c699df9d5084315a317d0747d83ca66]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:31.667810 30198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 740d1e5467ce4250960dbb48ce5a9ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.683393 30250 tablet_bootstrap.cc:492] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1: Bootstrap starting.
I20260709 13:09:31.683498 30251 tablet_bootstrap.cc:492] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d: Bootstrap starting.
I20260709 13:09:31.690224 30250 tablet_bootstrap.cc:654] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.690670 30251 tablet_bootstrap.cc:654] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.709738 30249 tablet_bootstrap.cc:492] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0: Bootstrap starting.
I20260709 13:09:31.719399 30251 tablet_bootstrap.cc:492] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d: No bootstrap required, opened a new log
I20260709 13:09:31.720063 30251 ts_tablet_manager.cc:1403] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.017s
I20260709 13:09:31.720922 30249 tablet_bootstrap.cc:654] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.722498 30250 tablet_bootstrap.cc:492] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1: No bootstrap required, opened a new log
I20260709 13:09:31.723117 30250 ts_tablet_manager.cc:1403] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.022s
I20260709 13:09:31.723220 30251 raft_consensus.cc:359] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.723963 30251 raft_consensus.cc:385] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.724224 30251 raft_consensus.cc:740] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1211f4238dd4e498de8e4cf239e6d3d, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.725088 30251 consensus_queue.cc:260] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.726236 30250 raft_consensus.cc:359] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.727072 30250 raft_consensus.cc:385] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.727443 30250 raft_consensus.cc:740] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a38ba837db4c40a9a14cef116f5fa1, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.727641 30251 ts_tablet_manager.cc:1434] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:31.728801 30251 tablet_bootstrap.cc:492] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d: Bootstrap starting.
I20260709 13:09:31.728426 30250 consensus_queue.cc:260] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.730803 30250 ts_tablet_manager.cc:1434] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:09:31.731889 30250 tablet_bootstrap.cc:492] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1: Bootstrap starting.
I20260709 13:09:31.733661 30249 tablet_bootstrap.cc:492] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0: No bootstrap required, opened a new log
I20260709 13:09:31.734279 30249 ts_tablet_manager.cc:1403] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260709 13:09:31.736029 30251 tablet_bootstrap.cc:654] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.742059 30249 raft_consensus.cc:359] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.742913 30249 raft_consensus.cc:385] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.743315 30249 raft_consensus.cc:740] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60ab7a41742140b693e0e9c72b4da4a0, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.744261 30249 consensus_queue.cc:260] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.746529 30249 ts_tablet_manager.cc:1434] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:09:31.746907 30250 tablet_bootstrap.cc:654] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.747808 30249 tablet_bootstrap.cc:492] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0: Bootstrap starting.
I20260709 13:09:31.758343 30249 tablet_bootstrap.cc:654] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.758536 30251 tablet_bootstrap.cc:492] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d: No bootstrap required, opened a new log
I20260709 13:09:31.759483 30251 ts_tablet_manager.cc:1403] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.019s
I20260709 13:09:31.763358 30251 raft_consensus.cc:359] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.764101 30250 tablet_bootstrap.cc:492] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1: No bootstrap required, opened a new log
I20260709 13:09:31.764226 30251 raft_consensus.cc:385] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.764706 30251 raft_consensus.cc:740] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1211f4238dd4e498de8e4cf239e6d3d, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.764762 30250 ts_tablet_manager.cc:1403] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.004s
I20260709 13:09:31.765585 30249 tablet_bootstrap.cc:492] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0: No bootstrap required, opened a new log
I20260709 13:09:31.766196 30249 ts_tablet_manager.cc:1403] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:09:31.765784 30251 consensus_queue.cc:260] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.768256 30251 ts_tablet_manager.cc:1434] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:31.768265 30250 raft_consensus.cc:359] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.769106 30250 raft_consensus.cc:385] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.769493 30250 raft_consensus.cc:740] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a38ba837db4c40a9a14cef116f5fa1, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.769251 30249 raft_consensus.cc:359] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.770061 30249 raft_consensus.cc:385] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.770376 30249 raft_consensus.cc:740] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60ab7a41742140b693e0e9c72b4da4a0, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.770375 30250 consensus_queue.cc:260] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.771422 30249 consensus_queue.cc:260] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.773032 30250 ts_tablet_manager.cc:1434] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:31.775471 30249 ts_tablet_manager.cc:1434] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:09:31.802167 30256 raft_consensus.cc:493] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.802732 30256 raft_consensus.cc:515] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.804908 30256 leader_election.cc:290] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51a38ba837db4c40a9a14cef116f5fa1 (127.20.130.66:34487), 60ab7a41742140b693e0e9c72b4da4a0 (127.20.130.67:43363)
I20260709 13:09:31.810864 30257 raft_consensus.cc:493] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.811645 30257 raft_consensus.cc:515] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.814579 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2986cf23ef4245840a0cc3eb516f45" candidate_uuid: "51a38ba837db4c40a9a14cef116f5fa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" is_pre_election: true
I20260709 13:09:31.814882 30209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2986cf23ef4245840a0cc3eb516f45" candidate_uuid: "51a38ba837db4c40a9a14cef116f5fa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ab7a41742140b693e0e9c72b4da4a0" is_pre_election: true
I20260709 13:09:31.815301 30060 raft_consensus.cc:2468] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a38ba837db4c40a9a14cef116f5fa1 in term 0.
I20260709 13:09:31.815644 30209 raft_consensus.cc:2468] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a38ba837db4c40a9a14cef116f5fa1 in term 0.
I20260709 13:09:31.814610 30257 leader_election.cc:290] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1211f4238dd4e498de8e4cf239e6d3d (127.20.130.65:41625), 60ab7a41742140b693e0e9c72b4da4a0 (127.20.130.67:43363)
I20260709 13:09:31.816767 30100 leader_election.cc:304] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a38ba837db4c40a9a14cef116f5fa1, 60ab7a41742140b693e0e9c72b4da4a0; no voters: 
I20260709 13:09:31.817320 30209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2986cf23ef4245840a0cc3eb516f45" candidate_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ab7a41742140b693e0e9c72b4da4a0" is_pre_election: true
I20260709 13:09:31.817955 30209 raft_consensus.cc:2468] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1211f4238dd4e498de8e4cf239e6d3d in term 0.
I20260709 13:09:31.818197 30257 raft_consensus.cc:2804] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.818681 30257 raft_consensus.cc:493] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.819026 30257 raft_consensus.cc:3060] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.819658 30025 leader_election.cc:304] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60ab7a41742140b693e0e9c72b4da4a0, a1211f4238dd4e498de8e4cf239e6d3d; no voters: 
I20260709 13:09:31.820747 30256 raft_consensus.cc:2804] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.821133 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2986cf23ef4245840a0cc3eb516f45" candidate_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a38ba837db4c40a9a14cef116f5fa1" is_pre_election: true
I20260709 13:09:31.821173 30256 raft_consensus.cc:493] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.821761 30256 raft_consensus.cc:3060] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.827751 30257 raft_consensus.cc:515] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.829147 30135 raft_consensus.cc:2393] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1211f4238dd4e498de8e4cf239e6d3d in current term 1: Already voted for candidate 51a38ba837db4c40a9a14cef116f5fa1 in this term.
I20260709 13:09:31.830634 30256 raft_consensus.cc:515] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.831312 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2986cf23ef4245840a0cc3eb516f45" candidate_uuid: "51a38ba837db4c40a9a14cef116f5fa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1211f4238dd4e498de8e4cf239e6d3d"
I20260709 13:09:31.831676 30209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2986cf23ef4245840a0cc3eb516f45" candidate_uuid: "51a38ba837db4c40a9a14cef116f5fa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ab7a41742140b693e0e9c72b4da4a0"
I20260709 13:09:31.832195 30060 raft_consensus.cc:2393] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 51a38ba837db4c40a9a14cef116f5fa1 in current term 1: Already voted for candidate a1211f4238dd4e498de8e4cf239e6d3d in this term.
I20260709 13:09:31.832346 30209 raft_consensus.cc:3060] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.834203 30256 leader_election.cc:290] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [CANDIDATE]: Term 1 election: Requested vote from peers 51a38ba837db4c40a9a14cef116f5fa1 (127.20.130.66:34487), 60ab7a41742140b693e0e9c72b4da4a0 (127.20.130.67:43363)
I20260709 13:09:31.835659 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2986cf23ef4245840a0cc3eb516f45" candidate_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a38ba837db4c40a9a14cef116f5fa1"
I20260709 13:09:31.836640 30135 raft_consensus.cc:2393] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1211f4238dd4e498de8e4cf239e6d3d in current term 1: Already voted for candidate 51a38ba837db4c40a9a14cef116f5fa1 in this term.
I20260709 13:09:31.837628 30208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2986cf23ef4245840a0cc3eb516f45" candidate_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ab7a41742140b693e0e9c72b4da4a0"
I20260709 13:09:31.839560 30025 leader_election.cc:304] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1211f4238dd4e498de8e4cf239e6d3d; no voters: 51a38ba837db4c40a9a14cef116f5fa1, 60ab7a41742140b693e0e9c72b4da4a0
I20260709 13:09:31.840487 30256 raft_consensus.cc:2749] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:31.841146 30209 raft_consensus.cc:2468] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a38ba837db4c40a9a14cef116f5fa1 in term 1.
I20260709 13:09:31.842614 30257 leader_election.cc:290] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [CANDIDATE]: Term 1 election: Requested vote from peers a1211f4238dd4e498de8e4cf239e6d3d (127.20.130.65:41625), 60ab7a41742140b693e0e9c72b4da4a0 (127.20.130.67:43363)
I20260709 13:09:31.842392 30100 leader_election.cc:304] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51a38ba837db4c40a9a14cef116f5fa1, 60ab7a41742140b693e0e9c72b4da4a0; no voters: a1211f4238dd4e498de8e4cf239e6d3d
I20260709 13:09:31.844023 30257 raft_consensus.cc:2804] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.844396 30257 raft_consensus.cc:697] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 LEADER]: Becoming Leader. State: Replica: 51a38ba837db4c40a9a14cef116f5fa1, State: Running, Role: LEADER
I20260709 13:09:31.845119 30257 consensus_queue.cc:237] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:31.852512 29956 catalog_manager.cc:5697] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51a38ba837db4c40a9a14cef116f5fa1 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "51a38ba837db4c40a9a14cef116f5fa1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:31.898196 30005 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:32.072686 30257 consensus_queue.cc:1048] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.080353 30280 consensus_queue.cc:1048] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.093279 30256 raft_consensus.cc:493] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.093221 30280 consensus_queue.cc:1048] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:32.093899 30256 raft_consensus.cc:515] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:32.097231 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740d1e5467ce4250960dbb48ce5a9ca3" candidate_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a38ba837db4c40a9a14cef116f5fa1" is_pre_election: true
I20260709 13:09:32.097878 30135 raft_consensus.cc:2468] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1211f4238dd4e498de8e4cf239e6d3d in term 0.
I20260709 13:09:32.099231 30026 leader_election.cc:304] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a38ba837db4c40a9a14cef116f5fa1, a1211f4238dd4e498de8e4cf239e6d3d; no voters: 
I20260709 13:09:32.100399 30262 consensus_queue.cc:1048] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:32.100451 30256 leader_election.cc:290] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51a38ba837db4c40a9a14cef116f5fa1 (127.20.130.66:34487), 60ab7a41742140b693e0e9c72b4da4a0 (127.20.130.67:43363)
I20260709 13:09:32.102721 30256 raft_consensus.cc:2804] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.103160 30256 raft_consensus.cc:493] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.103626 30256 raft_consensus.cc:3060] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.107440 30209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740d1e5467ce4250960dbb48ce5a9ca3" candidate_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ab7a41742140b693e0e9c72b4da4a0" is_pre_election: true
I20260709 13:09:32.109129 30209 raft_consensus.cc:2468] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1211f4238dd4e498de8e4cf239e6d3d in term 0.
I20260709 13:09:32.115401 30256 raft_consensus.cc:515] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:32.118777 30208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740d1e5467ce4250960dbb48ce5a9ca3" candidate_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ab7a41742140b693e0e9c72b4da4a0"
I20260709 13:09:32.119516 30208 raft_consensus.cc:3060] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.119544 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740d1e5467ce4250960dbb48ce5a9ca3" candidate_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a38ba837db4c40a9a14cef116f5fa1"
I20260709 13:09:32.120261 30135 raft_consensus.cc:3060] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.128274 30135 raft_consensus.cc:2468] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1211f4238dd4e498de8e4cf239e6d3d in term 1.
I20260709 13:09:32.128274 30208 raft_consensus.cc:2468] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1211f4238dd4e498de8e4cf239e6d3d in term 1.
I20260709 13:09:32.129748 30025 leader_election.cc:304] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60ab7a41742140b693e0e9c72b4da4a0, a1211f4238dd4e498de8e4cf239e6d3d; no voters: 
I20260709 13:09:32.130108 30256 leader_election.cc:290] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [CANDIDATE]: Term 1 election: Requested vote from peers 51a38ba837db4c40a9a14cef116f5fa1 (127.20.130.66:34487), 60ab7a41742140b693e0e9c72b4da4a0 (127.20.130.67:43363)
I20260709 13:09:32.130750 30256 raft_consensus.cc:2804] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.131407 30256 raft_consensus.cc:697] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 LEADER]: Becoming Leader. State: Replica: a1211f4238dd4e498de8e4cf239e6d3d, State: Running, Role: LEADER
I20260709 13:09:32.132520 30256 consensus_queue.cc:237] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:32.145008 29958 catalog_manager.cc:5697] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d reported cstate change: term changed from 0 to 1, leader changed from <none> to a1211f4238dd4e498de8e4cf239e6d3d (127.20.130.65). New cstate: current_term: 1 leader_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.274204 30135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a1c617da60c4fa089f127628ea54724"
dest_uuid: "51a38ba837db4c40a9a14cef116f5fa1"
mode: GRACEFUL
new_leader_uuid: "a1211f4238dd4e498de8e4cf239e6d3d"
 from {username='slave'} at 127.0.0.1:56968
I20260709 13:09:32.274813 30135 raft_consensus.cc:606] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 LEADER]: Received request to transfer leadership to TS a1211f4238dd4e498de8e4cf239e6d3d
I20260709 13:09:32.283713 30135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc2986cf23ef4245840a0cc3eb516f45"
dest_uuid: "51a38ba837db4c40a9a14cef116f5fa1"
mode: GRACEFUL
new_leader_uuid: "a1211f4238dd4e498de8e4cf239e6d3d"
 from {username='slave'} at 127.0.0.1:56968
I20260709 13:09:32.284296 30135 raft_consensus.cc:606] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 LEADER]: Received request to transfer leadership to TS a1211f4238dd4e498de8e4cf239e6d3d
I20260709 13:09:32.327193 30280 consensus_queue.cc:1048] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.342860 30257 consensus_queue.cc:1048] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.361152 30280 raft_consensus.cc:993] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1: : Instructing follower a1211f4238dd4e498de8e4cf239e6d3d to start an election
I20260709 13:09:32.361632 30280 raft_consensus.cc:1081] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 LEADER]: Signalling peer a1211f4238dd4e498de8e4cf239e6d3d to start an election
I20260709 13:09:32.363590 30059 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc2986cf23ef4245840a0cc3eb516f45"
dest_uuid: "a1211f4238dd4e498de8e4cf239e6d3d"
 from {username='slave'} at 127.0.0.1:55028
I20260709 13:09:32.364208 30059 raft_consensus.cc:493] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.364518 30059 raft_consensus.cc:3060] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.373075 30059 raft_consensus.cc:515] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:32.375790 30059 leader_election.cc:290] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [CANDIDATE]: Term 2 election: Requested vote from peers 51a38ba837db4c40a9a14cef116f5fa1 (127.20.130.66:34487), 60ab7a41742140b693e0e9c72b4da4a0 (127.20.130.67:43363)
I20260709 13:09:32.377179 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2986cf23ef4245840a0cc3eb516f45" candidate_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51a38ba837db4c40a9a14cef116f5fa1"
I20260709 13:09:32.377318 30208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2986cf23ef4245840a0cc3eb516f45" candidate_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60ab7a41742140b693e0e9c72b4da4a0"
I20260709 13:09:32.377730 30135 raft_consensus.cc:3055] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:32.378153 30135 raft_consensus.cc:740] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51a38ba837db4c40a9a14cef116f5fa1, State: Running, Role: LEADER
I20260709 13:09:32.378182 30208 raft_consensus.cc:3060] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.379222 30135 consensus_queue.cc:260] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:32.380569 30135 raft_consensus.cc:3060] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.389714 30135 raft_consensus.cc:2468] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1211f4238dd4e498de8e4cf239e6d3d in term 2.
I20260709 13:09:32.389866 30208 raft_consensus.cc:2468] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1211f4238dd4e498de8e4cf239e6d3d in term 2.
I20260709 13:09:32.390858 30026 leader_election.cc:304] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a38ba837db4c40a9a14cef116f5fa1, a1211f4238dd4e498de8e4cf239e6d3d; no voters: 
I20260709 13:09:32.391798 30256 raft_consensus.cc:2804] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:32.392282 30256 raft_consensus.cc:697] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 2 LEADER]: Becoming Leader. State: Replica: a1211f4238dd4e498de8e4cf239e6d3d, State: Running, Role: LEADER
I20260709 13:09:32.393069 30256 consensus_queue.cc:237] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:32.400463 29958 catalog_manager.cc:5697] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d reported cstate change: term changed from 1 to 2, leader changed from 51a38ba837db4c40a9a14cef116f5fa1 (127.20.130.66) to a1211f4238dd4e498de8e4cf239e6d3d (127.20.130.65). New cstate: current_term: 2 leader_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.521994 30256 consensus_queue.cc:1048] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.529556 30285 consensus_queue.cc:1048] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.722661 30262 raft_consensus.cc:993] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1: : Instructing follower a1211f4238dd4e498de8e4cf239e6d3d to start an election
I20260709 13:09:32.723209 30280 raft_consensus.cc:1081] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 LEADER]: Signalling peer a1211f4238dd4e498de8e4cf239e6d3d to start an election
I20260709 13:09:32.724726 30059 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a1c617da60c4fa089f127628ea54724"
dest_uuid: "a1211f4238dd4e498de8e4cf239e6d3d"
 from {username='slave'} at 127.0.0.1:55028
I20260709 13:09:32.725232 30059 raft_consensus.cc:493] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.725598 30059 raft_consensus.cc:3060] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.730517 30059 raft_consensus.cc:515] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } } peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } }
I20260709 13:09:32.732147 30059 leader_election.cc:290] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [CANDIDATE]: Term 2 election: Requested vote from peers 60ab7a41742140b693e0e9c72b4da4a0 (127.20.130.67:43363), 51a38ba837db4c40a9a14cef116f5fa1 (127.20.130.66:34487)
I20260709 13:09:32.733053 30208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1c617da60c4fa089f127628ea54724" candidate_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60ab7a41742140b693e0e9c72b4da4a0"
I20260709 13:09:32.733202 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1c617da60c4fa089f127628ea54724" candidate_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51a38ba837db4c40a9a14cef116f5fa1"
I20260709 13:09:32.733724 30208 raft_consensus.cc:3060] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.733819 30135 raft_consensus.cc:3055] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:32.734246 30135 raft_consensus.cc:740] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51a38ba837db4c40a9a14cef116f5fa1, State: Running, Role: LEADER
I20260709 13:09:32.735057 30135 consensus_queue.cc:260] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } } peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } }
I20260709 13:09:32.736014 30135 raft_consensus.cc:3060] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.739598 30208 raft_consensus.cc:2468] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1211f4238dd4e498de8e4cf239e6d3d in term 2.
I20260709 13:09:32.740895 30025 leader_election.cc:304] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60ab7a41742140b693e0e9c72b4da4a0, a1211f4238dd4e498de8e4cf239e6d3d; no voters: 
I20260709 13:09:32.741683 30256 raft_consensus.cc:2804] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:32.742146 30256 raft_consensus.cc:697] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [term 2 LEADER]: Becoming Leader. State: Replica: a1211f4238dd4e498de8e4cf239e6d3d, State: Running, Role: LEADER
I20260709 13:09:32.742700 30135 raft_consensus.cc:2468] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1211f4238dd4e498de8e4cf239e6d3d in term 2.
I20260709 13:09:32.742998 30256 consensus_queue.cc:237] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } } peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } }
I20260709 13:09:32.750104 29956 catalog_manager.cc:5697] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d reported cstate change: term changed from 1 to 2, leader changed from 51a38ba837db4c40a9a14cef116f5fa1 (127.20.130.66) to a1211f4238dd4e498de8e4cf239e6d3d (127.20.130.65). New cstate: current_term: 2 leader_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.850092 30208 raft_consensus.cc:1275] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0 [term 2 FOLLOWER]: Refusing update from remote peer a1211f4238dd4e498de8e4cf239e6d3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.851495 30256 consensus_queue.cc:1048] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:32.858841 30135 raft_consensus.cc:1275] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 2 FOLLOWER]: Refusing update from remote peer a1211f4238dd4e498de8e4cf239e6d3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.860410 30285 consensus_queue.cc:1048] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:33.034793 21001 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:09:33.036386 21001 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:09:33.036793 21001 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:09:33.048313 30059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "740d1e5467ce4250960dbb48ce5a9ca3"
dest_uuid: "a1211f4238dd4e498de8e4cf239e6d3d"
mode: GRACEFUL
new_leader_uuid: "60ab7a41742140b693e0e9c72b4da4a0"
 from {username='slave'} at 127.0.0.1:55042
I20260709 13:09:33.048859 30059 raft_consensus.cc:606] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 LEADER]: Received request to transfer leadership to TS 60ab7a41742140b693e0e9c72b4da4a0
I20260709 13:09:33.049968 21001 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:09:33.060159 30286 raft_consensus.cc:993] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d: : Instructing follower 60ab7a41742140b693e0e9c72b4da4a0 to start an election
I20260709 13:09:33.060601 30285 raft_consensus.cc:1081] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 LEADER]: Signalling peer 60ab7a41742140b693e0e9c72b4da4a0 to start an election
I20260709 13:09:33.062245 30208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "740d1e5467ce4250960dbb48ce5a9ca3"
dest_uuid: "60ab7a41742140b693e0e9c72b4da4a0"
 from {username='slave'} at 127.0.0.1:60614
I20260709 13:09:33.062840 30208 raft_consensus.cc:493] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:33.063210 30208 raft_consensus.cc:3060] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.068760 30208 raft_consensus.cc:515] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:33.071451 30208 leader_election.cc:290] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [CANDIDATE]: Term 2 election: Requested vote from peers a1211f4238dd4e498de8e4cf239e6d3d (127.20.130.65:41625), 51a38ba837db4c40a9a14cef116f5fa1 (127.20.130.66:34487)
I20260709 13:09:33.084486 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740d1e5467ce4250960dbb48ce5a9ca3" candidate_uuid: "60ab7a41742140b693e0e9c72b4da4a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51a38ba837db4c40a9a14cef116f5fa1"
I20260709 13:09:33.085114 30135 raft_consensus.cc:3060] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.086663 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "740d1e5467ce4250960dbb48ce5a9ca3" candidate_uuid: "60ab7a41742140b693e0e9c72b4da4a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1211f4238dd4e498de8e4cf239e6d3d"
I20260709 13:09:33.087371 30059 raft_consensus.cc:3055] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:33.087713 30059 raft_consensus.cc:740] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1211f4238dd4e498de8e4cf239e6d3d, State: Running, Role: LEADER
I20260709 13:09:33.088506 30059 consensus_queue.cc:260] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:33.089820 30059 raft_consensus.cc:3060] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.091921 30135 raft_consensus.cc:2468] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60ab7a41742140b693e0e9c72b4da4a0 in term 2.
I20260709 13:09:33.093129 30175 leader_election.cc:304] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a38ba837db4c40a9a14cef116f5fa1, 60ab7a41742140b693e0e9c72b4da4a0; no voters: 
I20260709 13:09:33.094113 30255 raft_consensus.cc:2804] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:33.095068 30255 raft_consensus.cc:697] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [term 2 LEADER]: Becoming Leader. State: Replica: 60ab7a41742140b693e0e9c72b4da4a0, State: Running, Role: LEADER
I20260709 13:09:33.095708 30059 raft_consensus.cc:2468] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60ab7a41742140b693e0e9c72b4da4a0 in term 2.
I20260709 13:09:33.095932 30255 consensus_queue.cc:237] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } }
I20260709 13:09:33.103394 29958 catalog_manager.cc:5697] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 reported cstate change: term changed from 1 to 2, leader changed from a1211f4238dd4e498de8e4cf239e6d3d (127.20.130.65) to 60ab7a41742140b693e0e9c72b4da4a0 (127.20.130.67). New cstate: current_term: 2 leader_uuid: "60ab7a41742140b693e0e9c72b4da4a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1211f4238dd4e498de8e4cf239e6d3d" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 41625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.125133 21001 tablet_server.cc:179] TabletServer@127.20.130.65:0 shutting down...
I20260709 13:09:33.129633 30135 raft_consensus.cc:1275] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 2 FOLLOWER]: Refusing update from remote peer a1211f4238dd4e498de8e4cf239e6d3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:33.131098 30285 consensus_queue.cc:1048] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a38ba837db4c40a9a14cef116f5fa1" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 34487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:33.142750 30208 raft_consensus.cc:1275] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0 [term 2 FOLLOWER]: Refusing update from remote peer a1211f4238dd4e498de8e4cf239e6d3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:33.145859 30286 consensus_queue.cc:1048] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60ab7a41742140b693e0e9c72b4da4a0" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:33.166342 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:33.167071 21001 tablet_replica.cc:333] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d: stopping tablet replica
I20260709 13:09:33.167745 21001 raft_consensus.cc:2243] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.168591 21001 raft_consensus.cc:2272] T cc2986cf23ef4245840a0cc3eb516f45 P a1211f4238dd4e498de8e4cf239e6d3d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.171295 21001 tablet_replica.cc:333] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d: stopping tablet replica
I20260709 13:09:33.172122 21001 raft_consensus.cc:2243] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.173071 21001 raft_consensus.cc:2272] T 9a1c617da60c4fa089f127628ea54724 P a1211f4238dd4e498de8e4cf239e6d3d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.175712 21001 tablet_replica.cc:333] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d: stopping tablet replica
I20260709 13:09:33.176227 21001 raft_consensus.cc:2243] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.176597 21001 raft_consensus.cc:2272] T 740d1e5467ce4250960dbb48ce5a9ca3 P a1211f4238dd4e498de8e4cf239e6d3d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.178809 21001 tablet_replica.cc:333] T dcb746fe7a894e52bfc7f399058d8df6 P a1211f4238dd4e498de8e4cf239e6d3d: stopping tablet replica
I20260709 13:09:33.179344 21001 raft_consensus.cc:2243] T dcb746fe7a894e52bfc7f399058d8df6 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.179749 21001 raft_consensus.cc:2272] T dcb746fe7a894e52bfc7f399058d8df6 P a1211f4238dd4e498de8e4cf239e6d3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.202898 21001 tablet_server.cc:196] TabletServer@127.20.130.65:0 shutdown complete.
I20260709 13:09:33.215052 21001 tablet_server.cc:179] TabletServer@127.20.130.66:0 shutting down...
I20260709 13:09:33.234246 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:33.234958 21001 tablet_replica.cc:333] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1: stopping tablet replica
I20260709 13:09:33.235562 21001 raft_consensus.cc:2243] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.236032 21001 raft_consensus.cc:2272] T cc2986cf23ef4245840a0cc3eb516f45 P 51a38ba837db4c40a9a14cef116f5fa1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.238260 21001 tablet_replica.cc:333] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1: stopping tablet replica
I20260709 13:09:33.238812 21001 raft_consensus.cc:2243] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.239295 21001 raft_consensus.cc:2272] T 740d1e5467ce4250960dbb48ce5a9ca3 P 51a38ba837db4c40a9a14cef116f5fa1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.241840 21001 tablet_replica.cc:333] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1: stopping tablet replica
I20260709 13:09:33.242367 21001 raft_consensus.cc:2243] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.243191 21001 raft_consensus.cc:2272] T dcb746fe7a894e52bfc7f399058d8df6 P 51a38ba837db4c40a9a14cef116f5fa1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.244913 21001 tablet_replica.cc:333] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1: stopping tablet replica
I20260709 13:09:33.245407 21001 raft_consensus.cc:2243] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.245817 21001 raft_consensus.cc:2272] T 9a1c617da60c4fa089f127628ea54724 P 51a38ba837db4c40a9a14cef116f5fa1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.268680 21001 tablet_server.cc:196] TabletServer@127.20.130.66:0 shutdown complete.
I20260709 13:09:33.282178 21001 tablet_server.cc:179] TabletServer@127.20.130.67:0 shutting down...
I20260709 13:09:33.302201 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:33.302902 21001 tablet_replica.cc:333] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0: stopping tablet replica
I20260709 13:09:33.303591 21001 raft_consensus.cc:2243] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.304073 21001 raft_consensus.cc:2272] T cc2986cf23ef4245840a0cc3eb516f45 P 60ab7a41742140b693e0e9c72b4da4a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.306393 21001 tablet_replica.cc:333] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0: stopping tablet replica
I20260709 13:09:33.306964 21001 raft_consensus.cc:2243] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.307576 21001 pending_rounds.cc:70] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0: Trying to abort 1 pending ops.
I20260709 13:09:33.307780 21001 pending_rounds.cc:77] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636139412340736 op_type: NO_OP noop_request { }
I20260709 13:09:33.308077 21001 raft_consensus.cc:2889] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:33.308354 21001 raft_consensus.cc:2272] T 740d1e5467ce4250960dbb48ce5a9ca3 P 60ab7a41742140b693e0e9c72b4da4a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.310609 21001 tablet_replica.cc:333] T dcb746fe7a894e52bfc7f399058d8df6 P 60ab7a41742140b693e0e9c72b4da4a0: stopping tablet replica
I20260709 13:09:33.311225 21001 raft_consensus.cc:2243] T dcb746fe7a894e52bfc7f399058d8df6 P 60ab7a41742140b693e0e9c72b4da4a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.311648 21001 raft_consensus.cc:2272] T dcb746fe7a894e52bfc7f399058d8df6 P 60ab7a41742140b693e0e9c72b4da4a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.313468 21001 tablet_replica.cc:333] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0: stopping tablet replica
I20260709 13:09:33.313925 21001 raft_consensus.cc:2243] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.314317 21001 raft_consensus.cc:2272] T 9a1c617da60c4fa089f127628ea54724 P 60ab7a41742140b693e0e9c72b4da4a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.336795 21001 tablet_server.cc:196] TabletServer@127.20.130.67:0 shutdown complete.
I20260709 13:09:33.348770 21001 master.cc:562] Master@127.20.130.126:44271 shutting down...
I20260709 13:09:33.365053 21001 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.365639 21001 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.365909 21001 tablet_replica.cc:333] T 00000000000000000000000000000000 P cf76566c64b947b0b08d2e3fd9dfe35c: stopping tablet replica
I20260709 13:09:33.376929 21001 master.cc:584] Master@127.20.130.126:44271 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2655 ms)
[----------] 6 tests from LeaderRebalancerTest (281691 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:09:33.406771 21001 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.130.126:32925
I20260709 13:09:33.407948 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:33.413223 30304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:33.413247 30303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:33.415237 30306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:33.415846 21001 server_base.cc:1061] running on GCE node
I20260709 13:09:33.416651 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:33.416869 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:33.417003 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602573416991 us; error 0 us; skew 500 ppm
I20260709 13:09:33.417469 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:33.419955 21001 webserver.cc:533] Webserver started at http://127.20.130.126:39183/ using document root <none> and password file <none>
I20260709 13:09:33.420454 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:33.420614 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:33.420826 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:33.421964 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/master-0-root/instance:
uuid: "b97bdbaa1d5449f48d1a87a458d40c63"
format_stamp: "Formatted at 2026-07-09 13:09:33 on dist-test-slave-csvd"
I20260709 13:09:33.426275 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:33.429565 30311 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:33.430361 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:33.430677 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/master-0-root
uuid: "b97bdbaa1d5449f48d1a87a458d40c63"
format_stamp: "Formatted at 2026-07-09 13:09:33 on dist-test-slave-csvd"
I20260709 13:09:33.430990 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:33.454671 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:33.455722 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:33.491854 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.126:32925
I20260709 13:09:33.491969 30362 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.126:32925 every 8 connection(s)
I20260709 13:09:33.495697 30363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.506285 30363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63: Bootstrap starting.
I20260709 13:09:33.510637 30363 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.514633 30363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63: No bootstrap required, opened a new log
I20260709 13:09:33.516677 30363 raft_consensus.cc:359] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97bdbaa1d5449f48d1a87a458d40c63" member_type: VOTER }
I20260709 13:09:33.517066 30363 raft_consensus.cc:385] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.517257 30363 raft_consensus.cc:740] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b97bdbaa1d5449f48d1a87a458d40c63, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.517731 30363 consensus_queue.cc:260] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97bdbaa1d5449f48d1a87a458d40c63" member_type: VOTER }
I20260709 13:09:33.518144 30363 raft_consensus.cc:399] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:33.518334 30363 raft_consensus.cc:493] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:33.518535 30363 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.523267 30363 raft_consensus.cc:515] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97bdbaa1d5449f48d1a87a458d40c63" member_type: VOTER }
I20260709 13:09:33.523774 30363 leader_election.cc:304] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b97bdbaa1d5449f48d1a87a458d40c63; no voters: 
I20260709 13:09:33.524808 30363 leader_election.cc:290] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:33.525185 30366 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.526598 30366 raft_consensus.cc:697] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [term 1 LEADER]: Becoming Leader. State: Replica: b97bdbaa1d5449f48d1a87a458d40c63, State: Running, Role: LEADER
I20260709 13:09:33.527312 30366 consensus_queue.cc:237] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97bdbaa1d5449f48d1a87a458d40c63" member_type: VOTER }
I20260709 13:09:33.527691 30363 sys_catalog.cc:565] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:33.530089 30368 sys_catalog.cc:455] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b97bdbaa1d5449f48d1a87a458d40c63. Latest consensus state: current_term: 1 leader_uuid: "b97bdbaa1d5449f48d1a87a458d40c63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97bdbaa1d5449f48d1a87a458d40c63" member_type: VOTER } }
I20260709 13:09:33.530052 30367 sys_catalog.cc:455] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b97bdbaa1d5449f48d1a87a458d40c63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97bdbaa1d5449f48d1a87a458d40c63" member_type: VOTER } }
I20260709 13:09:33.530836 30368 sys_catalog.cc:458] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:33.530951 30367 sys_catalog.cc:458] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:33.535036 30371 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:33.539915 30371 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:33.544006 21001 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:33.549127 30371 catalog_manager.cc:1383] Generated new cluster ID: 012c27a64d824956b816f5e167e853cd
I20260709 13:09:33.549412 30371 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:33.582911 30371 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:33.584273 30371 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:33.605091 30371 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63: Generated new TSK 0
I20260709 13:09:33.605693 30371 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:33.610460 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:33.616336 30384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:33.617419 30385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:33.619079 30387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:33.619786 21001 server_base.cc:1061] running on GCE node
I20260709 13:09:33.620644 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:33.620821 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:33.620946 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602573620926 us; error 0 us; skew 500 ppm
I20260709 13:09:33.621402 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:33.623644 21001 webserver.cc:533] Webserver started at http://127.20.130.65:36859/ using document root <none> and password file <none>
I20260709 13:09:33.624070 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:33.624218 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:33.624423 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:33.625418 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/ts-0-root/instance:
uuid: "3c7e424ddadf49589ee6d20102a08cc8"
format_stamp: "Formatted at 2026-07-09 13:09:33 on dist-test-slave-csvd"
I20260709 13:09:33.629956 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:33.633365 30392 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:33.634101 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:33.634404 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/ts-0-root
uuid: "3c7e424ddadf49589ee6d20102a08cc8"
format_stamp: "Formatted at 2026-07-09 13:09:33 on dist-test-slave-csvd"
I20260709 13:09:33.634701 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:33.682607 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:33.683866 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:33.685482 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:33.688046 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:33.688263 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:33.688510 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:33.688683 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:33.726584 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.65:46347
I20260709 13:09:33.726688 30454 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.65:46347 every 8 connection(s)
I20260709 13:09:33.731814 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:33.738950 30459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:33.741607 30460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:33.742162 21001 server_base.cc:1061] running on GCE node
W20260709 13:09:33.744238 30462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:33.745136 30455 heartbeater.cc:344] Connected to a master server at 127.20.130.126:32925
I20260709 13:09:33.745301 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:33.745550 30455 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:33.745649 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:33.745952 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602573745925 us; error 0 us; skew 500 ppm
I20260709 13:09:33.746419 30455 heartbeater.cc:507] Master 127.20.130.126:32925 requested a full tablet report, sending...
I20260709 13:09:33.746604 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:33.748682 30328 ts_manager.cc:194] Registered new tserver with Master: 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347)
I20260709 13:09:33.749615 21001 webserver.cc:533] Webserver started at http://127.20.130.66:46673/ using document root <none> and password file <none>
I20260709 13:09:33.750178 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:33.750379 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:33.750646 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:33.750670 30328 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60014
I20260709 13:09:33.751832 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/ts-1-root/instance:
uuid: "3284fa337a70463ab250f0d48d2f05f3"
format_stamp: "Formatted at 2026-07-09 13:09:33 on dist-test-slave-csvd"
I20260709 13:09:33.756235 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:33.759562 30467 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:33.760886 21001 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:33.761214 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/ts-1-root
uuid: "3284fa337a70463ab250f0d48d2f05f3"
format_stamp: "Formatted at 2026-07-09 13:09:33 on dist-test-slave-csvd"
I20260709 13:09:33.761546 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:33.783829 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:33.784912 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:33.786280 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:33.788492 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:33.788719 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:33.788957 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:33.789125 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:33.827446 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.66:38107
I20260709 13:09:33.827602 30529 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.66:38107 every 8 connection(s)
I20260709 13:09:33.832283 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:33.839308 30533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:33.840314 30534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:33.843219 21001 server_base.cc:1061] running on GCE node
W20260709 13:09:33.843364 30536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:33.844627 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:33.844846 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:33.845065 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602573845044 us; error 0 us; skew 500 ppm
I20260709 13:09:33.845499 30530 heartbeater.cc:344] Connected to a master server at 127.20.130.126:32925
I20260709 13:09:33.845703 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:33.845943 30530 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:33.846910 30530 heartbeater.cc:507] Master 127.20.130.126:32925 requested a full tablet report, sending...
I20260709 13:09:33.848702 21001 webserver.cc:533] Webserver started at http://127.20.130.67:39883/ using document root <none> and password file <none>
I20260709 13:09:33.849265 30328 ts_manager.cc:194] Registered new tserver with Master: 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:33.849419 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:33.849804 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:33.850137 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:33.851219 30328 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60022
I20260709 13:09:33.851649 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/ts-2-root/instance:
uuid: "0e9fe8a853314556bd34d155250e742e"
format_stamp: "Formatted at 2026-07-09 13:09:33 on dist-test-slave-csvd"
I20260709 13:09:33.856276 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:33.859609 30541 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:33.860410 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:33.860718 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/ts-2-root
uuid: "0e9fe8a853314556bd34d155250e742e"
format_stamp: "Formatted at 2026-07-09 13:09:33 on dist-test-slave-csvd"
I20260709 13:09:33.860988 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602291548094-21001-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:33.875825 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:33.876966 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:33.878441 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:33.880774 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:33.880957 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:33.881260 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:33.881426 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:33.919664 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.67:43211
I20260709 13:09:33.919790 30603 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.67:43211 every 8 connection(s)
I20260709 13:09:33.933842 30604 heartbeater.cc:344] Connected to a master server at 127.20.130.126:32925
I20260709 13:09:33.934329 30604 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:33.935071 30604 heartbeater.cc:507] Master 127.20.130.126:32925 requested a full tablet report, sending...
I20260709 13:09:33.937050 30328 ts_manager.cc:194] Registered new tserver with Master: 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:33.937687 21001 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014771226s
I20260709 13:09:33.938771 30328 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60030
I20260709 13:09:33.963444 30328 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60040:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:33.966063 30328 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:34.029671 30495 tablet_service.cc:1511] Processing CreateTablet for tablet 0e098385e0764553be2539bde5f9b930 (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:34.032091 30494 tablet_service.cc:1511] Processing CreateTablet for tablet fc98598beabc4030b90c6c62c89dc820 (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:34.034680 30494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc98598beabc4030b90c6c62c89dc820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.034844 30493 tablet_service.cc:1511] Processing CreateTablet for tablet 124c62e3b5064f9a87a9942c17470b2a (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:34.038470 30493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 124c62e3b5064f9a87a9942c17470b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.038341 30492 tablet_service.cc:1511] Processing CreateTablet for tablet 0d67a208fe8b44efbd18eb2511c74d0e (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:34.039803 30492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d67a208fe8b44efbd18eb2511c74d0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.041697 30495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e098385e0764553be2539bde5f9b930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.057405 30491 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4dbb67e82d4c45a54a820d4683c7d3 (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:34.059063 30491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4dbb67e82d4c45a54a820d4683c7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.062599 30490 tablet_service.cc:1511] Processing CreateTablet for tablet 44e4bfb965bc4bc8bea51fb54d634a6c (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:34.064204 30490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e4bfb965bc4bc8bea51fb54d634a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.069406 30489 tablet_service.cc:1511] Processing CreateTablet for tablet 16fc6ca9f41c475f9e193d853d9e5edd (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:34.071775 30489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16fc6ca9f41c475f9e193d853d9e5edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.074831 30420 tablet_service.cc:1511] Processing CreateTablet for tablet 0e098385e0764553be2539bde5f9b930 (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:34.076345 30420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e098385e0764553be2539bde5f9b930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.079792 30417 tablet_service.cc:1511] Processing CreateTablet for tablet 0d67a208fe8b44efbd18eb2511c74d0e (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:34.081364 30417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d67a208fe8b44efbd18eb2511c74d0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.081598 30415 tablet_service.cc:1511] Processing CreateTablet for tablet 44e4bfb965bc4bc8bea51fb54d634a6c (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:34.078440 30419 tablet_service.cc:1511] Processing CreateTablet for tablet fc98598beabc4030b90c6c62c89dc820 (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:34.079959 30416 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4dbb67e82d4c45a54a820d4683c7d3 (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:34.084340 30415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e4bfb965bc4bc8bea51fb54d634a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.084009 30414 tablet_service.cc:1511] Processing CreateTablet for tablet 16fc6ca9f41c475f9e193d853d9e5edd (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:34.085371 30414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16fc6ca9f41c475f9e193d853d9e5edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.086648 30413 tablet_service.cc:1511] Processing CreateTablet for tablet 41234aa848a244d186f86ae165931584 (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:34.088023 30413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41234aa848a244d186f86ae165931584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.089566 30418 tablet_service.cc:1511] Processing CreateTablet for tablet 124c62e3b5064f9a87a9942c17470b2a (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:34.089969 30412 tablet_service.cc:1511] Processing CreateTablet for tablet 49459d42810745468d5235656763e60b (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:34.092384 30495 tablet_service.cc:1511] Processing CreateTablet for tablet 41234aa848a244d186f86ae165931584 (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:34.093741 30495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41234aa848a244d186f86ae165931584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.097051 30488 tablet_service.cc:1511] Processing CreateTablet for tablet 49459d42810745468d5235656763e60b (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:34.098512 30488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49459d42810745468d5235656763e60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.100914 30418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 124c62e3b5064f9a87a9942c17470b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.101660 30412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49459d42810745468d5235656763e60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.102350 30419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc98598beabc4030b90c6c62c89dc820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.107465 30416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4dbb67e82d4c45a54a820d4683c7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.116449 30569 tablet_service.cc:1511] Processing CreateTablet for tablet 0e098385e0764553be2539bde5f9b930 (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:34.118422 30569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e098385e0764553be2539bde5f9b930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.122045 30568 tablet_service.cc:1511] Processing CreateTablet for tablet fc98598beabc4030b90c6c62c89dc820 (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:34.123600 30568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc98598beabc4030b90c6c62c89dc820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.124518 30562 tablet_service.cc:1511] Processing CreateTablet for tablet 41234aa848a244d186f86ae165931584 (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:34.126408 30562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41234aa848a244d186f86ae165931584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.128147 30566 tablet_service.cc:1511] Processing CreateTablet for tablet 0d67a208fe8b44efbd18eb2511c74d0e (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:34.129640 30566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d67a208fe8b44efbd18eb2511c74d0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.131589 30565 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4dbb67e82d4c45a54a820d4683c7d3 (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:34.131754 30561 tablet_service.cc:1511] Processing CreateTablet for tablet 49459d42810745468d5235656763e60b (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:34.133046 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4dbb67e82d4c45a54a820d4683c7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.136853 30563 tablet_service.cc:1511] Processing CreateTablet for tablet 16fc6ca9f41c475f9e193d853d9e5edd (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:34.138144 30567 tablet_service.cc:1511] Processing CreateTablet for tablet 124c62e3b5064f9a87a9942c17470b2a (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:34.141239 30564 tablet_service.cc:1511] Processing CreateTablet for tablet 44e4bfb965bc4bc8bea51fb54d634a6c (DEFAULT_TABLE table=test-workload [id=54c58751d4264cd395b7ce9cea4f9ecc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:34.143399 30561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49459d42810745468d5235656763e60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.144337 30563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16fc6ca9f41c475f9e193d853d9e5edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.147320 30567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 124c62e3b5064f9a87a9942c17470b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.150357 30564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e4bfb965bc4bc8bea51fb54d634a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.203675 30619 tablet_bootstrap.cc:492] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:34.249402 30621 tablet_bootstrap.cc:492] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:34.255568 30621 tablet_bootstrap.cc:654] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.264549 30620 tablet_bootstrap.cc:492] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:34.265410 30619 tablet_bootstrap.cc:654] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.277889 30619 tablet_bootstrap.cc:492] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:34.277935 30621 tablet_bootstrap.cc:492] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:34.278535 30621 ts_tablet_manager.cc:1403] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.005s
I20260709 13:09:34.278535 30619 ts_tablet_manager.cc:1403] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.004s
I20260709 13:09:34.279685 30620 tablet_bootstrap.cc:654] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.281555 30619 raft_consensus.cc:359] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.281790 30621 raft_consensus.cc:359] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.283250 30619 raft_consensus.cc:385] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.283381 30621 raft_consensus.cc:385] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.283639 30619 raft_consensus.cc:740] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.283926 30621 raft_consensus.cc:740] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.284638 30619 consensus_queue.cc:260] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.285040 30621 consensus_queue.cc:260] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.293712 30530 heartbeater.cc:499] Master 127.20.130.126:32925 was elected leader, sending a full tablet report...
I20260709 13:09:34.293993 30619 ts_tablet_manager.cc:1434] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.006s
I20260709 13:09:34.295148 30619 tablet_bootstrap.cc:492] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:34.296331 30620 tablet_bootstrap.cc:492] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:34.297070 30620 ts_tablet_manager.cc:1403] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.033s	user 0.004s	sys 0.014s
I20260709 13:09:34.301541 30619 tablet_bootstrap.cc:654] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.301750 30620 raft_consensus.cc:359] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.302618 30620 raft_consensus.cc:385] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.302886 30621 ts_tablet_manager.cc:1434] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.017s
I20260709 13:09:34.303694 30455 heartbeater.cc:499] Master 127.20.130.126:32925 was elected leader, sending a full tablet report...
I20260709 13:09:34.304081 30621 tablet_bootstrap.cc:492] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:34.302949 30620 raft_consensus.cc:740] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.309998 30620 consensus_queue.cc:260] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.311100 30621 tablet_bootstrap.cc:654] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.318665 30604 heartbeater.cc:499] Master 127.20.130.126:32925 was elected leader, sending a full tablet report...
I20260709 13:09:34.319787 30620 ts_tablet_manager.cc:1434] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.022s	user 0.014s	sys 0.002s
I20260709 13:09:34.321000 30620 tablet_bootstrap.cc:492] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:34.328178 30620 tablet_bootstrap.cc:654] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.331173 30621 tablet_bootstrap.cc:492] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:34.332840 30621 ts_tablet_manager.cc:1403] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.010s
I20260709 13:09:34.335835 30621 raft_consensus.cc:359] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.336323 30620 tablet_bootstrap.cc:492] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:34.336712 30621 raft_consensus.cc:385] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.336989 30620 ts_tablet_manager.cc:1403] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:09:34.337083 30621 raft_consensus.cc:740] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.338138 30621 consensus_queue.cc:260] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.340303 30621 ts_tablet_manager.cc:1434] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:34.340303 30620 raft_consensus.cc:359] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.341256 30620 raft_consensus.cc:385] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.341610 30621 tablet_bootstrap.cc:492] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:34.341624 30620 raft_consensus.cc:740] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.344517 30628 raft_consensus.cc:493] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.344759 30619 tablet_bootstrap.cc:492] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:34.345412 30619 ts_tablet_manager.cc:1403] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.029s
I20260709 13:09:34.345063 30628 raft_consensus.cc:515] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.343215 30620 consensus_queue.cc:260] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.352210 30628 leader_election.cc:290] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:34.382691 30620 ts_tablet_manager.cc:1434] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.045s	user 0.013s	sys 0.024s
I20260709 13:09:34.384162 30620 tablet_bootstrap.cc:492] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:34.386039 30619 raft_consensus.cc:359] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.386843 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c62e3b5064f9a87a9942c17470b2a" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:34.390424 30619 raft_consensus.cc:385] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.390894 30619 raft_consensus.cc:740] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
W20260709 13:09:34.391760 30545 leader_election.cc:343] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.392971 30619 consensus_queue.cc:260] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.395243 30625 raft_consensus.cc:493] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.395697 30625 raft_consensus.cc:515] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.389724 30621 tablet_bootstrap.cc:654] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.398156 30620 tablet_bootstrap.cc:654] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.398417 30625 leader_election.cc:290] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:34.413509 30619 ts_tablet_manager.cc:1434] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.007s
I20260709 13:09:34.416903 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c62e3b5064f9a87a9942c17470b2a" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
W20260709 13:09:34.418696 30542 leader_election.cc:343] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.419248 30542 leader_election.cc:304] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e; no voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:34.420074 30621 tablet_bootstrap.cc:492] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:34.420222 30631 raft_consensus.cc:2749] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.420962 30621 ts_tablet_manager.cc:1403] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.080s	user 0.035s	sys 0.006s
I20260709 13:09:34.423015 30619 tablet_bootstrap.cc:492] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:34.424275 30620 tablet_bootstrap.cc:492] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:34.424798 30620 ts_tablet_manager.cc:1403] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.013s
I20260709 13:09:34.424711 30621 raft_consensus.cc:359] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.425598 30621 raft_consensus.cc:385] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.425933 30621 raft_consensus.cc:740] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.426782 30621 consensus_queue.cc:260] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.427546 30620 raft_consensus.cc:359] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.429415 30620 raft_consensus.cc:385] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.429642 30621 ts_tablet_manager.cc:1434] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:34.430745 30621 tablet_bootstrap.cc:492] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:34.432781 30619 tablet_bootstrap.cc:654] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.429700 30620 raft_consensus.cc:740] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.436373 30620 consensus_queue.cc:260] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.438647 30620 ts_tablet_manager.cc:1434] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:09:34.439649 30620 tablet_bootstrap.cc:492] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:34.441068 30621 tablet_bootstrap.cc:654] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.445664 30620 tablet_bootstrap.cc:654] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.450086 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc98598beabc4030b90c6c62c89dc820" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
W20260709 13:09:34.451825 30471 leader_election.cc:343] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.455289 30621 tablet_bootstrap.cc:492] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:34.455935 30621 ts_tablet_manager.cc:1403] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.025s	user 0.004s	sys 0.007s
I20260709 13:09:34.457815 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc98598beabc4030b90c6c62c89dc820" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:34.459488 30620 tablet_bootstrap.cc:492] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
W20260709 13:09:34.459477 30471 leader_election.cc:343] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.460196 30620 ts_tablet_manager.cc:1403] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.001s
I20260709 13:09:34.460069 30471 leader_election.cc:304] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3; no voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:34.460765 30619 tablet_bootstrap.cc:492] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:34.460922 30625 raft_consensus.cc:2749] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.460680 30621 raft_consensus.cc:359] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.461556 30619 ts_tablet_manager.cc:1403] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.007s
I20260709 13:09:34.461618 30621 raft_consensus.cc:385] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.462059 30621 raft_consensus.cc:740] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.462977 30621 consensus_queue.cc:260] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.464167 30620 raft_consensus.cc:359] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.464900 30620 raft_consensus.cc:385] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.465229 30621 ts_tablet_manager.cc:1434] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:09:34.465225 30620 raft_consensus.cc:740] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.465051 30619 raft_consensus.cc:359] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.465992 30619 raft_consensus.cc:385] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.466305 30619 raft_consensus.cc:740] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.466728 30621 tablet_bootstrap.cc:492] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:34.466300 30620 consensus_queue.cc:260] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.467381 30619 consensus_queue.cc:260] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.469027 30620 ts_tablet_manager.cc:1434] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:34.469637 30619 ts_tablet_manager.cc:1434] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:34.471904 30620 tablet_bootstrap.cc:492] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:34.474306 30621 tablet_bootstrap.cc:654] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.479406 30620 tablet_bootstrap.cc:654] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.493711 30631 raft_consensus.cc:493] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.494496 30631 raft_consensus.cc:515] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.507282 30619 tablet_bootstrap.cc:492] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:34.507463 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fc6ca9f41c475f9e193d853d9e5edd" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:34.508560 30430 raft_consensus.cc:2468] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 0.
I20260709 13:09:34.510329 30545 leader_election.cc:304] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:34.512532 30628 raft_consensus.cc:2804] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.513078 30628 raft_consensus.cc:493] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.513507 30628 raft_consensus.cc:3060] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.521670 30619 tablet_bootstrap.cc:654] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.524127 30631 leader_election.cc:290] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:34.526237 30621 tablet_bootstrap.cc:492] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:34.526281 30620 tablet_bootstrap.cc:492] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:34.525956 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fc6ca9f41c475f9e193d853d9e5edd" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:34.525931 30628 raft_consensus.cc:515] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.527150 30620 ts_tablet_manager.cc:1403] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.032s
I20260709 13:09:34.527174 30621 ts_tablet_manager.cc:1403] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.061s	user 0.023s	sys 0.035s
I20260709 13:09:34.530277 30620 raft_consensus.cc:359] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
W20260709 13:09:34.528578 30542 leader_election.cc:343] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.531136 30620 raft_consensus.cc:385] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.531975 30620 raft_consensus.cc:740] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.532723 30621 raft_consensus.cc:359] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.533008 30620 consensus_queue.cc:260] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.528899 30628 leader_election.cc:290] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:34.533335 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fc6ca9f41c475f9e193d853d9e5edd" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:34.534425 30621 raft_consensus.cc:385] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.534819 30621 raft_consensus.cc:740] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.535454 30620 ts_tablet_manager.cc:1434] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:09:34.535651 30621 consensus_queue.cc:260] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.536754 30620 tablet_bootstrap.cc:492] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:34.538130 30621 ts_tablet_manager.cc:1434] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:09:34.539315 30621 tablet_bootstrap.cc:492] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
W20260709 13:09:34.540784 30376 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:34.541702 30626 raft_consensus.cc:493] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.544473 30620 tablet_bootstrap.cc:654] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.546085 30621 tablet_bootstrap.cc:654] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.542371 30626 raft_consensus.cc:515] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.530408 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fc6ca9f41c475f9e193d853d9e5edd" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:34.556744 30430 raft_consensus.cc:3060] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.557364 30620 tablet_bootstrap.cc:492] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:34.557983 30620 ts_tablet_manager.cc:1403] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.009s
W20260709 13:09:34.559757 30542 leader_election.cc:343] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.561198 30620 raft_consensus.cc:359] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.562002 30620 raft_consensus.cc:385] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.562315 30620 raft_consensus.cc:740] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.566354 30621 tablet_bootstrap.cc:492] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:34.567023 30621 ts_tablet_manager.cc:1403] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.013s
I20260709 13:09:34.569697 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e098385e0764553be2539bde5f9b930" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:34.570879 30505 raft_consensus.cc:2468] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 0.
I20260709 13:09:34.564666 30620 consensus_queue.cc:260] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.570363 30621 raft_consensus.cc:359] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.572368 30621 raft_consensus.cc:385] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.572227 30393 leader_election.cc:304] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:34.574774 30621 raft_consensus.cc:740] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.575683 30621 consensus_queue.cc:260] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.574340 30620 ts_tablet_manager.cc:1434] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:09:34.581656 30620 tablet_bootstrap.cc:492] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:34.606792 30620 tablet_bootstrap.cc:654] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.611387 30625 raft_consensus.cc:493] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.612232 30625 raft_consensus.cc:515] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.617404 30625 leader_election.cc:290] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:34.620007 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d67a208fe8b44efbd18eb2511c74d0e" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:34.621052 30579 raft_consensus.cc:2468] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 0.
I20260709 13:09:34.629694 30471 leader_election.cc:304] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3284fa337a70463ab250f0d48d2f05f3; no voters: 
I20260709 13:09:34.630981 30625 raft_consensus.cc:2804] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.631495 30625 raft_consensus.cc:493] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.631945 30625 raft_consensus.cc:3060] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.603019 30626 leader_election.cc:290] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:34.635972 30626 raft_consensus.cc:493] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.636579 30626 raft_consensus.cc:515] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.661087 30626 leader_election.cc:290] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:34.661588 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d67a208fe8b44efbd18eb2511c74d0e" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
W20260709 13:09:34.669003 30471 leader_election.cc:343] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.659785 30646 raft_consensus.cc:2804] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.670430 30646 raft_consensus.cc:493] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:34.671579 30393 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.66:38107, user_credentials={real_user=slave}} blocked reactor thread for 99466.9us
I20260709 13:09:34.674976 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41234aa848a244d186f86ae165931584" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:34.678951 30646 raft_consensus.cc:3060] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:34.680339 30393 leader_election.cc:343] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.684227 30430 raft_consensus.cc:2468] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 1.
I20260709 13:09:34.686556 30545 leader_election.cc:304] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 3284fa337a70463ab250f0d48d2f05f3
I20260709 13:09:34.688453 30631 raft_consensus.cc:2804] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.689185 30631 raft_consensus.cc:697] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Becoming Leader. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:34.690435 30631 consensus_queue.cc:237] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.705880 30625 raft_consensus.cc:515] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.725827 30619 tablet_bootstrap.cc:492] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:34.713757 30620 tablet_bootstrap.cc:492] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:34.719908 30327 catalog_manager.cc:5697] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e9fe8a853314556bd34d155250e742e (127.20.130.67). New cstate: current_term: 1 leader_uuid: "0e9fe8a853314556bd34d155250e742e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.727965 30619 ts_tablet_manager.cc:1403] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.221s	user 0.088s	sys 0.104s
I20260709 13:09:34.710140 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41234aa848a244d186f86ae165931584" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:34.730131 30646 raft_consensus.cc:515] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.730782 30578 raft_consensus.cc:2468] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 0.
I20260709 13:09:34.712472 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e098385e0764553be2539bde5f9b930" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:34.731830 30620 ts_tablet_manager.cc:1403] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.151s	user 0.035s	sys 0.038s
I20260709 13:09:34.727300 30621 ts_tablet_manager.cc:1434] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.160s	user 0.057s	sys 0.078s
I20260709 13:09:34.730006 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d67a208fe8b44efbd18eb2511c74d0e" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:34.732859 30396 leader_election.cc:304] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 3284fa337a70463ab250f0d48d2f05f3
W20260709 13:09:34.733237 30471 leader_election.cc:343] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.733582 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e098385e0764553be2539bde5f9b930" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:34.734270 30505 raft_consensus.cc:3060] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.734541 30619 raft_consensus.cc:359] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.734894 30620 raft_consensus.cc:359] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.735446 30619 raft_consensus.cc:385] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.735673 30620 raft_consensus.cc:385] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.736099 30620 raft_consensus.cc:740] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.735841 30619 raft_consensus.cc:740] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.736969 30625 leader_election.cc:290] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:34.737921 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d67a208fe8b44efbd18eb2511c74d0e" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e"
W20260709 13:09:34.738282 30396 leader_election.cc:343] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.739183 30647 raft_consensus.cc:493] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.739645 30648 raft_consensus.cc:2804] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.740203 30648 raft_consensus.cc:493] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.739786 30647 raft_consensus.cc:515] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.740612 30648 raft_consensus.cc:3060] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.743119 30505 raft_consensus.cc:2468] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 1.
I20260709 13:09:34.744071 30621 tablet_bootstrap.cc:492] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:34.743918 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c62e3b5064f9a87a9942c17470b2a" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:34.742957 30647 leader_election.cc:290] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:34.746568 30578 raft_consensus.cc:3060] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.747064 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c62e3b5064f9a87a9942c17470b2a" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:34.747191 30393 leader_election.cc:304] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:34.748165 30647 raft_consensus.cc:2804] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.737150 30619 consensus_queue.cc:260] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.749519 30504 raft_consensus.cc:2468] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 0.
I20260709 13:09:34.751101 30619 ts_tablet_manager.cc:1434] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:09:34.751709 30646 leader_election.cc:290] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 election: Requested vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:34.752118 30619 tablet_bootstrap.cc:492] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:34.752489 30647 raft_consensus.cc:697] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Becoming Leader. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:34.760958 30647 consensus_queue.cc:237] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.747879 30579 raft_consensus.cc:2468] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 0.
I20260709 13:09:34.754384 30577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e098385e0764553be2539bde5f9b930" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:34.765810 30578 raft_consensus.cc:2468] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 1.
W20260709 13:09:34.766399 30396 leader_election.cc:343] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.766883 30619 tablet_bootstrap.cc:654] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.768584 30471 leader_election.cc:304] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3284fa337a70463ab250f0d48d2f05f3; no voters: 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:34.769761 30625 raft_consensus.cc:2804] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.771844 30625 raft_consensus.cc:697] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Becoming Leader. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:34.773097 30625 consensus_queue.cc:237] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.754457 30620 consensus_queue.cc:260] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.755591 30393 leader_election.cc:304] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:34.776381 30619 tablet_bootstrap.cc:492] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:34.777063 30619 ts_tablet_manager.cc:1403] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 13:09:34.780078 30326 catalog_manager.cc:5697] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.780982 30619 raft_consensus.cc:359] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.781936 30619 raft_consensus.cc:385] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.782272 30619 raft_consensus.cc:740] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.760090 30621 tablet_bootstrap.cc:654] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.785281 30619 consensus_queue.cc:260] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.783008 30631 raft_consensus.cc:493] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.784164 30620 ts_tablet_manager.cc:1434] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:09:34.754379 30648 raft_consensus.cc:515] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.784458 30647 raft_consensus.cc:2804] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.788424 30647 raft_consensus.cc:493] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.788754 30620 tablet_bootstrap.cc:492] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:34.789180 30647 raft_consensus.cc:3060] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.789556 30631 raft_consensus.cc:515] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.792846 30631 leader_election.cc:290] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:34.793599 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4dbb67e82d4c45a54a820d4683c7d3" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:34.794039 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4dbb67e82d4c45a54a820d4683c7d3" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:34.794328 30430 raft_consensus.cc:2468] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 0.
I20260709 13:09:34.794730 30504 raft_consensus.cc:2468] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 0.
I20260709 13:09:34.796088 30542 leader_election.cc:304] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3284fa337a70463ab250f0d48d2f05f3; no voters: 
I20260709 13:09:34.797446 30620 tablet_bootstrap.cc:654] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.798135 30631 raft_consensus.cc:2804] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.798687 30631 raft_consensus.cc:493] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.799119 30631 raft_consensus.cc:3060] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.800581 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41234aa848a244d186f86ae165931584" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
W20260709 13:09:34.802806 30393 leader_election.cc:343] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.806807 30621 tablet_bootstrap.cc:492] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:34.799083 30619 ts_tablet_manager.cc:1434] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.003s
I20260709 13:09:34.807406 30621 ts_tablet_manager.cc:1403] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.008s
I20260709 13:09:34.808358 30648 leader_election.cc:290] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 election: Requested vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:34.808611 30619 tablet_bootstrap.cc:492] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:34.808995 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41234aa848a244d186f86ae165931584" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:34.809649 30579 raft_consensus.cc:3060] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.811996 30647 raft_consensus.cc:515] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.813661 30325 catalog_manager.cc:5697] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "3284fa337a70463ab250f0d48d2f05f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.815441 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c62e3b5064f9a87a9942c17470b2a" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:34.815579 30631 raft_consensus.cc:515] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.816216 30504 raft_consensus.cc:3060] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.817305 30579 raft_consensus.cc:2468] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 1.
I20260709 13:09:34.818575 30396 leader_election.cc:304] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 3284fa337a70463ab250f0d48d2f05f3
I20260709 13:09:34.819471 30628 raft_consensus.cc:493] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.820024 30628 raft_consensus.cc:515] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.821149 30621 raft_consensus.cc:359] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.821920 30621 raft_consensus.cc:385] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.822202 30621 raft_consensus.cc:740] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.822489 30628 leader_election.cc:290] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:34.823078 30621 consensus_queue.cc:260] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.824366 30646 raft_consensus.cc:2804] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.824944 30646 raft_consensus.cc:697] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Becoming Leader. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:34.818626 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4dbb67e82d4c45a54a820d4683c7d3" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:34.825927 30430 raft_consensus.cc:3060] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.826107 30621 ts_tablet_manager.cc:1434] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 13:09:34.825888 30646 consensus_queue.cc:237] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.827391 30621 tablet_bootstrap.cc:492] T 49459d42810745468d5235656763e60b P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:34.827837 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e4bfb965bc4bc8bea51fb54d634a6c" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:34.824227 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e4bfb965bc4bc8bea51fb54d634a6c" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:34.830160 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4dbb67e82d4c45a54a820d4683c7d3" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:34.830554 30429 raft_consensus.cc:2468] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 0.
I20260709 13:09:34.830816 30505 raft_consensus.cc:3060] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.832057 30545 leader_election.cc:304] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:34.835109 30628 raft_consensus.cc:2804] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:34.835213 30542 leader_election.cc:343] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.835819 30628 raft_consensus.cc:493] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.836304 30628 raft_consensus.cc:3060] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.837817 30619 tablet_bootstrap.cc:654] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.842079 30621 tablet_bootstrap.cc:654] T 49459d42810745468d5235656763e60b P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.849080 30620 tablet_bootstrap.cc:492] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:34.849640 30620 ts_tablet_manager.cc:1403] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.005s
I20260709 13:09:34.851065 30621 tablet_bootstrap.cc:492] T 49459d42810745468d5235656763e60b P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:34.851601 30621 ts_tablet_manager.cc:1403] T 49459d42810745468d5235656763e60b P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.000s
I20260709 13:09:34.837112 30631 leader_election.cc:290] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:34.852782 30647 leader_election.cc:290] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 election: Requested vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:34.854139 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c62e3b5064f9a87a9942c17470b2a" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:34.859186 30430 raft_consensus.cc:2468] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 1.
I20260709 13:09:34.855501 30621 raft_consensus.cc:359] T 49459d42810745468d5235656763e60b P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.859541 30579 raft_consensus.cc:3060] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.860680 30631 raft_consensus.cc:493] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.860736 30545 leader_election.cc:304] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:34.861536 30631 raft_consensus.cc:515] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.864828 30631 leader_election.cc:290] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:34.865461 30631 raft_consensus.cc:2804] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.865978 30631 raft_consensus.cc:697] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Becoming Leader. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:34.866909 30631 consensus_queue.cc:237] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.869143 30579 raft_consensus.cc:2468] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 1.
I20260709 13:09:34.859368 30619 tablet_bootstrap.cc:492] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:34.859781 30621 raft_consensus.cc:385] T 49459d42810745468d5235656763e60b P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.855373 30620 raft_consensus.cc:359] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.875373 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49459d42810745468d5235656763e60b" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:34.875838 30620 raft_consensus.cc:385] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.875748 30621 raft_consensus.cc:740] T 49459d42810745468d5235656763e60b P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.876353 30620 raft_consensus.cc:740] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
W20260709 13:09:34.877355 30542 leader_election.cc:343] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.877132 30620 consensus_queue.cc:260] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.878167 30646 raft_consensus.cc:493] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.872929 30325 catalog_manager.cc:5697] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.878703 30646 raft_consensus.cc:515] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.878895 30619 ts_tablet_manager.cc:1403] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.006s
I20260709 13:09:34.881989 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d67a208fe8b44efbd18eb2511c74d0e" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:34.855173 30504 raft_consensus.cc:2468] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 1.
I20260709 13:09:34.883438 30619 raft_consensus.cc:359] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.877048 30621 consensus_queue.cc:260] T 49459d42810745468d5235656763e60b P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.884588 30393 leader_election.cc:304] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:34.885993 30621 ts_tablet_manager.cc:1434] T 49459d42810745468d5235656763e60b P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:09:34.887754 30621 tablet_bootstrap.cc:492] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:34.886016 30648 raft_consensus.cc:2804] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.889778 30648 raft_consensus.cc:697] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Becoming Leader. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:34.890908 30648 consensus_queue.cc:237] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.873768 30628 raft_consensus.cc:515] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.894217 30628 leader_election.cc:290] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:34.857743 30505 raft_consensus.cc:2468] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 1.
I20260709 13:09:34.895568 30619 raft_consensus.cc:385] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.896745 30619 raft_consensus.cc:740] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.897877 30619 consensus_queue.cc:260] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.900138 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e4bfb965bc4bc8bea51fb54d634a6c" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:34.900996 30505 raft_consensus.cc:3060] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.901746 30619 ts_tablet_manager.cc:1434] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:09:34.904312 30619 tablet_bootstrap.cc:492] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:34.907208 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d67a208fe8b44efbd18eb2511c74d0e" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:34.908017 30646 leader_election.cc:290] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:34.908299 30579 raft_consensus.cc:2393] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c7e424ddadf49589ee6d20102a08cc8 in current term 1: Already voted for candidate 3284fa337a70463ab250f0d48d2f05f3 in this term.
I20260709 13:09:34.909770 30396 leader_election.cc:304] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c7e424ddadf49589ee6d20102a08cc8; no voters: 0e9fe8a853314556bd34d155250e742e, 3284fa337a70463ab250f0d48d2f05f3
I20260709 13:09:34.910353 30620 ts_tablet_manager.cc:1434] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.060s	user 0.016s	sys 0.004s
I20260709 13:09:34.905540 30621 tablet_bootstrap.cc:654] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.911399 30620 tablet_bootstrap.cc:492] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:34.915613 30505 raft_consensus.cc:2468] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 1.
W20260709 13:09:34.919049 30545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:46347, user_credentials={real_user=slave}} blocked reactor thread for 58404.7us
I20260709 13:09:34.920186 30325 catalog_manager.cc:5697] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.921504 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e4bfb965bc4bc8bea51fb54d634a6c" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:34.922204 30429 raft_consensus.cc:3060] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.923229 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49459d42810745468d5235656763e60b" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:34.923975 30430 raft_consensus.cc:2468] T 49459d42810745468d5235656763e60b P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 0.
I20260709 13:09:34.925312 30631 raft_consensus.cc:493] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.925642 30619 tablet_bootstrap.cc:654] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.925843 30621 tablet_bootstrap.cc:492] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:34.925825 30631 raft_consensus.cc:515] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.926661 30621 ts_tablet_manager.cc:1403] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.006s
I20260709 13:09:34.929209 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e098385e0764553be2539bde5f9b930" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:34.930076 30503 raft_consensus.cc:2393] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e9fe8a853314556bd34d155250e742e in current term 1: Already voted for candidate 3c7e424ddadf49589ee6d20102a08cc8 in this term.
I20260709 13:09:34.930505 30621 raft_consensus.cc:359] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.931710 30621 raft_consensus.cc:385] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.932160 30621 raft_consensus.cc:740] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.933280 30621 consensus_queue.cc:260] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.934634 30648 raft_consensus.cc:3060] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.934496 30327 catalog_manager.cc:5697] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e9fe8a853314556bd34d155250e742e (127.20.130.67). New cstate: current_term: 1 leader_uuid: "0e9fe8a853314556bd34d155250e742e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.938310 30631 leader_election.cc:290] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347)
I20260709 13:09:34.940457 30429 raft_consensus.cc:2468] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 1.
I20260709 13:09:34.941179 30545 leader_election.cc:304] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 3284fa337a70463ab250f0d48d2f05f3
I20260709 13:09:34.941632 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e098385e0764553be2539bde5f9b930" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:34.942026 30631 raft_consensus.cc:2804] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.942490 30631 raft_consensus.cc:493] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.942855 30631 raft_consensus.cc:3060] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.945919 30648 raft_consensus.cc:2749] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.943502 30621 ts_tablet_manager.cc:1434] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:09:34.947127 30619 tablet_bootstrap.cc:492] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:34.947685 30619 ts_tablet_manager.cc:1403] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.009s
I20260709 13:09:34.950133 30631 raft_consensus.cc:515] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.950366 30619 raft_consensus.cc:359] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.951264 30619 raft_consensus.cc:385] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.951536 30619 raft_consensus.cc:740] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.951604 30545 leader_election.cc:304] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:34.952752 30664 raft_consensus.cc:2804] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.953344 30620 tablet_bootstrap.cc:654] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.953464 30664 raft_consensus.cc:697] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Becoming Leader. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:34.954468 30664 consensus_queue.cc:237] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.952538 30619 consensus_queue.cc:260] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:34.952674 30545 leader_election.cc:304] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e; no voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:34.956489 30666 raft_consensus.cc:3060] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.957499 30631 leader_election.cc:290] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:34.959339 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49459d42810745468d5235656763e60b" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
W20260709 13:09:34.961388 30542 leader_election.cc:343] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.964967 30666 raft_consensus.cc:2749] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.975297 30619 ts_tablet_manager.cc:1434] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:09:34.977257 30619 tablet_bootstrap.cc:492] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:34.982344 30327 catalog_manager.cc:5697] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e9fe8a853314556bd34d155250e742e (127.20.130.67). New cstate: current_term: 1 leader_uuid: "0e9fe8a853314556bd34d155250e742e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.975894 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49459d42810745468d5235656763e60b" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:34.983964 30429 raft_consensus.cc:3060] T 49459d42810745468d5235656763e60b P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.990653 30429 raft_consensus.cc:2468] T 49459d42810745468d5235656763e60b P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 1.
I20260709 13:09:34.991833 30619 tablet_bootstrap.cc:654] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.991930 30545 leader_election.cc:304] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 3284fa337a70463ab250f0d48d2f05f3
I20260709 13:09:34.993352 30664 raft_consensus.cc:2804] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.993923 30664 raft_consensus.cc:697] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Becoming Leader. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:34.994792 30664 consensus_queue.cc:237] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.000867 30620 tablet_bootstrap.cc:492] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:35.001411 30620 ts_tablet_manager.cc:1403] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.090s	user 0.031s	sys 0.021s
I20260709 13:09:35.003264 30619 tablet_bootstrap.cc:492] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:35.003796 30619 ts_tablet_manager.cc:1403] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.004s
I20260709 13:09:35.004225 30620 raft_consensus.cc:359] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.004940 30620 raft_consensus.cc:385] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.005205 30620 raft_consensus.cc:740] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.005903 30620 consensus_queue.cc:260] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.005571 30327 catalog_manager.cc:5697] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e9fe8a853314556bd34d155250e742e (127.20.130.67). New cstate: current_term: 1 leader_uuid: "0e9fe8a853314556bd34d155250e742e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.006465 30619 raft_consensus.cc:359] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.007344 30619 raft_consensus.cc:385] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.007586 30619 raft_consensus.cc:740] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.008029 30620 ts_tablet_manager.cc:1434] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:35.008244 30619 consensus_queue.cc:260] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.010223 30619 ts_tablet_manager.cc:1434] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:09:35.011255 30619 tablet_bootstrap.cc:492] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:35.016321 30619 tablet_bootstrap.cc:654] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.021095 30619 tablet_bootstrap.cc:492] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:35.021545 30619 ts_tablet_manager.cc:1403] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:09:35.023799 30619 raft_consensus.cc:359] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.024330 30619 raft_consensus.cc:385] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.024588 30619 raft_consensus.cc:740] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.025100 30619 consensus_queue.cc:260] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.026619 30619 ts_tablet_manager.cc:1434] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:09:35.149721 30664 raft_consensus.cc:493] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.150354 30664 raft_consensus.cc:515] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.152199 30664 leader_election.cc:290] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:35.153131 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc98598beabc4030b90c6c62c89dc820" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:35.153262 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc98598beabc4030b90c6c62c89dc820" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:35.153863 30429 raft_consensus.cc:2468] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 0.
I20260709 13:09:35.153996 30503 raft_consensus.cc:2468] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 0.
I20260709 13:09:35.154989 30545 leader_election.cc:304] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:35.155884 30664 raft_consensus.cc:2804] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:35.156226 30664 raft_consensus.cc:493] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.156507 30664 raft_consensus.cc:3060] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.161933 30664 raft_consensus.cc:515] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.164007 30664 leader_election.cc:290] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:35.165563 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc98598beabc4030b90c6c62c89dc820" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:35.165715 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc98598beabc4030b90c6c62c89dc820" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:35.166252 30503 raft_consensus.cc:3060] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.166679 30429 raft_consensus.cc:3060] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.171752 30503 raft_consensus.cc:2468] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 1.
I20260709 13:09:35.172892 30429 raft_consensus.cc:2468] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 1.
I20260709 13:09:35.172916 30542 leader_election.cc:304] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3284fa337a70463ab250f0d48d2f05f3; no voters: 
I20260709 13:09:35.173898 30664 raft_consensus.cc:2804] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:35.174381 30664 raft_consensus.cc:697] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Becoming Leader. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:35.175164 30664 consensus_queue.cc:237] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.182000 30325 catalog_manager.cc:5697] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e9fe8a853314556bd34d155250e742e (127.20.130.67). New cstate: current_term: 1 leader_uuid: "0e9fe8a853314556bd34d155250e742e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.192976 30625 consensus_queue.cc:1048] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.204197 30625 consensus_queue.cc:1048] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.280771 30648 consensus_queue.cc:1048] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.290561 30505 raft_consensus.cc:3060] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.291640 30646 consensus_queue.cc:1048] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.299645 30646 consensus_queue.cc:1048] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.314079 30646 consensus_queue.cc:1048] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.315910 30505 raft_consensus.cc:3060] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.321944 30664 consensus_queue.cc:1048] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.324844 30664 consensus_queue.cc:1048] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.380744 30664 consensus_queue.cc:1048] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.381606 30646 consensus_queue.cc:1048] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.393878 30631 consensus_queue.cc:1048] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.394892 30646 consensus_queue.cc:1048] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.395663 30628 consensus_queue.cc:1048] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.405687 30625 raft_consensus.cc:493] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.406363 30625 raft_consensus.cc:515] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.410386 30428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49459d42810745468d5235656763e60b" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:35.414392 30625 leader_election.cc:290] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:35.416256 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49459d42810745468d5235656763e60b" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:35.417479 30628 consensus_queue.cc:1048] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.417908 30471 leader_election.cc:304] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3; no voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:35.420663 30625 raft_consensus.cc:2749] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:35.433240 30505 raft_consensus.cc:3060] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.462608 30631 consensus_queue.cc:1048] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.482188 30628 consensus_queue.cc:1048] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:35.497112 30579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc98598beabc4030b90c6c62c89dc820"
dest_uuid: "0e9fe8a853314556bd34d155250e742e"
mode: GRACEFUL
new_leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
 from {username='slave'} at 127.0.0.1:58382
I20260709 13:09:35.497802 30579 raft_consensus.cc:606] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Received request to transfer leadership to TS 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:35.520301 30505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d67a208fe8b44efbd18eb2511c74d0e"
dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
mode: GRACEFUL
new_leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
 from {username='slave'} at 127.0.0.1:59872
I20260709 13:09:35.520941 30505 raft_consensus.cc:606] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Received request to transfer leadership to TS 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:35.525841 30579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c4dbb67e82d4c45a54a820d4683c7d3"
dest_uuid: "0e9fe8a853314556bd34d155250e742e"
mode: GRACEFUL
new_leader_uuid: "3284fa337a70463ab250f0d48d2f05f3"
 from {username='slave'} at 127.0.0.1:58382
I20260709 13:09:35.526311 30579 raft_consensus.cc:606] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Received request to transfer leadership to TS 3284fa337a70463ab250f0d48d2f05f3
I20260709 13:09:35.530978 30579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44e4bfb965bc4bc8bea51fb54d634a6c"
dest_uuid: "0e9fe8a853314556bd34d155250e742e"
mode: GRACEFUL
new_leader_uuid: "3284fa337a70463ab250f0d48d2f05f3"
 from {username='slave'} at 127.0.0.1:58382
I20260709 13:09:35.531437 30579 raft_consensus.cc:606] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Received request to transfer leadership to TS 3284fa337a70463ab250f0d48d2f05f3
I20260709 13:09:35.536152 30579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16fc6ca9f41c475f9e193d853d9e5edd"
dest_uuid: "0e9fe8a853314556bd34d155250e742e"
mode: GRACEFUL
new_leader_uuid: "3284fa337a70463ab250f0d48d2f05f3"
 from {username='slave'} at 127.0.0.1:58382
I20260709 13:09:35.536747 30579 raft_consensus.cc:606] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Received request to transfer leadership to TS 3284fa337a70463ab250f0d48d2f05f3
I20260709 13:09:35.550792 30429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41234aa848a244d186f86ae165931584"
dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
mode: GRACEFUL
new_leader_uuid: "3284fa337a70463ab250f0d48d2f05f3"
 from {username='slave'} at 127.0.0.1:58766
I20260709 13:09:35.551484 30429 raft_consensus.cc:606] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Received request to transfer leadership to TS 3284fa337a70463ab250f0d48d2f05f3
I20260709 13:09:35.595860 30631 consensus_queue.cc:1048] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.603291 30628 raft_consensus.cc:993] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e: : Instructing follower 3c7e424ddadf49589ee6d20102a08cc8 to start an election
I20260709 13:09:35.603798 30666 raft_consensus.cc:1081] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Signalling peer 3c7e424ddadf49589ee6d20102a08cc8 to start an election
I20260709 13:09:35.605948 30430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc98598beabc4030b90c6c62c89dc820"
dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
 from {username='slave'} at 127.0.0.1:58748
I20260709 13:09:35.606523 30430 raft_consensus.cc:493] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.606879 30430 raft_consensus.cc:3060] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.609273 30631 consensus_queue.cc:1048] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.614662 30430 raft_consensus.cc:515] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.617606 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc98598beabc4030b90c6c62c89dc820" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:35.617811 30429 raft_consensus.cc:1240] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Rejecting Update request from peer 0e9fe8a853314556bd34d155250e742e for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:35.617892 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc98598beabc4030b90c6c62c89dc820" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:35.618309 30504 raft_consensus.cc:3060] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.617985 30430 leader_election.cc:290] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 2 election: Requested vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:35.618755 30579 raft_consensus.cc:3055] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:35.619226 30579 raft_consensus.cc:740] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:35.620035 30579 consensus_queue.cc:260] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.621281 30579 raft_consensus.cc:3060] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.624598 30504 raft_consensus.cc:2468] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 2.
I20260709 13:09:35.625795 30393 leader_election.cc:304] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:35.626513 30626 raft_consensus.cc:2804] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:35.626981 30626 raft_consensus.cc:697] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 LEADER]: Becoming Leader. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:35.627066 30579 raft_consensus.cc:2468] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 2.
I20260709 13:09:35.627884 30626 consensus_queue.cc:237] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.637233 30328 catalog_manager.cc:5697] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 reported cstate change: term changed from 1 to 2, leader changed from 0e9fe8a853314556bd34d155250e742e (127.20.130.67) to 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.698529 30648 raft_consensus.cc:993] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8: : Instructing follower 3284fa337a70463ab250f0d48d2f05f3 to start an election
I20260709 13:09:35.699046 30626 raft_consensus.cc:1081] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Signalling peer 3284fa337a70463ab250f0d48d2f05f3 to start an election
I20260709 13:09:35.700496 30504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41234aa848a244d186f86ae165931584"
dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
 from {username='slave'} at 127.0.0.1:59856
I20260709 13:09:35.700973 30504 raft_consensus.cc:493] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.701313 30504 raft_consensus.cc:3060] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.706319 30504 raft_consensus.cc:515] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.708117 30504 leader_election.cc:290] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 2 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:35.709116 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41234aa848a244d186f86ae165931584" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:35.709277 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41234aa848a244d186f86ae165931584" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:35.709744 30429 raft_consensus.cc:3055] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:35.709898 30579 raft_consensus.cc:3060] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.710027 30429 raft_consensus.cc:740] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:35.710877 30429 consensus_queue.cc:260] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.711867 30429 raft_consensus.cc:3060] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.716456 30579 raft_consensus.cc:2468] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 2.
I20260709 13:09:35.717855 30471 leader_election.cc:304] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3284fa337a70463ab250f0d48d2f05f3; no voters: 
I20260709 13:09:35.718724 30655 raft_consensus.cc:2804] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:35.719180 30655 raft_consensus.cc:697] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Becoming Leader. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:35.719971 30655 consensus_queue.cc:237] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.721040 30429 raft_consensus.cc:2468] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 2.
I20260709 13:09:35.726039 30328 catalog_manager.cc:5697] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 reported cstate change: term changed from 1 to 2, leader changed from 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65) to 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "3284fa337a70463ab250f0d48d2f05f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.745575 30625 raft_consensus.cc:993] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3: : Instructing follower 3c7e424ddadf49589ee6d20102a08cc8 to start an election
I20260709 13:09:35.746073 30701 raft_consensus.cc:1081] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Signalling peer 3c7e424ddadf49589ee6d20102a08cc8 to start an election
I20260709 13:09:35.747540 30429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d67a208fe8b44efbd18eb2511c74d0e"
dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
 from {username='slave'} at 127.0.0.1:58754
I20260709 13:09:35.748107 30429 raft_consensus.cc:493] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.748481 30429 raft_consensus.cc:3060] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.753609 30429 raft_consensus.cc:515] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.755190 30429 leader_election.cc:290] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 2 election: Requested vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:35.756026 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d67a208fe8b44efbd18eb2511c74d0e" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:35.756191 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d67a208fe8b44efbd18eb2511c74d0e" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:35.756675 30504 raft_consensus.cc:3055] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:35.756757 30579 raft_consensus.cc:3060] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.756981 30504 raft_consensus.cc:740] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:35.757825 30504 consensus_queue.cc:260] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.758764 30504 raft_consensus.cc:3060] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.761955 30579 raft_consensus.cc:2468] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 2.
I20260709 13:09:35.763193 30396 leader_election.cc:304] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:35.764008 30626 raft_consensus.cc:2804] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:35.764288 30504 raft_consensus.cc:2468] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 2.
I20260709 13:09:35.764520 30626 raft_consensus.cc:697] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 LEADER]: Becoming Leader. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:35.765462 30626 consensus_queue.cc:237] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.772051 30328 catalog_manager.cc:5697] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 reported cstate change: term changed from 1 to 2, leader changed from 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66) to 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.810068 30666 raft_consensus.cc:993] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e: : Instructing follower 3284fa337a70463ab250f0d48d2f05f3 to start an election
I20260709 13:09:35.810493 30631 raft_consensus.cc:1081] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Signalling peer 3284fa337a70463ab250f0d48d2f05f3 to start an election
I20260709 13:09:35.811913 30504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16fc6ca9f41c475f9e193d853d9e5edd"
dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
 from {username='slave'} at 127.0.0.1:59840
I20260709 13:09:35.812414 30504 raft_consensus.cc:493] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.812707 30504 raft_consensus.cc:3060] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.817517 30504 raft_consensus.cc:515] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.819128 30504 leader_election.cc:290] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 2 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:35.819981 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fc6ca9f41c475f9e193d853d9e5edd" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:35.820169 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fc6ca9f41c475f9e193d853d9e5edd" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:35.820583 30429 raft_consensus.cc:3060] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.820763 30579 raft_consensus.cc:3055] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:35.821203 30579 raft_consensus.cc:740] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:35.822024 30579 consensus_queue.cc:260] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.823366 30579 raft_consensus.cc:3060] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.826709 30429 raft_consensus.cc:2468] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 2.
I20260709 13:09:35.827874 30471 leader_election.cc:304] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:35.828685 30701 raft_consensus.cc:2804] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:35.828924 30579 raft_consensus.cc:2468] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 2.
I20260709 13:09:35.829152 30701 raft_consensus.cc:697] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Becoming Leader. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:35.830173 30701 consensus_queue.cc:237] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:35.836452 30328 catalog_manager.cc:5697] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 reported cstate change: term changed from 1 to 2, leader changed from 0e9fe8a853314556bd34d155250e742e (127.20.130.67) to 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "3284fa337a70463ab250f0d48d2f05f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.014165 30666 raft_consensus.cc:993] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e: : Instructing follower 3284fa337a70463ab250f0d48d2f05f3 to start an election
I20260709 13:09:36.014668 30628 raft_consensus.cc:1081] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Signalling peer 3284fa337a70463ab250f0d48d2f05f3 to start an election
I20260709 13:09:36.016185 30504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c4dbb67e82d4c45a54a820d4683c7d3"
dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
 from {username='slave'} at 127.0.0.1:59840
I20260709 13:09:36.016760 30504 raft_consensus.cc:493] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:36.017086 30504 raft_consensus.cc:3060] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.022439 30504 raft_consensus.cc:515] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:36.024219 30504 leader_election.cc:290] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 2 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:36.025012 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4dbb67e82d4c45a54a820d4683c7d3" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:36.025291 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4dbb67e82d4c45a54a820d4683c7d3" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:36.025713 30429 raft_consensus.cc:3060] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.025856 30579 raft_consensus.cc:3055] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:36.026299 30579 raft_consensus.cc:740] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:36.027163 30579 consensus_queue.cc:260] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:36.028409 30579 raft_consensus.cc:3060] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.032958 30578 raft_consensus.cc:1275] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Refusing update from remote peer 3c7e424ddadf49589ee6d20102a08cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.033104 30429 raft_consensus.cc:2468] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 2.
I20260709 13:09:36.035280 30471 leader_election.cc:304] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:36.035086 30626 consensus_queue.cc:1048] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:36.036245 30701 raft_consensus.cc:2804] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.036718 30701 raft_consensus.cc:697] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Becoming Leader. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:36.037530 30701 consensus_queue.cc:237] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:36.037811 30579 raft_consensus.cc:2468] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 2.
I20260709 13:09:36.050386 30504 raft_consensus.cc:1275] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Refusing update from remote peer 3c7e424ddadf49589ee6d20102a08cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.052620 30626 consensus_queue.cc:1048] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.055398 30328 catalog_manager.cc:5697] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 reported cstate change: term changed from 1 to 2, leader changed from 0e9fe8a853314556bd34d155250e742e (127.20.130.67) to 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "3284fa337a70463ab250f0d48d2f05f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.103109 30666 raft_consensus.cc:993] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e: : Instructing follower 3284fa337a70463ab250f0d48d2f05f3 to start an election
I20260709 13:09:36.103598 30628 raft_consensus.cc:1081] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Signalling peer 3284fa337a70463ab250f0d48d2f05f3 to start an election
I20260709 13:09:36.105139 30504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44e4bfb965bc4bc8bea51fb54d634a6c"
dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
 from {username='slave'} at 127.0.0.1:59840
I20260709 13:09:36.105696 30504 raft_consensus.cc:493] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:36.105960 30504 raft_consensus.cc:3060] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.110832 30504 raft_consensus.cc:515] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:36.112504 30504 leader_election.cc:290] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 2 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:36.113247 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e4bfb965bc4bc8bea51fb54d634a6c" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:36.113517 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e4bfb965bc4bc8bea51fb54d634a6c" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:36.113878 30429 raft_consensus.cc:3060] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.114077 30579 raft_consensus.cc:3055] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:36.114429 30579 raft_consensus.cc:740] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:36.115118 30579 consensus_queue.cc:260] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:36.116031 30579 raft_consensus.cc:3060] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.118897 30429 raft_consensus.cc:2468] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 2.
I20260709 13:09:36.120051 30471 leader_election.cc:304] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:36.120842 30701 raft_consensus.cc:2804] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.121261 30701 raft_consensus.cc:697] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Becoming Leader. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:36.121439 30579 raft_consensus.cc:2468] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 2.
I20260709 13:09:36.122189 30701 consensus_queue.cc:237] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:36.128582 30327 catalog_manager.cc:5697] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 reported cstate change: term changed from 1 to 2, leader changed from 0e9fe8a853314556bd34d155250e742e (127.20.130.67) to 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "3284fa337a70463ab250f0d48d2f05f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.210341 30429 raft_consensus.cc:1275] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Refusing update from remote peer 3284fa337a70463ab250f0d48d2f05f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.211829 30701 consensus_queue.cc:1048] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.219483 30579 raft_consensus.cc:1275] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Refusing update from remote peer 3284fa337a70463ab250f0d48d2f05f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.220943 30655 consensus_queue.cc:1048] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.239883 30579 raft_consensus.cc:1275] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Refusing update from remote peer 3284fa337a70463ab250f0d48d2f05f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.241052 30625 consensus_queue.cc:1048] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.251260 30429 raft_consensus.cc:1275] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Refusing update from remote peer 3284fa337a70463ab250f0d48d2f05f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.252677 30701 consensus_queue.cc:1048] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.264164 30504 raft_consensus.cc:1275] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Refusing update from remote peer 3c7e424ddadf49589ee6d20102a08cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.265482 30703 consensus_queue.cc:1048] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.274526 30578 raft_consensus.cc:1275] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Refusing update from remote peer 3c7e424ddadf49589ee6d20102a08cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.276893 30646 consensus_queue.cc:1048] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.463677 30429 raft_consensus.cc:1275] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Refusing update from remote peer 3284fa337a70463ab250f0d48d2f05f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.464897 30701 consensus_queue.cc:1048] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.474215 30578 raft_consensus.cc:1275] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Refusing update from remote peer 3284fa337a70463ab250f0d48d2f05f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.476210 30655 consensus_queue.cc:1048] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.511230 30429 raft_consensus.cc:1275] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Refusing update from remote peer 3284fa337a70463ab250f0d48d2f05f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.512451 30655 consensus_queue.cc:1048] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.521040 30578 raft_consensus.cc:1275] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Refusing update from remote peer 3284fa337a70463ab250f0d48d2f05f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.523890 30701 consensus_queue.cc:1048] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.579856 30328 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49530:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:38.581990 30328 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:38.634188 30419 tablet_service.cc:1511] Processing CreateTablet for tablet 865246a4b94f4a1eb11c3aaa38be37b8 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:38.635499 30419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 865246a4b94f4a1eb11c3aaa38be37b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.635421 30489 tablet_service.cc:1511] Processing CreateTablet for tablet 865246a4b94f4a1eb11c3aaa38be37b8 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:38.636575 30568 tablet_service.cc:1511] Processing CreateTablet for tablet 865246a4b94f4a1eb11c3aaa38be37b8 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:38.637797 30568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 865246a4b94f4a1eb11c3aaa38be37b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.636919 30489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 865246a4b94f4a1eb11c3aaa38be37b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.642297 30495 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc2b2e4b7484563969a834a26ada976 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:38.643679 30495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc2b2e4b7484563969a834a26ada976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.643924 30488 tablet_service.cc:1511] Processing CreateTablet for tablet a1388d8e11df4afc946646c17ae8d115 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:38.645152 30488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1388d8e11df4afc946646c17ae8d115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.652945 30569 tablet_service.cc:1511] Processing CreateTablet for tablet a1388d8e11df4afc946646c17ae8d115 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:38.654353 30569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1388d8e11df4afc946646c17ae8d115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.655179 30415 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc2b2e4b7484563969a834a26ada976 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:38.656481 30415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc2b2e4b7484563969a834a26ada976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.653020 30412 tablet_service.cc:1511] Processing CreateTablet for tablet a1388d8e11df4afc946646c17ae8d115 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:38.660997 30562 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc2b2e4b7484563969a834a26ada976 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:38.661396 30412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1388d8e11df4afc946646c17ae8d115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.662266 30562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc2b2e4b7484563969a834a26ada976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.665030 30491 tablet_service.cc:1511] Processing CreateTablet for tablet abf063de4e5a467f8c2f164fd4fe29fd (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:38.666319 30491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf063de4e5a467f8c2f164fd4fe29fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.672966 30490 tablet_service.cc:1511] Processing CreateTablet for tablet c99512107b2d48bb8509bc6f28758558 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:38.674243 30490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c99512107b2d48bb8509bc6f28758558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.676473 30492 tablet_service.cc:1511] Processing CreateTablet for tablet dd944e77faba4eb39a5417cb2656ae2e (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:38.677759 30492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd944e77faba4eb39a5417cb2656ae2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.684739 30417 tablet_service.cc:1511] Processing CreateTablet for tablet abf063de4e5a467f8c2f164fd4fe29fd (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:38.686069 30417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf063de4e5a467f8c2f164fd4fe29fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.688431 30722 tablet_bootstrap.cc:492] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:38.692687 30494 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc3a3ada2644e99a5e9b89b800e34dd (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:38.694044 30494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc3a3ada2644e99a5e9b89b800e34dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.700985 30416 tablet_service.cc:1511] Processing CreateTablet for tablet c99512107b2d48bb8509bc6f28758558 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:38.702499 30416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c99512107b2d48bb8509bc6f28758558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.700974 30565 tablet_service.cc:1511] Processing CreateTablet for tablet c99512107b2d48bb8509bc6f28758558 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:38.712517 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c99512107b2d48bb8509bc6f28758558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.700985 30418 tablet_service.cc:1511] Processing CreateTablet for tablet dd944e77faba4eb39a5417cb2656ae2e (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:38.714756 30418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd944e77faba4eb39a5417cb2656ae2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.723183 30567 tablet_service.cc:1511] Processing CreateTablet for tablet dd944e77faba4eb39a5417cb2656ae2e (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:38.731190 30567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd944e77faba4eb39a5417cb2656ae2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.734457 30721 tablet_bootstrap.cc:492] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:38.743815 30721 tablet_bootstrap.cc:654] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.744400 30488 tablet_service.cc:1511] Processing CreateTablet for tablet b26cb2d51c204733a3ece7144773c6a9 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:38.745734 30488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b26cb2d51c204733a3ece7144773c6a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.746513 30563 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc3a3ada2644e99a5e9b89b800e34dd (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:38.746519 30416 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc3a3ada2644e99a5e9b89b800e34dd (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:38.748093 30416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc3a3ada2644e99a5e9b89b800e34dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.748298 30563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc3a3ada2644e99a5e9b89b800e34dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.753124 30415 tablet_service.cc:1511] Processing CreateTablet for tablet 6b940ff440de4522a7eca8534dd40b66 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:38.753841 30566 tablet_service.cc:1511] Processing CreateTablet for tablet b26cb2d51c204733a3ece7144773c6a9 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:38.754532 30415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b940ff440de4522a7eca8534dd40b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.755131 30566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b26cb2d51c204733a3ece7144773c6a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.755909 30491 tablet_service.cc:1511] Processing CreateTablet for tablet 6b940ff440de4522a7eca8534dd40b66 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:38.757126 30561 tablet_service.cc:1511] Processing CreateTablet for tablet 6b940ff440de4522a7eca8534dd40b66 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:38.757855 30569 tablet_service.cc:1511] Processing CreateTablet for tablet abf063de4e5a467f8c2f164fd4fe29fd (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:38.758345 30561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b940ff440de4522a7eca8534dd40b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.764874 30419 tablet_service.cc:1511] Processing CreateTablet for tablet b26cb2d51c204733a3ece7144773c6a9 (DEFAULT_TABLE table=soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:38.780213 30419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b26cb2d51c204733a3ece7144773c6a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.775470 30722 tablet_bootstrap.cc:654] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.766222 30724 tablet_bootstrap.cc:492] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:38.757151 30491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b940ff440de4522a7eca8534dd40b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.790985 30569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf063de4e5a467f8c2f164fd4fe29fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.826287 30721 tablet_bootstrap.cc:492] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:38.826900 30721 ts_tablet_manager.cc:1403] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.040s
I20260709 13:09:38.814687 30724 tablet_bootstrap.cc:654] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.837450 30722 tablet_bootstrap.cc:492] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:38.838150 30722 ts_tablet_manager.cc:1403] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.150s	user 0.023s	sys 0.010s
I20260709 13:09:38.831091 30721 raft_consensus.cc:359] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.847031 30721 raft_consensus.cc:385] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.847419 30721 raft_consensus.cc:740] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.848138 30721 consensus_queue.cc:260] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.850486 30721 ts_tablet_manager.cc:1434] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.004s
I20260709 13:09:38.851505 30721 tablet_bootstrap.cc:492] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:38.853408 30722 raft_consensus.cc:359] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.854223 30722 raft_consensus.cc:385] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.854512 30722 raft_consensus.cc:740] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.858366 30721 tablet_bootstrap.cc:654] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.863611 30722 consensus_queue.cc:260] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.865042 30628 raft_consensus.cc:493] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.865657 30628 raft_consensus.cc:515] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.869683 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1388d8e11df4afc946646c17ae8d115" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
W20260709 13:09:38.871867 30545 leader_election.cc:343] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.874194 30628 leader_election.cc:290] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:38.875088 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1388d8e11df4afc946646c17ae8d115" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
W20260709 13:09:38.877238 30542 leader_election.cc:343] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.877863 30542 leader_election.cc:304] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e; no voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:38.891916 30729 raft_consensus.cc:2749] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.903170 30722 ts_tablet_manager.cc:1434] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.001s
I20260709 13:09:38.908396 30722 tablet_bootstrap.cc:492] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:38.922996 30724 tablet_bootstrap.cc:492] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:38.923180 30722 tablet_bootstrap.cc:654] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.923331 30721 tablet_bootstrap.cc:492] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:38.923592 30724 ts_tablet_manager.cc:1403] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.189s	user 0.031s	sys 0.039s
I20260709 13:09:38.923854 30721 ts_tablet_manager.cc:1403] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.073s	user 0.032s	sys 0.039s
I20260709 13:09:38.926009 30724 raft_consensus.cc:359] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.926724 30724 raft_consensus.cc:385] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.927057 30724 raft_consensus.cc:740] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.927165 30721 raft_consensus.cc:359] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.927866 30721 raft_consensus.cc:385] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.928138 30721 raft_consensus.cc:740] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.928011 30724 consensus_queue.cc:260] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.929033 30722 tablet_bootstrap.cc:492] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:38.929632 30722 ts_tablet_manager.cc:1403] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.009s
I20260709 13:09:38.928970 30721 consensus_queue.cc:260] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.932197 30724 ts_tablet_manager.cc:1434] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:38.933193 30724 tablet_bootstrap.cc:492] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:38.934360 30722 raft_consensus.cc:359] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.935139 30722 raft_consensus.cc:385] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.935439 30722 raft_consensus.cc:740] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.936204 30722 consensus_queue.cc:260] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.937754 30721 ts_tablet_manager.cc:1434] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:09:38.938862 30721 tablet_bootstrap.cc:492] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:38.940577 30724 tablet_bootstrap.cc:654] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.946012 30721 tablet_bootstrap.cc:654] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.948726 30722 ts_tablet_manager.cc:1434] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.004s
I20260709 13:09:38.949806 30722 tablet_bootstrap.cc:492] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:38.951368 30724 tablet_bootstrap.cc:492] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:38.951920 30724 ts_tablet_manager.cc:1403] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:09:38.955010 30724 raft_consensus.cc:359] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.955785 30724 raft_consensus.cc:385] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.956130 30724 raft_consensus.cc:740] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.956857 30724 consensus_queue.cc:260] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.958897 30722 tablet_bootstrap.cc:654] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.959581 30724 ts_tablet_manager.cc:1434] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:38.960843 30724 tablet_bootstrap.cc:492] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:38.962706 30721 tablet_bootstrap.cc:492] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:38.963589 30721 ts_tablet_manager.cc:1403] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.000s
I20260709 13:09:38.967180 30721 raft_consensus.cc:359] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.967993 30721 raft_consensus.cc:385] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.968372 30721 raft_consensus.cc:740] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.969485 30724 tablet_bootstrap.cc:654] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.969238 30721 consensus_queue.cc:260] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.978137 30722 tablet_bootstrap.cc:492] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:38.978678 30722 ts_tablet_manager.cc:1403] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.003s
I20260709 13:09:38.978737 30729 raft_consensus.cc:493] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.982877 30729 raft_consensus.cc:515] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.983268 30721 ts_tablet_manager.cc:1434] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:09:38.984464 30721 tablet_bootstrap.cc:492] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:38.985407 30722 raft_consensus.cc:359] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:38.985963 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc2b2e4b7484563969a834a26ada976" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:38.986229 30722 raft_consensus.cc:385] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.986534 30722 raft_consensus.cc:740] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.987334 30722 consensus_queue.cc:260] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
W20260709 13:09:38.987712 30545 leader_election.cc:343] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.989754 30722 ts_tablet_manager.cc:1434] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:09:38.990749 30722 tablet_bootstrap.cc:492] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:38.991073 30721 tablet_bootstrap.cc:654] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.993948 30729 leader_election.cc:290] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:38.995432 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc2b2e4b7484563969a834a26ada976" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:38.996104 30504 raft_consensus.cc:2468] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 0.
I20260709 13:09:38.997243 30724 tablet_bootstrap.cc:492] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:38.997478 30542 leader_election.cc:304] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3284fa337a70463ab250f0d48d2f05f3; no voters: 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:38.997763 30724 ts_tablet_manager.cc:1403] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.008s
I20260709 13:09:39.000262 30722 tablet_bootstrap.cc:654] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.001407 30729 raft_consensus.cc:2804] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.001838 30729 raft_consensus.cc:493] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.002102 30729 raft_consensus.cc:3060] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.005234 30721 tablet_bootstrap.cc:492] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:39.005544 30722 tablet_bootstrap.cc:492] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:39.005820 30721 ts_tablet_manager.cc:1403] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.003s
I20260709 13:09:39.006096 30722 ts_tablet_manager.cc:1403] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:09:39.001075 30724 raft_consensus.cc:359] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.007208 30724 raft_consensus.cc:385] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.007582 30724 raft_consensus.cc:740] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.008546 30724 consensus_queue.cc:260] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.008996 30721 raft_consensus.cc:359] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.009769 30721 raft_consensus.cc:385] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.010121 30721 raft_consensus.cc:740] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.009858 30729 raft_consensus.cc:515] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.010946 30721 consensus_queue.cc:260] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.011826 30724 ts_tablet_manager.cc:1434] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.002s
I20260709 13:09:39.013011 30724 tablet_bootstrap.cc:492] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:39.013374 30721 ts_tablet_manager.cc:1434] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:39.014503 30721 tablet_bootstrap.cc:492] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:39.015727 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc2b2e4b7484563969a834a26ada976" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:39.009315 30722 raft_consensus.cc:359] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.016399 30430 raft_consensus.cc:3060] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.016435 30722 raft_consensus.cc:385] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.017017 30722 raft_consensus.cc:740] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.020663 30723 raft_consensus.cc:493] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.020920 30721 tablet_bootstrap.cc:654] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.021210 30723 raft_consensus.cc:515] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.023481 30723 leader_election.cc:290] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.019313 30722 consensus_queue.cc:260] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.024698 30724 tablet_bootstrap.cc:654] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.027297 30722 ts_tablet_manager.cc:1434] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:09:39.028424 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf063de4e5a467f8c2f164fd4fe29fd" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:39.024605 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf063de4e5a467f8c2f164fd4fe29fd" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:39.032105 30722 tablet_bootstrap.cc:492] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:39.049515 30722 tablet_bootstrap.cc:654] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:39.040172 30396 leader_election.cc:343] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:39.052872 30393 leader_election.cc:343] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.055817 30393 leader_election.cc:304] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c7e424ddadf49589ee6d20102a08cc8; no voters: 0e9fe8a853314556bd34d155250e742e, 3284fa337a70463ab250f0d48d2f05f3
I20260709 13:09:39.056955 30723 raft_consensus.cc:2749] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.068171 30722 tablet_bootstrap.cc:492] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:39.068979 30722 ts_tablet_manager.cc:1403] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.015s
I20260709 13:09:39.069419 30430 raft_consensus.cc:2468] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 1.
I20260709 13:09:39.071460 30545 leader_election.cc:304] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:39.072624 30628 raft_consensus.cc:2804] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.084560 30722 raft_consensus.cc:359] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.085556 30722 raft_consensus.cc:385] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.085929 30722 raft_consensus.cc:740] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.087292 30628 raft_consensus.cc:697] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Becoming Leader. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:39.088671 30722 consensus_queue.cc:260] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.089341 30628 consensus_queue.cc:237] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.092414 30722 ts_tablet_manager.cc:1434] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.001s
I20260709 13:09:39.093714 30722 tablet_bootstrap.cc:492] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:39.094954 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc2b2e4b7484563969a834a26ada976" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:39.095871 30504 raft_consensus.cc:3060] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.102283 30722 tablet_bootstrap.cc:654] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.108726 30729 leader_election.cc:290] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:39.116107 30722 tablet_bootstrap.cc:492] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:39.116894 30722 ts_tablet_manager.cc:1403] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:09:39.120863 30722 raft_consensus.cc:359] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.121862 30722 raft_consensus.cc:385] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.127485 30722 raft_consensus.cc:740] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.130390 30722 consensus_queue.cc:260] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.128643 30504 raft_consensus.cc:2468] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 1.
I20260709 13:09:39.134159 30325 catalog_manager.cc:5697] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e9fe8a853314556bd34d155250e742e (127.20.130.67). New cstate: current_term: 1 leader_uuid: "0e9fe8a853314556bd34d155250e742e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.139832 30722 ts_tablet_manager.cc:1434] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 13:09:39.141080 30722 tablet_bootstrap.cc:492] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:39.143916 30724 tablet_bootstrap.cc:492] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:39.144492 30724 ts_tablet_manager.cc:1403] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.132s	user 0.058s	sys 0.052s
I20260709 13:09:39.144716 30721 tablet_bootstrap.cc:492] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:39.145394 30721 ts_tablet_manager.cc:1403] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.131s	user 0.054s	sys 0.062s
I20260709 13:09:39.147624 30724 raft_consensus.cc:359] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.148408 30724 raft_consensus.cc:385] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.148703 30724 raft_consensus.cc:740] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.149634 30710 raft_consensus.cc:493] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.149406 30724 consensus_queue.cc:260] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.150138 30710 raft_consensus.cc:515] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.151862 30724 ts_tablet_manager.cc:1434] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:39.152565 30710 leader_election.cc:290] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.153352 30724 tablet_bootstrap.cc:492] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:39.154001 30722 tablet_bootstrap.cc:654] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.150830 30721 raft_consensus.cc:359] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.154912 30721 raft_consensus.cc:385] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.155278 30721 raft_consensus.cc:740] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.156060 30721 consensus_queue.cc:260] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.160509 30724 tablet_bootstrap.cc:654] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.162736 30721 ts_tablet_manager.cc:1434] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:09:39.165180 30721 tablet_bootstrap.cc:492] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:39.166471 30722 tablet_bootstrap.cc:492] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:39.167096 30722 ts_tablet_manager.cc:1403] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
I20260709 13:09:39.170286 30722 raft_consensus.cc:359] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.170987 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1388d8e11df4afc946646c17ae8d115" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:39.171386 30722 raft_consensus.cc:385] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.172010 30722 raft_consensus.cc:740] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.172077 30579 raft_consensus.cc:2468] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 0.
I20260709 13:09:39.173179 30722 consensus_queue.cc:260] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.174839 30471 leader_election.cc:304] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3284fa337a70463ab250f0d48d2f05f3; no voters: 
I20260709 13:09:39.177475 30724 tablet_bootstrap.cc:492] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:39.178036 30724 ts_tablet_manager.cc:1403] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 13:09:39.179003 30710 raft_consensus.cc:2804] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.179421 30710 raft_consensus.cc:493] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.179793 30710 raft_consensus.cc:3060] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.179054 30721 tablet_bootstrap.cc:654] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.182117 30724 raft_consensus.cc:359] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.183332 30724 raft_consensus.cc:385] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.183655 30724 raft_consensus.cc:740] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.184350 30724 consensus_queue.cc:260] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.182300 30722 ts_tablet_manager.cc:1434] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:09:39.186654 30724 ts_tablet_manager.cc:1434] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:09:39.186753 30722 tablet_bootstrap.cc:492] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:39.191406 30724 tablet_bootstrap.cc:492] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:39.199801 30724 tablet_bootstrap.cc:654] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.200835 30722 tablet_bootstrap.cc:654] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.202018 30721 tablet_bootstrap.cc:492] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:39.202582 30721 ts_tablet_manager.cc:1403] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.006s
I20260709 13:09:39.205477 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1388d8e11df4afc946646c17ae8d115" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:39.206197 30721 raft_consensus.cc:359] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.207237 30721 raft_consensus.cc:385] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:39.207314 30471 leader_election.cc:343] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.207733 30721 raft_consensus.cc:740] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.208653 30721 consensus_queue.cc:260] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.219049 30722 tablet_bootstrap.cc:492] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:39.219923 30722 ts_tablet_manager.cc:1403] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.014s
I20260709 13:09:39.220840 30628 raft_consensus.cc:493] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.220919 30721 ts_tablet_manager.cc:1434] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.003s
I20260709 13:09:39.221472 30628 raft_consensus.cc:515] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.222225 30721 tablet_bootstrap.cc:492] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:39.223778 30628 leader_election.cc:290] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:39.225730 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26cb2d51c204733a3ece7144773c6a9" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:39.227032 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26cb2d51c204733a3ece7144773c6a9" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:39.228864 30721 tablet_bootstrap.cc:654] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:39.229028 30545 leader_election.cc:343] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:39.230324 30542 leader_election.cc:343] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.230947 30542 leader_election.cc:304] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e; no voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:39.232391 30628 raft_consensus.cc:2749] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.236589 30722 raft_consensus.cc:359] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.237582 30722 raft_consensus.cc:385] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.238061 30722 raft_consensus.cc:740] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.239156 30722 consensus_queue.cc:260] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.241611 30722 ts_tablet_manager.cc:1434] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:09:39.244016 30739 raft_consensus.cc:493] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.247035 30739 raft_consensus.cc:515] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
W20260709 13:09:39.244167 30393 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:38107, user_credentials={real_user=slave}} blocked reactor thread for 57427us
I20260709 13:09:39.246251 30722 tablet_bootstrap.cc:492] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e: Bootstrap starting.
I20260709 13:09:39.257316 30628 raft_consensus.cc:493] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.258118 30628 raft_consensus.cc:515] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.259641 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd944e77faba4eb39a5417cb2656ae2e" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:39.260533 30430 raft_consensus.cc:2468] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 0.
I20260709 13:09:39.261336 30747 raft_consensus.cc:493] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.262002 30471 leader_election.cc:304] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:39.263394 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b940ff440de4522a7eca8534dd40b66" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:39.264272 30754 raft_consensus.cc:2804] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.264719 30754 raft_consensus.cc:493] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.265069 30754 raft_consensus.cc:3060] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:39.266040 30545 leader_election.cc:343] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.262068 30747 raft_consensus.cc:515] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.268090 30739 leader_election.cc:290] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.268709 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd944e77faba4eb39a5417cb2656ae2e" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:39.269328 30579 raft_consensus.cc:2468] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 0.
I20260709 13:09:39.269825 30747 leader_election.cc:290] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.242807 30710 raft_consensus.cc:515] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.272068 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf063de4e5a467f8c2f164fd4fe29fd" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:39.272765 30429 raft_consensus.cc:2468] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 0.
I20260709 13:09:39.273272 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b940ff440de4522a7eca8534dd40b66" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:39.274766 30628 leader_election.cc:290] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
W20260709 13:09:39.274796 30542 leader_election.cc:343] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.278237 30542 leader_election.cc:304] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e; no voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:39.276037 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf063de4e5a467f8c2f164fd4fe29fd" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:39.279093 30729 raft_consensus.cc:2749] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.279340 30579 raft_consensus.cc:2468] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 0.
I20260709 13:09:39.276448 30722 tablet_bootstrap.cc:654] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.276952 30710 leader_election.cc:290] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.277673 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1388d8e11df4afc946646c17ae8d115" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:39.281585 30578 raft_consensus.cc:3060] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.284188 30754 raft_consensus.cc:515] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.287298 30754 leader_election.cc:290] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.293090 30578 raft_consensus.cc:2468] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 1.
I20260709 13:09:39.294458 30628 raft_consensus.cc:493] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.294937 30628 raft_consensus.cc:515] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.295812 30724 tablet_bootstrap.cc:492] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:39.296347 30724 ts_tablet_manager.cc:1403] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.105s	user 0.040s	sys 0.023s
I20260709 13:09:39.297082 30628 leader_election.cc:290] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:39.280901 30471 leader_election.cc:304] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:39.338689 30754 raft_consensus.cc:493] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.340252 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865246a4b94f4a1eb11c3aaa38be37b8" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:39.340108 30754 raft_consensus.cc:515] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.341583 30721 tablet_bootstrap.cc:492] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:39.341918 30429 raft_consensus.cc:2468] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 0.
I20260709 13:09:39.342866 30721 ts_tablet_manager.cc:1403] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.121s	user 0.019s	sys 0.018s
W20260709 13:09:39.343477 30471 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.130.65:46347, user_credentials={real_user=slave}} blocked reactor thread for 62507.6us
I20260709 13:09:39.344353 30739 raft_consensus.cc:2804] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.345007 30739 raft_consensus.cc:493] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.345439 30739 raft_consensus.cc:3060] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.347218 30749 raft_consensus.cc:493] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.347507 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1388d8e11df4afc946646c17ae8d115" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:39.302208 30724 raft_consensus.cc:359] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.348789 30724 raft_consensus.cc:385] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.348316 30749 raft_consensus.cc:515] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.349177 30724 raft_consensus.cc:740] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.350267 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865246a4b94f4a1eb11c3aaa38be37b8" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:39.350395 30724 consensus_queue.cc:260] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.351267 30504 raft_consensus.cc:2468] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 0.
I20260709 13:09:39.352882 30428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd944e77faba4eb39a5417cb2656ae2e" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:39.353577 30724 ts_tablet_manager.cc:1434] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.001s
I20260709 13:09:39.353981 30428 raft_consensus.cc:3060] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.354308 30542 leader_election.cc:304] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3284fa337a70463ab250f0d48d2f05f3; no voters: 
I20260709 13:09:39.356145 30430 raft_consensus.cc:3060] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.357038 30628 raft_consensus.cc:2804] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.357551 30628 raft_consensus.cc:493] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.357944 30628 raft_consensus.cc:3060] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.359011 30721 raft_consensus.cc:359] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.360034 30721 raft_consensus.cc:385] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.360478 30721 raft_consensus.cc:740] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.356180 30724 tablet_bootstrap.cc:492] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:39.365231 30749 leader_election.cc:290] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.366413 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99512107b2d48bb8509bc6f28758558" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:39.367761 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99512107b2d48bb8509bc6f28758558" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:39.368817 30505 raft_consensus.cc:2468] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 0.
W20260709 13:09:39.369562 30396 leader_election.cc:343] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.373127 30724 tablet_bootstrap.cc:654] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.374250 30393 leader_election.cc:304] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 0e9fe8a853314556bd34d155250e742e
I20260709 13:09:39.374323 30721 consensus_queue.cc:260] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.376185 30754 leader_election.cc:290] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.376817 30723 raft_consensus.cc:2804] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.377342 30723 raft_consensus.cc:493] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.377781 30723 raft_consensus.cc:3060] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.379213 30721 ts_tablet_manager.cc:1434] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.036s	user 0.012s	sys 0.002s
I20260709 13:09:39.380860 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd944e77faba4eb39a5417cb2656ae2e" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:39.384747 30721 tablet_bootstrap.cc:492] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:39.385896 30722 tablet_bootstrap.cc:492] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e: No bootstrap required, opened a new log
I20260709 13:09:39.391525 30578 raft_consensus.cc:3060] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.392311 30722 ts_tablet_manager.cc:1403] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e: Time spent bootstrapping tablet: real 0.146s	user 0.007s	sys 0.009s
I20260709 13:09:39.387281 30754 raft_consensus.cc:493] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.395202 30754 raft_consensus.cc:515] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.417703 30721 tablet_bootstrap.cc:654] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.420763 30722 raft_consensus.cc:359] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.424005 30722 raft_consensus.cc:385] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.424268 30722 raft_consensus.cc:740] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.433127 30754 leader_election.cc:290] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.437084 30430 raft_consensus.cc:2468] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 1.
I20260709 13:09:39.437857 30722 consensus_queue.cc:260] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.439538 30739 raft_consensus.cc:515] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.442036 30739 leader_election.cc:290] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.431377 30428 raft_consensus.cc:2468] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 1.
I20260709 13:09:39.443985 30722 ts_tablet_manager.cc:1434] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.004s
I20260709 13:09:39.434595 30628 raft_consensus.cc:515] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.451476 30471 leader_election.cc:304] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3284fa337a70463ab250f0d48d2f05f3; no voters: 
I20260709 13:09:39.453035 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865246a4b94f4a1eb11c3aaa38be37b8" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:39.453440 30758 raft_consensus.cc:2804] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.453816 30430 raft_consensus.cc:3060] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.454130 30758 raft_consensus.cc:697] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Becoming Leader. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:39.455554 30758 consensus_queue.cc:237] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.457175 30721 tablet_bootstrap.cc:492] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:39.457741 30721 ts_tablet_manager.cc:1403] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.015s
I20260709 13:09:39.458540 30724 tablet_bootstrap.cc:492] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:39.459163 30724 ts_tablet_manager.cc:1403] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.104s	user 0.023s	sys 0.012s
I20260709 13:09:39.461438 30721 raft_consensus.cc:359] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.462308 30721 raft_consensus.cc:385] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.462685 30721 raft_consensus.cc:740] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.462512 30724 raft_consensus.cc:359] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.463461 30724 raft_consensus.cc:385] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.463778 30724 raft_consensus.cc:740] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.464001 30721 consensus_queue.cc:260] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.453807 30723 raft_consensus.cc:515] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.467942 30428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865246a4b94f4a1eb11c3aaa38be37b8" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:39.469372 30471 leader_election.cc:304] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:39.469914 30576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3a3ada2644e99a5e9b89b800e34dd" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:39.470414 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865246a4b94f4a1eb11c3aaa38be37b8" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:39.470782 30576 raft_consensus.cc:2468] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 0.
I20260709 13:09:39.471273 30579 raft_consensus.cc:2393] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3284fa337a70463ab250f0d48d2f05f3 in current term 1: Already voted for candidate 0e9fe8a853314556bd34d155250e742e in this term.
I20260709 13:09:39.471191 30628 leader_election.cc:290] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:39.471850 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865246a4b94f4a1eb11c3aaa38be37b8" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:39.472162 30739 raft_consensus.cc:2804] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.472229 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf063de4e5a467f8c2f164fd4fe29fd" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:39.472604 30504 raft_consensus.cc:3060] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.472990 30739 raft_consensus.cc:697] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Becoming Leader. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:39.473155 30575 raft_consensus.cc:3060] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.473452 30427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf063de4e5a467f8c2f164fd4fe29fd" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:39.474556 30427 raft_consensus.cc:3060] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.474310 30739 consensus_queue.cc:237] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.475379 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3a3ada2644e99a5e9b89b800e34dd" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:39.478585 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99512107b2d48bb8509bc6f28758558" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:39.479367 30505 raft_consensus.cc:3060] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.479830 30578 raft_consensus.cc:2468] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 1.
I20260709 13:09:39.484791 30427 raft_consensus.cc:2468] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 1.
I20260709 13:09:39.487295 30575 raft_consensus.cc:2468] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 1.
I20260709 13:09:39.487627 30471 leader_election.cc:304] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:39.488785 30710 raft_consensus.cc:2804] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.489282 30710 raft_consensus.cc:697] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Becoming Leader. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:39.490343 30710 consensus_queue.cc:237] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.491044 30723 leader_election.cc:290] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 election: Requested vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.491631 30505 raft_consensus.cc:2468] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 1.
I20260709 13:09:39.493513 30393 leader_election.cc:304] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:39.464613 30724 consensus_queue.cc:260] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.494822 30504 raft_consensus.cc:2468] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 1.
I20260709 13:09:39.495922 30429 raft_consensus.cc:2468] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 0.
I20260709 13:09:39.501394 30542 leader_election.cc:304] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3284fa337a70463ab250f0d48d2f05f3; no voters: 
I20260709 13:09:39.502779 30628 raft_consensus.cc:2804] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.504209 30628 raft_consensus.cc:697] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Becoming Leader. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:39.503373 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99512107b2d48bb8509bc6f28758558" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:39.500455 30471 leader_election.cc:304] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3284fa337a70463ab250f0d48d2f05f3; no voters: 
I20260709 13:09:39.507454 30754 raft_consensus.cc:2804] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.507885 30754 raft_consensus.cc:493] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.508131 30724 ts_tablet_manager.cc:1434] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 13:09:39.508296 30754 raft_consensus.cc:3060] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.509660 30724 tablet_bootstrap.cc:492] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:39.511071 30578 raft_consensus.cc:3060] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.494738 30723 raft_consensus.cc:2804] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.523008 30628 consensus_queue.cc:237] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.527240 30430 raft_consensus.cc:2468] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 1.
I20260709 13:09:39.528633 30721 ts_tablet_manager.cc:1434] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.002s
I20260709 13:09:39.528837 30471 leader_election.cc:304] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3; no voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:39.530082 30721 tablet_bootstrap.cc:492] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3: Bootstrap starting.
I20260709 13:09:39.530489 30754 raft_consensus.cc:515] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.531209 30758 raft_consensus.cc:2749] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.532647 30754 leader_election.cc:290] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.523619 30723 raft_consensus.cc:697] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Becoming Leader. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:39.535094 30724 tablet_bootstrap.cc:654] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.535722 30723 consensus_queue.cc:237] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.544958 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3a3ada2644e99a5e9b89b800e34dd" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:39.545670 30430 raft_consensus.cc:3060] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.545140 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3a3ada2644e99a5e9b89b800e34dd" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:39.546221 30575 raft_consensus.cc:3060] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.545322 30328 catalog_manager.cc:5697] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e9fe8a853314556bd34d155250e742e (127.20.130.67). New cstate: current_term: 1 leader_uuid: "0e9fe8a853314556bd34d155250e742e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.543123 30325 catalog_manager.cc:5697] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "3284fa337a70463ab250f0d48d2f05f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.555558 30430 raft_consensus.cc:2468] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 1.
I20260709 13:09:39.541640 30578 raft_consensus.cc:2468] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 1.
I20260709 13:09:39.557554 30471 leader_election.cc:304] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:39.559145 30721 tablet_bootstrap.cc:654] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.559463 30710 raft_consensus.cc:2804] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.560031 30710 raft_consensus.cc:697] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Becoming Leader. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:39.561043 30710 consensus_queue.cc:237] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.562402 30575 raft_consensus.cc:2468] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 1.
I20260709 13:09:39.570151 30721 tablet_bootstrap.cc:492] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3: No bootstrap required, opened a new log
I20260709 13:09:39.570662 30721 ts_tablet_manager.cc:1403] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3: Time spent bootstrapping tablet: real 0.041s	user 0.002s	sys 0.009s
I20260709 13:09:39.571075 30328 catalog_manager.cc:5697] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.573411 30721 raft_consensus.cc:359] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.575311 30721 raft_consensus.cc:385] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.575605 30721 raft_consensus.cc:740] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.576244 30721 consensus_queue.cc:260] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.574714 30724 tablet_bootstrap.cc:492] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
I20260709 13:09:39.577267 30724 ts_tablet_manager.cc:1403] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.068s	user 0.007s	sys 0.018s
I20260709 13:09:39.580125 30724 raft_consensus.cc:359] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.580684 30724 raft_consensus.cc:385] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.580899 30724 raft_consensus.cc:740] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.581578 30724 consensus_queue.cc:260] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.584385 30721 ts_tablet_manager.cc:1434] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:09:39.585666 30724 ts_tablet_manager.cc:1434] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:09:39.585503 30325 catalog_manager.cc:5697] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "3284fa337a70463ab250f0d48d2f05f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.586728 30724 tablet_bootstrap.cc:492] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8: Bootstrap starting.
I20260709 13:09:39.587442 30325 catalog_manager.cc:5697] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "3284fa337a70463ab250f0d48d2f05f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.588960 30325 catalog_manager.cc:5697] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "3284fa337a70463ab250f0d48d2f05f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.593104 30724 tablet_bootstrap.cc:654] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.598100 30724 tablet_bootstrap.cc:492] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8: No bootstrap required, opened a new log
W20260709 13:09:39.598047 30376 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:39.598778 30724 ts_tablet_manager.cc:1403] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:09:39.601624 30724 raft_consensus.cc:359] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.602334 30724 raft_consensus.cc:385] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.602669 30724 raft_consensus.cc:740] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.603444 30724 consensus_queue.cc:260] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.605618 30724 ts_tablet_manager.cc:1434] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:39.620126 30723 raft_consensus.cc:493] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.620585 30723 raft_consensus.cc:515] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.622251 30723 leader_election.cc:290] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.623147 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26cb2d51c204733a3ece7144773c6a9" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3" is_pre_election: true
I20260709 13:09:39.623337 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26cb2d51c204733a3ece7144773c6a9" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:39.623734 30504 raft_consensus.cc:2468] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 0.
I20260709 13:09:39.624018 30575 raft_consensus.cc:2468] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 0.
I20260709 13:09:39.625249 30396 leader_election.cc:304] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:39.625965 30749 raft_consensus.cc:2804] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.626350 30749 raft_consensus.cc:493] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.626641 30749 raft_consensus.cc:3060] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.633374 30749 raft_consensus.cc:515] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.635596 30628 consensus_queue.cc:1048] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.635776 30749 leader_election.cc:290] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 election: Requested vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.635924 30505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26cb2d51c204733a3ece7144773c6a9" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:39.636595 30505 raft_consensus.cc:3060] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.643045 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26cb2d51c204733a3ece7144773c6a9" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:39.643805 30575 raft_consensus.cc:3060] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.644146 30505 raft_consensus.cc:2468] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 1.
I20260709 13:09:39.645298 30393 leader_election.cc:304] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:39.646114 30749 raft_consensus.cc:2804] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.646571 30749 raft_consensus.cc:697] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Becoming Leader. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:39.647382 30749 consensus_queue.cc:237] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.655578 30575 raft_consensus.cc:2468] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 1.
I20260709 13:09:39.657816 30325 catalog_manager.cc:5697] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65). New cstate: current_term: 1 leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.660486 30729 consensus_queue.cc:1048] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.700788 30710 raft_consensus.cc:493] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.701287 30710 raft_consensus.cc:515] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.703158 30710 leader_election.cc:290] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.703928 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b940ff440de4522a7eca8534dd40b66" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8" is_pre_election: true
I20260709 13:09:39.704150 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b940ff440de4522a7eca8534dd40b66" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e" is_pre_election: true
I20260709 13:09:39.704658 30430 raft_consensus.cc:2468] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 0.
I20260709 13:09:39.704764 30575 raft_consensus.cc:2468] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 0.
I20260709 13:09:39.705782 30471 leader_election.cc:304] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:39.706374 30710 raft_consensus.cc:2804] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.706713 30710 raft_consensus.cc:493] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.707060 30710 raft_consensus.cc:3060] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.712922 30710 raft_consensus.cc:515] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.714840 30710 leader_election.cc:290] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.715467 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b940ff440de4522a7eca8534dd40b66" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:39.715983 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b940ff440de4522a7eca8534dd40b66" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:39.716171 30430 raft_consensus.cc:3060] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.716560 30575 raft_consensus.cc:3060] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.721868 30430 raft_consensus.cc:2468] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 1.
I20260709 13:09:39.722308 30575 raft_consensus.cc:2468] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 1.
I20260709 13:09:39.722970 30471 leader_election.cc:304] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:39.723737 30710 raft_consensus.cc:2804] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.724153 30710 raft_consensus.cc:697] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Becoming Leader. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:39.724838 30710 consensus_queue.cc:237] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.733350 30325 catalog_manager.cc:5697] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "3284fa337a70463ab250f0d48d2f05f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.865609 30575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "865246a4b94f4a1eb11c3aaa38be37b8"
dest_uuid: "0e9fe8a853314556bd34d155250e742e"
mode: GRACEFUL
new_leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
 from {username='slave'} at 127.0.0.1:58382
I20260709 13:09:39.866222 30575 raft_consensus.cc:606] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Received request to transfer leadership to TS 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:39.871343 30505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1388d8e11df4afc946646c17ae8d115"
dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
mode: GRACEFUL
new_leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
 from {username='slave'} at 127.0.0.1:59872
I20260709 13:09:39.871852 30505 raft_consensus.cc:606] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Received request to transfer leadership to TS 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:39.876586 30575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cc2b2e4b7484563969a834a26ada976"
dest_uuid: "0e9fe8a853314556bd34d155250e742e"
mode: GRACEFUL
new_leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
 from {username='slave'} at 127.0.0.1:58382
I20260709 13:09:39.877095 30575 raft_consensus.cc:606] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Received request to transfer leadership to TS 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:39.880946 30710 consensus_queue.cc:1048] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.882300 30505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abf063de4e5a467f8c2f164fd4fe29fd"
dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
mode: GRACEFUL
new_leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
 from {username='slave'} at 127.0.0.1:59872
I20260709 13:09:39.882967 30505 raft_consensus.cc:606] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Received request to transfer leadership to TS 3c7e424ddadf49589ee6d20102a08cc8
I20260709 13:09:39.890890 30430 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c99512107b2d48bb8509bc6f28758558"
dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
mode: GRACEFUL
new_leader_uuid: "3284fa337a70463ab250f0d48d2f05f3"
 from {username='slave'} at 127.0.0.1:58766
I20260709 13:09:39.891554 30430 raft_consensus.cc:606] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Received request to transfer leadership to TS 3284fa337a70463ab250f0d48d2f05f3
I20260709 13:09:39.892791 30739 consensus_queue.cc:1048] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.903113 30739 consensus_queue.cc:1048] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.906157 30754 raft_consensus.cc:993] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3: : Instructing follower 3c7e424ddadf49589ee6d20102a08cc8 to start an election
I20260709 13:09:39.906641 30754 raft_consensus.cc:1081] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Signalling peer 3c7e424ddadf49589ee6d20102a08cc8 to start an election
I20260709 13:09:39.906869 30758 consensus_queue.cc:1048] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.909497 30429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abf063de4e5a467f8c2f164fd4fe29fd"
dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
 from {username='slave'} at 127.0.0.1:58754
I20260709 13:09:39.910271 30429 raft_consensus.cc:493] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.910602 30429 raft_consensus.cc:3060] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.913645 30628 consensus_queue.cc:1048] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.918669 30426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b26cb2d51c204733a3ece7144773c6a9"
dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
mode: GRACEFUL
new_leader_uuid: "0e9fe8a853314556bd34d155250e742e"
 from {username='slave'} at 127.0.0.1:58766
I20260709 13:09:39.919353 30426 raft_consensus.cc:606] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Received request to transfer leadership to TS 0e9fe8a853314556bd34d155250e742e
I20260709 13:09:39.923363 30429 raft_consensus.cc:515] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.928586 30749 consensus_queue.cc:1048] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.936007 30429 leader_election.cc:290] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 2 election: Requested vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:39.936944 30503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf063de4e5a467f8c2f164fd4fe29fd" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:39.937724 30503 raft_consensus.cc:3055] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.938043 30503 raft_consensus.cc:740] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:39.938943 30503 consensus_queue.cc:260] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.939689 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf063de4e5a467f8c2f164fd4fe29fd" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:39.940178 30503 raft_consensus.cc:3060] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.940352 30578 raft_consensus.cc:3060] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.948303 30723 consensus_queue.cc:1048] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.958954 30503 raft_consensus.cc:2468] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 2.
I20260709 13:09:39.959990 30646 raft_consensus.cc:993] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8: : Instructing follower 3284fa337a70463ab250f0d48d2f05f3 to start an election
I20260709 13:09:39.960485 30646 raft_consensus.cc:1081] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Signalling peer 3284fa337a70463ab250f0d48d2f05f3 to start an election
I20260709 13:09:39.960716 30393 leader_election.cc:304] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:39.961894 30646 raft_consensus.cc:2804] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.962371 30646 raft_consensus.cc:697] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 LEADER]: Becoming Leader. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:39.963116 30504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c99512107b2d48bb8509bc6f28758558"
dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
 from {username='slave'} at 127.0.0.1:59856
I20260709 13:09:39.963727 30504 raft_consensus.cc:493] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.963388 30646 consensus_queue.cc:237] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.964079 30504 raft_consensus.cc:3060] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.977324 30754 consensus_queue.cc:1048] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.978941 30578 raft_consensus.cc:2468] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 2.
I20260709 13:09:39.981290 30729 raft_consensus.cc:993] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e: : Instructing follower 3c7e424ddadf49589ee6d20102a08cc8 to start an election
I20260709 13:09:39.983633 30628 raft_consensus.cc:1081] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Signalling peer 3c7e424ddadf49589ee6d20102a08cc8 to start an election
I20260709 13:09:39.987124 30430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "865246a4b94f4a1eb11c3aaa38be37b8"
dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
 from {username='slave'} at 127.0.0.1:58748
I20260709 13:09:39.988245 30430 raft_consensus.cc:493] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.988790 30430 raft_consensus.cc:3060] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.993996 30504 raft_consensus.cc:515] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:39.995879 30325 catalog_manager.cc:5697] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 reported cstate change: term changed from 1 to 2, leader changed from 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66) to 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.001358 30505 raft_consensus.cc:1240] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Rejecting Update request from peer 3c7e424ddadf49589ee6d20102a08cc8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:40.000949 30430 raft_consensus.cc:515] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:40.007406 30502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865246a4b94f4a1eb11c3aaa38be37b8" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:40.008101 30502 raft_consensus.cc:3060] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.008486 30646 consensus_queue.cc:1059] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.009506 30749 raft_consensus.cc:3055] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:40.009881 30749 raft_consensus.cc:740] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:40.010737 30749 consensus_queue.cc:260] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:40.011225 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99512107b2d48bb8509bc6f28758558" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:40.011986 30749 raft_consensus.cc:3060] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.021345 30502 raft_consensus.cc:2468] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 2.
I20260709 13:09:40.022953 30393 leader_election.cc:304] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:40.024070 30504 leader_election.cc:290] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 2 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:40.027073 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99512107b2d48bb8509bc6f28758558" candidate_uuid: "3284fa337a70463ab250f0d48d2f05f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:40.027736 30579 raft_consensus.cc:3060] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.027968 30430 leader_election.cc:290] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 2 election: Requested vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:40.029733 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865246a4b94f4a1eb11c3aaa38be37b8" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:40.039602 30575 raft_consensus.cc:3055] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:40.031628 30646 raft_consensus.cc:2804] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.039976 30575 raft_consensus.cc:740] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:40.034489 30429 raft_consensus.cc:2468] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 2.
I20260709 13:09:40.034693 30739 consensus_queue.cc:1048] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.043711 30739 raft_consensus.cc:993] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3: : Instructing follower 3c7e424ddadf49589ee6d20102a08cc8 to start an election
I20260709 13:09:40.040083 30504 raft_consensus.cc:1240] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Rejecting Update request from peer 0e9fe8a853314556bd34d155250e742e for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:40.044163 30739 raft_consensus.cc:1081] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Signalling peer 3c7e424ddadf49589ee6d20102a08cc8 to start an election
I20260709 13:09:40.045234 30784 consensus_queue.cc:1059] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.040938 30646 raft_consensus.cc:697] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 LEADER]: Becoming Leader. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:40.046657 30471 leader_election.cc:304] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:40.048143 30758 raft_consensus.cc:2804] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.047366 30575 consensus_queue.cc:260] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:40.048722 30758 raft_consensus.cc:697] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Becoming Leader. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:40.049394 30575 raft_consensus.cc:3060] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.049661 30429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1388d8e11df4afc946646c17ae8d115"
dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
 from {username='slave'} at 127.0.0.1:58754
I20260709 13:09:40.050231 30429 raft_consensus.cc:493] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.050590 30429 raft_consensus.cc:3060] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.049685 30758 consensus_queue.cc:237] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:40.046815 30646 consensus_queue.cc:237] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:40.057443 30575 raft_consensus.cc:2468] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 2.
I20260709 13:09:40.057937 30429 raft_consensus.cc:515] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
W20260709 13:09:40.058377 30786 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:09:40.060843 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1388d8e11df4afc946646c17ae8d115" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:40.062005 30576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1388d8e11df4afc946646c17ae8d115" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:40.061470 30429 leader_election.cc:290] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 2 election: Requested vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:40.048122 30579 raft_consensus.cc:2468] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3284fa337a70463ab250f0d48d2f05f3 in term 2.
I20260709 13:09:40.065412 30327 catalog_manager.cc:5697] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 reported cstate change: term changed from 1 to 2, leader changed from 0e9fe8a853314556bd34d155250e742e (127.20.130.67) to 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.061405 30504 raft_consensus.cc:3055] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:40.067073 30504 raft_consensus.cc:740] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:40.067941 30504 consensus_queue.cc:260] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:40.069002 30504 raft_consensus.cc:3060] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.069216 30325 catalog_manager.cc:5697] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 reported cstate change: term changed from 1 to 2, leader changed from 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65) to 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "3284fa337a70463ab250f0d48d2f05f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.075754 30504 raft_consensus.cc:2468] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 2.
I20260709 13:09:40.077133 30393 leader_election.cc:304] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 0e9fe8a853314556bd34d155250e742e
I20260709 13:09:40.078312 30646 raft_consensus.cc:2804] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.078965 30646 raft_consensus.cc:697] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 LEADER]: Becoming Leader. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:40.079435 30739 consensus_queue.cc:1048] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.079788 30646 consensus_queue.cc:237] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:40.091480 30325 catalog_manager.cc:5697] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 reported cstate change: term changed from 1 to 2, leader changed from 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66) to 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.093227 30784 raft_consensus.cc:993] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e: : Instructing follower 3c7e424ddadf49589ee6d20102a08cc8 to start an election
I20260709 13:09:40.093775 30784 raft_consensus.cc:1081] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Signalling peer 3c7e424ddadf49589ee6d20102a08cc8 to start an election
I20260709 13:09:40.095541 30429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cc2b2e4b7484563969a834a26ada976"
dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
 from {username='slave'} at 127.0.0.1:58748
I20260709 13:09:40.096079 30429 raft_consensus.cc:493] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.096432 30429 raft_consensus.cc:3060] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.097218 30754 consensus_queue.cc:1048] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.102833 30429 raft_consensus.cc:515] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:40.105592 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc2b2e4b7484563969a834a26ada976" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:40.106108 30504 raft_consensus.cc:3060] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.108685 30429 leader_election.cc:290] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 2 election: Requested vote from peers 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107), 0e9fe8a853314556bd34d155250e742e (127.20.130.67:43211)
I20260709 13:09:40.109340 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc2b2e4b7484563969a834a26ada976" candidate_uuid: "3c7e424ddadf49589ee6d20102a08cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e9fe8a853314556bd34d155250e742e"
I20260709 13:09:40.109916 30578 raft_consensus.cc:3055] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:40.110208 30578 raft_consensus.cc:740] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:40.111021 30578 consensus_queue.cc:260] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:40.112344 30578 raft_consensus.cc:3060] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.113365 30504 raft_consensus.cc:2468] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 2.
I20260709 13:09:40.114568 30393 leader_election.cc:304] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3284fa337a70463ab250f0d48d2f05f3, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:40.115379 30646 raft_consensus.cc:2804] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.115847 30646 raft_consensus.cc:697] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 LEADER]: Becoming Leader. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:40.116778 30646 consensus_queue.cc:237] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:40.119359 30578 raft_consensus.cc:2468] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7e424ddadf49589ee6d20102a08cc8 in term 2.
I20260709 13:09:40.126012 30327 catalog_manager.cc:5697] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 reported cstate change: term changed from 1 to 2, leader changed from 0e9fe8a853314556bd34d155250e742e (127.20.130.67) to 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65). New cstate: current_term: 2 leader_uuid: "3c7e424ddadf49589ee6d20102a08cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.219136 30646 consensus_queue.cc:1048] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.229734 30754 consensus_queue.cc:1048] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.230554 30723 consensus_queue.cc:1048] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.241066 30723 raft_consensus.cc:993] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8: : Instructing follower 0e9fe8a853314556bd34d155250e742e to start an election
I20260709 13:09:40.241526 30723 raft_consensus.cc:1081] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Signalling peer 0e9fe8a853314556bd34d155250e742e to start an election
I20260709 13:09:40.243288 30578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b26cb2d51c204733a3ece7144773c6a9"
dest_uuid: "0e9fe8a853314556bd34d155250e742e"
 from {username='slave'} at 127.0.0.1:58366
I20260709 13:09:40.243835 30578 raft_consensus.cc:493] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.244176 30578 raft_consensus.cc:3060] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.248734 30710 consensus_queue.cc:1048] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.253726 30578 raft_consensus.cc:515] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:40.256413 30578 leader_election.cc:290] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 2 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:40.257603 30430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26cb2d51c204733a3ece7144773c6a9" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:40.258270 30430 raft_consensus.cc:3055] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:40.258610 30430 raft_consensus.cc:740] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:40.259475 30430 consensus_queue.cc:260] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:40.260047 30504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26cb2d51c204733a3ece7144773c6a9" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:40.260672 30504 raft_consensus.cc:3060] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.260772 30430 raft_consensus.cc:3060] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.267656 30504 raft_consensus.cc:2468] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 2.
I20260709 13:09:40.268792 30542 leader_election.cc:304] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3284fa337a70463ab250f0d48d2f05f3; no voters: 
I20260709 13:09:40.268965 30430 raft_consensus.cc:2468] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 2.
I20260709 13:09:40.269766 30784 raft_consensus.cc:2804] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.270254 30784 raft_consensus.cc:697] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 2 LEADER]: Becoming Leader. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:40.271145 30784 consensus_queue.cc:237] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:40.279362 30325 catalog_manager.cc:5697] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e reported cstate change: term changed from 1 to 2, leader changed from 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65) to 0e9fe8a853314556bd34d155250e742e (127.20.130.67). New cstate: current_term: 2 leader_uuid: "0e9fe8a853314556bd34d155250e742e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.382848 30504 raft_consensus.cc:1275] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Refusing update from remote peer 3c7e424ddadf49589ee6d20102a08cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.384117 30646 consensus_queue.cc:1048] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.391773 30578 raft_consensus.cc:1275] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Refusing update from remote peer 3c7e424ddadf49589ee6d20102a08cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.393361 30749 consensus_queue.cc:1048] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.455714 30504 raft_consensus.cc:1275] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Refusing update from remote peer 3c7e424ddadf49589ee6d20102a08cc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.456943 30749 consensus_queue.cc:1048] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.466619 30579 raft_consensus.cc:1275] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Refusing update from remote peer 3c7e424ddadf49589ee6d20102a08cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.468138 30749 consensus_queue.cc:1048] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.498596 30504 raft_consensus.cc:1275] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Refusing update from remote peer 3c7e424ddadf49589ee6d20102a08cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.499862 30749 consensus_queue.cc:1048] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.506999 30579 raft_consensus.cc:3060] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.514151 30579 raft_consensus.cc:1275] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Refusing update from remote peer 3c7e424ddadf49589ee6d20102a08cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.515606 30749 consensus_queue.cc:1048] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.606488 30579 raft_consensus.cc:1275] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Refusing update from remote peer 3284fa337a70463ab250f0d48d2f05f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.607789 30710 consensus_queue.cc:1048] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.614372 30430 raft_consensus.cc:1275] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Refusing update from remote peer 3284fa337a70463ab250f0d48d2f05f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.617388 30710 consensus_queue.cc:1048] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:40.644897 30579 raft_consensus.cc:1275] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Refusing update from remote peer 3c7e424ddadf49589ee6d20102a08cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.646101 30749 consensus_queue.cc:1048] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.648325 30504 raft_consensus.cc:1275] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Refusing update from remote peer 3c7e424ddadf49589ee6d20102a08cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.649583 30749 consensus_queue.cc:1048] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.812804 30430 raft_consensus.cc:1275] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Refusing update from remote peer 0e9fe8a853314556bd34d155250e742e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.814282 30784 consensus_queue.cc:1048] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.821945 30504 raft_consensus.cc:1275] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Refusing update from remote peer 0e9fe8a853314556bd34d155250e742e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.823436 30798 consensus_queue.cc:1048] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.923072 30325 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49530:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:09:42.943115 30325 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49530:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:09:43.014842 21001 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:09:43.073797 30834 tablet.cc:1724] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:43.160070 30839 log.cc:927] Time spent T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:09:43.202677 30426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cc2b2e4b7484563969a834a26ada976"
dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
mode: GRACEFUL
new_leader_uuid: "0e9fe8a853314556bd34d155250e742e"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:09:43.203645 30426 raft_consensus.cc:606] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 LEADER]: Received request to transfer leadership to TS 0e9fe8a853314556bd34d155250e742e
I20260709 13:09:43.223433 30856 tablet.cc:1724] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.256048 30854 tablet.cc:1724] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:43.248467 30531 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:9bc3a3ada2644e99a5e9b89b800e34dd)
I20260709 13:09:43.183226 30843 tablet.cc:1724] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.196825 30844 tablet.cc:1724] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.285216 30852 tablet.cc:1724] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.304389 30866 tablet.cc:1724] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:43.310588 30531 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:9bc3a3ada2644e99a5e9b89b800e34dd)
W20260709 13:09:43.314321 30531 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:9bc3a3ada2644e99a5e9b89b800e34dd)
I20260709 13:09:43.334908 30867 tablet.cc:1724] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.330592 30859 tablet.cc:1724] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.367532 30834 tablet.cc:1724] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.390597 30846 raft_consensus.cc:993] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8: : Instructing follower 0e9fe8a853314556bd34d155250e742e to start an election
I20260709 13:09:43.394506 30846 raft_consensus.cc:1081] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 LEADER]: Signalling peer 0e9fe8a853314556bd34d155250e742e to start an election
I20260709 13:09:43.402907 30579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cc2b2e4b7484563969a834a26ada976"
dest_uuid: "0e9fe8a853314556bd34d155250e742e"
 from {username='slave'} at 127.0.0.1:58366
I20260709 13:09:43.403497 30579 raft_consensus.cc:493] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:43.403824 30579 raft_consensus.cc:3060] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.411414 30856 tablet.cc:1724] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.412709 30862 tablet.cc:1724] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.416016 30854 tablet.cc:1724] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.418574 30579 raft_consensus.cc:515] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
W20260709 13:09:43.431747 30868 log.cc:927] Time spent T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:09:43.441982 30579 leader_election.cc:290] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 3 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:43.443506 30872 tablet.cc:1724] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.446382 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc2b2e4b7484563969a834a26ada976" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:43.447081 30501 raft_consensus.cc:3060] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.447896 30859 tablet.cc:1724] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.435659 30870 tablet.cc:1724] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.451649 30428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc2b2e4b7484563969a834a26ada976" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:43.454478 30428 raft_consensus.cc:3055] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:43.455897 30428 raft_consensus.cc:740] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:43.457382 30428 consensus_queue.cc:260] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:43.458709 30428 raft_consensus.cc:3060] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.461436 30843 tablet.cc:1724] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.454488 30844 tablet.cc:1724] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.464509 30867 tablet.cc:1724] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.470657 30872 tablet.cc:1724] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.472836 30503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c99512107b2d48bb8509bc6f28758558"
dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
mode: GRACEFUL
new_leader_uuid: "0e9fe8a853314556bd34d155250e742e"
 from {username='slave'} at 127.0.0.1:49722
I20260709 13:09:43.474731 30503 raft_consensus.cc:606] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Received request to transfer leadership to TS 0e9fe8a853314556bd34d155250e742e
I20260709 13:09:43.475500 30834 tablet.cc:1724] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.476912 21001 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:09:43.477596 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:43.479400 30852 tablet.cc:1724] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.488703 30854 tablet.cc:1724] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.491943 30428 raft_consensus.cc:2468] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 3.
I20260709 13:09:43.493284 30545 leader_election.cc:304] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:43.494264 30855 raft_consensus.cc:2804] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:43.494715 30855 raft_consensus.cc:697] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 3 LEADER]: Becoming Leader. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:43.495522 30855 consensus_queue.cc:237] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:43.496058 30429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "124c62e3b5064f9a87a9942c17470b2a"
dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
mode: GRACEFUL
new_leader_uuid: "0e9fe8a853314556bd34d155250e742e"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:09:43.496891 30862 tablet.cc:1724] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.497671 30429 raft_consensus.cc:606] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Received request to transfer leadership to TS 0e9fe8a853314556bd34d155250e742e
I20260709 13:09:43.501577 30866 tablet.cc:1724] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.509109 30501 raft_consensus.cc:2468] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 3.
I20260709 13:09:43.511032 30856 tablet.cc:1724] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.520764 30501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16fc6ca9f41c475f9e193d853d9e5edd"
dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
mode: GRACEFUL
new_leader_uuid: "0e9fe8a853314556bd34d155250e742e"
 from {username='slave'} at 127.0.0.1:49722
I20260709 13:09:43.521457 30501 raft_consensus.cc:606] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Received request to transfer leadership to TS 0e9fe8a853314556bd34d155250e742e
I20260709 13:09:43.525743 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:43.526329 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:43.530213 30854 tablet.cc:1724] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:43.533102 30326 catalog_manager.cc:5697] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e reported cstate change: term changed from 2 to 3, leader changed from 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65) to 0e9fe8a853314556bd34d155250e742e (127.20.130.67). New cstate: current_term: 3 leader_uuid: "0e9fe8a853314556bd34d155250e742e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.575793 30327 catalog_manager.cc:6242] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63: soft_deleted_table [id=17d8e46f2549474ca214eb3c805aadff] alter complete (version 1)
I20260709 13:09:43.768965 30845 raft_consensus.cc:993] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3: : Instructing follower 0e9fe8a853314556bd34d155250e742e to start an election
I20260709 13:09:43.769613 30835 raft_consensus.cc:1081] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Signalling peer 0e9fe8a853314556bd34d155250e742e to start an election
I20260709 13:09:43.771061 30579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c99512107b2d48bb8509bc6f28758558"
dest_uuid: "0e9fe8a853314556bd34d155250e742e"
 from {username='slave'} at 127.0.0.1:58358
I20260709 13:09:43.771463 30579 raft_consensus.cc:493] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:43.771675 30579 raft_consensus.cc:3060] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.776222 30579 raft_consensus.cc:515] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:43.778285 30579 leader_election.cc:290] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 3 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:43.778465 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99512107b2d48bb8509bc6f28758558" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:43.778851 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99512107b2d48bb8509bc6f28758558" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:43.779140 30429 raft_consensus.cc:3060] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.779647 30501 raft_consensus.cc:3055] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:43.780078 30501 raft_consensus.cc:740] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:43.780882 30501 consensus_queue.cc:260] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:43.782348 30501 raft_consensus.cc:3060] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.785858 30429 raft_consensus.cc:2468] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 3.
I20260709 13:09:43.786911 30545 leader_election.cc:304] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:43.787631 30798 raft_consensus.cc:2804] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:43.788007 30501 raft_consensus.cc:2468] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 3.
I20260709 13:09:43.788133 30798 raft_consensus.cc:697] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [term 3 LEADER]: Becoming Leader. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:43.789327 30798 consensus_queue.cc:237] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:43.796602 30325 catalog_manager.cc:5697] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e reported cstate change: term changed from 2 to 3, leader changed from 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66) to 0e9fe8a853314556bd34d155250e742e (127.20.130.67). New cstate: current_term: 3 leader_uuid: "0e9fe8a853314556bd34d155250e742e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.814106 30846 raft_consensus.cc:993] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8: : Instructing follower 0e9fe8a853314556bd34d155250e742e to start an election
I20260709 13:09:43.814644 30838 raft_consensus.cc:1081] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Signalling peer 0e9fe8a853314556bd34d155250e742e to start an election
I20260709 13:09:43.815928 30579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "124c62e3b5064f9a87a9942c17470b2a"
dest_uuid: "0e9fe8a853314556bd34d155250e742e"
 from {username='slave'} at 127.0.0.1:58366
I20260709 13:09:43.816375 30579 raft_consensus.cc:493] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:43.816632 30579 raft_consensus.cc:3060] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:43.820977 30579 raft_consensus.cc:515] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:43.822588 30579 leader_election.cc:290] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 2 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:43.823334 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c62e3b5064f9a87a9942c17470b2a" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:43.823613 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124c62e3b5064f9a87a9942c17470b2a" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:43.823971 30429 raft_consensus.cc:3055] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:43.824189 30501 raft_consensus.cc:3060] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:43.824328 30429 raft_consensus.cc:740] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c7e424ddadf49589ee6d20102a08cc8, State: Running, Role: LEADER
I20260709 13:09:43.825181 30429 consensus_queue.cc:260] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:43.826421 30429 raft_consensus.cc:3060] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:43.831496 30501 raft_consensus.cc:2468] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 2.
I20260709 13:09:43.832793 30542 leader_election.cc:304] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3284fa337a70463ab250f0d48d2f05f3; no voters: 
I20260709 13:09:43.833264 30429 raft_consensus.cc:2468] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 2.
I20260709 13:09:43.833653 30798 raft_consensus.cc:2804] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:43.834632 30798 raft_consensus.cc:697] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 2 LEADER]: Becoming Leader. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:43.835497 30798 consensus_queue.cc:237] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:43.845027 30325 catalog_manager.cc:5697] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e reported cstate change: term changed from 1 to 2, leader changed from 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65) to 0e9fe8a853314556bd34d155250e742e (127.20.130.67). New cstate: current_term: 2 leader_uuid: "0e9fe8a853314556bd34d155250e742e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.932570 30845 raft_consensus.cc:993] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3: : Instructing follower 0e9fe8a853314556bd34d155250e742e to start an election
I20260709 13:09:43.933009 30835 raft_consensus.cc:1081] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Signalling peer 0e9fe8a853314556bd34d155250e742e to start an election
I20260709 13:09:43.934434 30579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16fc6ca9f41c475f9e193d853d9e5edd"
dest_uuid: "0e9fe8a853314556bd34d155250e742e"
 from {username='slave'} at 127.0.0.1:58358
I20260709 13:09:43.934834 30579 raft_consensus.cc:493] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:43.935084 30579 raft_consensus.cc:3060] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.939610 30579 raft_consensus.cc:515] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:43.941020 30579 leader_election.cc:290] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 3 election: Requested vote from peers 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347), 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107)
I20260709 13:09:43.941850 30429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fc6ca9f41c475f9e193d853d9e5edd" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c7e424ddadf49589ee6d20102a08cc8"
I20260709 13:09:43.942082 30501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fc6ca9f41c475f9e193d853d9e5edd" candidate_uuid: "0e9fe8a853314556bd34d155250e742e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3284fa337a70463ab250f0d48d2f05f3"
I20260709 13:09:43.942441 30429 raft_consensus.cc:3060] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.942698 30501 raft_consensus.cc:3055] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:43.943109 30501 raft_consensus.cc:740] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3284fa337a70463ab250f0d48d2f05f3, State: Running, Role: LEADER
I20260709 13:09:43.943811 30501 consensus_queue.cc:260] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:43.944825 30501 raft_consensus.cc:3060] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.947325 30429 raft_consensus.cc:2468] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 3.
I20260709 13:09:43.948310 30545 leader_election.cc:304] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e9fe8a853314556bd34d155250e742e, 3c7e424ddadf49589ee6d20102a08cc8; no voters: 
I20260709 13:09:43.949056 30798 raft_consensus.cc:2804] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:43.949476 30798 raft_consensus.cc:697] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 3 LEADER]: Becoming Leader. State: Replica: 0e9fe8a853314556bd34d155250e742e, State: Running, Role: LEADER
I20260709 13:09:43.950320 30798 consensus_queue.cc:237] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } }
I20260709 13:09:43.950615 30501 raft_consensus.cc:2468] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e9fe8a853314556bd34d155250e742e in term 3.
I20260709 13:09:43.960345 30325 catalog_manager.cc:5697] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e reported cstate change: term changed from 2 to 3, leader changed from 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66) to 0e9fe8a853314556bd34d155250e742e (127.20.130.67). New cstate: current_term: 3 leader_uuid: "0e9fe8a853314556bd34d155250e742e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e9fe8a853314556bd34d155250e742e" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 43211 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.967109 30501 raft_consensus.cc:1275] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3 [term 3 FOLLOWER]: Refusing update from remote peer 0e9fe8a853314556bd34d155250e742e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:43.968719 30798 consensus_queue.cc:1048] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:43.979948 30429 raft_consensus.cc:1275] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 3 FOLLOWER]: Refusing update from remote peer 0e9fe8a853314556bd34d155250e742e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:43.981592 30798 consensus_queue.cc:1048] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:44.245330 30429 raft_consensus.cc:1275] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Refusing update from remote peer 0e9fe8a853314556bd34d155250e742e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:44.246600 30798 consensus_queue.cc:1048] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:44.256826 30501 raft_consensus.cc:1275] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Refusing update from remote peer 0e9fe8a853314556bd34d155250e742e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:44.258256 30882 consensus_queue.cc:1048] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:44.406456 30501 raft_consensus.cc:1275] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 3 FOLLOWER]: Refusing update from remote peer 0e9fe8a853314556bd34d155250e742e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:44.407881 30882 consensus_queue.cc:1048] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.408716 30429 raft_consensus.cc:1275] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 3 FOLLOWER]: Refusing update from remote peer 0e9fe8a853314556bd34d155250e742e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:44.410076 30882 consensus_queue.cc:1048] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:44.414101 30503 raft_consensus.cc:1275] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 3 FOLLOWER]: Refusing update from remote peer 0e9fe8a853314556bd34d155250e742e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:44.415722 30798 consensus_queue.cc:1048] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3284fa337a70463ab250f0d48d2f05f3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 38107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:44.427493 30429 raft_consensus.cc:1275] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8 [term 3 FOLLOWER]: Refusing update from remote peer 0e9fe8a853314556bd34d155250e742e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:44.428864 30798 consensus_queue.cc:1048] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e424ddadf49589ee6d20102a08cc8" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.586745 21001 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:09:44.591792 21001 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:09:44.592229 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:44.597271 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:09:44.597661 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:45.626780 21001 tablet_server.cc:179] TabletServer@127.20.130.65:0 shutting down...
I20260709 13:09:45.659634 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:45.660622 21001 tablet_replica.cc:333] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
W20260709 13:09:45.661384 30545 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
I20260709 13:09:45.661451 21001 raft_consensus.cc:2243] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.662330 21001 raft_consensus.cc:2272] T 6b940ff440de4522a7eca8534dd40b66 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.664640 30545 consensus_peers.cc:597] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e -> Peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Couldn't send request to peer 3c7e424ddadf49589ee6d20102a08cc8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.664885 21001 tablet_replica.cc:333] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.665747 21001 raft_consensus.cc:2243] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.666198 21001 raft_consensus.cc:2272] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.667578 30545 consensus_peers.cc:597] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e -> Peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Couldn't send request to peer 3c7e424ddadf49589ee6d20102a08cc8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.668149 21001 tablet_replica.cc:333] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.668836 21001 raft_consensus.cc:2243] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.669366 21001 raft_consensus.cc:2272] T c99512107b2d48bb8509bc6f28758558 P 3c7e424ddadf49589ee6d20102a08cc8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.671783 21001 tablet_replica.cc:333] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.672433 21001 raft_consensus.cc:2243] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.672894 21001 raft_consensus.cc:2272] T 6cc2b2e4b7484563969a834a26ada976 P 3c7e424ddadf49589ee6d20102a08cc8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.674667 30545 consensus_peers.cc:597] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e -> Peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Couldn't send request to peer 3c7e424ddadf49589ee6d20102a08cc8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.675213 21001 tablet_replica.cc:333] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.675853 21001 raft_consensus.cc:2243] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.676656 21001 raft_consensus.cc:2272] T fc98598beabc4030b90c6c62c89dc820 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.678999 21001 tablet_replica.cc:333] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.679544 21001 raft_consensus.cc:2243] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.680277 21001 raft_consensus.cc:2272] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.682236 21001 tablet_replica.cc:333] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.682801 21001 raft_consensus.cc:2243] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.683284 21001 raft_consensus.cc:2272] T 124c62e3b5064f9a87a9942c17470b2a P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.685231 21001 tablet_replica.cc:333] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.685746 21001 raft_consensus.cc:2243] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.686189 21001 raft_consensus.cc:2272] T b26cb2d51c204733a3ece7144773c6a9 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.687975 21001 tablet_replica.cc:333] T 49459d42810745468d5235656763e60b P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.688656 21001 raft_consensus.cc:2243] T 49459d42810745468d5235656763e60b P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.689160 21001 raft_consensus.cc:2272] T 49459d42810745468d5235656763e60b P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.691519 21001 tablet_replica.cc:333] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.692097 21001 raft_consensus.cc:2243] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.692893 21001 raft_consensus.cc:2272] T 0e098385e0764553be2539bde5f9b930 P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.694900 21001 tablet_replica.cc:333] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.695489 21001 raft_consensus.cc:2243] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.695956 21001 raft_consensus.cc:2272] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.698038 21001 tablet_replica.cc:333] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.698565 21001 raft_consensus.cc:2243] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.699359 21001 raft_consensus.cc:2272] T a1388d8e11df4afc946646c17ae8d115 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.701249 21001 tablet_replica.cc:333] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.701764 21001 raft_consensus.cc:2243] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.702527 21001 raft_consensus.cc:2272] T 0d67a208fe8b44efbd18eb2511c74d0e P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.704452 21001 tablet_replica.cc:333] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.705238 21001 raft_consensus.cc:2243] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.705709 21001 raft_consensus.cc:2272] T dd944e77faba4eb39a5417cb2656ae2e P 3c7e424ddadf49589ee6d20102a08cc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.708329 21001 tablet_replica.cc:333] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.708885 21001 raft_consensus.cc:2243] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.709308 21001 raft_consensus.cc:2272] T 16fc6ca9f41c475f9e193d853d9e5edd P 3c7e424ddadf49589ee6d20102a08cc8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.711416 21001 tablet_replica.cc:333] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.711931 21001 raft_consensus.cc:2243] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.712724 21001 raft_consensus.cc:2272] T abf063de4e5a467f8c2f164fd4fe29fd P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.715083 21001 tablet_replica.cc:333] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.715883 21001 raft_consensus.cc:2243] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.716329 21001 raft_consensus.cc:2272] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.717769 30471 consensus_peers.cc:597] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 -> Peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Couldn't send request to peer 3c7e424ddadf49589ee6d20102a08cc8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.718952 21001 tablet_replica.cc:333] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8: stopping tablet replica
I20260709 13:09:45.719601 21001 raft_consensus.cc:2243] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.720175 21001 raft_consensus.cc:2272] T 41234aa848a244d186f86ae165931584 P 3c7e424ddadf49589ee6d20102a08cc8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.757062 30471 consensus_peers.cc:597] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 -> Peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Couldn't send request to peer 3c7e424ddadf49589ee6d20102a08cc8. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:46347: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.762981 21001 tablet_server.cc:196] TabletServer@127.20.130.65:0 shutdown complete.
I20260709 13:09:45.793102 21001 tablet_server.cc:179] TabletServer@127.20.130.66:0 shutting down...
I20260709 13:09:45.822331 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:45.823058 21001 tablet_replica.cc:333] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.823756 21001 raft_consensus.cc:2243] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.824656 21001 raft_consensus.cc:2272] T 6b940ff440de4522a7eca8534dd40b66 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.826670 21001 tablet_replica.cc:333] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.827373 21001 raft_consensus.cc:2243] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.828152 21001 raft_consensus.cc:2272] T 9bc3a3ada2644e99a5e9b89b800e34dd P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.830277 21001 tablet_replica.cc:333] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.831025 21001 raft_consensus.cc:2243] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.831532 21001 raft_consensus.cc:2272] T c99512107b2d48bb8509bc6f28758558 P 3284fa337a70463ab250f0d48d2f05f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.834080 21001 tablet_replica.cc:333] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.834890 21001 raft_consensus.cc:2243] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:45.834887 30471 consensus_peers.cc:597] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 -> Peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Couldn't send request to peer 3c7e424ddadf49589ee6d20102a08cc8. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:46347: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.835489 21001 raft_consensus.cc:2272] T abf063de4e5a467f8c2f164fd4fe29fd P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.837397 21001 tablet_replica.cc:333] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.838140 21001 raft_consensus.cc:2243] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.838622 21001 raft_consensus.cc:2272] T fc98598beabc4030b90c6c62c89dc820 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.840757 21001 tablet_replica.cc:333] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.841364 21001 raft_consensus.cc:2243] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.841874 21001 raft_consensus.cc:2272] T 6cc2b2e4b7484563969a834a26ada976 P 3284fa337a70463ab250f0d48d2f05f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.844337 21001 tablet_replica.cc:333] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.844972 21001 raft_consensus.cc:2243] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.845826 21001 raft_consensus.cc:2272] T 41234aa848a244d186f86ae165931584 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.847632 30545 consensus_peers.cc:597] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e -> Peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Couldn't send request to peer 3c7e424ddadf49589ee6d20102a08cc8. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:46347: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.848287 21001 tablet_replica.cc:333] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.848944 21001 raft_consensus.cc:2243] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.849933 21001 raft_consensus.cc:2272] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.852065 21001 tablet_replica.cc:333] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.852545 21001 raft_consensus.cc:2243] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.852898 21001 raft_consensus.cc:2272] T b26cb2d51c204733a3ece7144773c6a9 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.854532 21001 tablet_replica.cc:333] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.855086 21001 raft_consensus.cc:2243] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.855434 21001 raft_consensus.cc:2272] T 49459d42810745468d5235656763e60b P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.857290 21001 tablet_replica.cc:333] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.857750 21001 raft_consensus.cc:2243] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.858594 21001 raft_consensus.cc:2272] T 44e4bfb965bc4bc8bea51fb54d634a6c P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.860502 21001 tablet_replica.cc:333] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.861014 21001 raft_consensus.cc:2243] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.861426 21001 raft_consensus.cc:2272] T 0e098385e0764553be2539bde5f9b930 P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.863569 21001 tablet_replica.cc:333] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.864094 21001 raft_consensus.cc:2243] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.864497 21001 raft_consensus.cc:2272] T 865246a4b94f4a1eb11c3aaa38be37b8 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.866386 21001 tablet_replica.cc:333] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.866966 21001 raft_consensus.cc:2243] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.867429 21001 raft_consensus.cc:2272] T 124c62e3b5064f9a87a9942c17470b2a P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.869186 21001 tablet_replica.cc:333] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.869696 21001 raft_consensus.cc:2243] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.870468 21001 raft_consensus.cc:2272] T dd944e77faba4eb39a5417cb2656ae2e P 3284fa337a70463ab250f0d48d2f05f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.872289 21001 tablet_replica.cc:333] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.872778 21001 raft_consensus.cc:2243] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.873183 21001 raft_consensus.cc:2272] T 16fc6ca9f41c475f9e193d853d9e5edd P 3284fa337a70463ab250f0d48d2f05f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.875332 21001 tablet_replica.cc:333] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.875823 21001 raft_consensus.cc:2243] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.876245 21001 raft_consensus.cc:2272] T a1388d8e11df4afc946646c17ae8d115 P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.878059 21001 tablet_replica.cc:333] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3: stopping tablet replica
I20260709 13:09:45.878552 21001 raft_consensus.cc:2243] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.878998 21001 raft_consensus.cc:2272] T 0d67a208fe8b44efbd18eb2511c74d0e P 3284fa337a70463ab250f0d48d2f05f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.919605 21001 tablet_server.cc:196] TabletServer@127.20.130.66:0 shutdown complete.
W20260709 13:09:45.941954 30545 consensus_peers.cc:597] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e -> Peer 3c7e424ddadf49589ee6d20102a08cc8 (127.20.130.65:46347): Couldn't send request to peer 3c7e424ddadf49589ee6d20102a08cc8. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:46347: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.953887 21001 tablet_server.cc:179] TabletServer@127.20.130.67:0 shutting down...
W20260709 13:09:45.982550 30542 consensus_peers.cc:597] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e -> Peer 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107): Couldn't send request to peer 3284fa337a70463ab250f0d48d2f05f3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:38107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.983878 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:45.984577 21001 tablet_replica.cc:333] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:45.985185 21001 raft_consensus.cc:2243] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.985944 21001 raft_consensus.cc:2272] T c99512107b2d48bb8509bc6f28758558 P 0e9fe8a853314556bd34d155250e742e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.987938 21001 tablet_replica.cc:333] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:45.989039 21001 raft_consensus.cc:2243] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.989691 21001 raft_consensus.cc:2272] T 6b940ff440de4522a7eca8534dd40b66 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.991732 21001 tablet_replica.cc:333] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:45.992514 21001 raft_consensus.cc:2243] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.992964 21001 raft_consensus.cc:2272] T abf063de4e5a467f8c2f164fd4fe29fd P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.993659 30542 consensus_peers.cc:597] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e -> Peer 3284fa337a70463ab250f0d48d2f05f3 (127.20.130.66:38107): Couldn't send request to peer 3284fa337a70463ab250f0d48d2f05f3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:38107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.994836 21001 tablet_replica.cc:333] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:45.995503 21001 raft_consensus.cc:2243] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.995944 21001 raft_consensus.cc:2272] T 9bc3a3ada2644e99a5e9b89b800e34dd P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.997785 21001 tablet_replica.cc:333] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:45.998302 21001 raft_consensus.cc:2243] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.998705 21001 raft_consensus.cc:2272] T 865246a4b94f4a1eb11c3aaa38be37b8 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.000572 21001 tablet_replica.cc:333] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:46.001067 21001 raft_consensus.cc:2243] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.001459 21001 raft_consensus.cc:2272] T fc98598beabc4030b90c6c62c89dc820 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.003670 21001 tablet_replica.cc:333] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:46.004173 21001 raft_consensus.cc:2243] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.004858 21001 raft_consensus.cc:2272] T 6cc2b2e4b7484563969a834a26ada976 P 0e9fe8a853314556bd34d155250e742e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.006580 21001 tablet_replica.cc:333] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:46.007135 21001 raft_consensus.cc:2243] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.007546 21001 raft_consensus.cc:2272] T 0d67a208fe8b44efbd18eb2511c74d0e P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.009413 21001 tablet_replica.cc:333] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:46.009883 21001 raft_consensus.cc:2243] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.010326 21001 raft_consensus.cc:2272] T a1388d8e11df4afc946646c17ae8d115 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.012197 21001 tablet_replica.cc:333] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:46.012668 21001 raft_consensus.cc:2243] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.013029 21001 raft_consensus.cc:2272] T 0c4dbb67e82d4c45a54a820d4683c7d3 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.014873 21001 tablet_replica.cc:333] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:46.015475 21001 raft_consensus.cc:2243] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.015905 21001 raft_consensus.cc:2272] T 41234aa848a244d186f86ae165931584 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.017959 21001 tablet_replica.cc:333] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:46.018488 21001 raft_consensus.cc:2243] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.018904 21001 raft_consensus.cc:2272] T 0e098385e0764553be2539bde5f9b930 P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.020740 21001 tablet_replica.cc:333] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:46.021286 21001 raft_consensus.cc:2243] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.021693 21001 raft_consensus.cc:2272] T 44e4bfb965bc4bc8bea51fb54d634a6c P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.023671 21001 tablet_replica.cc:333] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:46.024204 21001 raft_consensus.cc:2243] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.024922 21001 raft_consensus.cc:2272] T b26cb2d51c204733a3ece7144773c6a9 P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.026727 21001 tablet_replica.cc:333] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:46.027266 21001 raft_consensus.cc:2243] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.028060 21001 raft_consensus.cc:2272] T 49459d42810745468d5235656763e60b P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.030061 21001 tablet_replica.cc:333] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:46.030578 21001 raft_consensus.cc:2243] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.031059 21001 raft_consensus.cc:2272] T dd944e77faba4eb39a5417cb2656ae2e P 0e9fe8a853314556bd34d155250e742e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.033105 21001 tablet_replica.cc:333] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:46.033859 21001 raft_consensus.cc:2243] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.035013 21001 raft_consensus.cc:2272] T 16fc6ca9f41c475f9e193d853d9e5edd P 0e9fe8a853314556bd34d155250e742e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.038029 21001 tablet_replica.cc:333] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e: stopping tablet replica
I20260709 13:09:46.038717 21001 raft_consensus.cc:2243] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.039690 21001 raft_consensus.cc:2272] T 124c62e3b5064f9a87a9942c17470b2a P 0e9fe8a853314556bd34d155250e742e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.078437 21001 tablet_server.cc:196] TabletServer@127.20.130.67:0 shutdown complete.
I20260709 13:09:46.110219 21001 master.cc:562] Master@127.20.130.126:32925 shutting down...
I20260709 13:09:46.136011 21001 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.136509 21001 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.136786 21001 tablet_replica.cc:333] T 00000000000000000000000000000000 P b97bdbaa1d5449f48d1a87a458d40c63: stopping tablet replica
I20260709 13:09:46.157547 21001 master.cc:584] Master@127.20.130.126:32925 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12806 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:09:46.212975 21001 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.130.126:35751
I20260709 13:09:46.214056 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:46.220494 30894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:46.220568 30896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:46.220865 30893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:46.221654 21001 server_base.cc:1061] running on GCE node
I20260709 13:09:46.222502 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:46.222708 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:46.222868 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602586222837 us; error 0 us; skew 500 ppm
I20260709 13:09:46.223423 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:46.225816 21001 webserver.cc:533] Webserver started at http://127.20.130.126:45787/ using document root <none> and password file <none>
I20260709 13:09:46.226280 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:46.226466 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:46.226743 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:46.227867 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/master-0-root/instance:
uuid: "39fbffc4bb444ecd86de6b3dcc1e7101"
format_stamp: "Formatted at 2026-07-09 13:09:46 on dist-test-slave-csvd"
I20260709 13:09:46.232146 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:46.235450 30901 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.236176 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:46.236467 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/master-0-root
uuid: "39fbffc4bb444ecd86de6b3dcc1e7101"
format_stamp: "Formatted at 2026-07-09 13:09:46 on dist-test-slave-csvd"
I20260709 13:09:46.236729 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:46.250135 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:46.251411 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:46.289739 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.126:35751
I20260709 13:09:46.289868 30952 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.126:35751 every 8 connection(s)
I20260709 13:09:46.294001 30953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.305857 30953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101: Bootstrap starting.
I20260709 13:09:46.311136 30953 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.315753 30953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101: No bootstrap required, opened a new log
I20260709 13:09:46.318116 30953 raft_consensus.cc:359] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39fbffc4bb444ecd86de6b3dcc1e7101" member_type: VOTER }
I20260709 13:09:46.318533 30953 raft_consensus.cc:385] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.318850 30953 raft_consensus.cc:740] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39fbffc4bb444ecd86de6b3dcc1e7101, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.319585 30953 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39fbffc4bb444ecd86de6b3dcc1e7101" member_type: VOTER }
I20260709 13:09:46.320092 30953 raft_consensus.cc:399] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:46.320339 30953 raft_consensus.cc:493] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:46.320595 30953 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.325897 30953 raft_consensus.cc:515] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39fbffc4bb444ecd86de6b3dcc1e7101" member_type: VOTER }
I20260709 13:09:46.326508 30953 leader_election.cc:304] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39fbffc4bb444ecd86de6b3dcc1e7101; no voters: 
I20260709 13:09:46.327790 30953 leader_election.cc:290] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:46.328125 30956 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:46.329711 30956 raft_consensus.cc:697] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [term 1 LEADER]: Becoming Leader. State: Replica: 39fbffc4bb444ecd86de6b3dcc1e7101, State: Running, Role: LEADER
I20260709 13:09:46.330417 30956 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39fbffc4bb444ecd86de6b3dcc1e7101" member_type: VOTER }
I20260709 13:09:46.331219 30953 sys_catalog.cc:565] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:46.335067 30957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39fbffc4bb444ecd86de6b3dcc1e7101" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39fbffc4bb444ecd86de6b3dcc1e7101" member_type: VOTER } }
I20260709 13:09:46.335166 30958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39fbffc4bb444ecd86de6b3dcc1e7101. Latest consensus state: current_term: 1 leader_uuid: "39fbffc4bb444ecd86de6b3dcc1e7101" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39fbffc4bb444ecd86de6b3dcc1e7101" member_type: VOTER } }
I20260709 13:09:46.335908 30957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:46.336356 30958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:46.342815 30962 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:46.347815 30962 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:46.351408 21001 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:46.356784 30962 catalog_manager.cc:1383] Generated new cluster ID: d8990acfe7b94d24b877f70c9fe7e70b
I20260709 13:09:46.357026 30962 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:46.377403 30962 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:46.378811 30962 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:46.396489 30962 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101: Generated new TSK 0
I20260709 13:09:46.397102 30962 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:46.418198 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:46.424093 30974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:46.425956 30975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:46.429606 21001 server_base.cc:1061] running on GCE node
W20260709 13:09:46.429623 30977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:46.430742 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:46.430974 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:46.431149 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602586431110 us; error 0 us; skew 500 ppm
I20260709 13:09:46.431658 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:46.433828 21001 webserver.cc:533] Webserver started at http://127.20.130.65:46659/ using document root <none> and password file <none>
I20260709 13:09:46.434306 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:46.434502 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:46.434770 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:46.435845 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/ts-0-root/instance:
uuid: "5c382658a46f4bd99e74ea9750916b7b"
format_stamp: "Formatted at 2026-07-09 13:09:46 on dist-test-slave-csvd"
I20260709 13:09:46.440162 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:46.443524 30982 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.444319 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:46.444640 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/ts-0-root
uuid: "5c382658a46f4bd99e74ea9750916b7b"
format_stamp: "Formatted at 2026-07-09 13:09:46 on dist-test-slave-csvd"
I20260709 13:09:46.444972 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:46.490043 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:46.491283 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:46.492771 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:46.495043 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:46.495252 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.495517 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:46.495699 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.535063 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.65:34613
I20260709 13:09:46.535246 31044 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.65:34613 every 8 connection(s)
I20260709 13:09:46.540086 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:46.547950 31049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:46.549656 31050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:46.554430 21001 server_base.cc:1061] running on GCE node
W20260709 13:09:46.555253 31052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:46.556097 31045 heartbeater.cc:344] Connected to a master server at 127.20.130.126:35751
I20260709 13:09:46.556428 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:46.556532 31045 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:46.556715 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:46.556988 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602586556969 us; error 0 us; skew 500 ppm
I20260709 13:09:46.557652 31045 heartbeater.cc:507] Master 127.20.130.126:35751 requested a full tablet report, sending...
I20260709 13:09:46.557837 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:46.560494 30918 ts_manager.cc:194] Registered new tserver with Master: 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613)
I20260709 13:09:46.560945 21001 webserver.cc:533] Webserver started at http://127.20.130.66:41345/ using document root <none> and password file <none>
I20260709 13:09:46.561470 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:46.561612 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:46.561851 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:46.562435 30918 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56480
I20260709 13:09:46.562981 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/ts-1-root/instance:
uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
format_stamp: "Formatted at 2026-07-09 13:09:46 on dist-test-slave-csvd"
I20260709 13:09:46.567982 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:09:46.571372 31057 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.572192 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:09:46.572441 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/ts-1-root
uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
format_stamp: "Formatted at 2026-07-09 13:09:46 on dist-test-slave-csvd"
I20260709 13:09:46.572680 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:46.616231 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:46.617413 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:46.618817 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:46.621111 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:46.621333 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.621609 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:46.621774 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.664387 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.66:36553
I20260709 13:09:46.664496 31119 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.66:36553 every 8 connection(s)
I20260709 13:09:46.669206 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:46.677635 31123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:46.680375 31124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:46.681965 31120 heartbeater.cc:344] Connected to a master server at 127.20.130.126:35751
I20260709 13:09:46.682489 31120 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:46.683415 21001 server_base.cc:1061] running on GCE node
I20260709 13:09:46.683573 31120 heartbeater.cc:507] Master 127.20.130.126:35751 requested a full tablet report, sending...
W20260709 13:09:46.683799 31126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:46.684921 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:46.685254 21001 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:46.685463 21001 hybrid_clock.cc:648] HybridClock initialized: now 1783602586685445 us; error 0 us; skew 500 ppm
I20260709 13:09:46.686064 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:46.686095 30918 ts_manager.cc:194] Registered new tserver with Master: 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:46.687872 30918 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56490
I20260709 13:09:46.688647 21001 webserver.cc:533] Webserver started at http://127.20.130.67:41487/ using document root <none> and password file <none>
I20260709 13:09:46.689360 21001 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:46.689600 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:46.689914 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:46.691246 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/ts-2-root/instance:
uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
format_stamp: "Formatted at 2026-07-09 13:09:46 on dist-test-slave-csvd"
I20260709 13:09:46.695596 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:09:46.698859 31131 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.699746 21001 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:46.700045 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/ts-2-root
uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
format_stamp: "Formatted at 2026-07-09 13:09:46 on dist-test-slave-csvd"
I20260709 13:09:46.700304 21001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKUiAlE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602291548094-21001-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:46.725616 21001 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:46.726773 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:46.728350 21001 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:46.730667 21001 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:46.730839 21001 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.731158 21001 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:46.731328 21001 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.772087 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.130.67:35711
I20260709 13:09:46.772197 31193 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.130.67:35711 every 8 connection(s)
I20260709 13:09:46.785513 31194 heartbeater.cc:344] Connected to a master server at 127.20.130.126:35751
I20260709 13:09:46.785995 31194 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:46.786716 31194 heartbeater.cc:507] Master 127.20.130.126:35751 requested a full tablet report, sending...
I20260709 13:09:46.788568 30918 ts_manager.cc:194] Registered new tserver with Master: d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:46.788679 21001 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013461158s
I20260709 13:09:46.790056 30918 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56496
I20260709 13:09:46.813171 30918 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56502:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:46.815987 30918 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:46.900801 31010 tablet_service.cc:1511] Processing CreateTablet for tablet 61a03085114f4ebabbb523e570c801a4 (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:46.902276 31010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61a03085114f4ebabbb523e570c801a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.902527 31159 tablet_service.cc:1511] Processing CreateTablet for tablet 61a03085114f4ebabbb523e570c801a4 (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:46.903963 31159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61a03085114f4ebabbb523e570c801a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.904983 31007 tablet_service.cc:1511] Processing CreateTablet for tablet da148d817ae24f6fb599aadd9772c0e8 (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:46.906368 31007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da148d817ae24f6fb599aadd9772c0e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.903988 31008 tablet_service.cc:1511] Processing CreateTablet for tablet a4ff963e1ccd424d8583b181b615a33f (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:46.908499 31008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ff963e1ccd424d8583b181b615a33f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.912031 31006 tablet_service.cc:1511] Processing CreateTablet for tablet e42a9584abca42a6b79a8b4d1c1ecf2e (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:46.913405 31006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42a9584abca42a6b79a8b4d1c1ecf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.916105 31005 tablet_service.cc:1511] Processing CreateTablet for tablet 031141cccb7a430aa3c07e54cc681b08 (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:46.917301 31005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031141cccb7a430aa3c07e54cc681b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.919866 31009 tablet_service.cc:1511] Processing CreateTablet for tablet 7a53c1d466e14df5b51a71c79aefa5a1 (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:46.921234 31009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a53c1d466e14df5b51a71c79aefa5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.924010 31208 tablet_bootstrap.cc:492] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:46.929571 31004 tablet_service.cc:1511] Processing CreateTablet for tablet f85ba457bfe94972ac7bdd03a7bf399d (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:46.929649 31159 tablet_service.cc:1511] Processing CreateTablet for tablet 7a53c1d466e14df5b51a71c79aefa5a1 (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:46.930512 31157 tablet_service.cc:1511] Processing CreateTablet for tablet da148d817ae24f6fb599aadd9772c0e8 (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:46.931195 31159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a53c1d466e14df5b51a71c79aefa5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.931227 31208 tablet_bootstrap.cc:654] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.931195 31004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85ba457bfe94972ac7bdd03a7bf399d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.934247 31003 tablet_service.cc:1511] Processing CreateTablet for tablet fd903a490c6d450ab42df8564e1756c1 (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:46.934759 31155 tablet_service.cc:1511] Processing CreateTablet for tablet 031141cccb7a430aa3c07e54cc681b08 (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:46.935602 31003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd903a490c6d450ab42df8564e1756c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.936110 31155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031141cccb7a430aa3c07e54cc681b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.932935 31156 tablet_service.cc:1511] Processing CreateTablet for tablet e42a9584abca42a6b79a8b4d1c1ecf2e (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:46.939821 31156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42a9584abca42a6b79a8b4d1c1ecf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.939996 31002 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0e9964b96640fc80bb0e3ea3adb09c (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:46.940514 31154 tablet_service.cc:1511] Processing CreateTablet for tablet f85ba457bfe94972ac7bdd03a7bf399d (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:46.941406 31002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0e9964b96640fc80bb0e3ea3adb09c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.942306 31154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85ba457bfe94972ac7bdd03a7bf399d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.929008 31158 tablet_service.cc:1511] Processing CreateTablet for tablet a4ff963e1ccd424d8583b181b615a33f (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:46.945298 31158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ff963e1ccd424d8583b181b615a33f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.944955 31085 tablet_service.cc:1511] Processing CreateTablet for tablet 61a03085114f4ebabbb523e570c801a4 (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:46.946591 31085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61a03085114f4ebabbb523e570c801a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.948338 31084 tablet_service.cc:1511] Processing CreateTablet for tablet 7a53c1d466e14df5b51a71c79aefa5a1 (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:46.953166 31153 tablet_service.cc:1511] Processing CreateTablet for tablet fd903a490c6d450ab42df8564e1756c1 (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:46.956535 31152 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0e9964b96640fc80bb0e3ea3adb09c (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:46.958848 31084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a53c1d466e14df5b51a71c79aefa5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.960335 31153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd903a490c6d450ab42df8564e1756c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.961917 31157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da148d817ae24f6fb599aadd9772c0e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.967459 31152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0e9964b96640fc80bb0e3ea3adb09c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.969395 31209 tablet_bootstrap.cc:492] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:46.971573 31083 tablet_service.cc:1511] Processing CreateTablet for tablet a4ff963e1ccd424d8583b181b615a33f (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:46.972618 31080 tablet_service.cc:1511] Processing CreateTablet for tablet 031141cccb7a430aa3c07e54cc681b08 (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:46.974334 31082 tablet_service.cc:1511] Processing CreateTablet for tablet da148d817ae24f6fb599aadd9772c0e8 (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:46.974830 31079 tablet_service.cc:1511] Processing CreateTablet for tablet f85ba457bfe94972ac7bdd03a7bf399d (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:46.976709 31081 tablet_service.cc:1511] Processing CreateTablet for tablet e42a9584abca42a6b79a8b4d1c1ecf2e (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:46.977128 31078 tablet_service.cc:1511] Processing CreateTablet for tablet fd903a490c6d450ab42df8564e1756c1 (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:46.979372 31077 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0e9964b96640fc80bb0e3ea3adb09c (DEFAULT_TABLE table=test-workload [id=845ef8bc52984c71ae0a73ed52c922f3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:46.973034 31083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ff963e1ccd424d8583b181b615a33f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.981242 31082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da148d817ae24f6fb599aadd9772c0e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.984493 31077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0e9964b96640fc80bb0e3ea3adb09c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.987309 31080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031141cccb7a430aa3c07e54cc681b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.987991 31079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85ba457bfe94972ac7bdd03a7bf399d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.988612 31078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd903a490c6d450ab42df8564e1756c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.991291 31081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42a9584abca42a6b79a8b4d1c1ecf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.012692 31209 tablet_bootstrap.cc:654] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.032141 31208 tablet_bootstrap.cc:492] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:47.032955 31208 ts_tablet_manager.cc:1403] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.010s
I20260709 13:09:47.037017 31208 raft_consensus.cc:359] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } } peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } }
I20260709 13:09:47.038018 31208 raft_consensus.cc:385] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.038403 31208 raft_consensus.cc:740] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.047668 31211 tablet_bootstrap.cc:492] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:47.051098 31209 tablet_bootstrap.cc:492] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:47.052896 31209 ts_tablet_manager.cc:1403] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.000s
I20260709 13:09:47.049067 31208 consensus_queue.cc:260] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } } peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } }
I20260709 13:09:47.076004 31209 raft_consensus.cc:359] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.076864 31209 raft_consensus.cc:385] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.077163 31209 raft_consensus.cc:740] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.077975 31209 consensus_queue.cc:260] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.080174 31211 tablet_bootstrap.cc:654] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.104728 31213 raft_consensus.cc:493] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.105505 31213 raft_consensus.cc:515] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } } peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } }
I20260709 13:09:47.111543 31213 leader_election.cc:290] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:47.112192 31209 ts_tablet_manager.cc:1434] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.059s	user 0.011s	sys 0.000s
I20260709 13:09:47.112398 31194 heartbeater.cc:499] Master 127.20.130.126:35751 was elected leader, sending a full tablet report...
I20260709 13:09:47.112980 31045 heartbeater.cc:499] Master 127.20.130.126:35751 was elected leader, sending a full tablet report...
I20260709 13:09:47.113328 31209 tablet_bootstrap.cc:492] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:47.135591 31209 tablet_bootstrap.cc:654] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.146564 31208 ts_tablet_manager.cc:1434] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.113s	user 0.013s	sys 0.011s
I20260709 13:09:47.147886 31208 tablet_bootstrap.cc:492] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:47.150316 31211 tablet_bootstrap.cc:492] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:47.155421 31208 tablet_bootstrap.cc:654] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.164252 31211 ts_tablet_manager.cc:1403] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.117s	user 0.004s	sys 0.017s
I20260709 13:09:47.166622 31211 raft_consensus.cc:359] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } } peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } }
I20260709 13:09:47.167341 31211 raft_consensus.cc:385] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.167658 31211 raft_consensus.cc:740] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.168433 31211 consensus_queue.cc:260] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } } peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } }
I20260709 13:09:47.169600 31209 tablet_bootstrap.cc:492] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:47.170337 31209 ts_tablet_manager.cc:1403] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.000s
I20260709 13:09:47.174222 31209 raft_consensus.cc:359] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.175357 31209 raft_consensus.cc:385] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.175740 31209 raft_consensus.cc:740] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.177837 31209 consensus_queue.cc:260] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.182075 31208 tablet_bootstrap.cc:492] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:47.182725 31208 ts_tablet_manager.cc:1403] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.011s
I20260709 13:09:47.182878 31095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a03085114f4ebabbb523e570c801a4" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:47.183652 31095 raft_consensus.cc:2468] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 0.
I20260709 13:09:47.184195 31209 ts_tablet_manager.cc:1434] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:09:47.184861 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a03085114f4ebabbb523e570c801a4" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b" is_pre_election: true
I20260709 13:09:47.185325 31209 tablet_bootstrap.cc:492] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:47.185148 31135 leader_election.cc:304] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:47.186188 31208 raft_consensus.cc:359] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
W20260709 13:09:47.186685 31135 leader_election.cc:343] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.186833 31214 raft_consensus.cc:2804] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.187106 31208 raft_consensus.cc:385] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.187479 31214 raft_consensus.cc:493] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.187616 31208 raft_consensus.cc:740] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.187955 31214 raft_consensus.cc:3060] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.188612 31208 consensus_queue.cc:260] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.192585 31208 ts_tablet_manager.cc:1434] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:09:47.193595 31208 tablet_bootstrap.cc:492] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:47.197425 31120 heartbeater.cc:499] Master 127.20.130.126:35751 was elected leader, sending a full tablet report...
I20260709 13:09:47.197273 31214 raft_consensus.cc:515] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } } peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } }
I20260709 13:09:47.200965 31095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a03085114f4ebabbb523e570c801a4" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:47.201601 31095 raft_consensus.cc:3060] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.204234 31209 tablet_bootstrap.cc:654] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.203544 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a03085114f4ebabbb523e570c801a4" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:47.211796 31208 tablet_bootstrap.cc:654] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:47.212730 31135 leader_election.cc:343] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.208846 31211 ts_tablet_manager.cc:1434] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.044s	user 0.014s	sys 0.005s
I20260709 13:09:47.216110 31211 tablet_bootstrap.cc:492] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:47.208979 31214 leader_election.cc:290] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:47.209800 31095 raft_consensus.cc:2468] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 1.
I20260709 13:09:47.217828 31135 leader_election.cc:304] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 5c382658a46f4bd99e74ea9750916b7b
I20260709 13:09:47.218286 31208 tablet_bootstrap.cc:492] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:47.218887 31208 ts_tablet_manager.cc:1403] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.003s
I20260709 13:09:47.219295 31214 raft_consensus.cc:2804] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.220631 31214 raft_consensus.cc:697] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Becoming Leader. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:47.221598 31209 tablet_bootstrap.cc:492] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:47.221534 31214 consensus_queue.cc:237] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } } peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } }
I20260709 13:09:47.222942 31215 raft_consensus.cc:493] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.222164 31209 ts_tablet_manager.cc:1403] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.000s
I20260709 13:09:47.223165 31211 tablet_bootstrap.cc:654] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.223469 31215 raft_consensus.cc:515] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.226315 31215 leader_election.cc:290] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:47.231704 31209 raft_consensus.cc:359] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.232578 31209 raft_consensus.cc:385] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.232950 31209 raft_consensus.cc:740] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.233752 31208 raft_consensus.cc:359] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.235828 31208 raft_consensus.cc:385] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.235103 31209 consensus_queue.cc:260] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.236157 31208 raft_consensus.cc:740] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.237049 31208 consensus_queue.cc:260] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.238273 31209 ts_tablet_manager.cc:1434] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:09:47.239279 31208 ts_tablet_manager.cc:1434] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.020s	user 0.000s	sys 0.007s
I20260709 13:09:47.239439 31209 tablet_bootstrap.cc:492] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:47.240319 31208 tablet_bootstrap.cc:492] T a4ff963e1ccd424d8583b181b615a33f P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:47.248785 31211 tablet_bootstrap.cc:492] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:47.249508 31211 ts_tablet_manager.cc:1403] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.008s
I20260709 13:09:47.252604 31211 raft_consensus.cc:359] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.253402 31211 raft_consensus.cc:385] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.253706 31211 raft_consensus.cc:740] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.254559 31211 consensus_queue.cc:260] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.257094 31211 ts_tablet_manager.cc:1434] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:09:47.258147 31211 tablet_bootstrap.cc:492] T 7a0e9964b96640fc80bb0e3ea3adb09c P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:47.258575 31208 tablet_bootstrap.cc:654] T a4ff963e1ccd424d8583b181b615a33f P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.261641 30917 catalog_manager.cc:5697] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.263203 31209 tablet_bootstrap.cc:654] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.264424 31211 tablet_bootstrap.cc:654] T 7a0e9964b96640fc80bb0e3ea3adb09c P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.265311 31095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0e9964b96640fc80bb0e3ea3adb09c" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
W20260709 13:09:47.273562 30986 leader_election.cc:343] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.274616 31208 tablet_bootstrap.cc:492] T a4ff963e1ccd424d8583b181b615a33f P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:47.275203 31208 ts_tablet_manager.cc:1403] T a4ff963e1ccd424d8583b181b615a33f P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.009s
I20260709 13:09:47.276602 31209 tablet_bootstrap.cc:492] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:47.277240 31209 ts_tablet_manager.cc:1403] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.008s
I20260709 13:09:47.278460 31208 raft_consensus.cc:359] T a4ff963e1ccd424d8583b181b615a33f P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.279285 31208 raft_consensus.cc:385] T a4ff963e1ccd424d8583b181b615a33f P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.279608 31208 raft_consensus.cc:740] T a4ff963e1ccd424d8583b181b615a33f P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.280522 31208 consensus_queue.cc:260] T a4ff963e1ccd424d8583b181b615a33f P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.282842 31208 ts_tablet_manager.cc:1434] T a4ff963e1ccd424d8583b181b615a33f P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:09:47.284189 31208 tablet_bootstrap.cc:492] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:47.289414 31211 tablet_bootstrap.cc:492] T 7a0e9964b96640fc80bb0e3ea3adb09c P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:47.290122 31211 ts_tablet_manager.cc:1403] T 7a0e9964b96640fc80bb0e3ea3adb09c P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.012s
I20260709 13:09:47.292207 31208 tablet_bootstrap.cc:654] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.293395 31209 raft_consensus.cc:359] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.294353 31209 raft_consensus.cc:385] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.294721 31209 raft_consensus.cc:740] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.295671 31209 consensus_queue.cc:260] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.297683 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0e9964b96640fc80bb0e3ea3adb09c" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" is_pre_election: true
I20260709 13:09:47.297998 31208 tablet_bootstrap.cc:492] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:47.297884 31209 ts_tablet_manager.cc:1434] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.007s
I20260709 13:09:47.298751 31208 ts_tablet_manager.cc:1403] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.005s
I20260709 13:09:47.299685 31209 tablet_bootstrap.cc:492] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:47.299451 31211 raft_consensus.cc:359] T 7a0e9964b96640fc80bb0e3ea3adb09c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.300311 31211 raft_consensus.cc:385] T 7a0e9964b96640fc80bb0e3ea3adb09c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.300635 31211 raft_consensus.cc:740] T 7a0e9964b96640fc80bb0e3ea3adb09c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.301496 31211 consensus_queue.cc:260] T 7a0e9964b96640fc80bb0e3ea3adb09c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
W20260709 13:09:47.299505 30986 leader_election.cc:343] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.302423 30986 leader_election.cc:304] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b; no voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04
I20260709 13:09:47.302448 31208 raft_consensus.cc:359] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.306286 31208 raft_consensus.cc:385] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.306682 31208 raft_consensus.cc:740] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.306751 31215 raft_consensus.cc:2749] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.307029 31209 tablet_bootstrap.cc:654] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.307855 31208 consensus_queue.cc:260] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.310477 31208 ts_tablet_manager.cc:1434] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:47.311535 31208 tablet_bootstrap.cc:492] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:47.317986 31208 tablet_bootstrap.cc:654] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.319536 31209 tablet_bootstrap.cc:492] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:47.320132 31209 ts_tablet_manager.cc:1403] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.002s
I20260709 13:09:47.323043 31208 tablet_bootstrap.cc:492] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:47.322810 31209 raft_consensus.cc:359] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.303710 31211 ts_tablet_manager.cc:1434] T 7a0e9964b96640fc80bb0e3ea3adb09c P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:09:47.323606 31209 raft_consensus.cc:385] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.323617 31208 ts_tablet_manager.cc:1403] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.003s
I20260709 13:09:47.324100 31209 raft_consensus.cc:740] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.325090 31211 tablet_bootstrap.cc:492] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:47.325068 31209 consensus_queue.cc:260] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.327486 31209 ts_tablet_manager.cc:1434] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 13:09:47.327489 31208 raft_consensus.cc:359] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.328576 31208 raft_consensus.cc:385] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.328810 31209 tablet_bootstrap.cc:492] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:47.328963 31208 raft_consensus.cc:740] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.330121 31208 consensus_queue.cc:260] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.332810 31211 tablet_bootstrap.cc:654] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.336066 31209 tablet_bootstrap.cc:654] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.336289 31208 ts_tablet_manager.cc:1434] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:47.337960 31208 tablet_bootstrap.cc:492] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:47.346578 31211 tablet_bootstrap.cc:492] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
W20260709 13:09:47.349933 30966 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:47.350059 31208 tablet_bootstrap.cc:654] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.350885 31211 ts_tablet_manager.cc:1403] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.004s
I20260709 13:09:47.354696 31209 tablet_bootstrap.cc:492] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:47.355262 31209 ts_tablet_manager.cc:1403] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.018s
I20260709 13:09:47.354475 31211 raft_consensus.cc:359] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.355605 31211 raft_consensus.cc:385] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.356117 31211 raft_consensus.cc:740] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.357081 31211 consensus_queue.cc:260] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.358000 31209 raft_consensus.cc:359] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } } peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } }
I20260709 13:09:47.358744 31208 tablet_bootstrap.cc:492] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:47.358798 31209 raft_consensus.cc:385] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.359416 31209 raft_consensus.cc:740] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.359463 31208 ts_tablet_manager.cc:1403] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.002s
I20260709 13:09:47.359580 31211 ts_tablet_manager.cc:1434] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:47.360374 31209 consensus_queue.cc:260] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } } peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } }
I20260709 13:09:47.360929 31211 tablet_bootstrap.cc:492] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:47.363121 31208 raft_consensus.cc:359] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.363926 31208 raft_consensus.cc:385] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.364236 31208 raft_consensus.cc:740] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.365168 31208 consensus_queue.cc:260] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.368736 31211 tablet_bootstrap.cc:654] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.369659 31209 ts_tablet_manager.cc:1434] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:09:47.371021 31208 ts_tablet_manager.cc:1434] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:09:47.372355 31208 tablet_bootstrap.cc:492] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:47.373484 31209 tablet_bootstrap.cc:492] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:47.381230 31209 tablet_bootstrap.cc:654] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.381235 31208 tablet_bootstrap.cc:654] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.381312 31211 tablet_bootstrap.cc:492] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:47.382287 31211 ts_tablet_manager.cc:1403] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 13:09:47.385842 31211 raft_consensus.cc:359] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.386616 31209 tablet_bootstrap.cc:492] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:47.386675 31211 raft_consensus.cc:385] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.387272 31209 ts_tablet_manager.cc:1403] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:09:47.387326 31211 raft_consensus.cc:740] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.388715 31211 consensus_queue.cc:260] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.390409 31209 raft_consensus.cc:359] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.391201 31209 raft_consensus.cc:385] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.391489 31209 raft_consensus.cc:740] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.392730 31211 ts_tablet_manager.cc:1434] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:09:47.392376 31209 consensus_queue.cc:260] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.393850 31211 tablet_bootstrap.cc:492] T a4ff963e1ccd424d8583b181b615a33f P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:47.400143 31215 raft_consensus.cc:493] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.400748 31215 raft_consensus.cc:515] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.401297 31211 tablet_bootstrap.cc:654] T a4ff963e1ccd424d8583b181b615a33f P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.403002 31215 leader_election.cc:290] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:47.405792 31095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ff963e1ccd424d8583b181b615a33f" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:47.407473 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ff963e1ccd424d8583b181b615a33f" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" is_pre_election: true
I20260709 13:09:47.408308 31169 raft_consensus.cc:2468] T a4ff963e1ccd424d8583b181b615a33f P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 0.
W20260709 13:09:47.410346 30986 leader_election.cc:343] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.411160 30986 leader_election.cc:304] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 2f11c03dfbff48eb9690cf91e2cb4ac3
I20260709 13:09:47.412217 31215 raft_consensus.cc:2804] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.412583 31215 raft_consensus.cc:493] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.412935 31215 raft_consensus.cc:3060] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.413136 31211 tablet_bootstrap.cc:492] T a4ff963e1ccd424d8583b181b615a33f P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:47.413757 31211 ts_tablet_manager.cc:1403] T a4ff963e1ccd424d8583b181b615a33f P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:09:47.416637 31211 raft_consensus.cc:359] T a4ff963e1ccd424d8583b181b615a33f P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.417344 31211 raft_consensus.cc:385] T a4ff963e1ccd424d8583b181b615a33f P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.417637 31211 raft_consensus.cc:740] T a4ff963e1ccd424d8583b181b615a33f P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.418457 31211 consensus_queue.cc:260] T a4ff963e1ccd424d8583b181b615a33f P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.418992 31209 ts_tablet_manager.cc:1434] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:09:47.420499 31215 raft_consensus.cc:515] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.422689 31208 tablet_bootstrap.cc:492] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:47.423259 31208 ts_tablet_manager.cc:1403] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.018s
I20260709 13:09:47.423302 31095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ff963e1ccd424d8583b181b615a33f" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:47.424017 31095 raft_consensus.cc:3060] T a4ff963e1ccd424d8583b181b615a33f P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.426362 31208 raft_consensus.cc:359] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.426673 31211 ts_tablet_manager.cc:1434] T a4ff963e1ccd424d8583b181b615a33f P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:09:47.427331 31208 raft_consensus.cc:385] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.427738 31208 raft_consensus.cc:740] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.428781 31211 tablet_bootstrap.cc:492] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:47.428589 31208 consensus_queue.cc:260] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.429925 31209 tablet_bootstrap.cc:492] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:47.431631 31095 raft_consensus.cc:2468] T a4ff963e1ccd424d8583b181b615a33f P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 1.
I20260709 13:09:47.436429 31211 tablet_bootstrap.cc:654] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.438033 31209 tablet_bootstrap.cc:654] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.438414 31208 ts_tablet_manager.cc:1434] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:09:47.439575 31208 tablet_bootstrap.cc:492] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:47.447325 31208 tablet_bootstrap.cc:654] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.452780 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ff963e1ccd424d8583b181b615a33f" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:47.453682 31169 raft_consensus.cc:3060] T a4ff963e1ccd424d8583b181b615a33f P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.460765 31208 tablet_bootstrap.cc:492] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:47.461633 31208 ts_tablet_manager.cc:1403] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 13:09:47.463440 31214 raft_consensus.cc:493] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.464210 31214 raft_consensus.cc:515] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.465662 31208 raft_consensus.cc:359] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.466769 31208 raft_consensus.cc:385] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.467176 31208 raft_consensus.cc:740] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.468251 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031141cccb7a430aa3c07e54cc681b08" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b" is_pre_election: true
I20260709 13:09:47.468493 31208 consensus_queue.cc:260] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
W20260709 13:09:47.470402 31135 leader_election.cc:343] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.471915 31214 leader_election.cc:290] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:47.474356 31094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031141cccb7a430aa3c07e54cc681b08" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:47.475158 31208 ts_tablet_manager.cc:1434] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 13:09:47.475540 31094 raft_consensus.cc:2468] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 0.
I20260709 13:09:47.477455 31135 leader_election.cc:304] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 5c382658a46f4bd99e74ea9750916b7b
I20260709 13:09:47.478744 31214 raft_consensus.cc:2804] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.479286 31214 raft_consensus.cc:493] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.479737 31214 raft_consensus.cc:3060] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.484078 30986 leader_election.cc:304] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: 
I20260709 13:09:47.485026 31215 leader_election.cc:290] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 election: Requested vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:47.486050 31215 raft_consensus.cc:2804] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.488999 31215 raft_consensus.cc:697] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Becoming Leader. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Running, Role: LEADER
I20260709 13:09:47.493080 31215 consensus_queue.cc:237] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.488055 31169 raft_consensus.cc:2468] T a4ff963e1ccd424d8583b181b615a33f P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 1.
I20260709 13:09:47.500867 31213 raft_consensus.cc:493] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.501444 31213 raft_consensus.cc:515] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.503675 31213 leader_election.cc:290] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:47.504621 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a53c1d466e14df5b51a71c79aefa5a1" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b" is_pre_election: true
I20260709 13:09:47.504962 31094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a53c1d466e14df5b51a71c79aefa5a1" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:47.505568 31020 raft_consensus.cc:2468] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 0.
I20260709 13:09:47.505724 31094 raft_consensus.cc:2468] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 0.
I20260709 13:09:47.507128 31135 leader_election.cc:304] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:47.508033 31209 tablet_bootstrap.cc:492] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:47.508729 31213 raft_consensus.cc:2804] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.509336 31209 ts_tablet_manager.cc:1403] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.080s	user 0.035s	sys 0.035s
I20260709 13:09:47.509426 31213 raft_consensus.cc:493] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.510176 31213 raft_consensus.cc:3060] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.512169 31211 tablet_bootstrap.cc:492] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:47.507807 30917 catalog_manager.cc:5697] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65). New cstate: current_term: 1 leader_uuid: "5c382658a46f4bd99e74ea9750916b7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.512745 31211 ts_tablet_manager.cc:1403] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.084s	user 0.022s	sys 0.049s
I20260709 13:09:47.512676 31209 raft_consensus.cc:359] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.513600 31209 raft_consensus.cc:385] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.513911 31209 raft_consensus.cc:740] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.514741 31209 consensus_queue.cc:260] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.512748 31214 raft_consensus.cc:515] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.515949 31211 raft_consensus.cc:359] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.516664 31211 raft_consensus.cc:385] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.516947 31211 raft_consensus.cc:740] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.517234 31209 ts_tablet_manager.cc:1434] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:47.517657 31211 consensus_queue.cc:260] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.518712 31209 tablet_bootstrap.cc:492] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:47.517164 31214 leader_election.cc:290] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:47.520023 31211 ts_tablet_manager.cc:1434] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:47.521198 31211 tablet_bootstrap.cc:492] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:47.525323 31213 raft_consensus.cc:515] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.525990 31209 tablet_bootstrap.cc:654] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.527305 31211 tablet_bootstrap.cc:654] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.528857 31213 leader_election.cc:290] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:47.530268 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a53c1d466e14df5b51a71c79aefa5a1" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:47.530952 31019 raft_consensus.cc:3060] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.534299 31094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031141cccb7a430aa3c07e54cc681b08" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:47.535261 31094 raft_consensus.cc:3060] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.539798 31095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a53c1d466e14df5b51a71c79aefa5a1" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:47.540474 31095 raft_consensus.cc:3060] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.540874 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031141cccb7a430aa3c07e54cc681b08" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:47.541527 31020 raft_consensus.cc:3060] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.550570 31094 raft_consensus.cc:2468] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 1.
I20260709 13:09:47.552172 31135 leader_election.cc:304] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:47.553108 31214 raft_consensus.cc:493] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.553225 31209 tablet_bootstrap.cc:492] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:47.553805 31209 ts_tablet_manager.cc:1403] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.011s
I20260709 13:09:47.553642 31214 raft_consensus.cc:515] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.555753 31095 raft_consensus.cc:2468] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 1.
I20260709 13:09:47.555891 31214 leader_election.cc:290] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:47.556970 31209 raft_consensus.cc:359] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.557754 31209 raft_consensus.cc:385] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.558051 31209 raft_consensus.cc:740] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.557958 31135 leader_election.cc:304] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:47.558439 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0e9964b96640fc80bb0e3ea3adb09c" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b" is_pre_election: true
I20260709 13:09:47.558974 31209 consensus_queue.cc:260] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.559490 31018 raft_consensus.cc:2468] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 0.
I20260709 13:09:47.559724 31214 raft_consensus.cc:2804] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.560441 31213 raft_consensus.cc:2804] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.561233 31243 raft_consensus.cc:493] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.561802 31243 raft_consensus.cc:515] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.564687 31243 leader_election.cc:290] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:47.565476 31135 leader_election.cc:304] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:47.566555 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ba457bfe94972ac7bdd03a7bf399d" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:47.567426 31209 ts_tablet_manager.cc:1434] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:09:47.567350 31093 raft_consensus.cc:2468] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 0.
I20260709 13:09:47.568500 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ba457bfe94972ac7bdd03a7bf399d" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" is_pre_election: true
I20260709 13:09:47.569268 31169 raft_consensus.cc:2468] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 0.
I20260709 13:09:47.570595 31248 raft_consensus.cc:2804] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.570785 30986 leader_election.cc:304] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:47.571130 31248 raft_consensus.cc:493] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.571520 31248 raft_consensus.cc:3060] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.571823 31243 raft_consensus.cc:2804] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.540819 31019 raft_consensus.cc:2468] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 1.
I20260709 13:09:47.572362 31243 raft_consensus.cc:493] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.572896 31243 raft_consensus.cc:3060] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.574939 31213 raft_consensus.cc:697] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Becoming Leader. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:47.576994 31213 consensus_queue.cc:237] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.575834 31095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0e9964b96640fc80bb0e3ea3adb09c" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:47.580096 31095 raft_consensus.cc:2468] T 7a0e9964b96640fc80bb0e3ea3adb09c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 0.
I20260709 13:09:47.580660 31215 raft_consensus.cc:493] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.580541 31248 raft_consensus.cc:515] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.581236 31215 raft_consensus.cc:515] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.581636 31214 raft_consensus.cc:697] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Becoming Leader. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:47.582995 31248 leader_election.cc:290] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:47.582805 31214 consensus_queue.cc:237] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.583426 31215 leader_election.cc:290] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:47.585700 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd903a490c6d450ab42df8564e1756c1" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" is_pre_election: true
I20260709 13:09:47.586639 31169 raft_consensus.cc:2468] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 0.
I20260709 13:09:47.588524 30986 leader_election.cc:304] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:47.589938 31215 raft_consensus.cc:2804] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.590454 31215 raft_consensus.cc:493] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.590533 31095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0e9964b96640fc80bb0e3ea3adb09c" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:47.591360 31095 raft_consensus.cc:3060] T 7a0e9964b96640fc80bb0e3ea3adb09c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.591279 31020 raft_consensus.cc:2468] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 1.
I20260709 13:09:47.595000 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0e9964b96640fc80bb0e3ea3adb09c" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:47.595923 31019 raft_consensus.cc:3060] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.591059 31215 raft_consensus.cc:3060] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.599005 31211 tablet_bootstrap.cc:492] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:47.599581 31211 ts_tablet_manager.cc:1403] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.031s
I20260709 13:09:47.602406 31211 raft_consensus.cc:359] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.603082 31211 raft_consensus.cc:385] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.603351 31211 raft_consensus.cc:740] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.604265 31211 consensus_queue.cc:260] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.607332 31094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd903a490c6d450ab42df8564e1756c1" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:47.609630 31094 raft_consensus.cc:2468] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 0.
I20260709 13:09:47.619668 31211 ts_tablet_manager.cc:1434] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.011s
I20260709 13:09:47.620814 31211 tablet_bootstrap.cc:492] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:47.626017 31211 tablet_bootstrap.cc:654] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.628572 31243 raft_consensus.cc:515] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.635692 31094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ba457bfe94972ac7bdd03a7bf399d" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:47.636552 31094 raft_consensus.cc:3060] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.639536 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ba457bfe94972ac7bdd03a7bf399d" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:47.640259 31169 raft_consensus.cc:3060] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.647819 31019 raft_consensus.cc:2468] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 1.
I20260709 13:09:47.650306 31095 raft_consensus.cc:2468] T 7a0e9964b96640fc80bb0e3ea3adb09c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 1.
I20260709 13:09:47.650712 31135 leader_election.cc:304] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:47.644685 31215 raft_consensus.cc:515] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.652418 31214 raft_consensus.cc:2804] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.653024 31214 raft_consensus.cc:697] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Becoming Leader. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:47.648365 31169 raft_consensus.cc:2468] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 1.
I20260709 13:09:47.654256 31214 consensus_queue.cc:237] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.643982 30917 catalog_manager.cc:5697] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.654446 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd903a490c6d450ab42df8564e1756c1" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:47.655509 31168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd903a490c6d450ab42df8564e1756c1" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:47.656288 31168 raft_consensus.cc:3060] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.659513 31211 tablet_bootstrap.cc:492] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:47.660096 31211 ts_tablet_manager.cc:1403] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.017s
I20260709 13:09:47.661571 31094 raft_consensus.cc:2468] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 1.
I20260709 13:09:47.662823 30986 leader_election.cc:304] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: 
I20260709 13:09:47.662765 31211 raft_consensus.cc:359] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.663826 31211 raft_consensus.cc:385] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.664160 31211 raft_consensus.cc:740] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.646715 31243 leader_election.cc:290] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 election: Requested vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:47.664820 31243 raft_consensus.cc:2804] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.664954 31211 consensus_queue.cc:260] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.665424 31243 raft_consensus.cc:697] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Becoming Leader. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Running, Role: LEADER
I20260709 13:09:47.655717 31093 raft_consensus.cc:3060] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.667129 31211 ts_tablet_manager.cc:1434] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:47.666210 31243 consensus_queue.cc:237] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.680549 31093 raft_consensus.cc:2468] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 1.
I20260709 13:09:47.681928 31215 leader_election.cc:290] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 election: Requested vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:47.686136 31168 raft_consensus.cc:2468] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 1.
I20260709 13:09:47.656312 30917 catalog_manager.cc:5697] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.692160 30986 leader_election.cc:304] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:47.693851 31243 raft_consensus.cc:2804] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.694427 31243 raft_consensus.cc:697] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Becoming Leader. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Running, Role: LEADER
I20260709 13:09:47.695279 31243 consensus_queue.cc:237] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.701323 30918 catalog_manager.cc:5697] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65). New cstate: current_term: 1 leader_uuid: "5c382658a46f4bd99e74ea9750916b7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.710141 30917 catalog_manager.cc:5697] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.715504 31214 raft_consensus.cc:493] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.715371 30918 catalog_manager.cc:5697] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65). New cstate: current_term: 1 leader_uuid: "5c382658a46f4bd99e74ea9750916b7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.716056 31214 raft_consensus.cc:515] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.718851 31243 raft_consensus.cc:493] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.719055 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da148d817ae24f6fb599aadd9772c0e8" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b" is_pre_election: true
I20260709 13:09:47.719448 31243 raft_consensus.cc:515] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } } peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } }
I20260709 13:09:47.719717 31019 raft_consensus.cc:2468] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 0.
I20260709 13:09:47.720165 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da148d817ae24f6fb599aadd9772c0e8" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:47.720870 31135 leader_election.cc:304] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:47.722368 31213 raft_consensus.cc:2804] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.722302 31168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a03085114f4ebabbb523e570c801a4" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" is_pre_election: true
I20260709 13:09:47.722847 31243 leader_election.cc:290] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:47.722987 31213 raft_consensus.cc:493] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.723572 31213 raft_consensus.cc:3060] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.724296 31214 leader_election.cc:290] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:47.725502 31094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a03085114f4ebabbb523e570c801a4" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:47.726307 31094 raft_consensus.cc:2393] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c382658a46f4bd99e74ea9750916b7b in current term 1: Already voted for candidate d001d8370bf744e6acc9b7a7e75e5b04 in this term.
I20260709 13:09:47.720887 31093 raft_consensus.cc:2468] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 0.
I20260709 13:09:47.727617 30986 leader_election.cc:304] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b; no voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04
I20260709 13:09:47.728657 31249 raft_consensus.cc:493] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.729156 31249 raft_consensus.cc:515] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.729724 31243 raft_consensus.cc:3060] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.731282 31249 leader_election.cc:290] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:47.732120 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a9584abca42a6b79a8b4d1c1ecf2e" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b" is_pre_election: true
I20260709 13:09:47.732477 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a9584abca42a6b79a8b4d1c1ecf2e" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:47.732825 31020 raft_consensus.cc:2468] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 0.
I20260709 13:09:47.733174 31093 raft_consensus.cc:2468] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 0.
I20260709 13:09:47.734050 31135 leader_election.cc:304] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:47.731283 31213 raft_consensus.cc:515] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.734807 31249 raft_consensus.cc:2804] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.735286 31249 raft_consensus.cc:493] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.735662 31249 raft_consensus.cc:3060] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.736374 31213 leader_election.cc:290] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:47.737169 31243 raft_consensus.cc:2749] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.737423 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da148d817ae24f6fb599aadd9772c0e8" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:47.737700 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da148d817ae24f6fb599aadd9772c0e8" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:47.738157 31093 raft_consensus.cc:3060] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.738338 31020 raft_consensus.cc:3060] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.742357 31213 consensus_queue.cc:1048] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.743799 31249 raft_consensus.cc:515] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.745937 31020 raft_consensus.cc:2468] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 1.
I20260709 13:09:47.747123 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a9584abca42a6b79a8b4d1c1ecf2e" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:47.747376 31135 leader_election.cc:304] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:47.747534 31093 raft_consensus.cc:2468] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 1.
I20260709 13:09:47.747844 31249 leader_election.cc:290] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:47.747855 31018 raft_consensus.cc:3060] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.748749 31249 raft_consensus.cc:2804] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.749507 31249 raft_consensus.cc:697] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Becoming Leader. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:47.749562 31094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a9584abca42a6b79a8b4d1c1ecf2e" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:47.750293 31094 raft_consensus.cc:3060] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.750527 31249 consensus_queue.cc:237] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.758086 31018 raft_consensus.cc:2468] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 1.
I20260709 13:09:47.759826 31135 leader_election.cc:304] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:47.760870 31213 raft_consensus.cc:2804] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.761720 31213 raft_consensus.cc:697] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Becoming Leader. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:47.763026 31094 raft_consensus.cc:2468] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 1.
I20260709 13:09:47.763230 31213 consensus_queue.cc:237] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:47.772549 30917 catalog_manager.cc:5697] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.774713 31248 consensus_queue.cc:1048] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:47.796108 30917 catalog_manager.cc:5697] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.876938 31243 consensus_queue.cc:1048] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.887948 31254 consensus_queue.cc:1048] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:47.992336 31213 consensus_queue.cc:1048] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.993784 31213 consensus_queue.cc:1048] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.006951 31248 consensus_queue.cc:1048] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.015506 31249 consensus_queue.cc:1048] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.042965 31249 consensus_queue.cc:1048] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.045017 31168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61a03085114f4ebabbb523e570c801a4"
dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
mode: GRACEFUL
new_leader_uuid: "5c382658a46f4bd99e74ea9750916b7b"
 from {username='slave'} at 127.0.0.1:54764
I20260709 13:09:48.045548 31168 raft_consensus.cc:606] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Received request to transfer leadership to TS 5c382658a46f4bd99e74ea9750916b7b
I20260709 13:09:48.054171 31168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a53c1d466e14df5b51a71c79aefa5a1"
dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
mode: GRACEFUL
new_leader_uuid: "5c382658a46f4bd99e74ea9750916b7b"
 from {username='slave'} at 127.0.0.1:54764
I20260709 13:09:48.054777 31168 raft_consensus.cc:606] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Received request to transfer leadership to TS 5c382658a46f4bd99e74ea9750916b7b
I20260709 13:09:48.056398 31254 consensus_queue.cc:1048] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.057396 31213 consensus_queue.cc:1048] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.070070 31168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da148d817ae24f6fb599aadd9772c0e8"
dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
mode: GRACEFUL
new_leader_uuid: "5c382658a46f4bd99e74ea9750916b7b"
 from {username='slave'} at 127.0.0.1:54764
I20260709 13:09:48.070791 31168 raft_consensus.cc:606] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Received request to transfer leadership to TS 5c382658a46f4bd99e74ea9750916b7b
I20260709 13:09:48.081918 31243 consensus_queue.cc:1048] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.085250 31168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e42a9584abca42a6b79a8b4d1c1ecf2e"
dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
mode: GRACEFUL
new_leader_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
 from {username='slave'} at 127.0.0.1:54764
I20260709 13:09:48.085856 31168 raft_consensus.cc:606] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Received request to transfer leadership to TS 2f11c03dfbff48eb9690cf91e2cb4ac3
I20260709 13:09:48.094022 31169 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "031141cccb7a430aa3c07e54cc681b08"
dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
mode: GRACEFUL
new_leader_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
 from {username='slave'} at 127.0.0.1:54764
I20260709 13:09:48.094542 31169 raft_consensus.cc:606] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Received request to transfer leadership to TS 2f11c03dfbff48eb9690cf91e2cb4ac3
I20260709 13:09:48.109316 31019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f85ba457bfe94972ac7bdd03a7bf399d"
dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
mode: GRACEFUL
new_leader_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
 from {username='slave'} at 127.0.0.1:53824
I20260709 13:09:48.109789 31019 raft_consensus.cc:606] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Received request to transfer leadership to TS 2f11c03dfbff48eb9690cf91e2cb4ac3
I20260709 13:09:48.114837 31019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd903a490c6d450ab42df8564e1756c1"
dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
mode: GRACEFUL
new_leader_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
 from {username='slave'} at 127.0.0.1:53824
I20260709 13:09:48.115338 31019 raft_consensus.cc:606] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Received request to transfer leadership to TS 2f11c03dfbff48eb9690cf91e2cb4ac3
I20260709 13:09:48.146888 31213 consensus_queue.cc:1048] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.153469 31247 raft_consensus.cc:993] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04: : Instructing follower 5c382658a46f4bd99e74ea9750916b7b to start an election
I20260709 13:09:48.153968 31249 raft_consensus.cc:1081] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Signalling peer 5c382658a46f4bd99e74ea9750916b7b to start an election
I20260709 13:09:48.156301 31018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da148d817ae24f6fb599aadd9772c0e8"
dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
 from {username='slave'} at 127.0.0.1:53808
I20260709 13:09:48.156884 31018 raft_consensus.cc:493] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.157275 31018 raft_consensus.cc:3060] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.160400 31247 consensus_queue.cc:1048] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.165889 31018 raft_consensus.cc:515] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.168583 31018 leader_election.cc:290] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 2 election: Requested vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:48.170084 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da148d817ae24f6fb599aadd9772c0e8" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:48.170773 31169 raft_consensus.cc:3055] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.171150 31169 raft_consensus.cc:740] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:48.171116 31094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da148d817ae24f6fb599aadd9772c0e8" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:48.172000 31094 raft_consensus.cc:3060] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.172292 31169 consensus_queue.cc:260] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.173646 31169 raft_consensus.cc:3060] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.179692 31094 raft_consensus.cc:2468] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 2.
I20260709 13:09:48.180847 31169 raft_consensus.cc:2468] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 2.
I20260709 13:09:48.182057 30986 leader_election.cc:304] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: 
I20260709 13:09:48.182837 31215 raft_consensus.cc:2804] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.183377 31215 raft_consensus.cc:697] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 2 LEADER]: Becoming Leader. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Running, Role: LEADER
I20260709 13:09:48.184082 31215 consensus_queue.cc:237] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.190290 30915 catalog_manager.cc:5697] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b reported cstate change: term changed from 1 to 2, leader changed from d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67) to 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65). New cstate: current_term: 2 leader_uuid: "5c382658a46f4bd99e74ea9750916b7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.274338 31215 consensus_queue.cc:1048] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.285259 31215 consensus_queue.cc:1048] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:48.294523 31254 raft_consensus.cc:993] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b: : Instructing follower 2f11c03dfbff48eb9690cf91e2cb4ac3 to start an election
I20260709 13:09:48.295079 31215 raft_consensus.cc:1081] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Signalling peer 2f11c03dfbff48eb9690cf91e2cb4ac3 to start an election
I20260709 13:09:48.296756 31094 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd903a490c6d450ab42df8564e1756c1"
dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
 from {username='slave'} at 127.0.0.1:35002
I20260709 13:09:48.297392 31094 raft_consensus.cc:493] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.297763 31094 raft_consensus.cc:3060] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.302698 31094 raft_consensus.cc:515] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.305106 31094 leader_election.cc:290] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 2 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:48.318470 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd903a490c6d450ab42df8564e1756c1" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:48.318661 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd903a490c6d450ab42df8564e1756c1" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:48.319182 31169 raft_consensus.cc:3060] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.319396 31018 raft_consensus.cc:3055] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.319793 31018 raft_consensus.cc:740] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Running, Role: LEADER
I20260709 13:09:48.320546 31018 consensus_queue.cc:260] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.321592 31018 raft_consensus.cc:3060] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.326683 31169 raft_consensus.cc:2468] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 2.
I20260709 13:09:48.327104 31018 raft_consensus.cc:2468] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 2.
I20260709 13:09:48.328106 31061 leader_election.cc:304] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:48.329107 31220 raft_consensus.cc:2804] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.330247 31220 raft_consensus.cc:697] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 LEADER]: Becoming Leader. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Running, Role: LEADER
I20260709 13:09:48.330960 31220 consensus_queue.cc:237] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.337260 30915 catalog_manager.cc:5697] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 reported cstate change: term changed from 1 to 2, leader changed from 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65) to 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.340375 31249 consensus_queue.cc:1048] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.345693 31249 raft_consensus.cc:993] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04: : Instructing follower 5c382658a46f4bd99e74ea9750916b7b to start an election
I20260709 13:09:48.346228 31213 raft_consensus.cc:1081] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Signalling peer 5c382658a46f4bd99e74ea9750916b7b to start an election
I20260709 13:09:48.347947 31018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61a03085114f4ebabbb523e570c801a4"
dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
 from {username='slave'} at 127.0.0.1:53808
I20260709 13:09:48.348500 31018 raft_consensus.cc:493] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.348713 31249 raft_consensus.cc:993] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04: : Instructing follower 2f11c03dfbff48eb9690cf91e2cb4ac3 to start an election
I20260709 13:09:48.348855 31018 raft_consensus.cc:3060] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.349301 31249 raft_consensus.cc:1081] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Signalling peer 2f11c03dfbff48eb9690cf91e2cb4ac3 to start an election
I20260709 13:09:48.351744 31093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e42a9584abca42a6b79a8b4d1c1ecf2e"
dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
 from {username='slave'} at 127.0.0.1:34990
I20260709 13:09:48.352301 31093 raft_consensus.cc:493] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.352669 31093 raft_consensus.cc:3060] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.356184 31018 raft_consensus.cc:515] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } } peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } }
I20260709 13:09:48.357963 31018 leader_election.cc:290] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 2 election: Requested vote from peers d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:48.359786 31095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a03085114f4ebabbb523e570c801a4" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:48.360423 31095 raft_consensus.cc:3060] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.362473 31248 consensus_queue.cc:1048] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.371325 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a03085114f4ebabbb523e570c801a4" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:48.372140 31169 raft_consensus.cc:3055] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.372495 31169 raft_consensus.cc:740] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:48.373402 31169 consensus_queue.cc:260] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } } peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } }
I20260709 13:09:48.374728 31095 raft_consensus.cc:2468] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 2.
I20260709 13:09:48.374739 31169 raft_consensus.cc:3060] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.375689 31093 raft_consensus.cc:515] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.376179 30986 leader_election.cc:304] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: 
I20260709 13:09:48.376858 31094 raft_consensus.cc:1240] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Rejecting Update request from peer d001d8370bf744e6acc9b7a7e75e5b04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:48.378576 31215 raft_consensus.cc:2804] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.379153 31215 raft_consensus.cc:697] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [term 2 LEADER]: Becoming Leader. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Running, Role: LEADER
I20260709 13:09:48.379379 31248 consensus_queue.cc:1059] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.380129 31249 raft_consensus.cc:3055] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.379982 31215 consensus_queue.cc:237] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } } peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } }
I20260709 13:09:48.380538 31249 raft_consensus.cc:740] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:48.381439 31249 consensus_queue.cc:260] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.382404 31249 raft_consensus.cc:3060] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.384163 31169 raft_consensus.cc:2468] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 2.
I20260709 13:09:48.386464 31093 leader_election.cc:290] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 2 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:48.387708 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a9584abca42a6b79a8b4d1c1ecf2e" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:48.388164 31019 raft_consensus.cc:3060] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.388823 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a9584abca42a6b79a8b4d1c1ecf2e" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:48.392510 30915 catalog_manager.cc:5697] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b reported cstate change: term changed from 1 to 2, leader changed from d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67) to 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65). New cstate: current_term: 2 leader_uuid: "5c382658a46f4bd99e74ea9750916b7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.395712 31019 raft_consensus.cc:2468] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 2.
I20260709 13:09:48.396991 31061 leader_election.cc:304] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: 
I20260709 13:09:48.397672 31169 raft_consensus.cc:2468] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 2.
I20260709 13:09:48.397717 31220 raft_consensus.cc:2804] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.398470 31220 raft_consensus.cc:697] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 LEADER]: Becoming Leader. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Running, Role: LEADER
I20260709 13:09:48.399420 31220 consensus_queue.cc:237] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.407575 30915 catalog_manager.cc:5697] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 reported cstate change: term changed from 1 to 2, leader changed from d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67) to 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.416023 31249 raft_consensus.cc:993] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04: : Instructing follower 5c382658a46f4bd99e74ea9750916b7b to start an election
I20260709 13:09:48.416582 31213 raft_consensus.cc:1081] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Signalling peer 5c382658a46f4bd99e74ea9750916b7b to start an election
I20260709 13:09:48.418187 31019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a53c1d466e14df5b51a71c79aefa5a1"
dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
 from {username='slave'} at 127.0.0.1:53808
I20260709 13:09:48.418608 31019 raft_consensus.cc:493] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.418869 31019 raft_consensus.cc:3060] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.423986 31019 raft_consensus.cc:515] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.425729 31019 leader_election.cc:290] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 2 election: Requested vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:48.426663 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a53c1d466e14df5b51a71c79aefa5a1" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:48.426877 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a53c1d466e14df5b51a71c79aefa5a1" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:48.427461 31169 raft_consensus.cc:3055] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.427433 31093 raft_consensus.cc:3060] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.428128 31169 raft_consensus.cc:740] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:48.429008 31169 consensus_queue.cc:260] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.430320 31169 raft_consensus.cc:3060] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.435402 31093 raft_consensus.cc:2468] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 2.
I20260709 13:09:48.436744 30986 leader_election.cc:304] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: 
I20260709 13:09:48.437489 31215 raft_consensus.cc:2804] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.437578 31169 raft_consensus.cc:2468] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 2.
I20260709 13:09:48.438030 31215 raft_consensus.cc:697] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [term 2 LEADER]: Becoming Leader. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Running, Role: LEADER
I20260709 13:09:48.438931 31215 consensus_queue.cc:237] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.445881 30915 catalog_manager.cc:5697] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b reported cstate change: term changed from 1 to 2, leader changed from d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67) to 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65). New cstate: current_term: 2 leader_uuid: "5c382658a46f4bd99e74ea9750916b7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.495582 31249 raft_consensus.cc:993] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04: : Instructing follower 2f11c03dfbff48eb9690cf91e2cb4ac3 to start an election
I20260709 13:09:48.496057 31213 raft_consensus.cc:1081] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Signalling peer 2f11c03dfbff48eb9690cf91e2cb4ac3 to start an election
I20260709 13:09:48.497766 31093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "031141cccb7a430aa3c07e54cc681b08"
dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
 from {username='slave'} at 127.0.0.1:34990
I20260709 13:09:48.498275 31093 raft_consensus.cc:493] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.498598 31093 raft_consensus.cc:3060] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.504103 31093 raft_consensus.cc:515] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.505913 31093 leader_election.cc:290] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 2 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:48.506824 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031141cccb7a430aa3c07e54cc681b08" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:48.507073 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031141cccb7a430aa3c07e54cc681b08" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:48.507592 31019 raft_consensus.cc:3060] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.507671 31169 raft_consensus.cc:3055] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.508078 31169 raft_consensus.cc:740] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:48.508927 31169 consensus_queue.cc:260] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.510191 31169 raft_consensus.cc:3060] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.515197 31019 raft_consensus.cc:2468] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 2.
I20260709 13:09:48.516448 31061 leader_election.cc:304] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: 
I20260709 13:09:48.517269 31220 raft_consensus.cc:2804] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.517769 31220 raft_consensus.cc:697] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 LEADER]: Becoming Leader. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Running, Role: LEADER
I20260709 13:09:48.518442 31169 raft_consensus.cc:2468] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 2.
I20260709 13:09:48.518630 31220 consensus_queue.cc:237] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.524981 30915 catalog_manager.cc:5697] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 reported cstate change: term changed from 1 to 2, leader changed from d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67) to 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.626736 31169 raft_consensus.cc:1275] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Refusing update from remote peer 5c382658a46f4bd99e74ea9750916b7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.628135 31215 consensus_queue.cc:1048] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.636070 31093 raft_consensus.cc:1275] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Refusing update from remote peer 5c382658a46f4bd99e74ea9750916b7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.637755 31243 consensus_queue.cc:1048] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.680909 31254 raft_consensus.cc:993] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b: : Instructing follower 2f11c03dfbff48eb9690cf91e2cb4ac3 to start an election
I20260709 13:09:48.681378 31243 raft_consensus.cc:1081] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Signalling peer 2f11c03dfbff48eb9690cf91e2cb4ac3 to start an election
I20260709 13:09:48.683002 31093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f85ba457bfe94972ac7bdd03a7bf399d"
dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
 from {username='slave'} at 127.0.0.1:35002
I20260709 13:09:48.683511 31093 raft_consensus.cc:493] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.683964 31093 raft_consensus.cc:3060] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.688851 31093 raft_consensus.cc:515] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.690326 31093 leader_election.cc:290] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 2 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:48.691215 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ba457bfe94972ac7bdd03a7bf399d" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:48.691557 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ba457bfe94972ac7bdd03a7bf399d" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:48.691941 31019 raft_consensus.cc:3055] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.692199 31169 raft_consensus.cc:3060] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.692335 31019 raft_consensus.cc:740] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Running, Role: LEADER
I20260709 13:09:48.693214 31019 consensus_queue.cc:260] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.694492 31019 raft_consensus.cc:3060] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.699478 31169 raft_consensus.cc:2468] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 2.
I20260709 13:09:48.700749 31061 leader_election.cc:304] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:48.701521 31220 raft_consensus.cc:2804] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.701642 31019 raft_consensus.cc:2468] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 2.
I20260709 13:09:48.702047 31220 raft_consensus.cc:697] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 LEADER]: Becoming Leader. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Running, Role: LEADER
I20260709 13:09:48.702991 31220 consensus_queue.cc:237] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:48.708904 30918 catalog_manager.cc:5697] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 reported cstate change: term changed from 1 to 2, leader changed from 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65) to 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.766211 31169 raft_consensus.cc:1275] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Refusing update from remote peer 5c382658a46f4bd99e74ea9750916b7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.767498 31243 consensus_queue.cc:1048] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.774910 31093 raft_consensus.cc:1275] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Refusing update from remote peer 5c382658a46f4bd99e74ea9750916b7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.776713 31215 consensus_queue.cc:1048] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.778564 31019 raft_consensus.cc:1275] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Refusing update from remote peer 2f11c03dfbff48eb9690cf91e2cb4ac3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.780211 31220 consensus_queue.cc:1048] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.789206 31169 raft_consensus.cc:1275] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Refusing update from remote peer 2f11c03dfbff48eb9690cf91e2cb4ac3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.791467 31284 consensus_queue.cc:1048] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.808420 31169 raft_consensus.cc:1275] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Refusing update from remote peer 2f11c03dfbff48eb9690cf91e2cb4ac3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.809594 31220 consensus_queue.cc:1048] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.822532 31019 raft_consensus.cc:1275] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Refusing update from remote peer 2f11c03dfbff48eb9690cf91e2cb4ac3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.825076 31284 consensus_queue.cc:1048] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.825557 31093 raft_consensus.cc:1275] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Refusing update from remote peer 5c382658a46f4bd99e74ea9750916b7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.827019 31215 consensus_queue.cc:1048] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.836903 31169 raft_consensus.cc:1275] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Refusing update from remote peer 5c382658a46f4bd99e74ea9750916b7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.838385 31280 consensus_queue.cc:1048] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.096541 31019 raft_consensus.cc:1275] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Refusing update from remote peer 2f11c03dfbff48eb9690cf91e2cb4ac3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.097903 31284 consensus_queue.cc:1048] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.106478 31169 raft_consensus.cc:1275] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Refusing update from remote peer 2f11c03dfbff48eb9690cf91e2cb4ac3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.109153 31287 consensus_queue.cc:1048] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.185005 31019 raft_consensus.cc:1275] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Refusing update from remote peer 2f11c03dfbff48eb9690cf91e2cb4ac3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.186519 31287 consensus_queue.cc:1048] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.195421 31169 raft_consensus.cc:1275] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Refusing update from remote peer 2f11c03dfbff48eb9690cf91e2cb4ac3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.197644 31220 consensus_queue.cc:1048] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.150177 30915 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56504:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:51.153610 30915 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:51.209168 31006 tablet_service.cc:1511] Processing CreateTablet for tablet b0ddc62d5ccb4bf4820717c6eb8bc29c (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:51.210379 31078 tablet_service.cc:1511] Processing CreateTablet for tablet b0ddc62d5ccb4bf4820717c6eb8bc29c (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:51.212208 31078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ddc62d5ccb4bf4820717c6eb8bc29c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.212251 31157 tablet_service.cc:1511] Processing CreateTablet for tablet b0ddc62d5ccb4bf4820717c6eb8bc29c (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:51.212908 31005 tablet_service.cc:1511] Processing CreateTablet for tablet f7cb19b823c4489fbf5f31428feb94df (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:51.216039 31081 tablet_service.cc:1511] Processing CreateTablet for tablet f7cb19b823c4489fbf5f31428feb94df (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:51.217466 31081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7cb19b823c4489fbf5f31428feb94df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.222388 31009 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae514d5d69940acaa48d2a8dba5a83d (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:51.224552 31079 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae514d5d69940acaa48d2a8dba5a83d (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:51.225035 31153 tablet_service.cc:1511] Processing CreateTablet for tablet f7cb19b823c4489fbf5f31428feb94df (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:51.226292 31079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae514d5d69940acaa48d2a8dba5a83d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.227895 31006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ddc62d5ccb4bf4820717c6eb8bc29c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.228708 31152 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae514d5d69940acaa48d2a8dba5a83d (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:51.213882 31157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ddc62d5ccb4bf4820717c6eb8bc29c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.230197 31152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae514d5d69940acaa48d2a8dba5a83d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.232849 31009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae514d5d69940acaa48d2a8dba5a83d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.232999 31010 tablet_service.cc:1511] Processing CreateTablet for tablet 88189344ff05453a904357390f6981b8 (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:51.234493 31010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88189344ff05453a904357390f6981b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.239394 31005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7cb19b823c4489fbf5f31428feb94df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.241432 31153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7cb19b823c4489fbf5f31428feb94df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.250129 31155 tablet_service.cc:1511] Processing CreateTablet for tablet 88189344ff05453a904357390f6981b8 (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:51.250401 31007 tablet_service.cc:1511] Processing CreateTablet for tablet 0816779035984a5cad888f259370be09 (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:51.251638 31155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88189344ff05453a904357390f6981b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.251861 31007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0816779035984a5cad888f259370be09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.256122 31154 tablet_service.cc:1511] Processing CreateTablet for tablet 0816779035984a5cad888f259370be09 (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:51.257589 31154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0816779035984a5cad888f259370be09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.259040 31004 tablet_service.cc:1511] Processing CreateTablet for tablet eaaf0a7aa5bf460692de45930b3e6da5 (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:51.260438 31004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaaf0a7aa5bf460692de45930b3e6da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.264253 31083 tablet_service.cc:1511] Processing CreateTablet for tablet 88189344ff05453a904357390f6981b8 (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:51.265722 31083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88189344ff05453a904357390f6981b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.268867 31082 tablet_service.cc:1511] Processing CreateTablet for tablet 0816779035984a5cad888f259370be09 (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:51.270283 31082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0816779035984a5cad888f259370be09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.291165 31084 tablet_service.cc:1511] Processing CreateTablet for tablet eaaf0a7aa5bf460692de45930b3e6da5 (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:51.292677 31084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaaf0a7aa5bf460692de45930b3e6da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.299269 31158 tablet_service.cc:1511] Processing CreateTablet for tablet eaaf0a7aa5bf460692de45930b3e6da5 (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:51.301415 31158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaaf0a7aa5bf460692de45930b3e6da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.314661 31077 tablet_service.cc:1511] Processing CreateTablet for tablet a6d34d28bac44d3a8c7c758c010646dc (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:51.316295 31077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d34d28bac44d3a8c7c758c010646dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.326371 31156 tablet_service.cc:1511] Processing CreateTablet for tablet a6d34d28bac44d3a8c7c758c010646dc (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:51.327900 31156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d34d28bac44d3a8c7c758c010646dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.363448 31085 tablet_service.cc:1511] Processing CreateTablet for tablet 7fa69a77796d4eff8052c4f02b27668b (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:51.365067 31085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fa69a77796d4eff8052c4f02b27668b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.374877 31159 tablet_service.cc:1511] Processing CreateTablet for tablet 7fa69a77796d4eff8052c4f02b27668b (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:51.376166 31306 tablet_bootstrap.cc:492] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:51.376577 31159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fa69a77796d4eff8052c4f02b27668b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.380155 31010 tablet_service.cc:1511] Processing CreateTablet for tablet 7fa69a77796d4eff8052c4f02b27668b (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:51.381871 31010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fa69a77796d4eff8052c4f02b27668b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.383993 31009 tablet_service.cc:1511] Processing CreateTablet for tablet 53b9895f1f274252a696a22d22f8f12a (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:51.385396 31009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b9895f1f274252a696a22d22f8f12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.387986 31005 tablet_service.cc:1511] Processing CreateTablet for tablet a6d34d28bac44d3a8c7c758c010646dc (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:51.389415 31005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d34d28bac44d3a8c7c758c010646dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.424851 31305 tablet_bootstrap.cc:492] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
W20260709 13:09:51.435197 30966 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:51.442171 31307 tablet_bootstrap.cc:492] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:51.442332 31084 tablet_service.cc:1511] Processing CreateTablet for tablet 53b9895f1f274252a696a22d22f8f12a (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:51.445518 31084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b9895f1f274252a696a22d22f8f12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.443145 31305 tablet_bootstrap.cc:654] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.446616 31159 tablet_service.cc:1511] Processing CreateTablet for tablet 53b9895f1f274252a696a22d22f8f12a (DEFAULT_TABLE table=soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:51.448149 31159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b9895f1f274252a696a22d22f8f12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.455080 31306 tablet_bootstrap.cc:654] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.457089 31307 tablet_bootstrap.cc:654] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.466063 31305 tablet_bootstrap.cc:492] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:51.466699 31305 ts_tablet_manager.cc:1403] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.008s
I20260709 13:09:51.470618 31305 raft_consensus.cc:359] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.471818 31305 raft_consensus.cc:385] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.472203 31305 raft_consensus.cc:740] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.473714 31307 tablet_bootstrap.cc:492] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:51.474368 31307 ts_tablet_manager.cc:1403] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.005s
I20260709 13:09:51.475595 31306 tablet_bootstrap.cc:492] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:51.474164 31305 consensus_queue.cc:260] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.476311 31306 ts_tablet_manager.cc:1403] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.101s	user 0.008s	sys 0.008s
I20260709 13:09:51.478505 31305 ts_tablet_manager.cc:1434] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:51.477708 31307 raft_consensus.cc:359] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.479038 31307 raft_consensus.cc:385] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.479389 31307 raft_consensus.cc:740] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.479733 31305 tablet_bootstrap.cc:492] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:51.480196 31307 consensus_queue.cc:260] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.485124 31307 ts_tablet_manager.cc:1434] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:51.486331 31307 tablet_bootstrap.cc:492] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:51.487564 31305 tablet_bootstrap.cc:654] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:51.489743 31121 tablet.cc:2406] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:51.493793 31305 tablet_bootstrap.cc:492] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:51.494446 31305 ts_tablet_manager.cc:1403] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:09:51.495951 31307 tablet_bootstrap.cc:654] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.497670 31306 raft_consensus.cc:359] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.498353 31306 raft_consensus.cc:385] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.498610 31306 raft_consensus.cc:740] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.498698 31305 raft_consensus.cc:359] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.499330 31306 consensus_queue.cc:260] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.499703 31305 raft_consensus.cc:385] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.500053 31305 raft_consensus.cc:740] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.501120 31305 consensus_queue.cc:260] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.503400 31307 tablet_bootstrap.cc:492] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:51.503559 31305 ts_tablet_manager.cc:1434] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:51.504063 31307 ts_tablet_manager.cc:1403] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 13:09:51.504619 31305 tablet_bootstrap.cc:492] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:51.507639 31307 raft_consensus.cc:359] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.508534 31307 raft_consensus.cc:385] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.508881 31307 raft_consensus.cc:740] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.509652 31307 consensus_queue.cc:260] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.512245 31307 ts_tablet_manager.cc:1434] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:51.513232 31307 tablet_bootstrap.cc:492] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:51.514278 31306 ts_tablet_manager.cc:1434] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.002s
I20260709 13:09:51.516459 31305 tablet_bootstrap.cc:654] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.520083 31307 tablet_bootstrap.cc:654] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.520366 31306 tablet_bootstrap.cc:492] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:51.530009 31306 tablet_bootstrap.cc:654] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.530560 31305 tablet_bootstrap.cc:492] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:51.531230 31305 ts_tablet_manager.cc:1403] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 13:09:51.531708 31307 tablet_bootstrap.cc:492] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:51.532312 31307 ts_tablet_manager.cc:1403] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.008s
I20260709 13:09:51.534467 31305 raft_consensus.cc:359] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.535183 31305 raft_consensus.cc:385] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.535456 31305 raft_consensus.cc:740] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.535893 31306 tablet_bootstrap.cc:492] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:51.535418 31307 raft_consensus.cc:359] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.536468 31306 ts_tablet_manager.cc:1403] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.001s
I20260709 13:09:51.536428 31307 raft_consensus.cc:385] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.536371 31305 consensus_queue.cc:260] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.537170 31307 raft_consensus.cc:740] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.538045 31307 consensus_queue.cc:260] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.538892 31305 ts_tablet_manager.cc:1434] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:51.539999 31305 tablet_bootstrap.cc:492] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:51.539948 31306 raft_consensus.cc:359] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.540918 31306 raft_consensus.cc:385] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.541033 31307 ts_tablet_manager.cc:1434] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:51.541266 31306 raft_consensus.cc:740] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.542143 31307 tablet_bootstrap.cc:492] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:51.542279 31306 consensus_queue.cc:260] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.544938 31306 ts_tablet_manager.cc:1434] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:51.546028 31306 tablet_bootstrap.cc:492] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:51.547722 31305 tablet_bootstrap.cc:654] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.550312 31307 tablet_bootstrap.cc:654] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.553169 31306 tablet_bootstrap.cc:654] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.559715 31305 tablet_bootstrap.cc:492] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:51.560331 31305 ts_tablet_manager.cc:1403] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:09:51.562635 31307 tablet_bootstrap.cc:492] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:51.563303 31307 ts_tablet_manager.cc:1403] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.021s	user 0.003s	sys 0.017s
I20260709 13:09:51.563556 31306 tablet_bootstrap.cc:492] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:51.563722 31305 raft_consensus.cc:359] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.564792 31305 raft_consensus.cc:385] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.565166 31305 raft_consensus.cc:740] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.565971 31305 consensus_queue.cc:260] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.566722 31307 raft_consensus.cc:359] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.567680 31307 raft_consensus.cc:385] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.564411 31306 ts_tablet_manager.cc:1403] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:09:51.568023 31307 raft_consensus.cc:740] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.568547 31305 ts_tablet_manager.cc:1434] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:09:51.569104 31307 consensus_queue.cc:260] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.569679 31305 tablet_bootstrap.cc:492] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:51.571708 31307 ts_tablet_manager.cc:1434] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:09:51.571772 31306 raft_consensus.cc:359] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.572597 31306 raft_consensus.cc:385] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.572903 31307 tablet_bootstrap.cc:492] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:51.572932 31306 raft_consensus.cc:740] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.574108 31306 consensus_queue.cc:260] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.576980 31306 ts_tablet_manager.cc:1434] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:51.577340 31305 tablet_bootstrap.cc:654] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.578106 31306 tablet_bootstrap.cc:492] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:51.580713 31307 tablet_bootstrap.cc:654] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.586333 31306 tablet_bootstrap.cc:654] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.588173 31300 raft_consensus.cc:493] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.588750 31300 raft_consensus.cc:515] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.589469 31305 tablet_bootstrap.cc:492] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:51.590122 31305 ts_tablet_manager.cc:1403] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.010s
I20260709 13:09:51.592234 31094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ddc62d5ccb4bf4820717c6eb8bc29c" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:51.593084 31094 raft_consensus.cc:2468] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 0.
I20260709 13:09:51.592971 31307 tablet_bootstrap.cc:492] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:51.593904 31307 ts_tablet_manager.cc:1403] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.002s
I20260709 13:09:51.593257 31305 raft_consensus.cc:359] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.594391 31305 raft_consensus.cc:385] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.594763 31305 raft_consensus.cc:740] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.594882 30986 leader_election.cc:304] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: 
I20260709 13:09:51.595616 31305 consensus_queue.cc:260] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.596082 31293 raft_consensus.cc:2804] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.596521 31293 raft_consensus.cc:493] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.596837 31293 raft_consensus.cc:3060] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.597147 31307 raft_consensus.cc:359] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.597893 31307 raft_consensus.cc:385] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.598197 31307 raft_consensus.cc:740] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.599207 31307 consensus_queue.cc:260] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.602022 31307 ts_tablet_manager.cc:1434] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:09:51.603570 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ddc62d5ccb4bf4820717c6eb8bc29c" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" is_pre_election: true
I20260709 13:09:51.604239 31169 raft_consensus.cc:2468] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 0.
I20260709 13:09:51.611240 31307 tablet_bootstrap.cc:492] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:51.611929 31300 leader_election.cc:290] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.614130 31293 raft_consensus.cc:515] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.617195 31094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ddc62d5ccb4bf4820717c6eb8bc29c" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:51.617779 31094 raft_consensus.cc:3060] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.624903 31307 tablet_bootstrap.cc:654] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.630183 31305 ts_tablet_manager.cc:1434] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.040s	user 0.023s	sys 0.007s
I20260709 13:09:51.631407 31305 tablet_bootstrap.cc:492] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:51.636770 31168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ddc62d5ccb4bf4820717c6eb8bc29c" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:51.637727 31168 raft_consensus.cc:3060] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.638398 31305 tablet_bootstrap.cc:654] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.650036 31168 raft_consensus.cc:2468] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 1.
I20260709 13:09:51.651087 31293 leader_election.cc:290] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 election: Requested vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.654080 31293 raft_consensus.cc:493] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.654433 30986 leader_election.cc:304] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:51.656751 31248 raft_consensus.cc:493] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.657608 31293 raft_consensus.cc:515] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.657642 31248 raft_consensus.cc:515] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.661136 31305 tablet_bootstrap.cc:492] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:51.661850 31284 raft_consensus.cc:493] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.663278 31305 ts_tablet_manager.cc:1403] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.005s
I20260709 13:09:51.662165 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cb19b823c4489fbf5f31428feb94df" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b" is_pre_election: true
I20260709 13:09:51.663484 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cb19b823c4489fbf5f31428feb94df" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:51.663141 31284 raft_consensus.cc:515] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.664237 31248 leader_election.cc:290] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:51.656849 31322 raft_consensus.cc:2804] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:51.665607 31322 raft_consensus.cc:697] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Becoming Leader. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Running, Role: LEADER
I20260709 13:09:51.665805 31284 leader_election.cc:290] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.666538 31322 consensus_queue.cc:237] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.667789 31168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cb19b823c4489fbf5f31428feb94df" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" is_pre_election: true
I20260709 13:09:51.668462 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cb19b823c4489fbf5f31428feb94df" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b" is_pre_election: true
I20260709 13:09:51.668802 31168 raft_consensus.cc:2468] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 0.
I20260709 13:09:51.655396 31094 raft_consensus.cc:2468] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 1.
I20260709 13:09:51.670236 31305 raft_consensus.cc:359] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.670704 31061 leader_election.cc:304] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:51.671222 31305 raft_consensus.cc:385] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.671612 31305 raft_consensus.cc:740] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.672176 31093 raft_consensus.cc:2468] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 0.
I20260709 13:09:51.672461 31305 consensus_queue.cc:260] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.673919 31019 raft_consensus.cc:2468] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 0.
I20260709 13:09:51.675634 31305 ts_tablet_manager.cc:1434] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:09:51.675184 31135 leader_election.cc:304] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:51.677033 31305 tablet_bootstrap.cc:492] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:51.677383 31284 raft_consensus.cc:2804] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.677577 31248 raft_consensus.cc:2804] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.677903 31284 raft_consensus.cc:493] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.678467 31284 raft_consensus.cc:3060] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.679353 31293 leader_election.cc:290] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.678012 31248 raft_consensus.cc:493] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.679946 31248 raft_consensus.cc:3060] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.682160 31168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cb19b823c4489fbf5f31428feb94df" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" is_pre_election: true
I20260709 13:09:51.676992 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cb19b823c4489fbf5f31428feb94df" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:51.690451 31307 tablet_bootstrap.cc:492] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:51.690248 30916 catalog_manager.cc:5697] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65). New cstate: current_term: 1 leader_uuid: "5c382658a46f4bd99e74ea9750916b7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.691095 31307 ts_tablet_manager.cc:1403] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.080s	user 0.028s	sys 0.037s
I20260709 13:09:51.694339 31284 raft_consensus.cc:515] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.694510 31307 raft_consensus.cc:359] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.694643 31248 raft_consensus.cc:515] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.698181 31307 raft_consensus.cc:385] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.698473 31093 raft_consensus.cc:2393] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c382658a46f4bd99e74ea9750916b7b in current term 1: Already voted for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in this term.
I20260709 13:09:51.698572 31307 raft_consensus.cc:740] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.699775 31307 consensus_queue.cc:260] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.701218 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cb19b823c4489fbf5f31428feb94df" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:51.701730 31284 leader_election.cc:290] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.702077 31019 raft_consensus.cc:3060] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.698802 31168 raft_consensus.cc:2393] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c382658a46f4bd99e74ea9750916b7b in current term 1: Already voted for candidate d001d8370bf744e6acc9b7a7e75e5b04 in this term.
I20260709 13:09:51.704295 30986 leader_election.cc:304] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b; no voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04
I20260709 13:09:51.697650 31305 tablet_bootstrap.cc:654] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.711733 31307 ts_tablet_manager.cc:1434] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 13:09:51.711867 31168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cb19b823c4489fbf5f31428feb94df" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:51.712761 31168 raft_consensus.cc:2393] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in current term 1: Already voted for candidate d001d8370bf744e6acc9b7a7e75e5b04 in this term.
I20260709 13:09:51.713054 31307 tablet_bootstrap.cc:492] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:51.713292 31305 tablet_bootstrap.cc:492] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:51.713891 31305 ts_tablet_manager.cc:1403] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.000s
I20260709 13:09:51.714730 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cb19b823c4489fbf5f31428feb94df" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:51.716430 31061 leader_election.cc:304] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3; no voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04
I20260709 13:09:51.716892 31305 raft_consensus.cc:359] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.717630 31305 raft_consensus.cc:385] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.717995 31305 raft_consensus.cc:740] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.718791 31305 consensus_queue.cc:260] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.717828 31326 raft_consensus.cc:2749] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:51.719722 31019 raft_consensus.cc:2468] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 1.
I20260709 13:09:51.720270 31322 raft_consensus.cc:2749] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:51.721338 31305 ts_tablet_manager.cc:1434] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:51.697419 31306 tablet_bootstrap.cc:492] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:51.722488 31305 tablet_bootstrap.cc:492] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:51.722847 31306 ts_tablet_manager.cc:1403] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.145s	user 0.013s	sys 0.011s
I20260709 13:09:51.723130 31307 tablet_bootstrap.cc:654] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.726089 31306 raft_consensus.cc:359] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.735842 31306 raft_consensus.cc:385] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.734392 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cb19b823c4489fbf5f31428feb94df" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:51.736583 31306 raft_consensus.cc:740] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.736968 31093 raft_consensus.cc:2393] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d001d8370bf744e6acc9b7a7e75e5b04 in current term 1: Already voted for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in this term.
I20260709 13:09:51.737568 31306 consensus_queue.cc:260] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.742056 31135 leader_election.cc:304] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 2f11c03dfbff48eb9690cf91e2cb4ac3
I20260709 13:09:51.735373 31248 leader_election.cc:290] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:51.729665 31305 tablet_bootstrap.cc:654] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.743607 31248 raft_consensus.cc:2804] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:51.744196 31248 raft_consensus.cc:697] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Becoming Leader. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:51.745077 31248 consensus_queue.cc:237] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.776013 31305 tablet_bootstrap.cc:492] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:51.776540 31305 ts_tablet_manager.cc:1403] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.019s
I20260709 13:09:51.778285 31307 tablet_bootstrap.cc:492] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:51.778869 31307 ts_tablet_manager.cc:1403] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.066s	user 0.027s	sys 0.022s
I20260709 13:09:51.778901 31305 raft_consensus.cc:359] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.779860 31305 raft_consensus.cc:385] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.780400 31305 raft_consensus.cc:740] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.779852 30917 catalog_manager.cc:5697] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67). New cstate: current_term: 1 leader_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:51.782480 31306 ts_tablet_manager.cc:1434] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.059s	user 0.016s	sys 0.008s
I20260709 13:09:51.782382 31307 raft_consensus.cc:359] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.782527 31305 consensus_queue.cc:260] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.783327 31307 raft_consensus.cc:385] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.783780 31307 raft_consensus.cc:740] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.783954 31306 tablet_bootstrap.cc:492] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:51.784615 31307 consensus_queue.cc:260] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.785279 31305 ts_tablet_manager.cc:1434] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:09:51.787389 31307 ts_tablet_manager.cc:1434] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
I20260709 13:09:51.788475 31307 tablet_bootstrap.cc:492] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:51.791539 31306 tablet_bootstrap.cc:654] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.795922 31307 tablet_bootstrap.cc:654] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.801905 31305 tablet_bootstrap.cc:492] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b: Bootstrap starting.
I20260709 13:09:51.803566 31306 tablet_bootstrap.cc:492] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:51.804159 31306 ts_tablet_manager.cc:1403] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.006s
I20260709 13:09:51.807467 31306 raft_consensus.cc:359] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.808156 31305 tablet_bootstrap.cc:654] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.808458 31306 raft_consensus.cc:385] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.808781 31326 raft_consensus.cc:493] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.808821 31306 raft_consensus.cc:740] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.809389 31326 raft_consensus.cc:515] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.809885 31306 consensus_queue.cc:260] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.812515 31306 ts_tablet_manager.cc:1434] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:51.813611 31306 tablet_bootstrap.cc:492] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:51.811736 31326 leader_election.cc:290] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.818650 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d34d28bac44d3a8c7c758c010646dc" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b" is_pre_election: true
I20260709 13:09:51.818895 31168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d34d28bac44d3a8c7c758c010646dc" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" is_pre_election: true
I20260709 13:09:51.819628 31019 raft_consensus.cc:2468] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 0.
W20260709 13:09:51.820240 31061 leader_election.cc:343] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.821329 31061 leader_election.cc:304] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: d001d8370bf744e6acc9b7a7e75e5b04
I20260709 13:09:51.822572 31326 raft_consensus.cc:2804] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.823045 31326 raft_consensus.cc:493] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.823467 31326 raft_consensus.cc:3060] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.825814 31284 raft_consensus.cc:493] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.826516 31307 tablet_bootstrap.cc:492] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:51.826341 31284 raft_consensus.cc:515] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.826788 31305 tablet_bootstrap.cc:492] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b: No bootstrap required, opened a new log
I20260709 13:09:51.827066 31307 ts_tablet_manager.cc:1403] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.007s
I20260709 13:09:51.827394 31305 ts_tablet_manager.cc:1403] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.000s
I20260709 13:09:51.828460 31284 leader_election.cc:290] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.830017 31307 raft_consensus.cc:359] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.830227 31305 raft_consensus.cc:359] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.830754 31307 raft_consensus.cc:385] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.830993 31305 raft_consensus.cc:385] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.831252 31307 raft_consensus.cc:740] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.831489 31305 raft_consensus.cc:740] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.831705 31168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88189344ff05453a904357390f6981b8" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" is_pre_election: true
I20260709 13:09:51.830856 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88189344ff05453a904357390f6981b8" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b" is_pre_election: true
I20260709 13:09:51.832404 31168 raft_consensus.cc:2468] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 0.
I20260709 13:09:51.832305 31307 consensus_queue.cc:260] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.832332 31326 raft_consensus.cc:515] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.834038 31061 leader_election.cc:304] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:51.834498 31306 tablet_bootstrap.cc:654] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.834740 31307 ts_tablet_manager.cc:1434] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:09:51.835060 31326 leader_election.cc:290] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.835338 31019 raft_consensus.cc:2468] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 0.
I20260709 13:09:51.835846 31307 tablet_bootstrap.cc:492] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3: Bootstrap starting.
I20260709 13:09:51.835986 31326 raft_consensus.cc:2804] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.836465 31326 raft_consensus.cc:493] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.836843 31326 raft_consensus.cc:3060] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.841470 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d34d28bac44d3a8c7c758c010646dc" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:51.842139 31018 raft_consensus.cc:3060] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.843143 31307 tablet_bootstrap.cc:654] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.842689 31305 consensus_queue.cc:260] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.850306 31305 ts_tablet_manager.cc:1434] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:09:51.854280 31326 raft_consensus.cc:515] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.855705 31168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d34d28bac44d3a8c7c758c010646dc" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:51.857169 31326 leader_election.cc:290] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.859030 31306 tablet_bootstrap.cc:492] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:51.859639 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88189344ff05453a904357390f6981b8" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:51.860209 31168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88189344ff05453a904357390f6981b8" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:51.860337 31020 raft_consensus.cc:3060] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.860870 31168 raft_consensus.cc:3060] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:51.860242 31061 leader_election.cc:343] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.859692 31306 ts_tablet_manager.cc:1403] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.014s
I20260709 13:09:51.868170 31326 raft_consensus.cc:493] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.868803 31168 raft_consensus.cc:2468] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 1.
I20260709 13:09:51.869400 31020 raft_consensus.cc:2468] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 1.
I20260709 13:09:51.868686 31326 raft_consensus.cc:515] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.871681 31326 leader_election.cc:290] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.874020 31307 tablet_bootstrap.cc:492] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3: No bootstrap required, opened a new log
I20260709 13:09:51.874588 31307 ts_tablet_manager.cc:1403] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.007s
I20260709 13:09:51.877354 31307 raft_consensus.cc:359] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.878176 31307 raft_consensus.cc:385] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.878449 31307 raft_consensus.cc:740] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.879083 31307 consensus_queue.cc:260] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.880638 31322 raft_consensus.cc:493] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.881150 31322 raft_consensus.cc:515] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.882325 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0816779035984a5cad888f259370be09" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b" is_pre_election: true
I20260709 13:09:51.869310 31306 raft_consensus.cc:359] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.883028 31020 raft_consensus.cc:2468] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 0.
I20260709 13:09:51.883498 31306 raft_consensus.cc:385] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.883982 31306 raft_consensus.cc:740] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.884759 31306 consensus_queue.cc:260] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.885224 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf0a7aa5bf460692de45930b3e6da5" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:51.885957 31093 raft_consensus.cc:2468] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 0.
I20260709 13:09:51.886670 31306 ts_tablet_manager.cc:1434] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:09:51.883404 31168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0816779035984a5cad888f259370be09" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" is_pre_election: true
I20260709 13:09:51.886952 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf0a7aa5bf460692de45930b3e6da5" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" is_pre_election: true
I20260709 13:09:51.887537 31168 raft_consensus.cc:2468] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 0.
I20260709 13:09:51.887801 31306 tablet_bootstrap.cc:492] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
W20260709 13:09:51.888734 30986 leader_election.cc:343] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.888995 31061 leader_election.cc:304] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: 
I20260709 13:09:51.889473 30986 leader_election.cc:304] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: d001d8370bf744e6acc9b7a7e75e5b04
I20260709 13:09:51.889988 31061 leader_election.cc:304] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: 
I20260709 13:09:51.890704 31336 raft_consensus.cc:2804] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:51.891371 31293 raft_consensus.cc:2804] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.891796 31293 raft_consensus.cc:493] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.892128 31293 raft_consensus.cc:3060] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.893136 31018 raft_consensus.cc:2468] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 1.
I20260709 13:09:51.894398 31284 raft_consensus.cc:2804] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.895201 31336 raft_consensus.cc:697] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Becoming Leader. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Running, Role: LEADER
I20260709 13:09:51.895404 31306 tablet_bootstrap.cc:654] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.896111 31336 consensus_queue.cc:237] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.894812 31284 raft_consensus.cc:493] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.883204 31322 leader_election.cc:290] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.899271 31284 raft_consensus.cc:3060] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.900907 31293 raft_consensus.cc:515] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.904290 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf0a7aa5bf460692de45930b3e6da5" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:51.904922 31093 raft_consensus.cc:3060] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.908314 31306 tablet_bootstrap.cc:492] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:51.908838 31307 ts_tablet_manager.cc:1434] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 13:09:51.909008 31306 ts_tablet_manager.cc:1403] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.010s
I20260709 13:09:51.911362 31168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf0a7aa5bf460692de45930b3e6da5" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:51.912415 31306 raft_consensus.cc:359] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
W20260709 13:09:51.912770 30986 leader_election.cc:343] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.912976 31322 raft_consensus.cc:493] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.913276 31306 raft_consensus.cc:385] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.913424 31093 raft_consensus.cc:2468] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 1.
I20260709 13:09:51.913789 31306 raft_consensus.cc:740] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.913731 31322 raft_consensus.cc:515] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.914700 30986 leader_election.cc:304] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: d001d8370bf744e6acc9b7a7e75e5b04
I20260709 13:09:51.914798 31306 consensus_queue.cc:260] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.915541 31300 raft_consensus.cc:2804] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:51.915875 31322 leader_election.cc:290] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.916568 31293 leader_election.cc:290] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 election: Requested vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.917486 31306 ts_tablet_manager.cc:1434] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:09:51.918480 31306 tablet_bootstrap.cc:492] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:51.918855 31094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae514d5d69940acaa48d2a8dba5a83d" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:51.919585 31094 raft_consensus.cc:2468] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 0.
I20260709 13:09:51.919838 31284 raft_consensus.cc:515] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.921366 31168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae514d5d69940acaa48d2a8dba5a83d" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" is_pre_election: true
I20260709 13:09:51.922045 31168 raft_consensus.cc:2468] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 0.
I20260709 13:09:51.923533 30986 leader_election.cc:304] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:51.924023 31306 tablet_bootstrap.cc:654] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.918718 31061 leader_election.cc:304] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: d001d8370bf744e6acc9b7a7e75e5b04
I20260709 13:09:51.924700 31293 raft_consensus.cc:2804] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.925145 31293 raft_consensus.cc:493] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.925602 31293 raft_consensus.cc:3060] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.932466 31326 raft_consensus.cc:2804] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:51.933674 31300 raft_consensus.cc:697] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Becoming Leader. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Running, Role: LEADER
I20260709 13:09:51.934692 31293 raft_consensus.cc:515] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.934864 31300 consensus_queue.cc:237] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.937892 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae514d5d69940acaa48d2a8dba5a83d" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:51.938998 31093 raft_consensus.cc:3060] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.941028 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0816779035984a5cad888f259370be09" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:51.941926 31018 raft_consensus.cc:3060] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.944628 31306 tablet_bootstrap.cc:492] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:51.945250 31306 ts_tablet_manager.cc:1403] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.004s
I20260709 13:09:51.947737 31343 raft_consensus.cc:493] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.948588 31343 raft_consensus.cc:515] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.951874 31343 leader_election.cc:290] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.922143 31284 leader_election.cc:290] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.945639 31326 raft_consensus.cc:697] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Becoming Leader. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Running, Role: LEADER
I20260709 13:09:51.957676 31293 leader_election.cc:290] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 election: Requested vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.957798 31326 consensus_queue.cc:237] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.961268 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae514d5d69940acaa48d2a8dba5a83d" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:51.961884 31169 raft_consensus.cc:3060] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.962090 31168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0816779035984a5cad888f259370be09" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:51.962738 31168 raft_consensus.cc:3060] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.965723 31093 raft_consensus.cc:2468] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 1.
I20260709 13:09:51.957350 31284 raft_consensus.cc:493] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.967073 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa69a77796d4eff8052c4f02b27668b" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b" is_pre_election: true
I20260709 13:09:51.967092 30986 leader_election.cc:304] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: 
I20260709 13:09:51.967923 31020 raft_consensus.cc:2468] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 0.
I20260709 13:09:51.968268 31293 raft_consensus.cc:2804] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:51.968382 31167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa69a77796d4eff8052c4f02b27668b" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" is_pre_election: true
I20260709 13:09:51.968920 31293 raft_consensus.cc:697] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Becoming Leader. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Running, Role: LEADER
I20260709 13:09:51.969091 31167 raft_consensus.cc:2468] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 0.
I20260709 13:09:51.972765 31169 raft_consensus.cc:2468] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 1.
I20260709 13:09:51.963809 30915 catalog_manager.cc:5697] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65). New cstate: current_term: 1 leader_uuid: "5c382658a46f4bd99e74ea9750916b7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.971289 31293 consensus_queue.cc:237] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.974938 31061 leader_election.cc:304] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:51.967074 31284 raft_consensus.cc:515] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.976233 30916 catalog_manager.cc:5697] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.977475 31284 leader_election.cc:290] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:51.978024 31284 raft_consensus.cc:2804] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.978328 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b9895f1f274252a696a22d22f8f12a" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b" is_pre_election: true
I20260709 13:09:51.979012 31020 raft_consensus.cc:2468] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 0.
I20260709 13:09:51.981666 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b9895f1f274252a696a22d22f8f12a" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" is_pre_election: true
I20260709 13:09:51.982625 31306 raft_consensus.cc:359] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:51.983389 31306 raft_consensus.cc:385] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.983651 31306 raft_consensus.cc:740] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.981848 31168 raft_consensus.cc:2468] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 1.
I20260709 13:09:51.983763 31061 leader_election.cc:304] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: 
I20260709 13:09:51.984359 31306 consensus_queue.cc:260] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
W20260709 13:09:51.985618 31061 leader_election.cc:343] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.986594 31061 leader_election.cc:304] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:51.978355 31284 raft_consensus.cc:493] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.987919 31284 raft_consensus.cc:3060] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.989552 31344 raft_consensus.cc:2804] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.989997 31344 raft_consensus.cc:493] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.990329 31344 raft_consensus.cc:3060] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.987478 31306 ts_tablet_manager.cc:1434] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:09:51.991642 31306 tablet_bootstrap.cc:492] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04: Bootstrap starting.
I20260709 13:09:51.994230 31336 raft_consensus.cc:2804] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:51.999621 31336 raft_consensus.cc:697] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Becoming Leader. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Running, Role: LEADER
I20260709 13:09:51.972776 31018 raft_consensus.cc:2468] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 1.
I20260709 13:09:52.000869 31336 consensus_queue.cc:237] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.010003 31306 tablet_bootstrap.cc:654] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.008502 31344 raft_consensus.cc:515] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.014464 31284 raft_consensus.cc:515] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.016172 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b9895f1f274252a696a22d22f8f12a" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:52.016839 31020 raft_consensus.cc:3060] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.023460 30915 catalog_manager.cc:5697] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65). New cstate: current_term: 1 leader_uuid: "5c382658a46f4bd99e74ea9750916b7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.031812 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa69a77796d4eff8052c4f02b27668b" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:52.032908 31018 raft_consensus.cc:3060] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.034737 30917 catalog_manager.cc:5697] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.041627 31020 raft_consensus.cc:2468] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 1.
I20260709 13:09:52.047813 31284 leader_election.cc:290] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:52.048106 31168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b9895f1f274252a696a22d22f8f12a" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:52.049890 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa69a77796d4eff8052c4f02b27668b" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
W20260709 13:09:52.050192 31061 leader_election.cc:343] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.050514 31169 raft_consensus.cc:3060] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.049530 31344 leader_election.cc:290] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:52.051913 31306 tablet_bootstrap.cc:492] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04: No bootstrap required, opened a new log
I20260709 13:09:52.052929 31306 ts_tablet_manager.cc:1403] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.000s
I20260709 13:09:52.053371 31061 leader_election.cc:304] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b; no voters: d001d8370bf744e6acc9b7a7e75e5b04
I20260709 13:09:52.054530 31344 raft_consensus.cc:2804] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.055080 31344 raft_consensus.cc:697] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Becoming Leader. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Running, Role: LEADER
I20260709 13:09:52.055923 31344 consensus_queue.cc:237] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.056012 31306 raft_consensus.cc:359] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.056821 31306 raft_consensus.cc:385] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.057144 31306 raft_consensus.cc:740] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.057572 31169 raft_consensus.cc:2468] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 1.
I20260709 13:09:52.057955 31306 consensus_queue.cc:260] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.058938 31061 leader_election.cc:304] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:52.059799 31336 raft_consensus.cc:2804] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.060266 31336 raft_consensus.cc:697] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Becoming Leader. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Running, Role: LEADER
I20260709 13:09:52.060626 31306 ts_tablet_manager.cc:1434] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:52.060782 30915 catalog_manager.cc:5697] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.061069 31336 consensus_queue.cc:237] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.070230 31018 raft_consensus.cc:2468] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 1.
I20260709 13:09:52.077477 31293 consensus_queue.cc:1048] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.080727 30915 catalog_manager.cc:5697] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.082057 30915 catalog_manager.cc:5697] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66). New cstate: current_term: 1 leader_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.090505 31300 consensus_queue.cc:1048] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:52.187966 31169 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7cb19b823c4489fbf5f31428feb94df"
dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
mode: GRACEFUL
new_leader_uuid: "5c382658a46f4bd99e74ea9750916b7b"
 from {username='slave'} at 127.0.0.1:54764
I20260709 13:09:52.188526 31169 raft_consensus.cc:606] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Received request to transfer leadership to TS 5c382658a46f4bd99e74ea9750916b7b
I20260709 13:09:52.207476 31093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88189344ff05453a904357390f6981b8"
dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
mode: GRACEFUL
new_leader_uuid: "5c382658a46f4bd99e74ea9750916b7b"
 from {username='slave'} at 127.0.0.1:35004
I20260709 13:09:52.208039 31093 raft_consensus.cc:606] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Received request to transfer leadership to TS 5c382658a46f4bd99e74ea9750916b7b
I20260709 13:09:52.216037 31018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaaf0a7aa5bf460692de45930b3e6da5"
dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
mode: GRACEFUL
new_leader_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
 from {username='slave'} at 127.0.0.1:53824
I20260709 13:09:52.216601 31018 raft_consensus.cc:606] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Received request to transfer leadership to TS 2f11c03dfbff48eb9690cf91e2cb4ac3
I20260709 13:09:52.226487 31093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53b9895f1f274252a696a22d22f8f12a"
dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
mode: GRACEFUL
new_leader_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
 from {username='slave'} at 127.0.0.1:35004
I20260709 13:09:52.227069 31093 raft_consensus.cc:606] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Received request to transfer leadership to TS d001d8370bf744e6acc9b7a7e75e5b04
I20260709 13:09:52.324926 31248 consensus_queue.cc:1048] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.331413 31329 raft_consensus.cc:993] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04: : Instructing follower 5c382658a46f4bd99e74ea9750916b7b to start an election
I20260709 13:09:52.332973 31248 raft_consensus.cc:1081] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Signalling peer 5c382658a46f4bd99e74ea9750916b7b to start an election
I20260709 13:09:52.337092 31020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7cb19b823c4489fbf5f31428feb94df"
dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
 from {username='slave'} at 127.0.0.1:53808
I20260709 13:09:52.337975 31020 raft_consensus.cc:493] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.338351 31020 raft_consensus.cc:3060] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.343719 31360 consensus_queue.cc:1048] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:52.347216 31020 raft_consensus.cc:515] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.348446 31018 raft_consensus.cc:1240] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Rejecting Update request from peer d001d8370bf744e6acc9b7a7e75e5b04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:52.349697 31020 leader_election.cc:290] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 2 election: Requested vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:52.352257 31360 consensus_queue.cc:1059] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.352349 31094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cb19b823c4489fbf5f31428feb94df" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:52.353202 31169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cb19b823c4489fbf5f31428feb94df" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:52.353304 31329 raft_consensus.cc:3055] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:52.353929 31329 raft_consensus.cc:740] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:52.354995 31361 raft_consensus.cc:493] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.354776 31329 consensus_queue.cc:260] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.355641 31361 raft_consensus.cc:515] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.356036 31329 raft_consensus.cc:3060] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.360308 31361 leader_election.cc:290] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:52.361173 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d34d28bac44d3a8c7c758c010646dc" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b" is_pre_election: true
I20260709 13:09:52.362138 31018 raft_consensus.cc:2393] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d001d8370bf744e6acc9b7a7e75e5b04 in current term 1: Already voted for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in this term.
I20260709 13:09:52.363277 31094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d34d28bac44d3a8c7c758c010646dc" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:52.364727 31135 leader_election.cc:304] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d001d8370bf744e6acc9b7a7e75e5b04; no voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b
I20260709 13:09:52.365507 31361 raft_consensus.cc:3060] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.370476 31169 raft_consensus.cc:2468] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 2.
I20260709 13:09:52.372888 31361 raft_consensus.cc:2749] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:52.374059 30986 leader_election.cc:304] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 2f11c03dfbff48eb9690cf91e2cb4ac3
I20260709 13:09:52.374997 31300 raft_consensus.cc:2804] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:52.375474 31300 raft_consensus.cc:697] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 2 LEADER]: Becoming Leader. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Running, Role: LEADER
I20260709 13:09:52.376289 31300 consensus_queue.cc:237] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.383518 30915 catalog_manager.cc:5697] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b reported cstate change: term changed from 1 to 2, leader changed from d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67) to 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65). New cstate: current_term: 2 leader_uuid: "5c382658a46f4bd99e74ea9750916b7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.392647 31344 consensus_queue.cc:1048] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.400251 31169 raft_consensus.cc:3060] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.405114 31336 consensus_queue.cc:1048] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.409497 31300 consensus_queue.cc:1048] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.420270 31341 consensus_queue.cc:1048] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.428970 31293 raft_consensus.cc:993] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b: : Instructing follower 2f11c03dfbff48eb9690cf91e2cb4ac3 to start an election
I20260709 13:09:52.429497 31341 raft_consensus.cc:1081] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Signalling peer 2f11c03dfbff48eb9690cf91e2cb4ac3 to start an election
I20260709 13:09:52.431137 31094 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eaaf0a7aa5bf460692de45930b3e6da5"
dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
 from {username='slave'} at 127.0.0.1:35002
I20260709 13:09:52.431625 31094 raft_consensus.cc:493] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.431933 31094 raft_consensus.cc:3060] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.437371 31094 raft_consensus.cc:515] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.440687 31336 consensus_queue.cc:1048] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.442065 31341 consensus_queue.cc:1048] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.446018 31094 leader_election.cc:290] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 2 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:52.447206 31167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf0a7aa5bf460692de45930b3e6da5" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:52.447907 31167 raft_consensus.cc:3060] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.452921 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf0a7aa5bf460692de45930b3e6da5" candidate_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:52.453640 31018 raft_consensus.cc:3055] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:52.454195 31018 raft_consensus.cc:740] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Running, Role: LEADER
I20260709 13:09:52.464341 31018 consensus_queue.cc:260] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.465746 31018 raft_consensus.cc:3060] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.472050 31344 consensus_queue.cc:1048] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:52.483505 31326 raft_consensus.cc:993] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3: : Instructing follower 5c382658a46f4bd99e74ea9750916b7b to start an election
I20260709 13:09:52.484030 31343 raft_consensus.cc:1081] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Signalling peer 5c382658a46f4bd99e74ea9750916b7b to start an election
I20260709 13:09:52.467501 31167 raft_consensus.cc:2468] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 2.
I20260709 13:09:52.495014 31341 consensus_queue.cc:1048] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.497135 31061 leader_election.cc:304] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:52.499289 31344 raft_consensus.cc:2804] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:52.499769 31344 raft_consensus.cc:697] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 LEADER]: Becoming Leader. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Running, Role: LEADER
I20260709 13:09:52.505685 31020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88189344ff05453a904357390f6981b8"
dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
 from {username='slave'} at 127.0.0.1:53840
I20260709 13:09:52.509765 31020 raft_consensus.cc:493] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.506081 31326 consensus_queue.cc:1048] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:52.511497 31020 raft_consensus.cc:3060] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.502426 31344 consensus_queue.cc:237] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.512923 31018 raft_consensus.cc:2468] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f11c03dfbff48eb9690cf91e2cb4ac3 in term 2.
I20260709 13:09:52.526417 31020 raft_consensus.cc:515] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.529248 31020 leader_election.cc:290] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 2 election: Requested vote from peers 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553), d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67:35711)
I20260709 13:09:52.531183 31094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88189344ff05453a904357390f6981b8" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:52.531917 31094 raft_consensus.cc:3055] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:52.532276 31094 raft_consensus.cc:740] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Running, Role: LEADER
I20260709 13:09:52.533059 31094 consensus_queue.cc:260] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.534677 31361 raft_consensus.cc:493] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.535229 31361 raft_consensus.cc:515] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.535789 31094 raft_consensus.cc:3060] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.537168 31361 leader_election.cc:290] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:52.538789 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b9895f1f274252a696a22d22f8f12a" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c382658a46f4bd99e74ea9750916b7b" is_pre_election: true
I20260709 13:09:52.539713 31169 raft_consensus.cc:3060] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.539829 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b9895f1f274252a696a22d22f8f12a" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" is_pre_election: true
I20260709 13:09:52.541596 31135 leader_election.cc:304] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d001d8370bf744e6acc9b7a7e75e5b04; no voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, 5c382658a46f4bd99e74ea9750916b7b
I20260709 13:09:52.541836 31167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88189344ff05453a904357390f6981b8" candidate_uuid: "5c382658a46f4bd99e74ea9750916b7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
I20260709 13:09:52.542462 31167 raft_consensus.cc:3060] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.546507 31343 consensus_queue.cc:1048] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.556713 30916 catalog_manager.cc:5697] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 reported cstate change: term changed from 1 to 2, leader changed from 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65) to 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66). New cstate: current_term: 2 leader_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.577768 31167 raft_consensus.cc:2468] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 2.
I20260709 13:09:52.580056 31094 raft_consensus.cc:2468] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c382658a46f4bd99e74ea9750916b7b in term 2.
I20260709 13:09:52.580946 30986 leader_election.cc:304] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:52.582202 31341 raft_consensus.cc:2804] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:52.582679 31341 raft_consensus.cc:697] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [term 2 LEADER]: Becoming Leader. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Running, Role: LEADER
I20260709 13:09:52.583555 31341 consensus_queue.cc:237] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.584381 31361 raft_consensus.cc:2749] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:52.585865 31343 consensus_queue.cc:1048] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.596820 31326 consensus_queue.cc:1048] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.598206 31284 raft_consensus.cc:993] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3: : Instructing follower d001d8370bf744e6acc9b7a7e75e5b04 to start an election
I20260709 13:09:52.598660 31284 raft_consensus.cc:1081] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Signalling peer d001d8370bf744e6acc9b7a7e75e5b04 to start an election
I20260709 13:09:52.600328 31167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53b9895f1f274252a696a22d22f8f12a"
dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
 from {username='slave'} at 127.0.0.1:54768
I20260709 13:09:52.607095 31167 raft_consensus.cc:493] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.607733 31167 raft_consensus.cc:3060] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.610102 30915 catalog_manager.cc:5697] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b reported cstate change: term changed from 1 to 2, leader changed from 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66) to 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65). New cstate: current_term: 2 leader_uuid: "5c382658a46f4bd99e74ea9750916b7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.617666 31167 raft_consensus.cc:515] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.621120 31094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b9895f1f274252a696a22d22f8f12a" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:52.621213 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b9895f1f274252a696a22d22f8f12a" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:52.621874 31094 raft_consensus.cc:3055] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:52.621958 31018 raft_consensus.cc:3060] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.622251 31094 raft_consensus.cc:740] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Running, Role: LEADER
I20260709 13:09:52.620060 31167 leader_election.cc:290] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 2 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:52.623214 31094 consensus_queue.cc:260] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.624701 31094 raft_consensus.cc:3060] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.628958 31018 raft_consensus.cc:2468] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 2.
I20260709 13:09:52.634357 31135 leader_election.cc:304] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:52.635241 31361 raft_consensus.cc:2804] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:52.635730 31361 raft_consensus.cc:697] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 LEADER]: Becoming Leader. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:52.636536 31361 consensus_queue.cc:237] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:52.639565 31094 raft_consensus.cc:2468] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 2.
I20260709 13:09:52.644246 31343 consensus_queue.cc:1048] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.645028 30916 catalog_manager.cc:5697] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 reported cstate change: term changed from 1 to 2, leader changed from 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66) to d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67). New cstate: current_term: 2 leader_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.651511 31343 consensus_queue.cc:1048] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.826818 31094 raft_consensus.cc:3060] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.831549 31094 raft_consensus.cc:1275] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Refusing update from remote peer 5c382658a46f4bd99e74ea9750916b7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.832850 31293 consensus_queue.cc:1048] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.841883 31167 raft_consensus.cc:1275] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Refusing update from remote peer 5c382658a46f4bd99e74ea9750916b7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.843261 31300 consensus_queue.cc:1048] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.032272 31018 raft_consensus.cc:1275] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Refusing update from remote peer 2f11c03dfbff48eb9690cf91e2cb4ac3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:53.033813 31343 consensus_queue.cc:1048] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.042197 31167 raft_consensus.cc:1275] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Refusing update from remote peer 2f11c03dfbff48eb9690cf91e2cb4ac3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:53.043802 31343 consensus_queue.cc:1048] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.053205 31167 raft_consensus.cc:1275] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Refusing update from remote peer 5c382658a46f4bd99e74ea9750916b7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:53.054649 31300 consensus_queue.cc:1048] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.060967 31094 raft_consensus.cc:1275] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Refusing update from remote peer d001d8370bf744e6acc9b7a7e75e5b04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:53.064421 31361 consensus_queue.cc:1048] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.064864 31094 raft_consensus.cc:1275] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Refusing update from remote peer 5c382658a46f4bd99e74ea9750916b7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:53.066671 31341 consensus_queue.cc:1048] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.078369 31018 raft_consensus.cc:1275] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Refusing update from remote peer d001d8370bf744e6acc9b7a7e75e5b04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:53.080612 31329 consensus_queue.cc:1048] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:55.230083 30915 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56504:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:09:55.248440 30915 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56504:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:09:55.326035 21001 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:55.355940 31410 tablet.cc:1724] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.359764 31412 tablet.cc:1724] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.403043 31422 tablet.cc:1724] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:55.410602 30986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:36553, user_credentials={real_user=slave}} blocked reactor thread for 63619.7us
I20260709 13:09:55.422449 31425 tablet.cc:1724] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.468927 31432 tablet.cc:1724] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:55.471313 30986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:36553, user_credentials={real_user=slave}} blocked reactor thread for 43781.1us
I20260709 13:09:55.453116 31422 tablet.cc:1724] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:55.515223 31135 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.130.66:36553, user_credentials={real_user=slave}} blocked reactor thread for 53915.2us
I20260709 13:09:55.547914 31430 tablet.cc:1724] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.517287 31428 tablet.cc:1724] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.546499 31410 tablet.cc:1724] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.539433 31439 tablet.cc:1724] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.602555 31432 tablet.cc:1724] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.619386 31412 tablet.cc:1724] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.624413 31442 tablet.cc:1724] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.634244 31430 tablet.cc:1724] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.640184 31444 tablet.cc:1724] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.641570 31020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da148d817ae24f6fb599aadd9772c0e8"
dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
mode: GRACEFUL
new_leader_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
 from {username='slave'} at 127.0.0.1:53852
I20260709 13:09:55.655287 31422 tablet.cc:1724] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.658870 31412 tablet.cc:1724] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.660825 31020 raft_consensus.cc:606] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 2 LEADER]: Received request to transfer leadership to TS d001d8370bf744e6acc9b7a7e75e5b04
I20260709 13:09:55.644276 31410 tablet.cc:1724] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.656608 31439 tablet.cc:1724] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.696751 31432 tablet.cc:1724] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.704505 31442 tablet.cc:1724] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.711398 31448 tablet.cc:1724] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.718710 31425 tablet.cc:1724] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.739564 31093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd903a490c6d450ab42df8564e1756c1"
dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
mode: GRACEFUL
new_leader_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
 from {username='slave'} at 127.0.0.1:42604
I20260709 13:09:55.740410 31449 tablet.cc:1724] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.742142 31425 tablet.cc:1724] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.743209 31093 raft_consensus.cc:606] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 LEADER]: Received request to transfer leadership to TS d001d8370bf744e6acc9b7a7e75e5b04
I20260709 13:09:55.744946 21001 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:55.744571 31428 tablet.cc:1724] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.745656 21001 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:55.749363 31410 tablet.cc:1724] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:55.755131 31394 raft_consensus.cc:993] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b: : Instructing follower d001d8370bf744e6acc9b7a7e75e5b04 to start an election
I20260709 13:09:55.755800 31413 raft_consensus.cc:1081] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 2 LEADER]: Signalling peer d001d8370bf744e6acc9b7a7e75e5b04 to start an election
I20260709 13:09:55.760823 31166 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da148d817ae24f6fb599aadd9772c0e8"
dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
 from {username='slave'} at 127.0.0.1:54754
I20260709 13:09:55.761430 31166 raft_consensus.cc:493] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:55.761824 31166 raft_consensus.cc:3060] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:55.772241 31166 raft_consensus.cc:515] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:55.783978 31166 leader_election.cc:290] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 3 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:55.785382 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da148d817ae24f6fb599aadd9772c0e8" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:55.786068 31093 raft_consensus.cc:3060] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:55.785943 31017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da148d817ae24f6fb599aadd9772c0e8" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:55.786728 31017 raft_consensus.cc:3055] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:55.787086 31017 raft_consensus.cc:740] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c382658a46f4bd99e74ea9750916b7b, State: Running, Role: LEADER
I20260709 13:09:55.787887 31017 consensus_queue.cc:260] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:55.789149 31017 raft_consensus.cc:3060] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:55.791109 31093 raft_consensus.cc:2468] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 3.
I20260709 13:09:55.792315 31135 leader_election.cc:304] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f11c03dfbff48eb9690cf91e2cb4ac3, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:55.793656 31443 raft_consensus.cc:2804] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:55.794245 31443 raft_consensus.cc:697] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 3 LEADER]: Becoming Leader. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:55.795218 31017 raft_consensus.cc:2468] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 3.
I20260709 13:09:55.795315 31443 consensus_queue.cc:237] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:55.804275 31424 raft_consensus.cc:993] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3: : Instructing follower d001d8370bf744e6acc9b7a7e75e5b04 to start an election
I20260709 13:09:55.804740 31424 raft_consensus.cc:1081] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 LEADER]: Signalling peer d001d8370bf744e6acc9b7a7e75e5b04 to start an election
I20260709 13:09:55.806285 31166 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd903a490c6d450ab42df8564e1756c1"
dest_uuid: "d001d8370bf744e6acc9b7a7e75e5b04"
 from {username='slave'} at 127.0.0.1:54768
I20260709 13:09:55.804960 30918 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101: soft_deleted_table [id=23f0f801a153408d8b4c646c0b3f5c33] alter complete (version 1)
I20260709 13:09:55.806905 31166 raft_consensus.cc:493] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:55.807417 31166 raft_consensus.cc:3060] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:55.814348 31166 raft_consensus.cc:515] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:55.815564 30917 catalog_manager.cc:5697] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 reported cstate change: term changed from 2 to 3, leader changed from 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65) to d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67). New cstate: current_term: 3 leader_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.816473 31166 leader_election.cc:290] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 3 election: Requested vote from peers 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613), 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553)
I20260709 13:09:55.817517 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd903a490c6d450ab42df8564e1756c1" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3"
I20260709 13:09:55.818101 31093 raft_consensus.cc:3055] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:55.817965 31017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd903a490c6d450ab42df8564e1756c1" candidate_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c382658a46f4bd99e74ea9750916b7b"
I20260709 13:09:55.818449 31093 raft_consensus.cc:740] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f11c03dfbff48eb9690cf91e2cb4ac3, State: Running, Role: LEADER
I20260709 13:09:55.818624 31017 raft_consensus.cc:3060] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:55.819242 31093 consensus_queue.cc:260] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:55.820475 31093 raft_consensus.cc:3060] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:55.826104 31017 raft_consensus.cc:2468] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 3.
I20260709 13:09:55.827376 31135 leader_election.cc:304] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c382658a46f4bd99e74ea9750916b7b, d001d8370bf744e6acc9b7a7e75e5b04; no voters: 
I20260709 13:09:55.827280 31093 raft_consensus.cc:2468] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d001d8370bf744e6acc9b7a7e75e5b04 in term 3.
I20260709 13:09:55.828444 31443 raft_consensus.cc:2804] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:55.828929 31443 raft_consensus.cc:697] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 3 LEADER]: Becoming Leader. State: Replica: d001d8370bf744e6acc9b7a7e75e5b04, State: Running, Role: LEADER
I20260709 13:09:55.829767 31443 consensus_queue.cc:237] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } }
I20260709 13:09:55.837761 30917 catalog_manager.cc:5697] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 reported cstate change: term changed from 2 to 3, leader changed from 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66) to d001d8370bf744e6acc9b7a7e75e5b04 (127.20.130.67). New cstate: current_term: 3 leader_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d001d8370bf744e6acc9b7a7e75e5b04" member_type: VOTER last_known_addr { host: "127.20.130.67" port: 35711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:56.206463 31017 raft_consensus.cc:1275] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 3 FOLLOWER]: Refusing update from remote peer d001d8370bf744e6acc9b7a7e75e5b04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:56.208096 31443 consensus_queue.cc:1048] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:56.218355 31093 raft_consensus.cc:1275] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 3 FOLLOWER]: Refusing update from remote peer d001d8370bf744e6acc9b7a7e75e5b04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:56.219678 31433 consensus_queue.cc:1048] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:56.292865 31017 raft_consensus.cc:1275] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 3 FOLLOWER]: Refusing update from remote peer d001d8370bf744e6acc9b7a7e75e5b04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:56.294096 31433 consensus_queue.cc:1048] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c382658a46f4bd99e74ea9750916b7b" member_type: VOTER last_known_addr { host: "127.20.130.65" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:56.303597 31093 raft_consensus.cc:1275] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 3 FOLLOWER]: Refusing update from remote peer d001d8370bf744e6acc9b7a7e75e5b04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:56.305512 31443 consensus_queue.cc:1048] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f11c03dfbff48eb9690cf91e2cb4ac3" member_type: VOTER last_known_addr { host: "127.20.130.66" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:56.800493 21001 tablet_server.cc:179] TabletServer@127.20.130.65:0 shutting down...
I20260709 13:09:56.829293 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:56.829983 21001 tablet_replica.cc:333] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.830571 21001 raft_consensus.cc:2243] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.831104 21001 raft_consensus.cc:2272] T 7fa69a77796d4eff8052c4f02b27668b P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.833082 21001 tablet_replica.cc:333] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.833634 21001 raft_consensus.cc:2243] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.834055 21001 raft_consensus.cc:2272] T a6d34d28bac44d3a8c7c758c010646dc P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.835808 21001 tablet_replica.cc:333] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.836341 21001 raft_consensus.cc:2243] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.836740 21001 raft_consensus.cc:2272] T 0816779035984a5cad888f259370be09 P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.838546 21001 tablet_replica.cc:333] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.839123 21001 raft_consensus.cc:2243] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.839551 21001 raft_consensus.cc:2272] T eaaf0a7aa5bf460692de45930b3e6da5 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.841329 21001 tablet_replica.cc:333] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.841871 21001 raft_consensus.cc:2243] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.842252 21001 raft_consensus.cc:2272] T da148d817ae24f6fb599aadd9772c0e8 P 5c382658a46f4bd99e74ea9750916b7b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.845458 21001 tablet_replica.cc:333] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.846036 21001 raft_consensus.cc:2243] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.846886 21001 raft_consensus.cc:2272] T 6ae514d5d69940acaa48d2a8dba5a83d P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.848642 21001 tablet_replica.cc:333] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.849184 21001 raft_consensus.cc:2243] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.849584 21001 raft_consensus.cc:2272] T 53b9895f1f274252a696a22d22f8f12a P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.851289 21001 tablet_replica.cc:333] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.851821 21001 raft_consensus.cc:2243] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.852228 21001 raft_consensus.cc:2272] T 031141cccb7a430aa3c07e54cc681b08 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.854156 21001 tablet_replica.cc:333] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.854701 21001 raft_consensus.cc:2243] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.855574 21001 raft_consensus.cc:2272] T 61a03085114f4ebabbb523e570c801a4 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.856200 31061 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20260709 13:09:56.857967 21001 tablet_replica.cc:333] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.858780 21001 raft_consensus.cc:2243] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:09:56.859253 31061 consensus_peers.cc:597] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 -> Peer 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613): Couldn't send request to peer 5c382658a46f4bd99e74ea9750916b7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.859634 21001 raft_consensus.cc:2272] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.861474 21001 tablet_replica.cc:333] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.862053 21001 raft_consensus.cc:2243] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.862527 21001 raft_consensus.cc:2272] T fd903a490c6d450ab42df8564e1756c1 P 5c382658a46f4bd99e74ea9750916b7b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.865710 21001 tablet_replica.cc:333] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.866331 21001 raft_consensus.cc:2243] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.867249 21001 raft_consensus.cc:2272] T f7cb19b823c4489fbf5f31428feb94df P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.867254 31135 consensus_peers.cc:597] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 -> Peer 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613): Couldn't send request to peer 5c382658a46f4bd99e74ea9750916b7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.869292 21001 tablet_replica.cc:333] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.869843 21001 raft_consensus.cc:2243] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.870332 21001 raft_consensus.cc:2272] T e42a9584abca42a6b79a8b4d1c1ecf2e P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.870975 31061 consensus_peers.cc:597] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 -> Peer 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613): Couldn't send request to peer 5c382658a46f4bd99e74ea9750916b7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.872393 21001 tablet_replica.cc:333] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.873036 21001 raft_consensus.cc:2243] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.873581 21001 raft_consensus.cc:2272] T f85ba457bfe94972ac7bdd03a7bf399d P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.875902 21001 tablet_replica.cc:333] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.876529 21001 raft_consensus.cc:2243] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.877028 21001 raft_consensus.cc:2272] T 7a0e9964b96640fc80bb0e3ea3adb09c P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.878971 21001 tablet_replica.cc:333] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.879413 21001 raft_consensus.cc:2243] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.880077 21001 raft_consensus.cc:2272] T 88189344ff05453a904357390f6981b8 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.881703 21001 tablet_replica.cc:333] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.882170 21001 raft_consensus.cc:2243] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.882841 21001 raft_consensus.cc:2272] T 7a53c1d466e14df5b51a71c79aefa5a1 P 5c382658a46f4bd99e74ea9750916b7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.884953 21001 tablet_replica.cc:333] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b: stopping tablet replica
I20260709 13:09:56.885388 21001 raft_consensus.cc:2243] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.886099 21001 raft_consensus.cc:2272] T a4ff963e1ccd424d8583b181b615a33f P 5c382658a46f4bd99e74ea9750916b7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.919085 21001 tablet_server.cc:196] TabletServer@127.20.130.65:0 shutdown complete.
I20260709 13:09:56.949703 21001 tablet_server.cc:179] TabletServer@127.20.130.66:0 shutting down...
I20260709 13:09:56.975199 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:56.975975 21001 tablet_replica.cc:333] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:56.976925 21001 raft_consensus.cc:2243] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.977887 21001 raft_consensus.cc:2272] T 7fa69a77796d4eff8052c4f02b27668b P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.979785 21001 tablet_replica.cc:333] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:56.980305 21001 raft_consensus.cc:2243] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.980988 21001 raft_consensus.cc:2272] T a6d34d28bac44d3a8c7c758c010646dc P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.983094 21001 tablet_replica.cc:333] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:56.983801 21001 raft_consensus.cc:2243] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.984732 21001 raft_consensus.cc:2272] T eaaf0a7aa5bf460692de45930b3e6da5 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.988444 21001 tablet_replica.cc:333] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:56.988993 21001 raft_consensus.cc:2243] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.989369 21001 raft_consensus.cc:2272] T 61a03085114f4ebabbb523e570c801a4 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.991307 21001 tablet_replica.cc:333] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:56.991801 21001 raft_consensus.cc:2243] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.992161 21001 raft_consensus.cc:2272] T b0ddc62d5ccb4bf4820717c6eb8bc29c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.993831 21001 tablet_replica.cc:333] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:56.994376 21001 raft_consensus.cc:2243] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.994828 21001 raft_consensus.cc:2272] T fd903a490c6d450ab42df8564e1756c1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.997387 21001 tablet_replica.cc:333] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:56.997902 21001 raft_consensus.cc:2243] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.998268 21001 raft_consensus.cc:2272] T f7cb19b823c4489fbf5f31428feb94df P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.000003 21001 tablet_replica.cc:333] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:57.000465 21001 raft_consensus.cc:2243] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.001181 21001 raft_consensus.cc:2272] T e42a9584abca42a6b79a8b4d1c1ecf2e P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.003388 21001 tablet_replica.cc:333] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:57.003923 21001 raft_consensus.cc:2243] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.004621 21001 raft_consensus.cc:2272] T f85ba457bfe94972ac7bdd03a7bf399d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.006520 21001 tablet_replica.cc:333] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:57.007109 21001 raft_consensus.cc:2243] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.007848 21001 raft_consensus.cc:2272] T 0816779035984a5cad888f259370be09 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.009631 21001 tablet_replica.cc:333] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:57.010138 21001 raft_consensus.cc:2243] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.010553 21001 raft_consensus.cc:2272] T 53b9895f1f274252a696a22d22f8f12a P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.012297 21001 tablet_replica.cc:333] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:57.012877 21001 raft_consensus.cc:2243] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.013613 21001 raft_consensus.cc:2272] T 031141cccb7a430aa3c07e54cc681b08 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.015655 21001 tablet_replica.cc:333] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:57.016178 21001 raft_consensus.cc:2243] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.016600 21001 raft_consensus.cc:2272] T 6ae514d5d69940acaa48d2a8dba5a83d P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.018272 21001 tablet_replica.cc:333] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:57.018805 21001 raft_consensus.cc:2243] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.019238 21001 raft_consensus.cc:2272] T da148d817ae24f6fb599aadd9772c0e8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.021678 21001 tablet_replica.cc:333] T a4ff963e1ccd424d8583b181b615a33f P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:57.022197 21001 raft_consensus.cc:2243] T a4ff963e1ccd424d8583b181b615a33f P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.022612 21001 raft_consensus.cc:2272] T a4ff963e1ccd424d8583b181b615a33f P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.024551 21001 tablet_replica.cc:333] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:57.025038 21001 raft_consensus.cc:2243] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.025521 21001 raft_consensus.cc:2272] T 88189344ff05453a904357390f6981b8 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.027220 21001 tablet_replica.cc:333] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:57.027709 21001 raft_consensus.cc:2243] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.028128 21001 raft_consensus.cc:2272] T 7a53c1d466e14df5b51a71c79aefa5a1 P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.029986 21001 tablet_replica.cc:333] T 7a0e9964b96640fc80bb0e3ea3adb09c P 2f11c03dfbff48eb9690cf91e2cb4ac3: stopping tablet replica
I20260709 13:09:57.030447 21001 raft_consensus.cc:2243] T 7a0e9964b96640fc80bb0e3ea3adb09c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.030851 21001 raft_consensus.cc:2272] T 7a0e9964b96640fc80bb0e3ea3adb09c P 2f11c03dfbff48eb9690cf91e2cb4ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.067498 21001 tablet_server.cc:196] TabletServer@127.20.130.66:0 shutdown complete.
W20260709 13:09:57.097065 31135 consensus_peers.cc:597] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 -> Peer 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553): Couldn't send request to peer 2f11c03dfbff48eb9690cf91e2cb4ac3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:36553: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:57.099236 21001 tablet_server.cc:179] TabletServer@127.20.130.67:0 shutting down...
W20260709 13:09:57.106585 31135 consensus_peers.cc:597] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 -> Peer 2f11c03dfbff48eb9690cf91e2cb4ac3 (127.20.130.66:36553): Couldn't send request to peer 2f11c03dfbff48eb9690cf91e2cb4ac3. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.66:36553: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:57.118672 31135 consensus_peers.cc:597] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 -> Peer 5c382658a46f4bd99e74ea9750916b7b (127.20.130.65:34613): Couldn't send request to peer 5c382658a46f4bd99e74ea9750916b7b. Status: Network error: Client connection negotiation failed: client connection to 127.20.130.65:34613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:57.132393 21001 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:57.133210 21001 tablet_replica.cc:333] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.133819 21001 raft_consensus.cc:2243] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.134308 21001 raft_consensus.cc:2272] T eaaf0a7aa5bf460692de45930b3e6da5 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.136235 21001 tablet_replica.cc:333] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.136829 21001 raft_consensus.cc:2243] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.137274 21001 raft_consensus.cc:2272] T 7fa69a77796d4eff8052c4f02b27668b P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.139099 21001 tablet_replica.cc:333] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.139631 21001 raft_consensus.cc:2243] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.140057 21001 raft_consensus.cc:2272] T a6d34d28bac44d3a8c7c758c010646dc P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.141788 21001 tablet_replica.cc:333] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.142333 21001 raft_consensus.cc:2243] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.142745 21001 raft_consensus.cc:2272] T 0816779035984a5cad888f259370be09 P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.144448 21001 tablet_replica.cc:333] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.145156 21001 raft_consensus.cc:2243] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.145620 21001 raft_consensus.cc:2272] T e42a9584abca42a6b79a8b4d1c1ecf2e P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.147631 21001 tablet_replica.cc:333] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.148155 21001 raft_consensus.cc:2243] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.148576 21001 raft_consensus.cc:2272] T f7cb19b823c4489fbf5f31428feb94df P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.150314 21001 tablet_replica.cc:333] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.150982 21001 raft_consensus.cc:2243] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.151443 21001 raft_consensus.cc:2272] T 61a03085114f4ebabbb523e570c801a4 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.153368 21001 tablet_replica.cc:333] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.153903 21001 raft_consensus.cc:2243] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.154322 21001 raft_consensus.cc:2272] T b0ddc62d5ccb4bf4820717c6eb8bc29c P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.156212 21001 tablet_replica.cc:333] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.156762 21001 raft_consensus.cc:2243] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.157516 21001 raft_consensus.cc:2272] T fd903a490c6d450ab42df8564e1756c1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.159898 21001 tablet_replica.cc:333] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.160478 21001 raft_consensus.cc:2243] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.161569 21001 raft_consensus.cc:2272] T 7a0e9964b96640fc80bb0e3ea3adb09c P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.163985 21001 tablet_replica.cc:333] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.164631 21001 raft_consensus.cc:2243] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.165102 21001 raft_consensus.cc:2272] T 88189344ff05453a904357390f6981b8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.166998 21001 tablet_replica.cc:333] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.167578 21001 raft_consensus.cc:2243] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.168018 21001 raft_consensus.cc:2272] T 7a53c1d466e14df5b51a71c79aefa5a1 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.170096 21001 tablet_replica.cc:333] T a4ff963e1ccd424d8583b181b615a33f P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.170637 21001 raft_consensus.cc:2243] T a4ff963e1ccd424d8583b181b615a33f P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.171125 21001 raft_consensus.cc:2272] T a4ff963e1ccd424d8583b181b615a33f P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.173087 21001 tablet_replica.cc:333] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.173623 21001 raft_consensus.cc:2243] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.174060 21001 raft_consensus.cc:2272] T f85ba457bfe94972ac7bdd03a7bf399d P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.176054 21001 tablet_replica.cc:333] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.176600 21001 raft_consensus.cc:2243] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.177033 21001 raft_consensus.cc:2272] T 6ae514d5d69940acaa48d2a8dba5a83d P d001d8370bf744e6acc9b7a7e75e5b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.178824 21001 tablet_replica.cc:333] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.179369 21001 raft_consensus.cc:2243] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.180126 21001 raft_consensus.cc:2272] T da148d817ae24f6fb599aadd9772c0e8 P d001d8370bf744e6acc9b7a7e75e5b04 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.182376 21001 tablet_replica.cc:333] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.182987 21001 raft_consensus.cc:2243] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.183765 21001 raft_consensus.cc:2272] T 53b9895f1f274252a696a22d22f8f12a P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.185487 21001 tablet_replica.cc:333] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04: stopping tablet replica
I20260709 13:09:57.186036 21001 raft_consensus.cc:2243] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.186486 21001 raft_consensus.cc:2272] T 031141cccb7a430aa3c07e54cc681b08 P d001d8370bf744e6acc9b7a7e75e5b04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.225966 21001 tablet_server.cc:196] TabletServer@127.20.130.67:0 shutdown complete.
I20260709 13:09:57.254442 21001 master.cc:562] Master@127.20.130.126:35751 shutting down...
I20260709 13:09:57.277711 21001 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.278213 21001 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.278523 21001 tablet_replica.cc:333] T 00000000000000000000000000000000 P 39fbffc4bb444ecd86de6b3dcc1e7101: stopping tablet replica
I20260709 13:09:57.298640 21001 master.cc:584] Master@127.20.130.126:35751 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11135 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (23942 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (305634 ms total)
[  PASSED  ] 8 tests.
I20260709 13:09:57.351523 21001 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 411 messages since previous log ~14 seconds ago
I20260709 13:09:57.351735 21001 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 410 messages since previous log ~14 seconds ago
I20260709 13:09:57.351877 21001 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 405 messages since previous log ~14 seconds ago
I20260709 13:09:57.352027 21001 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:09:57.352167 21001 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:09:57.352308 21001 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~77 seconds ago
I20260709 13:09:57.352449 21001 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~155 seconds ago
I20260709 13:09:57.352638 21001 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 5 messages since previous log ~0 seconds ago
I20260709 13:09:57.352931 21001 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~5 seconds ago
